2021-02-12T17:05:48.248 INFO:root:teuthology version: 1.1.0-87d40f79 2021-02-12T17:05:48.249 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-02-12_03:15:03-fs-master-distro-basic-gibba/5875490 --name teuthology-2021-02-12_03:15:03-fs-master-distro-basic-gibba -- /home/teuthworker/archive/teuthology-2021-02-12_03:15:03-fs-master-distro-basic-gibba/5875490/orig.config.yaml 2021-02-12T17:05:48.311 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-02-12T17:05:48.382 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2021-02-12_03:15:03-fs-master-distro-basic-gibba/5875490 branch: master description: fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} email: ceph-qa@ceph.io first_in_suite: false job_id: '5875490' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: gibba name: teuthology-2021-02-12_03:15:03-fs-master-distro-basic-gibba nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: '8.2' overrides: admin_socket: branch: master ceph: cephfs: fs: - name: a - name: b session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Replacing daemon mds log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 4819f209edcf86cf21724c2e068d1a90ce8b9945 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: sha1: 4819f209edcf86cf21724c2e068d1a90ce8b9945 kclient: client.0: cephfs_name: a client.1: cephfs_name: b selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: master sha1: 3016de877106ce6671c889d12c3ef9513a2cf899 owner: scheduled_teuthology@teuthology priority: 100 repo: git://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: 4819f209edcf86cf21724c2e068d1a90ce8b9945 sleep_before_teardown: 0 suite: fs suite_branch: master suite_path: /home/teuthworker/src/git.ceph.com_ceph_3016de877106ce6671c889d12c3ef9513a2cf899/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph.git suite_sha1: 3016de877106ce6671c889d12c3ef9513a2cf899 targets: gibba002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLCdALlEEkciJNrzyj1shN8HBBnvdxxLimcJWtZ0se8LMCa58a0hc6732o+hNZ5RijCcm///+RStLhFrCa6DZdOXa2pJi+G4Ft06xgGTl71fLaUduKB4YoP35OLwu8xG3ZyXcn0EJFxzI7ZElwdU3EPjRoYXedoWvupgo6I5ZGgkKtuEzqMMmxSIGJXt3W4SHB8foPgFmCeDjMYcL56EFcU5u+Md0zxTcVHjTxQTf+grFPgluE4Ac7QGGiYhlc6nuhrxnncEDIerqC4xtgTq3rJhHzMbfEyplqdXMydW+HfVpM5cPwvIa8IqYRL87Q4FnsBwF/W1CskGOXNaIa0QHzPADsCZDcl7Pq3r+wl5VDy00gxlcLMcBP2LuRwnQMNhhrHPQJMoo9UcGCQRCOfcdD8T/M9bzdmwaV0oES2OrzgjwQn1rtJr6+4q/03BS+mRXRXPvCC4xuvEp9QLTenYAaNR/Vpc2EZq/9Nba1r8oFu9B48nJMBQhXMdg0uzv6nks= gibba004.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6vzI2KWoAEnISt+HUd7CzHECsKnIXUzr7XqI/50AQgp+ndOK7wsUhOFmmqeLwdQ7UxOa2K8xqX2jZ4r3P2mBIH+3P/jqEe4bfnBNJwFVYsVwEqDXDdM6oCSY9ZpZv5UFhvbf+9IrTS4BzzR4CjWyx6K+VAFjUbxnCNIgIDQxT0FvkDmjG+pCHMI3PAVOlaH/vM3FQEQqnMgBFkY2lOJUP6hnxgDj4lMEt9rR+NVnXngHg1I9F2J9+7BSpN5FA2hSSzAgnt3vHJD1DPyO646u8odTJIkUHy0AhK4jeT7JfOS9x+10AyPZ5apzFncnzGDwb6xExfMJQQAbLuKyRs25BEwg1uswJALF0w/YrH5HBDHFTKFP4bsgkgSjVW/ykImlw/3asLM9A3jETc1xfaAklAGvVPNspu52KpSoYaSuPaVvhB3IUdmtuzkXOpc/+WyVCAMZOlcd0krSjadmbjk3Dgt7efO6BP5sn7mfohKAnp6f/yReX7e1osG5oiVLvpfc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - mds_thrash: null - workunit: clients: all: - fs/snaps teuthology_branch: master teuthology_sha1: 87d40f79d7da6caf6da06c190938773bf745140c timestamp: 2021-02-12_03:15:03 tube: gibba user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.gibba.29737 2021-02-12T17:05:48.382 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_3016de877106ce6671c889d12c3ef9513a2cf899/qa; will attempt to use it 2021-02-12T17:05:48.384 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_3016de877106ce6671c889d12c3ef9513a2cf899/qa/tasks 2021-02-12T17:05:48.384 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-02-12T17:05:48.386 INFO:teuthology.task.internal:Checking packages... 2021-02-12T17:05:48.408 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '4819f209edcf86cf21724c2e068d1a90ce8b9945' 2021-02-12T17:05:48.409 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-02-12T17:05:48.409 INFO:teuthology.packaging:ref: None 2021-02-12T17:05:48.409 INFO:teuthology.packaging:tag: None 2021-02-12T17:05:48.409 INFO:teuthology.packaging:branch: master 2021-02-12T17:05:48.409 INFO:teuthology.packaging:sha1: 4819f209edcf86cf21724c2e068d1a90ce8b9945 2021-02-12T17:05:48.409 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=master 2021-02-12T17:05:49.301 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-743.g27a6c46f 2021-02-12T17:05:49.301 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-02-12T17:05:49.310 INFO:teuthology.task.internal:no buildpackages task found 2021-02-12T17:05:49.310 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-02-12T17:05:51.074 INFO:teuthology.task.internal:Saving configuration 2021-02-12T17:05:51.095 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-02-12T17:05:51.435 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-12T17:05:51.452 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-12 17:01:08.271236', 'description': '/home/teuthworker/archive/teuthology-2021-02-12_03:15:03-fs-master-distro-basic-gibba/5875490', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDnZJPABKnHM8W2NdoEQ5VYH9YnncFVBhvQnpmbondIPjKb7zA4qZb9a2VFIqvkDNhGOUphmZXyDMa+tygWPW10=', 'os_version': '8', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba002.front.sepia.ceph.com'} 2021-02-12T17:05:51.468 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-12 17:01:08.271182', 'description': '/home/teuthworker/archive/teuthology-2021-02-12_03:15:03-fs-master-distro-basic-gibba/5875490', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFAFeBy/pyDoH8G+5F6i5mmVWUV75ts15KORasEUFDDPyU1vlb7YIuUNVEobEryrcrEuYyrhbD7+BUpZgwIXCDA=', 'os_version': '8', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba004.front.sepia.ceph.com'} 2021-02-12T17:05:51.468 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-02-12T17:05:52.426 INFO:teuthology.task.internal:roles: ubuntu@gibba002.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2021-02-12T17:05:52.426 INFO:teuthology.task.internal:roles: ubuntu@gibba004.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2021-02-12T17:05:52.426 INFO:teuthology.run_tasks:Running task console_log... 2021-02-12T17:05:52.555 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f60b5b31e18>, signals=[15]) 2021-02-12T17:05:52.555 INFO:teuthology.run_tasks:Running task internal.connect... 2021-02-12T17:05:52.563 INFO:teuthology.task.internal:Opening connections... 2021-02-12T17:05:52.563 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba002.front.sepia.ceph.com 2021-02-12T17:05:52.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-12T17:05:52.635 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba004.front.sepia.ceph.com 2021-02-12T17:05:52.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-12T17:05:52.700 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-02-12T17:05:52.781 DEBUG:teuthology.orchestra.run.gibba002:> uname -m 2021-02-12T17:05:52.795 INFO:teuthology.orchestra.run.gibba002.stdout:x86_64 2021-02-12T17:05:52.795 DEBUG:teuthology.orchestra.run.gibba002:> cat /etc/os-release 2021-02-12T17:05:52.848 INFO:teuthology.orchestra.run.gibba002.stdout:NAME="CentOS Linux" 2021-02-12T17:05:52.848 INFO:teuthology.orchestra.run.gibba002.stdout:VERSION="8 (Core)" 2021-02-12T17:05:52.849 INFO:teuthology.orchestra.run.gibba002.stdout:ID="centos" 2021-02-12T17:05:52.849 INFO:teuthology.orchestra.run.gibba002.stdout:ID_LIKE="rhel fedora" 2021-02-12T17:05:52.849 INFO:teuthology.orchestra.run.gibba002.stdout:VERSION_ID="8" 2021-02-12T17:05:52.849 INFO:teuthology.orchestra.run.gibba002.stdout:PLATFORM_ID="platform:el8" 2021-02-12T17:05:52.849 INFO:teuthology.orchestra.run.gibba002.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-02-12T17:05:52.849 INFO:teuthology.orchestra.run.gibba002.stdout:ANSI_COLOR="0;31" 2021-02-12T17:05:52.849 INFO:teuthology.orchestra.run.gibba002.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-02-12T17:05:52.849 INFO:teuthology.orchestra.run.gibba002.stdout:HOME_URL="https://www.centos.org/" 2021-02-12T17:05:52.849 INFO:teuthology.orchestra.run.gibba002.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-02-12T17:05:52.849 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:05:52.849 INFO:teuthology.orchestra.run.gibba002.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-02-12T17:05:52.850 INFO:teuthology.orchestra.run.gibba002.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-02-12T17:05:52.850 INFO:teuthology.orchestra.run.gibba002.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-02-12T17:05:52.850 INFO:teuthology.orchestra.run.gibba002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-02-12T17:05:52.850 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:05:52.851 INFO:teuthology.lock.ops:Updating gibba002.front.sepia.ceph.com on lock server 2021-02-12T17:05:52.866 DEBUG:teuthology.orchestra.run.gibba004:> uname -m 2021-02-12T17:05:52.880 INFO:teuthology.orchestra.run.gibba004.stdout:x86_64 2021-02-12T17:05:52.880 DEBUG:teuthology.orchestra.run.gibba004:> cat /etc/os-release 2021-02-12T17:05:52.933 INFO:teuthology.orchestra.run.gibba004.stdout:NAME="CentOS Linux" 2021-02-12T17:05:52.933 INFO:teuthology.orchestra.run.gibba004.stdout:VERSION="8 (Core)" 2021-02-12T17:05:52.933 INFO:teuthology.orchestra.run.gibba004.stdout:ID="centos" 2021-02-12T17:05:52.933 INFO:teuthology.orchestra.run.gibba004.stdout:ID_LIKE="rhel fedora" 2021-02-12T17:05:52.933 INFO:teuthology.orchestra.run.gibba004.stdout:VERSION_ID="8" 2021-02-12T17:05:52.933 INFO:teuthology.orchestra.run.gibba004.stdout:PLATFORM_ID="platform:el8" 2021-02-12T17:05:52.933 INFO:teuthology.orchestra.run.gibba004.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-02-12T17:05:52.933 INFO:teuthology.orchestra.run.gibba004.stdout:ANSI_COLOR="0;31" 2021-02-12T17:05:52.933 INFO:teuthology.orchestra.run.gibba004.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-02-12T17:05:52.933 INFO:teuthology.orchestra.run.gibba004.stdout:HOME_URL="https://www.centos.org/" 2021-02-12T17:05:52.934 INFO:teuthology.orchestra.run.gibba004.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-02-12T17:05:52.934 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:05:52.934 INFO:teuthology.orchestra.run.gibba004.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-02-12T17:05:52.934 INFO:teuthology.orchestra.run.gibba004.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-02-12T17:05:52.934 INFO:teuthology.orchestra.run.gibba004.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-02-12T17:05:52.934 INFO:teuthology.orchestra.run.gibba004.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-02-12T17:05:52.934 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:05:52.934 INFO:teuthology.lock.ops:Updating gibba004.front.sepia.ceph.com on lock server 2021-02-12T17:05:52.950 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-02-12T17:05:53.022 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-02-12T17:05:53.093 INFO:teuthology.task.internal:Checking for old test directory... 2021-02-12T17:05:53.093 DEBUG:teuthology.orchestra.run.gibba002:> test '!' -e /home/ubuntu/cephtest 2021-02-12T17:05:53.096 DEBUG:teuthology.orchestra.run.gibba004:> test '!' -e /home/ubuntu/cephtest 2021-02-12T17:05:53.108 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-02-12T17:05:53.339 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-02-12T17:05:53.339 DEBUG:teuthology.orchestra.run.gibba002:> test -z $(ls -A /var/lib/ceph) 2021-02-12T17:05:53.342 DEBUG:teuthology.orchestra.run.gibba004:> test -z $(ls -A /var/lib/ceph) 2021-02-12T17:05:53.365 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-02-12T17:05:53.757 INFO:teuthology.run_tasks:Running task kernel... 2021-02-12T17:05:53.885 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'mds.c': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'mds.d': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}} 2021-02-12T17:05:53.885 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-02-12T17:05:53.885 DEBUG:teuthology.orchestra.run.gibba002:> uname -r 2021-02-12T17:05:53.898 INFO:teuthology.orchestra.run.gibba002.stdout:4.18.0-193.28.1.el8_2.x86_64 2021-02-12T17:05:53.898 INFO:teuthology.task.kernel:Running kernel on gibba002: 4.18.0-193.28.1.el8_2.x86_64 2021-02-12T17:05:53.899 DEBUG:teuthology.orchestra.run.gibba002:> sudo yum install -y kernel 2021-02-12T17:05:56.288 INFO:teuthology.orchestra.run.gibba002.stdout:CentOS-8 - AppStream 36 MB/s | 6.3 MB 00:00 2021-02-12T17:05:57.121 INFO:teuthology.orchestra.run.gibba002.stdout:CentOS-8 - Base 28 MB/s | 2.3 MB 00:00 2021-02-12T17:05:57.483 INFO:teuthology.orchestra.run.gibba002.stdout:CentOS-8 - Extras 118 kB/s | 8.6 kB 00:00 2021-02-12T17:05:57.953 INFO:teuthology.orchestra.run.gibba002.stdout:Extra Packages for Enterprise Linux 21 MB/s | 8.9 MB 00:00 2021-02-12T17:05:59.319 INFO:teuthology.orchestra.run.gibba002.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2021-02-12T17:06:00.161 INFO:teuthology.orchestra.run.gibba002.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2021-02-12T17:06:00.162 INFO:teuthology.orchestra.run.gibba002.stdout:Package kernel-4.18.0-193.28.1.el8_2.x86_64 is already installed. 2021-02-12T17:06:00.316 INFO:teuthology.orchestra.run.gibba002.stdout:Dependencies resolved. 2021-02-12T17:06:00.320 INFO:teuthology.orchestra.run.gibba002.stdout:================================================================================ 2021-02-12T17:06:00.320 INFO:teuthology.orchestra.run.gibba002.stdout: Package Arch Version Repository Size 2021-02-12T17:06:00.321 INFO:teuthology.orchestra.run.gibba002.stdout:================================================================================ 2021-02-12T17:06:00.321 INFO:teuthology.orchestra.run.gibba002.stdout:Installing: 2021-02-12T17:06:00.321 INFO:teuthology.orchestra.run.gibba002.stdout: kernel x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 4.3 M 2021-02-12T17:06:00.321 INFO:teuthology.orchestra.run.gibba002.stdout:Upgrading: 2021-02-12T17:06:00.321 INFO:teuthology.orchestra.run.gibba002.stdout: linux-firmware noarch 20200619-101.git3890db36.el8_3 CentOS-Base 101 M 2021-02-12T17:06:00.321 INFO:teuthology.orchestra.run.gibba002.stdout:Installing dependencies: 2021-02-12T17:06:00.321 INFO:teuthology.orchestra.run.gibba002.stdout: kernel-core x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 30 M 2021-02-12T17:06:00.321 INFO:teuthology.orchestra.run.gibba002.stdout: kernel-modules x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 26 M 2021-02-12T17:06:00.321 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:06:00.321 INFO:teuthology.orchestra.run.gibba002.stdout:Transaction Summary 2021-02-12T17:06:00.321 INFO:teuthology.orchestra.run.gibba002.stdout:================================================================================ 2021-02-12T17:06:00.321 INFO:teuthology.orchestra.run.gibba002.stdout:Install 3 Packages 2021-02-12T17:06:00.321 INFO:teuthology.orchestra.run.gibba002.stdout:Upgrade 1 Package 2021-02-12T17:06:00.322 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:06:00.322 INFO:teuthology.orchestra.run.gibba002.stdout:Total download size: 162 M 2021-02-12T17:06:00.322 INFO:teuthology.orchestra.run.gibba002.stdout:Downloading Packages: 2021-02-12T17:06:00.540 INFO:teuthology.orchestra.run.gibba002.stdout:(1/4): kernel-4.18.0-240.10.1.el8_3.x86_64.rpm 20 MB/s | 4.3 MB 00:00 2021-02-12T17:06:01.305 INFO:teuthology.orchestra.run.gibba002.stdout:(2/4): kernel-modules-4.18.0-240.10.1.el8_3.x86 26 MB/s | 26 MB 00:00 2021-02-12T17:06:01.662 INFO:teuthology.orchestra.run.gibba002.stdout:(3/4): kernel-core-4.18.0-240.10.1.el8_3.x86_64 23 MB/s | 30 MB 00:01 2021-02-12T17:06:03.222 INFO:teuthology.orchestra.run.gibba002.stdout:(4/4): linux-firmware-20200619-101.git3890db36. 38 MB/s | 101 MB 00:02 2021-02-12T17:06:03.224 INFO:teuthology.orchestra.run.gibba002.stdout:-------------------------------------------------------------------------------- 2021-02-12T17:06:03.224 INFO:teuthology.orchestra.run.gibba002.stdout:Total 56 MB/s | 162 MB 00:02 2021-02-12T17:06:03.299 INFO:teuthology.orchestra.run.gibba002.stdout:Running transaction check 2021-02-12T17:06:03.585 INFO:teuthology.orchestra.run.gibba002.stdout:Transaction check succeeded. 2021-02-12T17:06:03.585 INFO:teuthology.orchestra.run.gibba002.stdout:Running transaction test 2021-02-12T17:06:05.018 INFO:teuthology.orchestra.run.gibba002.stdout:Transaction test succeeded. 2021-02-12T17:06:05.018 INFO:teuthology.orchestra.run.gibba002.stdout:Running transaction 2021-02-12T17:06:12.931 INFO:teuthology.orchestra.run.gibba002.stdout: Preparing : 1/1 2021-02-12T17:06:14.348 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : linux-firmware-20200619-101.git3890db36.el8_3.noarch 1/5 2021-02-12T17:06:14.869 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-12T17:06:16.930 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-12T17:06:17.257 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-12T17:06:19.565 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-12T17:06:19.744 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : kernel-4.18.0-240.10.1.el8_3.x86_64 4/5 2021-02-12T17:06:19.962 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-12T17:06:35.163 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: kernel-core-4.18.0-240.10.1.el8_3.x86_64 5/5 2021-02-12T17:06:35.452 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-12T17:06:35.452 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : kernel-4.18.0-240.10.1.el8_3.x86_64 1/5 2021-02-12T17:06:35.452 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-12T17:06:35.452 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-12T17:06:35.452 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : linux-firmware-20200619-101.git3890db36.el8_3.noarch 4/5 2021-02-12T17:06:35.803 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-12T17:06:35.803 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:06:35.803 INFO:teuthology.orchestra.run.gibba002.stdout:Upgraded: 2021-02-12T17:06:35.803 INFO:teuthology.orchestra.run.gibba002.stdout: linux-firmware-20200619-101.git3890db36.el8_3.noarch 2021-02-12T17:06:35.803 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:06:35.803 INFO:teuthology.orchestra.run.gibba002.stdout:Installed: 2021-02-12T17:06:35.803 INFO:teuthology.orchestra.run.gibba002.stdout: kernel-4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:06:35.803 INFO:teuthology.orchestra.run.gibba002.stdout: kernel-core-4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:06:35.803 INFO:teuthology.orchestra.run.gibba002.stdout: kernel-modules-4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:06:35.803 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:06:35.804 INFO:teuthology.orchestra.run.gibba002.stdout:Complete! 2021-02-12T17:06:35.983 DEBUG:teuthology.orchestra.run.gibba002:> rpm -q kernel --last | head -n 1 2021-02-12T17:06:36.082 INFO:teuthology.orchestra.run.gibba002.stdout:kernel-4.18.0-240.10.1.el8_3.x86_64 Fri 12 Feb 2021 05:06:19 PM UTC 2021-02-12T17:06:36.084 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:06:36.084 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-193.28.1.el8_2.x86_64 Expected: 4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:06:36.084 DEBUG:teuthology.orchestra.run.gibba004:> uname -r 2021-02-12T17:06:36.097 INFO:teuthology.orchestra.run.gibba004.stdout:4.18.0-193.28.1.el8_2.x86_64 2021-02-12T17:06:36.097 INFO:teuthology.task.kernel:Running kernel on gibba004: 4.18.0-193.28.1.el8_2.x86_64 2021-02-12T17:06:36.097 DEBUG:teuthology.orchestra.run.gibba004:> sudo yum install -y kernel 2021-02-12T17:06:38.319 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS-8 - AppStream 42 MB/s | 6.3 MB 00:00 2021-02-12T17:06:39.167 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS-8 - Base 26 MB/s | 2.3 MB 00:00 2021-02-12T17:06:39.516 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS-8 - Extras 138 kB/s | 8.6 kB 00:00 2021-02-12T17:06:40.053 INFO:teuthology.orchestra.run.gibba004.stdout:Extra Packages for Enterprise Linux 18 MB/s | 8.9 MB 00:00 2021-02-12T17:06:41.414 INFO:teuthology.orchestra.run.gibba004.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2021-02-12T17:06:42.304 INFO:teuthology.orchestra.run.gibba004.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2021-02-12T17:06:42.304 INFO:teuthology.orchestra.run.gibba004.stdout:Package kernel-4.18.0-193.28.1.el8_2.x86_64 is already installed. 2021-02-12T17:06:42.459 INFO:teuthology.orchestra.run.gibba004.stdout:Dependencies resolved. 2021-02-12T17:06:42.470 INFO:teuthology.orchestra.run.gibba004.stdout:================================================================================ 2021-02-12T17:06:42.470 INFO:teuthology.orchestra.run.gibba004.stdout: Package Arch Version Repository Size 2021-02-12T17:06:42.470 INFO:teuthology.orchestra.run.gibba004.stdout:================================================================================ 2021-02-12T17:06:42.470 INFO:teuthology.orchestra.run.gibba004.stdout:Installing: 2021-02-12T17:06:42.470 INFO:teuthology.orchestra.run.gibba004.stdout: kernel x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 4.3 M 2021-02-12T17:06:42.470 INFO:teuthology.orchestra.run.gibba004.stdout:Upgrading: 2021-02-12T17:06:42.470 INFO:teuthology.orchestra.run.gibba004.stdout: linux-firmware noarch 20200619-101.git3890db36.el8_3 CentOS-Base 101 M 2021-02-12T17:06:42.470 INFO:teuthology.orchestra.run.gibba004.stdout:Installing dependencies: 2021-02-12T17:06:42.471 INFO:teuthology.orchestra.run.gibba004.stdout: kernel-core x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 30 M 2021-02-12T17:06:42.471 INFO:teuthology.orchestra.run.gibba004.stdout: kernel-modules x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 26 M 2021-02-12T17:06:42.471 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:06:42.471 INFO:teuthology.orchestra.run.gibba004.stdout:Transaction Summary 2021-02-12T17:06:42.471 INFO:teuthology.orchestra.run.gibba004.stdout:================================================================================ 2021-02-12T17:06:42.471 INFO:teuthology.orchestra.run.gibba004.stdout:Install 3 Packages 2021-02-12T17:06:42.471 INFO:teuthology.orchestra.run.gibba004.stdout:Upgrade 1 Package 2021-02-12T17:06:42.471 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:06:42.472 INFO:teuthology.orchestra.run.gibba004.stdout:Total download size: 162 M 2021-02-12T17:06:42.472 INFO:teuthology.orchestra.run.gibba004.stdout:Downloading Packages: 2021-02-12T17:06:42.651 INFO:teuthology.orchestra.run.gibba004.stdout:(1/4): kernel-4.18.0-240.10.1.el8_3.x86_64.rpm 24 MB/s | 4.3 MB 00:00 2021-02-12T17:06:43.153 INFO:teuthology.orchestra.run.gibba004.stdout:(2/4): kernel-core-4.18.0-240.10.1.el8_3.x86_64 45 MB/s | 30 MB 00:00 2021-02-12T17:06:43.511 INFO:teuthology.orchestra.run.gibba004.stdout:(3/4): kernel-modules-4.18.0-240.10.1.el8_3.x86 25 MB/s | 26 MB 00:01 2021-02-12T17:06:44.983 INFO:teuthology.orchestra.run.gibba004.stdout:(4/4): linux-firmware-20200619-101.git3890db36. 44 MB/s | 101 MB 00:02 2021-02-12T17:06:44.985 INFO:teuthology.orchestra.run.gibba004.stdout:-------------------------------------------------------------------------------- 2021-02-12T17:06:44.985 INFO:teuthology.orchestra.run.gibba004.stdout:Total 64 MB/s | 162 MB 00:02 2021-02-12T17:06:45.052 INFO:teuthology.orchestra.run.gibba004.stdout:Running transaction check 2021-02-12T17:06:45.313 INFO:teuthology.orchestra.run.gibba004.stdout:Transaction check succeeded. 2021-02-12T17:06:45.314 INFO:teuthology.orchestra.run.gibba004.stdout:Running transaction test 2021-02-12T17:06:46.735 INFO:teuthology.orchestra.run.gibba004.stdout:Transaction test succeeded. 2021-02-12T17:06:46.735 INFO:teuthology.orchestra.run.gibba004.stdout:Running transaction 2021-02-12T17:06:54.535 INFO:teuthology.orchestra.run.gibba004.stdout: Preparing : 1/1 2021-02-12T17:06:55.936 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : linux-firmware-20200619-101.git3890db36.el8_3.noarch 1/5 2021-02-12T17:06:56.463 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-12T17:06:58.568 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-12T17:06:58.897 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-12T17:07:01.209 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-12T17:07:01.370 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : kernel-4.18.0-240.10.1.el8_3.x86_64 4/5 2021-02-12T17:07:01.624 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-12T17:07:16.744 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: kernel-core-4.18.0-240.10.1.el8_3.x86_64 5/5 2021-02-12T17:07:17.009 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-12T17:07:17.010 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : kernel-4.18.0-240.10.1.el8_3.x86_64 1/5 2021-02-12T17:07:17.010 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-12T17:07:17.010 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-12T17:07:17.010 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : linux-firmware-20200619-101.git3890db36.el8_3.noarch 4/5 2021-02-12T17:07:17.321 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-12T17:07:17.321 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:07:17.321 INFO:teuthology.orchestra.run.gibba004.stdout:Upgraded: 2021-02-12T17:07:17.321 INFO:teuthology.orchestra.run.gibba004.stdout: linux-firmware-20200619-101.git3890db36.el8_3.noarch 2021-02-12T17:07:17.321 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:07:17.321 INFO:teuthology.orchestra.run.gibba004.stdout:Installed: 2021-02-12T17:07:17.321 INFO:teuthology.orchestra.run.gibba004.stdout: kernel-4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:07:17.321 INFO:teuthology.orchestra.run.gibba004.stdout: kernel-core-4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:07:17.322 INFO:teuthology.orchestra.run.gibba004.stdout: kernel-modules-4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:07:17.322 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:07:17.322 INFO:teuthology.orchestra.run.gibba004.stdout:Complete! 2021-02-12T17:07:17.482 DEBUG:teuthology.orchestra.run.gibba004:> rpm -q kernel --last | head -n 1 2021-02-12T17:07:17.571 INFO:teuthology.orchestra.run.gibba004.stdout:kernel-4.18.0-240.10.1.el8_3.x86_64 Fri 12 Feb 2021 05:07:01 PM UTC 2021-02-12T17:07:17.572 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:07:17.573 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-193.28.1.el8_2.x86_64 Expected: 4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:07:17.573 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-02-12T17:07:17.573 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-12T17:07:17.573 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-12T17:07:17.573 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-02-12T17:07:17.573 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba002.front.sepia.ceph.com, path=None, version=distro) 2021-02-12T17:07:17.573 DEBUG:teuthology.orchestra.run.gibba002:> rpm -q kernel --last | head -n 1 2021-02-12T17:07:17.641 INFO:teuthology.orchestra.run.gibba002.stdout:kernel-4.18.0-240.10.1.el8_3.x86_64 Fri 12 Feb 2021 05:06:19 PM UTC 2021-02-12T17:07:17.642 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:07:17.642 DEBUG:teuthology.orchestra.run.gibba002:> sudo rpm -qi grub2-tools 2021-02-12T17:07:17.667 INFO:teuthology.orchestra.run.gibba002.stdout:Name : grub2-tools 2021-02-12T17:07:17.668 INFO:teuthology.orchestra.run.gibba002.stdout:Epoch : 1 2021-02-12T17:07:17.668 INFO:teuthology.orchestra.run.gibba002.stdout:Version : 2.02 2021-02-12T17:07:17.668 INFO:teuthology.orchestra.run.gibba002.stdout:Release : 81.el8 2021-02-12T17:07:17.668 INFO:teuthology.orchestra.run.gibba002.stdout:Architecture: x86_64 2021-02-12T17:07:17.668 INFO:teuthology.orchestra.run.gibba002.stdout:Install Date: Tue 10 Nov 2020 01:44:25 PM UTC 2021-02-12T17:07:17.668 INFO:teuthology.orchestra.run.gibba002.stdout:Group : System Environment/Base 2021-02-12T17:07:17.668 INFO:teuthology.orchestra.run.gibba002.stdout:Size : 9192705 2021-02-12T17:07:17.668 INFO:teuthology.orchestra.run.gibba002.stdout:License : GPLv3+ 2021-02-12T17:07:17.668 INFO:teuthology.orchestra.run.gibba002.stdout:Signature : RSA/SHA256, Tue 14 Apr 2020 03:18:37 PM UTC, Key ID 05b555b38483c65d 2021-02-12T17:07:17.668 INFO:teuthology.orchestra.run.gibba002.stdout:Source RPM : grub2-2.02-81.el8.src.rpm 2021-02-12T17:07:17.668 INFO:teuthology.orchestra.run.gibba002.stdout:Build Date : Tue 14 Apr 2020 02:54:04 PM UTC 2021-02-12T17:07:17.668 INFO:teuthology.orchestra.run.gibba002.stdout:Build Host : kbuilder.bsys.centos.org 2021-02-12T17:07:17.668 INFO:teuthology.orchestra.run.gibba002.stdout:Relocations : (not relocatable) 2021-02-12T17:07:17.669 INFO:teuthology.orchestra.run.gibba002.stdout:Packager : CentOS BuildSystem 2021-02-12T17:07:17.669 INFO:teuthology.orchestra.run.gibba002.stdout:Vendor : CentOS 2021-02-12T17:07:17.669 INFO:teuthology.orchestra.run.gibba002.stdout:URL : http://www.gnu.org/software/grub/ 2021-02-12T17:07:17.669 INFO:teuthology.orchestra.run.gibba002.stdout:Summary : Support tools for GRUB. 2021-02-12T17:07:17.669 INFO:teuthology.orchestra.run.gibba002.stdout:Description : 2021-02-12T17:07:17.669 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:07:17.669 INFO:teuthology.orchestra.run.gibba002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-02-12T17:07:17.669 INFO:teuthology.orchestra.run.gibba002.stdout:customizable bootloader with modular architecture. It supports a rich 2021-02-12T17:07:17.669 INFO:teuthology.orchestra.run.gibba002.stdout:variety of kernel formats, file systems, computer architectures and 2021-02-12T17:07:17.669 INFO:teuthology.orchestra.run.gibba002.stdout:hardware devices. 2021-02-12T17:07:17.669 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:07:17.669 INFO:teuthology.orchestra.run.gibba002.stdout:This subpackage provides tools for support of all platforms. 2021-02-12T17:07:17.670 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-02-12T17:07:17.670 INFO:teuthology.task.kernel:Updating grub on gibba002 to boot 4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:07:17.670 DEBUG:teuthology.orchestra.run.gibba002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-02-12T17:07:18.332 INFO:teuthology.orchestra.run.gibba002.stderr:Generating grub configuration file ... 2021-02-12T17:07:20.035 INFO:teuthology.orchestra.run.gibba002.stderr:done 2021-02-12T17:07:20.039 DEBUG:teuthology.orchestra.run.gibba002:> mktemp 2021-02-12T17:07:20.058 INFO:teuthology.orchestra.run.gibba002.stdout:/tmp/tmp.gWJSx8lDo9 2021-02-12T17:07:20.058 DEBUG:teuthology.orchestra.run.gibba002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gWJSx8lDo9 2021-02-12T17:07:20.127 DEBUG:teuthology.orchestra.run.gibba002:> sudo chmod 0666 /tmp/tmp.gWJSx8lDo9 2021-02-12T17:07:20.277 DEBUG:teuthology.orchestra.remote:gibba002:/tmp/tmp.gWJSx8lDo9 is 4KB 2021-02-12T17:07:20.328 DEBUG:teuthology.orchestra.run.gibba002:> rm -fr /tmp/tmp.gWJSx8lDo9 2021-02-12T17:07:20.340 DEBUG:teuthology.orchestra.run.gibba002:> sudo /bin/ls /boot/loader/entries || true 2021-02-12T17:07:20.398 INFO:teuthology.orchestra.run.gibba002.stdout:347a65e5579f44008a35edab13368c0b-0-rescue.conf 2021-02-12T17:07:20.399 INFO:teuthology.orchestra.run.gibba002.stdout:347a65e5579f44008a35edab13368c0b-4.18.0-193.28.1.el8_2.x86_64.conf 2021-02-12T17:07:20.399 INFO:teuthology.orchestra.run.gibba002.stdout:347a65e5579f44008a35edab13368c0b-4.18.0-193.el8.x86_64.conf 2021-02-12T17:07:20.399 INFO:teuthology.orchestra.run.gibba002.stdout:347a65e5579f44008a35edab13368c0b-4.18.0-240.10.1.el8_3.x86_64.conf 2021-02-12T17:07:20.400 DEBUG:teuthology.orchestra.run.gibba002:> sudo grub2-set-default 347a65e5579f44008a35edab13368c0b-4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:07:20.547 DEBUG:teuthology.orchestra.run.gibba002:> sudo shutdown -r now 2021-02-12T17:07:20.550 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-02-12T17:07:20.550 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba004.front.sepia.ceph.com, path=None, version=distro) 2021-02-12T17:07:20.550 DEBUG:teuthology.orchestra.run.gibba004:> rpm -q kernel --last | head -n 1 2021-02-12T17:07:20.619 INFO:teuthology.orchestra.run.gibba004.stdout:kernel-4.18.0-240.10.1.el8_3.x86_64 Fri 12 Feb 2021 05:07:01 PM UTC 2021-02-12T17:07:20.620 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:07:20.620 DEBUG:teuthology.orchestra.run.gibba004:> sudo rpm -qi grub2-tools 2021-02-12T17:07:20.644 INFO:teuthology.orchestra.run.gibba004.stdout:Name : grub2-tools 2021-02-12T17:07:20.644 INFO:teuthology.orchestra.run.gibba004.stdout:Epoch : 1 2021-02-12T17:07:20.644 INFO:teuthology.orchestra.run.gibba004.stdout:Version : 2.02 2021-02-12T17:07:20.644 INFO:teuthology.orchestra.run.gibba004.stdout:Release : 81.el8 2021-02-12T17:07:20.645 INFO:teuthology.orchestra.run.gibba004.stdout:Architecture: x86_64 2021-02-12T17:07:20.645 INFO:teuthology.orchestra.run.gibba004.stdout:Install Date: Tue 10 Nov 2020 01:44:25 PM UTC 2021-02-12T17:07:20.645 INFO:teuthology.orchestra.run.gibba004.stdout:Group : System Environment/Base 2021-02-12T17:07:20.645 INFO:teuthology.orchestra.run.gibba004.stdout:Size : 9192705 2021-02-12T17:07:20.645 INFO:teuthology.orchestra.run.gibba004.stdout:License : GPLv3+ 2021-02-12T17:07:20.645 INFO:teuthology.orchestra.run.gibba004.stdout:Signature : RSA/SHA256, Tue 14 Apr 2020 03:18:37 PM UTC, Key ID 05b555b38483c65d 2021-02-12T17:07:20.645 INFO:teuthology.orchestra.run.gibba004.stdout:Source RPM : grub2-2.02-81.el8.src.rpm 2021-02-12T17:07:20.645 INFO:teuthology.orchestra.run.gibba004.stdout:Build Date : Tue 14 Apr 2020 02:54:04 PM UTC 2021-02-12T17:07:20.645 INFO:teuthology.orchestra.run.gibba004.stdout:Build Host : kbuilder.bsys.centos.org 2021-02-12T17:07:20.645 INFO:teuthology.orchestra.run.gibba004.stdout:Relocations : (not relocatable) 2021-02-12T17:07:20.645 INFO:teuthology.orchestra.run.gibba004.stdout:Packager : CentOS BuildSystem 2021-02-12T17:07:20.645 INFO:teuthology.orchestra.run.gibba004.stdout:Vendor : CentOS 2021-02-12T17:07:20.645 INFO:teuthology.orchestra.run.gibba004.stdout:URL : http://www.gnu.org/software/grub/ 2021-02-12T17:07:20.645 INFO:teuthology.orchestra.run.gibba004.stdout:Summary : Support tools for GRUB. 2021-02-12T17:07:20.646 INFO:teuthology.orchestra.run.gibba004.stdout:Description : 2021-02-12T17:07:20.646 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:07:20.646 INFO:teuthology.orchestra.run.gibba004.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-02-12T17:07:20.646 INFO:teuthology.orchestra.run.gibba004.stdout:customizable bootloader with modular architecture. It supports a rich 2021-02-12T17:07:20.646 INFO:teuthology.orchestra.run.gibba004.stdout:variety of kernel formats, file systems, computer architectures and 2021-02-12T17:07:20.646 INFO:teuthology.orchestra.run.gibba004.stdout:hardware devices. 2021-02-12T17:07:20.646 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:07:20.646 INFO:teuthology.orchestra.run.gibba004.stdout:This subpackage provides tools for support of all platforms. 2021-02-12T17:07:20.647 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-02-12T17:07:20.647 INFO:teuthology.task.kernel:Updating grub on gibba004 to boot 4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:07:20.647 DEBUG:teuthology.orchestra.run.gibba004:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-02-12T17:07:22.639 INFO:teuthology.orchestra.run.gibba004.stderr:Generating grub configuration file ... 2021-02-12T17:07:24.307 INFO:teuthology.orchestra.run.gibba004.stderr:done 2021-02-12T17:07:24.310 DEBUG:teuthology.orchestra.run.gibba004:> mktemp 2021-02-12T17:07:24.321 INFO:teuthology.orchestra.run.gibba004.stdout:/tmp/tmp.qnk0X1smav 2021-02-12T17:07:24.322 DEBUG:teuthology.orchestra.run.gibba004:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qnk0X1smav 2021-02-12T17:07:24.384 DEBUG:teuthology.orchestra.run.gibba004:> sudo chmod 0666 /tmp/tmp.qnk0X1smav 2021-02-12T17:07:24.532 DEBUG:teuthology.orchestra.remote:gibba004:/tmp/tmp.qnk0X1smav is 4KB 2021-02-12T17:07:24.582 DEBUG:teuthology.orchestra.run.gibba004:> rm -fr /tmp/tmp.qnk0X1smav 2021-02-12T17:07:24.594 DEBUG:teuthology.orchestra.run.gibba004:> sudo /bin/ls /boot/loader/entries || true 2021-02-12T17:07:24.653 INFO:teuthology.orchestra.run.gibba004.stdout:347a65e5579f44008a35edab13368c0b-0-rescue.conf 2021-02-12T17:07:24.653 INFO:teuthology.orchestra.run.gibba004.stdout:347a65e5579f44008a35edab13368c0b-4.18.0-193.28.1.el8_2.x86_64.conf 2021-02-12T17:07:24.653 INFO:teuthology.orchestra.run.gibba004.stdout:347a65e5579f44008a35edab13368c0b-4.18.0-193.el8.x86_64.conf 2021-02-12T17:07:24.653 INFO:teuthology.orchestra.run.gibba004.stdout:347a65e5579f44008a35edab13368c0b-4.18.0-240.10.1.el8_3.x86_64.conf 2021-02-12T17:07:24.654 DEBUG:teuthology.orchestra.run.gibba004:> sudo grub2-set-default 347a65e5579f44008a35edab13368c0b-4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:07:24.807 DEBUG:teuthology.orchestra.run.gibba004:> sudo shutdown -r now 2021-02-12T17:07:54.838 INFO:teuthology.misc:Re-opening connections... 2021-02-12T17:07:54.839 INFO:teuthology.misc:trying to connect to ubuntu@gibba002.front.sepia.ceph.com 2021-02-12T17:07:54.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-12T17:07:54.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-12T17:08:29.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.102 2021-02-12T17:08:29.507 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-02-12T17:08:29.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-12T17:08:29.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-12T17:08:32.582 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-02-12T17:08:32.582 DEBUG:teuthology.misc:waited 37.74377107620239 2021-02-12T17:08:33.583 INFO:teuthology.misc:trying to connect to ubuntu@gibba002.front.sepia.ceph.com 2021-02-12T17:08:33.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-12T17:08:33.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-12T17:08:34.882 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.102 2021-02-12T17:08:34.882 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-02-12T17:08:34.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-12T17:08:34.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-12T17:08:35.650 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-02-12T17:08:35.650 DEBUG:teuthology.misc:waited 40.81185007095337 2021-02-12T17:08:36.651 INFO:teuthology.misc:trying to connect to ubuntu@gibba002.front.sepia.ceph.com 2021-02-12T17:08:36.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-12T17:08:36.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-12T17:08:37.958 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.102 2021-02-12T17:08:37.958 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-02-12T17:08:37.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-12T17:08:37.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-12T17:08:41.026 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.104 2021-02-12T17:08:41.026 DEBUG:teuthology.misc:waited 46.18790149688721 2021-02-12T17:08:42.027 INFO:teuthology.misc:trying to connect to ubuntu@gibba002.front.sepia.ceph.com 2021-02-12T17:08:42.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-12T17:08:42.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-12T17:09:13.830 DEBUG:teuthology.orchestra.run.gibba002:> true 2021-02-12T17:09:14.104 DEBUG:teuthology.misc:waited 79.2651686668396 2021-02-12T17:09:15.104 INFO:teuthology.misc:trying to connect to ubuntu@gibba004.front.sepia.ceph.com 2021-02-12T17:09:15.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-12T17:09:15.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-12T17:09:16.430 DEBUG:teuthology.orchestra.run.gibba004:> true 2021-02-12T17:09:16.746 DEBUG:teuthology.misc:waited 81.90755558013916 2021-02-12T17:09:17.747 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-02-12T17:09:17.748 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-240.10.1.el8_3.x86_64"... 2021-02-12T17:09:17.748 DEBUG:teuthology.orchestra.run.gibba002:> uname -r 2021-02-12T17:09:17.760 INFO:teuthology.orchestra.run.gibba002.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:09:17.761 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-240.10.1.el8_3.x86_64 vs 4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:09:17.761 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-12T17:09:17.761 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-02-12T17:09:17.761 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-02-12T17:09:17.761 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-240.10.1.el8_3.x86_64"... 2021-02-12T17:09:17.761 DEBUG:teuthology.orchestra.run.gibba004:> uname -r 2021-02-12T17:09:17.773 INFO:teuthology.orchestra.run.gibba004.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:09:17.774 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-240.10.1.el8_3.x86_64 vs 4.18.0-240.10.1.el8_3.x86_64 2021-02-12T17:09:17.774 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-12T17:09:17.774 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-02-12T17:09:18.774 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-02-12T17:09:18.775 DEBUG:teuthology.orchestra.run.gibba002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-12T17:09:18.854 INFO:teuthology.orchestra.run.gibba002.stdout:ttyS1 2021-02-12T17:09:18.868 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-02-12T17:09:18.868 DEBUG:teuthology.orchestra.run.gibba004:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-12T17:09:18.910 INFO:teuthology.orchestra.run.gibba004.stdout:ttyS1 2021-02-12T17:09:18.922 INFO:teuthology.run_tasks:Running task internal.base... 2021-02-12T17:09:18.930 INFO:teuthology.task.internal:Creating test directory... 2021-02-12T17:09:18.930 DEBUG:teuthology.orchestra.run.gibba002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-12T17:09:18.934 DEBUG:teuthology.orchestra.run.gibba004:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-12T17:09:18.975 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-02-12T17:09:19.686 INFO:teuthology.run_tasks:Running task internal.archive... 2021-02-12T17:09:20.178 INFO:teuthology.task.internal:Creating archive directory... 2021-02-12T17:09:20.179 DEBUG:teuthology.orchestra.run.gibba002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-12T17:09:20.182 DEBUG:teuthology.orchestra.run.gibba004:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-12T17:09:20.202 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-02-12T17:09:20.238 INFO:teuthology.task.internal:Enabling coredump saving... 2021-02-12T17:09:20.238 DEBUG:teuthology.orchestra.run.gibba002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-12T17:09:20.241 DEBUG:teuthology.orchestra.run.gibba004:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-12T17:09:20.260 INFO:teuthology.orchestra.run.gibba002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-12T17:09:20.265 INFO:teuthology.orchestra.run.gibba004.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-12T17:09:20.268 INFO:teuthology.orchestra.run.gibba002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-12T17:09:20.274 INFO:teuthology.orchestra.run.gibba004.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-12T17:09:20.275 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-02-12T17:09:20.558 INFO:teuthology.task.internal:Configuring sudo... 2021-02-12T17:09:20.558 DEBUG:teuthology.orchestra.run.gibba002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-12T17:09:20.561 DEBUG:teuthology.orchestra.run.gibba004:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-12T17:09:20.580 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-02-12T17:09:20.606 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-02-12T17:09:20.606 DEBUG:teuthology.orchestra.run.gibba002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-12T17:09:20.623 DEBUG:teuthology.orchestra.run.gibba004:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-12T17:09:20.635 DEBUG:teuthology.orchestra.run.gibba002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-12T17:09:20.704 DEBUG:teuthology.orchestra.run.gibba002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-12T17:09:20.754 DEBUG:teuthology.orchestra.run.gibba002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-12T17:09:20.823 DEBUG:teuthology.orchestra.run.gibba002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-12T17:09:20.867 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:09:20.867 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-12T17:09:20.927 DEBUG:teuthology.orchestra.run.gibba004:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-12T17:09:20.957 DEBUG:teuthology.orchestra.run.gibba004:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-12T17:09:21.003 DEBUG:teuthology.orchestra.run.gibba004:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-12T17:09:21.081 DEBUG:teuthology.orchestra.run.gibba004:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-12T17:09:21.122 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:09:21.122 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-12T17:09:21.184 DEBUG:teuthology.orchestra.run.gibba002:> sudo service rsyslog restart 2021-02-12T17:09:21.187 DEBUG:teuthology.orchestra.run.gibba004:> sudo service rsyslog restart 2021-02-12T17:09:21.235 INFO:teuthology.orchestra.run.gibba002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-02-12T17:09:21.269 INFO:teuthology.orchestra.run.gibba004.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-02-12T17:09:21.712 INFO:teuthology.run_tasks:Running task internal.timer... 2021-02-12T17:09:21.723 INFO:teuthology.task.internal:Starting timer... 2021-02-12T17:09:21.723 INFO:teuthology.run_tasks:Running task pcp... 2021-02-12T17:09:21.777 INFO:teuthology.run_tasks:Running task selinux... 2021-02-12T17:09:21.968 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-02-12T17:09:21.969 DEBUG:teuthology.orchestra.run.gibba002:> sudo service auditd rotate 2021-02-12T17:09:22.003 INFO:teuthology.orchestra.run.gibba002.stdout:Rotating logs: [ OK ] 2021-02-12T17:09:22.005 DEBUG:teuthology.orchestra.run.gibba004:> sudo service auditd rotate 2021-02-12T17:09:22.053 INFO:teuthology.orchestra.run.gibba004.stdout:Rotating logs: [ OK ] 2021-02-12T17:09:22.054 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-02-12T17:09:22.054 DEBUG:teuthology.orchestra.run.gibba002:> /usr/sbin/getenforce 2021-02-12T17:09:22.074 INFO:teuthology.orchestra.run.gibba002.stdout:Permissive 2021-02-12T17:09:22.074 DEBUG:teuthology.orchestra.run.gibba004:> /usr/sbin/getenforce 2021-02-12T17:09:22.137 INFO:teuthology.orchestra.run.gibba004.stdout:Permissive 2021-02-12T17:09:22.138 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@gibba002.front.sepia.ceph.com': 'permissive', 'ubuntu@gibba004.front.sepia.ceph.com': 'permissive'} 2021-02-12T17:09:22.138 DEBUG:teuthology.orchestra.run.gibba002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-02-12T17:09:22.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-12T17:09:22.157 DEBUG:teuthology.orchestra.run.gibba004:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-02-12T17:09:22.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-12T17:09:22.201 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-02-12T17:09:22.201 DEBUG:teuthology.orchestra.run.gibba002:> sudo /usr/sbin/setenforce permissive 2021-02-12T17:09:22.219 DEBUG:teuthology.orchestra.run.gibba004:> sudo /usr/sbin/setenforce permissive 2021-02-12T17:09:22.273 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-02-12T17:09:22.405 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-02-12T17:09:22.405 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-02-12T17:09:22.424 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-02-12T17:09:22.426 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit gibba002.front.sepia.ceph.com,gibba004.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-02-12T17:09:22.772 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-02-12T17:09:23.639 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-02-12T17:09:26.258 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-02-12T17:09:26.278 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:26 +0000 (0:00:00.070) 0:00:00.070 ******* 2021-02-12T17:09:26.295 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:26 +0000 (0:00:00.016) 0:00:00.086 ******* 2021-02-12T17:09:27.621 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba002.front.sepia.ceph.com] 2021-02-12T17:09:27.705 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:27 +0000 (0:00:01.410) 0:00:01.497 ******* 2021-02-12T17:09:27.734 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] 2021-02-12T17:09:27.826 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:27 +0000 (0:00:00.121) 0:00:01.618 ******* 2021-02-12T17:09:27.976 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-02-12T17:09:27.978 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-02-12T17:09:28.010 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:28 +0000 (0:00:00.183) 0:00:01.801 ******* 2021-02-12T17:09:28.040 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:28 +0000 (0:00:00.030) 0:00:01.832 ******* 2021-02-12T17:09:28.371 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-02-12T17:09:28.372 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} ok: [gibba002.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-12T17:09:28.406 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:28 +0000 (0:00:00.366) 0:00:02.198 ******* 2021-02-12T17:09:28.438 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:28 +0000 (0:00:00.031) 0:00:02.230 ******* 2021-02-12T17:09:28.443 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-02-12T17:09:28.444 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:09:28.477 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:28 +0000 (0:00:00.039) 0:00:02.269 ******* 2021-02-12T17:09:28.484 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:09:28.519 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:28 +0000 (0:00:00.041) 0:00:02.311 ******* 2021-02-12T17:09:28.744 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-02-12T17:09:28.745 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [gibba004.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-12T17:09:28.780 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:28 +0000 (0:00:00.261) 0:00:02.572 ******* 2021-02-12T17:09:28.816 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:28 +0000 (0:00:00.035) 0:00:02.607 ******* 2021-02-12T17:09:29.520 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-02-12T17:09:29.522 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613149768.798097-234379159666285/source", "state": "file", "uid": 0} changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613149768.8338199-129603269110348/source", "state": "file", "uid": 0} 2021-02-12T17:09:29.563 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:29 +0000 (0:00:00.747) 0:00:03.355 ******* 2021-02-12T17:09:29.597 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:29 +0000 (0:00:00.031) 0:00:03.386 ******* 2021-02-12T17:09:29.933 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-02-12T17:09:29.935 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-02-12T17:09:29.936 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-02-12T17:09:29.976 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-02-12T17:09:29.978 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-02-12T17:09:30.097 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-02-12T17:09:30.104 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-02-12T17:09:30.248 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:30 +0000 (0:00:00.654) 0:00:04.040 ******* 2021-02-12T17:09:30.279 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:30 +0000 (0:00:00.030) 0:00:04.071 ******* 2021-02-12T17:09:30.795 INFO:teuthology.task.ansible.out: 2021-02-12T17:09:30.797 INFO:teuthology.task.ansible.out:TASK [Gathering Facts] ********************************************************* ok: [gibba002.front.sepia.ceph.com] 2021-02-12T17:09:30.870 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] 2021-02-12T17:09:30.919 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-02-12T17:09:30.921 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:30 +0000 (0:00:00.640) 0:00:04.711 ******* 2021-02-12T17:09:30.987 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:30 +0000 (0:00:00.067) 0:00:04.779 ******* 2021-02-12T17:09:31.393 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-02-12T17:09:31.395 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.147944", "end": "2021-02-12 17:09:31.373027", "rc": 0, "start": "2021-02-12 17:09:31.225083", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-02-12T17:09:31.430 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:31 +0000 (0:00:00.443) 0:00:05.222 ******* 2021-02-12T17:09:31.447 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.156004", "end": "2021-02-12 17:09:31.412131", "rc": 0, "start": "2021-02-12 17:09:31.256127", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-02-12T17:09:31.480 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:31 +0000 (0:00:00.050) 0:00:05.272 ******* 2021-02-12T17:09:31.582 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-02-12T17:09:31.583 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.005787", "end": "2021-02-12 17:09:31.565818", "failed_when_result": false, "rc": 0, "start": "2021-02-12 17:09:31.560031", "stderr": "", "stderr_lines": [], "stdout": "3af9be36a63516879e86faffe49764ecad425070", "stdout_lines": ["3af9be36a63516879e86faffe49764ecad425070"]} 2021-02-12T17:09:31.623 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:31 +0000 (0:00:00.142) 0:00:05.415 ******* 2021-02-12T17:09:31.651 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008417", "end": "2021-02-12 17:09:31.632661", "failed_when_result": false, "rc": 0, "start": "2021-02-12 17:09:31.624244", "stderr": "", "stderr_lines": [], "stdout": "3af9be36a63516879e86faffe49764ecad425070", "stdout_lines": ["3af9be36a63516879e86faffe49764ecad425070"]} 2021-02-12T17:09:31.653 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:09:31.688 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:31 +0000 (0:00:00.064) 0:00:05.480 ******* 2021-02-12T17:09:31.721 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:31 +0000 (0:00:00.032) 0:00:05.513 ******* 2021-02-12T17:09:31.727 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-02-12T17:09:31.728 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:09:31.765 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:31 +0000 (0:00:00.044) 0:00:05.557 ******* 2021-02-12T17:09:31.771 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-02-12T17:09:31.772 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:09:31.805 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:31 +0000 (0:00:00.040) 0:00:05.597 ******* 2021-02-12T17:09:31.811 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-02-12T17:09:31.813 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:09:31.848 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:31 +0000 (0:00:00.042) 0:00:05.640 ******* 2021-02-12T17:09:31.855 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:09:31.894 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:31 +0000 (0:00:00.046) 0:00:05.686 ******* 2021-02-12T17:09:31.900 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-02-12T17:09:31.901 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:09:31.937 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:31 +0000 (0:00:00.042) 0:00:05.729 ******* 2021-02-12T17:09:31.943 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-02-12T17:09:31.945 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:09:31.980 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:31 +0000 (0:00:00.042) 0:00:05.772 ******* 2021-02-12T17:09:31.988 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-02-12T17:09:31.988 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:09:32.023 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:32 +0000 (0:00:00.043) 0:00:05.815 ******* 2021-02-12T17:09:32.030 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-02-12T17:09:32.030 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:09:32.067 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:32 +0000 (0:00:00.043) 0:00:05.859 ******* 2021-02-12T17:09:32.095 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-02-12T17:09:32.095 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:09:32.149 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:32 +0000 (0:00:00.082) 0:00:05.941 ******* 2021-02-12T17:09:32.180 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-02-12T17:09:32.181 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-12T17:09:32.215 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:32 +0000 (0:00:00.065) 0:00:06.007 ******* 2021-02-12T17:09:32.326 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-12T17:09:32.361 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:32 +0000 (0:00:00.146) 0:00:06.153 ******* 2021-02-12T17:09:32.409 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-12T17:09:32.411 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-02-12T17:09:32.557 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-02-12T17:09:32.558 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-12T17:09:32.705 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-12T17:09:32.706 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-12T17:09:32.846 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-12T17:09:32.859 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-12T17:09:33.017 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-12T17:09:33.019 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-12T17:09:33.166 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-12T17:09:33.167 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-12T17:09:33.314 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-12T17:09:33.325 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-12T17:09:33.461 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-12T17:09:33.473 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-12T17:09:33.610 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-12T17:09:33.621 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-12T17:09:33.757 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-12T17:09:33.768 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-12T17:09:33.905 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-12T17:09:33.916 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-12T17:09:34.053 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-12T17:09:34.076 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-12T17:09:34.202 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-12T17:09:34.224 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-12T17:09:34.360 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-12T17:09:34.371 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-12T17:09:34.507 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-12T17:09:34.520 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-12T17:09:34.658 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-12T17:09:34.669 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-12T17:09:34.806 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-12T17:09:34.817 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-12T17:09:34.954 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-12T17:09:34.966 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-12T17:09:35.102 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-12T17:09:35.113 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-12T17:09:35.251 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-12T17:09:35.262 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-12T17:09:35.399 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-12T17:09:35.421 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-12T17:09:35.557 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-12T17:09:35.569 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-12T17:09:35.706 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-12T17:09:35.718 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-12T17:09:35.855 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-12T17:09:35.867 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-12T17:09:36.014 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-12T17:09:36.016 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-12T17:09:36.162 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-12T17:09:36.164 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-12T17:09:36.165 INFO:teuthology.task.ansible.out: 2021-02-12T17:09:36.311 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-12T17:09:36.312 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-12T17:09:36.458 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-12T17:09:36.460 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-12T17:09:36.598 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-12T17:09:36.609 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-12T17:09:36.756 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-12T17:09:36.757 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-12T17:09:36.906 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-12T17:09:36.908 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-12T17:09:37.053 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-12T17:09:37.054 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-12T17:09:37.202 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-12T17:09:37.203 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-12T17:09:37.350 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-12T17:09:37.352 INFO:teuthology.task.ansible.out: ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-12T17:09:37.502 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-12T17:09:37.504 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-12T17:09:37.654 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-12T17:09:37.655 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-12T17:09:37.802 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-12T17:09:37.803 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-12T17:09:37.951 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-12T17:09:37.952 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-12T17:09:37.952 INFO:teuthology.task.ansible.out: 2021-02-12T17:09:38.103 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-12T17:09:38.105 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-12T17:09:38.243 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-12T17:09:38.254 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-12T17:09:38.403 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-12T17:09:38.404 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-12T17:09:38.551 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-12T17:09:38.552 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-12T17:09:38.689 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-12T17:09:38.701 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-12T17:09:38.840 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-12T17:09:38.852 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-12T17:09:38.988 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-12T17:09:38.999 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-12T17:09:39.146 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-12T17:09:39.147 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-12T17:09:39.296 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-12T17:09:39.297 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-12T17:09:39.444 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-12T17:09:39.455 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-12T17:09:39.592 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-12T17:09:39.603 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-12T17:09:39.741 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-12T17:09:39.753 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-12T17:09:39.890 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-12T17:09:39.902 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-12T17:09:40.039 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-12T17:09:40.051 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-12T17:09:40.188 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-12T17:09:40.200 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-12T17:09:40.328 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-12T17:09:40.361 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-12T17:09:40.477 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-12T17:09:40.519 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-12T17:09:40.625 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-12T17:09:40.668 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-12T17:09:40.774 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-12T17:09:40.817 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-12T17:09:40.932 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-12T17:09:40.965 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-12T17:09:41.071 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-12T17:09:41.114 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-12T17:09:41.220 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-12T17:09:41.262 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-12T17:09:41.369 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-12T17:09:41.412 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-12T17:09:41.517 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-12T17:09:41.571 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-12T17:09:41.675 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-12T17:09:41.719 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-12T17:09:41.824 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-12T17:09:41.868 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-12T17:09:41.973 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-12T17:09:42.017 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-12T17:09:42.133 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-12T17:09:42.165 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-12T17:09:42.281 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-12T17:09:42.313 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-12T17:09:42.428 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-12T17:09:42.460 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-12T17:09:42.585 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-12T17:09:42.606 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-12T17:09:42.743 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-12T17:09:42.755 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-12T17:09:42.891 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-12T17:09:42.903 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-12T17:09:43.041 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-12T17:09:43.064 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-12T17:09:43.201 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-12T17:09:43.212 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-12T17:09:43.347 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-12T17:09:43.358 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-12T17:09:43.493 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-12T17:09:43.505 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-12T17:09:43.651 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-12T17:09:43.662 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-12T17:09:43.801 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-12T17:09:43.802 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-12T17:09:43.959 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-12T17:09:43.960 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-12T17:09:44.121 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-12T17:09:44.122 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-12T17:09:44.280 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-12T17:09:44.281 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-12T17:09:44.429 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-12T17:09:44.430 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-12T17:09:44.578 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-12T17:09:44.579 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-12T17:09:44.736 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-12T17:09:44.737 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-12T17:09:44.883 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-12T17:09:44.884 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-12T17:09:45.031 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-12T17:09:45.032 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-12T17:09:45.181 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-12T17:09:45.182 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-12T17:09:45.329 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-12T17:09:45.330 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-12T17:09:45.480 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-12T17:09:45.481 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-12T17:09:45.627 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-12T17:09:45.628 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-12T17:09:45.775 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-12T17:09:45.776 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-12T17:09:45.918 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-12T17:09:45.920 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-12T17:09:46.071 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-12T17:09:46.072 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-12T17:09:46.219 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-12T17:09:46.221 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-12T17:09:46.368 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-12T17:09:46.369 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-12T17:09:46.517 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-12T17:09:46.517 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-12T17:09:46.665 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-12T17:09:46.668 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-12T17:09:46.818 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-12T17:09:46.830 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-12T17:09:46.966 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-12T17:09:46.977 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-12T17:09:47.114 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-12T17:09:47.125 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-12T17:09:47.274 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-12T17:09:47.276 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-12T17:09:47.422 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-12T17:09:47.423 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-12T17:09:47.571 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-12T17:09:47.572 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-12T17:09:47.730 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-12T17:09:47.731 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-12T17:09:47.870 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-12T17:09:47.882 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-12T17:09:48.020 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-12T17:09:48.032 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-12T17:09:48.169 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-12T17:09:48.497 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", " 2021-02-12T17:09:48.498 INFO:teuthology.task.ansible.out:item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-12T17:09:48.627 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-12T17:09:48.639 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-12T17:09:48.786 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-12T17:09:48.787 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-12T17:09:48.933 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-12T17:09:48.934 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-12T17:09:49.082 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-12T17:09:49.082 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-12T17:09:49.230 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-12T17:09:49.231 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-12T17:09:49.378 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-12T17:09:49.380 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-12T17:09:49.527 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-12T17:09:49.539 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-12T17:09:49.675 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-12T17:09:49.686 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-12T17:09:49.822 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-12T17:09:49.834 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-12T17:09:49.981 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-12T17:09:49.983 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-12T17:09:50.131 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-12T17:09:50.144 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-12T17:09:50.282 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-12T17:09:50.293 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-12T17:09:50.441 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-12T17:09:50.442 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-12T17:09:50.590 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-12T17:09:50.591 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-12T17:09:50.739 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-12T17:09:50.740 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-12T17:09:50.888 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-12T17:09:50.889 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-12T17:09:51.047 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-12T17:09:51.048 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-12T17:09:51.197 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-12T17:09:51.210 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-12T17:09:51.357 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-12T17:09:51.357 INFO:teuthology.task.ansible.out: 2021-02-12T17:09:51.359 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-12T17:09:51.507 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-12T17:09:51.508 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-12T17:09:51.667 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-12T17:09:51.668 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-12T17:09:51.816 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-12T17:09:51.818 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-12T17:09:51.965 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-12T17:09:51.966 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-12T17:09:52.113 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-12T17:09:52.125 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-12T17:09:52.264 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-12T17:09:52.266 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-12T17:09:52.416 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-12T17:09:52.417 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-12T17:09:52.566 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-12T17:09:53.713 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "name": "pdhange", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-12T17:09:53.880 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "name": "pdhange", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-12T17:09:54.712 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-02-12T17:09:54.993 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-02-12T17:09:55.827 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "name": "adking", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-02-12T17:09:55.974 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "name": "adking", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-02-12T17:09:56.845 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "name": "amathuri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-02-12T17:09:57.056 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "name": "amathuri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-02-12T17:09:57.868 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-02-12T17:09:57.985 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:57 +0000 (0:00:25.623) 0:00:31.777 ******* 2021-02-12T17:09:58.014 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-02-12T17:09:58.050 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:58 +0000 (0:00:00.064) 0:00:31.842 ******* 2021-02-12T17:09:58.070 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-12T17:09:58.071 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-02-12T17:09:58.166 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-02-12T17:09:58.168 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-02-12T17:09:58.169 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-02-12T17:09:58.171 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich 2021-02-12T17:09:58.172 INFO:teuthology.task.ansible.out:", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiR 2021-02-12T17:09:58.173 INFO:teuthology.task.ansible.out:enVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdi 2021-02-12T17:09:58.174 INFO:teuthology.task.ansible.out:llaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumr 2021-02-12T17:09:58.175 INFO:teuthology.task.ansible.out:ao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69m 2021-02-12T17:09:58.176 INFO:teuthology.task.ansible.out:h95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d84 2021-02-12T17:09:58.178 INFO:teuthology.task.ansible.out:1a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan 2021-02-12T17:09:58.179 INFO:teuthology.task.ansible.out:@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOen 2021-02-12T17:09:58.180 INFO:teuthology.task.ansible.out:VV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9g 2021-02-12T17:09:58.182 INFO:teuthology.task.ansible.out:I46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": " 2021-02-12T17:09:58.183 INFO:teuthology.task.ansible.out:dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "acl 2021-02-12T17:09:58.183 INFO:teuthology.task.ansible.out:ewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NIN 2021-02-12T17:09:58.185 INFO:teuthology.task.ansible.out:j0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-02-12T17:09:58.225 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:58 +0000 (0:00:00.174) 0:00:32.017 ******* 2021-02-12T17:09:58.262 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:58 +0000 (0:00:00.036) 0:00:32.054 ******* 2021-02-12T17:09:58.292 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-02-12T17:09:58.337 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:58 +0000 (0:00:00.075) 0:00:32.129 ******* 2021-02-12T17:09:58.389 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-02-12T17:09:58.391 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-02-12T17:09:58.392 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-02-12T17:09:58.394 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich 2021-02-12T17:09:58.395 INFO:teuthology.task.ansible.out:", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiR 2021-02-12T17:09:58.397 INFO:teuthology.task.ansible.out:enVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumr 2021-02-12T17:09:58.398 INFO:teuthology.task.ansible.out:ao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69m 2021-02-12T17:09:58.399 INFO:teuthology.task.ansible.out:h95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5 2021-02-12T17:09:58.400 INFO:teuthology.task.ansible.out:d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d84 2021-02-12T17:09:58.401 INFO:teuthology.task.ansible.out:1a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan 2021-02-12T17:09:58.402 INFO:teuthology.task.ansible.out:@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOen 2021-02-12T17:09:58.404 INFO:teuthology.task.ansible.out:VV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9g 2021-02-12T17:09:58.406 INFO:teuthology.task.ansible.out:I46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": " 2021-02-12T17:09:58.408 INFO:teuthology.task.ansible.out:dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NIN 2021-02-12T17:09:58.409 INFO:teuthology.task.ansible.out:j0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa33958 2021-02-12T17:09:58.410 INFO:teuthology.task.ansible.out:62e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-02-12T17:09:58.459 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:58 +0000 (0:00:00.122) 0:00:32.251 ******* 2021-02-12T17:09:59.049 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-02-12T17:09:59.050 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com -> localhost] => {"after": "df8946f08e870e2d2565b79099289ca48bd825f3", "attempts": 1, "before": "df8946f08e870e2d2565b79099289ca48bd825f3", "changed": false, "remote_url_changed": false} 2021-02-12T17:09:59.088 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:59 +0000 (0:00:00.628) 0:00:32.880 ******* 2021-02-12T17:09:59.096 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com -> localhost] => {"after": "df8946f08e870e2d2565b79099289ca48bd825f3", "attempts": 1, "before": "df8946f08e870e2d2565b79099289ca48bd825f3", "changed": false, "remote_url_changed": false} 2021-02-12T17:09:59.134 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:09:59 +0000 (0:00:00.046) 0:00:32.926 ******* 2021-02-12T17:09:59.331 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-12T17:09:59.363 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-12T17:09:59.510 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-12T17:09:59.543 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-12T17:09:59.689 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-12T17:09:59.711 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-12T17:09:59.880 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-02-12T17:09:59.882 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc 2021-02-12T17:09:59.883 INFO:teuthology.task.ansible.out:2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-02-12T17:10:00.048 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-02-12T17:10:00.049 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-02-12T17:10:00.208 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-02-12T17:10:00.209 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-02-12T17:10:00.209 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LN 2021-02-12T17:10:00.211 INFO:teuthology.task.ansible.out:ZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-02-12T17:10:00.380 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-02-12T17:10:00.381 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-02-12T17:10:00.540 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-12T17:10:00.551 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-12T17:10:00.720 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-12T17:10:00.731 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-12T17:10:00.732 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:00.743 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:00.902 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-02-12T17:10:00.904 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAAD 2021-02-12T17:10:00.905 INFO:teuthology.task.ansible.out:AQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-02-12T17:10:01.072 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-02-12T17:10:01.074 INFO:teuthology.task.ansible.out:on", "validate_certs": true} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:01.084 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-02-12T17:10:01.085 INFO:teuthology.task.ansible.out:on", "validate_certs": true} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:01.096 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:01.107 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:01.265 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-12T17:10:01.266 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-12T17:10:01.435 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-02-12T17:10:01.437 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-12T17:10:01.447 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-02-12T17:10:01.448 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-12T17:10:01.605 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-12T17:10:01.618 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-12T17:10:01.775 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-12T17:10:01.786 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-12T17:10:01.933 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-12T17:10:01.944 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-12T17:10:02.100 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-12T17:10:02.111 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-12T17:10:02.267 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-12T17:10:02.279 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-12T17:10:02.430 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-02-12T17:10:02.432 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-12T17:10:02.453 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-02-12T17:10:02.454 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-12T17:10:02.601 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-02-12T17:10:02.602 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-12T17:10:02.633 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-02-12T17:10:02.635 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-12T17:10:02.785 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-12T17:10:02.807 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-12T17:10:02.956 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-12T17:10:02.968 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-12T17:10:03.124 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-02-12T17:10:03.125 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-02-12T17:10:03.135 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-02-12T17:10:03.136 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-02-12T17:10:03.294 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-02-12T17:10:03.316 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-02-12T17:10:03.462 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-12T17:10:03.486 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-12T17:10:03.652 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-12T17:10:03.653 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-12T17:10:03.817 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-12T17:10:03.828 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-12T17:10:03.986 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-12T17:10:04.008 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-12T17:10:04.166 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-02-12T17:10:04.168 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-02-12T17:10:04.188 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-02-12T17:10:04.189 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-02-12T17:10:04.359 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-12T17:10:04.392 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-12T17:10:04.518 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-12T17:10:04.551 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-12T17:10:04.687 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-02-12T17:10:04.721 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-02-12T17:10:04.856 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-02-12T17:10:04.887 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-02-12T17:10:05.023 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-02-12T17:10:05.055 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-02-12T17:10:05.192 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-02-12T17:10:05.225 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-02-12T17:10:05.363 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-12T17:10:05.397 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-12T17:10:05.534 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-12T17:10:05.556 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-12T17:10:05.713 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-02-12T17:10:05.724 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-02-12T17:10:05.882 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-02-12T17:10:05.883 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL 2021-02-12T17:10:05.884 INFO:teuthology.task.ansible.out:+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-02-12T17:10:06.040 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-02-12T17:10:06.042 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-02-12T17:10:06.052 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-02-12T17:10:06.053 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-02-12T17:10:06.212 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-02-12T17:10:06.212 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-02-12T17:10:06.379 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-02-12T17:10:06.380 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-02-12T17:10:06.546 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-12T17:10:06.547 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-12T17:10:06.705 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-02-12T17:10:06.706 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-12T17:10:06.716 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-02-12T17:10:06.718 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-12T17:10:06.884 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-02-12T17:10:06.885 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-02-12T17:10:06.887 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwo 2021-02-12T17:10:06.888 INFO:teuthology.task.ansible.out:j3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53 2021-02-12T17:10:06.889 INFO:teuthology.task.ansible.out:BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-02-12T17:10:07.053 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-12T17:10:07.054 INFO:teuthology.task.ansible.out: 2021-02-12T17:10:07.055 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-12T17:10:07.056 INFO:teuthology.task.ansible.out: 2021-02-12T17:10:07.223 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-12T17:10:07.224 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-12T17:10:07.391 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-02-12T17:10:07.392 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-02-12T17:10:07.550 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-12T17:10:07.551 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-12T17:10:07.719 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-02-12T17:10:07.719 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-02-12T17:10:07.880 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-02-12T17:10:07.882 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsf 2021-02-12T17:10:07.883 INFO:teuthology.task.ansible.out:xfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-02-12T17:10:08.049 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-12T17:10:08.049 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-12T17:10:08.206 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-02-12T17:10:08.207 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-02-12T17:10:08.373 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-02-12T17:10:08.375 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-02-12T17:10:08.385 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-02-12T17:10:08.386 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-02-12T17:10:08.552 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-12T17:10:08.554 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-12T17:10:08.712 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-02-12T17:10:08.713 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-02-12T17:10:08.892 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-02-12T17:10:08.893 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5 2021-02-12T17:10:08.895 INFO:teuthology.task.ansible.out:IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCO 2021-02-12T17:10:08.896 INFO:teuthology.task.ansible.out:TPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-02-12T17:10:09.049 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-12T17:10:09.060 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-12T17:10:09.217 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-02-12T17:10:09.218 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-02-12T17:10:09.385 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-12T17:10:09.386 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-12T17:10:09.552 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-12T17:10:09.553 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-12T17:10:09.709 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-12T17:10:09.710 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-12T17:10:09.877 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-12T17:10:09.878 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-12T17:10:10.035 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-12T17:10:10.036 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-12T17:10:10.202 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-12T17:10:10.214 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-12T17:10:10.370 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-12T17:10:10.371 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-12T17:10:10.529 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-12T17:10:10.540 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-12T17:10:10.696 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-12T17:10:10.707 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-12T17:10:10.862 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-12T17:10:10.873 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-12T17:10:11.030 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-12T17:10:11.041 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-12T17:10:11.198 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-12T17:10:11.220 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-12T17:10:11.369 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-12T17:10:11.378 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-12T17:10:11.535 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-12T17:10:11.536 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-12T17:10:11.703 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-12T17:10:11.703 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-12T17:10:11.870 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-12T17:10:11.871 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-12T17:10:12.028 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-12T17:10:12.028 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-12T17:10:12.196 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-12T17:10:12.196 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-12T17:10:12.363 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-02-12T17:10:12.365 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrlu 2021-02-12T17:10:12.366 INFO:teuthology.task.ansible.out:aEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-02-12T17:10:12.520 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-12T17:10:12.520 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-12T17:10:12.687 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-12T17:10:12.688 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-12T17:10:12.844 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-12T17:10:12.855 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-12T17:10:13.011 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-12T17:10:13.012 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-12T17:10:13.178 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-02-12T17:10:13.179 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22 2021-02-12T17:10:13.180 INFO:teuthology.task.ansible.out:+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-02-12T17:10:13.345 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-02-12T17:10:13.346 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-12T17:10:13.356 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-02-12T17:10:13.357 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-12T17:10:13.512 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-12T17:10:13.523 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-12T17:10:13.679 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-12T17:10:13.680 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-12T17:10:13.841 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-12T17:10:13.852 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-12T17:10:13.998 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-12T17:10:14.009 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-12T17:10:14.167 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-12T17:10:14.178 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-12T17:10:14.334 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-12T17:10:14.335 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-12T17:10:14.491 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-12T17:10:14.502 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-12T17:10:14.658 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-02-12T17:10:14.659 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-02-12T17:10:14.669 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-02-12T17:10:14.670 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-02-12T17:10:14.825 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-12T17:10:14.836 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-12T17:10:14.992 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-12T17:10:15.013 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-12T17:10:15.148 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-12T17:10:15.170 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-12T17:10:15.316 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-12T17:10:15.338 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-12T17:10:15.483 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-12T17:10:15.494 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-12T17:10:15.639 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-12T17:10:15.661 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-12T17:10:15.807 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-02-12T17:10:15.809 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-12T17:10:15.819 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-02-12T17:10:15.820 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-12T17:10:15.986 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-12T17:10:15.987 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-12T17:10:16.144 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-12T17:10:16.145 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-12T17:10:16.311 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-12T17:10:16.313 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-12T17:10:16.479 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-12T17:10:16.480 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-12T17:10:16.639 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-12T17:10:16.640 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-12T17:10:16.807 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-12T17:10:16.808 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-12T17:10:16.964 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-12T17:10:16.975 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-12T17:10:17.132 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-12T17:10:17.133 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-12T17:10:17.299 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-12T17:10:17.299 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-12T17:10:17.458 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-12T17:10:17.469 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-12T17:10:17.625 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-12T17:10:17.626 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-12T17:10:17.782 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-12T17:10:17.793 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-12T17:10:17.795 INFO:teuthology.task.ansible.out: 2021-02-12T17:10:17.950 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-12T17:10:17.961 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-12T17:10:18.117 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-12T17:10:18.128 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-12T17:10:18.284 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-12T17:10:18.285 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-12T17:10:18.452 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-12T17:10:18.452 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-12T17:10:18.619 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-12T17:10:18.620 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-12T17:10:18.776 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-12T17:10:18.787 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-12T17:10:18.789 INFO:teuthology.task.ansible.out: 2021-02-12T17:10:18.944 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-02-12T17:10:18.946 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-02-12T17:10:18.956 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-02-12T17:10:18.957 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-02-12T17:10:19.102 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-12T17:10:19.788 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} ok: [gibba004.front 2021-02-12T17:10:19.789 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY 2021-02-12T17:10:19.791 INFO:teuthology.task.ansible.out:3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr" 2021-02-12T17:10:19.792 INFO:teuthology.task.ansible.out:, "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKph 2021-02-12T17:10:19.793 INFO:teuthology.task.ansible.out:PHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "ke 2021-02-12T17:10:19.795 INFO:teuthology.task.ansible.out:y": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-12T17:10:19.939 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-12T17:10:19.950 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-12T17:10:20.106 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-12T17:10:20.107 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-12T17:10:20.285 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-12T17:10:20.296 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-12T17:10:20.443 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-12T17:10:20.444 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-12T17:10:20.601 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-02-12T17:10:20.612 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-02-12T17:10:20.769 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-12T17:10:20.769 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-12T17:10:20.936 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-12T17:10:20.936 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-12T17:10:21.103 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-12T17:10:21.103 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-12T17:10:21.271 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-12T17:10:21.272 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-12T17:10:21.429 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-12T17:10:21.430 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-12T17:10:21.597 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-02-12T17:10:21.598 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-02-12T17:10:21.767 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-12T17:10:21.768 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-12T17:10:21.935 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-02-12T17:10:21.936 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-02-12T17:10:22.061 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:22 +0000 (0:00:22.927) 0:00:55.853 ******* 2021-02-12T17:10:22.094 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:22 +0000 (0:00:00.032) 0:00:55.886 ******* 2021-02-12T17:10:22.113 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-12T17:10:22.115 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.125 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.136 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.137 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.137 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.148 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.149 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.160 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.160 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.162 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.172 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.172 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.174 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.184 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.184 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.196 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.344 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-02-12T17:10:22.356 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.356 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-02-12T17:10:22.367 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.369 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.379 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.539 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-02-12T17:10:22.539 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-02-12T17:10:22.699 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-12T17:10:22.699 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-12T17:10:22.711 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.712 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.723 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.724 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.738 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item 2021-02-12T17:10:22.740 INFO:teuthology.task.ansible.out:": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.749 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.750 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.763 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.764 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.765 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.765 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.777 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.778 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.779 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.779 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.791 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.791 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.802 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.803 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.814 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.815 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.827 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.827 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.828 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.829 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.840 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.841 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.851 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.853 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.864 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.864 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.866 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.877 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.879 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.889 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.890 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.901 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.904 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.913 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.913 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.925 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.926 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.937 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.937 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.948 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.950 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.961 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.962 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.974 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.975 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.986 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.987 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.988 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:22.999 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.001 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.012 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.023 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.024 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.035 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.036 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.046 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.047 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.048 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.062 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.071 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.071 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.073 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.084 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.084 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.095 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.096 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.097 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.108 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.108 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.109 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.121 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.121 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.122 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.132 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.133 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.134 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.144 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.145 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.146 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.156 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.157 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.158 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.168 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.170 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.180 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.182 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.192 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.192 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.193 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.204 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.205 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.206 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.216 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.217 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.218 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.229 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.230 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.231 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.241 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.243 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.253 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.255 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.265 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.267 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.278 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.278 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.280 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.290 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.290 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.292 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.302 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.303 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.304 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.314 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.315 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.326 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.328 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.338 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.339 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.349 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.350 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.351 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.361 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.362 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.363 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.373 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.374 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.385 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.386 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.397 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.397 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.399 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.409 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.409 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.411 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.421 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.422 INFO:teuthology.task.ansible.out: skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.434 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.434 INFO:teuthology.task.ansible.out: 2021-02-12T17:10:23.445 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.446 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.447 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.457 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.457 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.459 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.470 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.470 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.481 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.483 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.494 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.495 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.506 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.506 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.508 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.519 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.520 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.530 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.530 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.531 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.542 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.543 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.554 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.554 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.556 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.566 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.568 INFO:teuthology.task.ansible.out: skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.569 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.579 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.580 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.591 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.592 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.603 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.604 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.615 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.616 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.617 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.629 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.629 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.631 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.641 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.643 INFO:teuthology.task.ansible.out: skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.654 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.655 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.656 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.666 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.667 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.669 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.670 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.680 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.681 INFO:teuthology.task.ansible.out: skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.692 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.693 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.694 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.704 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.705 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.707 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.725 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.726 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.782 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:23 +0000 (0:00:01.687) 0:00:57.573 ******* 2021-02-12T17:10:23.815 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:23 +0000 (0:00:00.033) 0:00:57.607 ******* 2021-02-12T17:10:23.821 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-02-12T17:10:23.822 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.858 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:23 +0000 (0:00:00.043) 0:00:57.650 ******* 2021-02-12T17:10:23.865 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:23.903 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:23 +0000 (0:00:00.045) 0:00:57.695 ******* 2021-02-12T17:10:24.035 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-12T17:10:24.037 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-02-12T17:10:24.079 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-02-12T17:10:24.185 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-02-12T17:10:24.229 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-02-12T17:10:24.335 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-02-12T17:10:24.378 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-02-12T17:10:24.473 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-02-12T17:10:24.526 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-02-12T17:10:24.528 INFO:teuthology.task.ansible.out: 2021-02-12T17:10:24.623 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-02-12T17:10:24.676 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-02-12T17:10:24.771 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-02-12T17:10:24.824 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-02-12T17:10:24.908 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-02-12T17:10:24.982 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-02-12T17:10:25.057 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-02-12T17:10:25.129 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-02-12T17:10:25.203 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-02-12T17:10:25.278 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-02-12T17:10:25.343 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-12T17:10:25.427 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-12T17:10:25.491 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-12T17:10:25.567 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-12T17:10:25.642 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-12T17:10:25.716 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-12T17:10:25.780 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-12T17:10:25.864 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-12T17:10:25.928 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-02-12T17:10:26.012 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-02-12T17:10:26.076 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-02-12T17:10:26.160 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-02-12T17:10:26.225 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-12T17:10:26.321 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-12T17:10:26.363 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-12T17:10:26.468 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-12T17:10:26.511 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-12T17:10:26.606 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-12T17:10:26.648 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-02-12T17:10:26.754 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-02-12T17:10:26.797 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-12T17:10:26.903 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-12T17:10:26.904 INFO:teuthology.task.ansible.out: 2021-02-12T17:10:26.936 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-12T17:10:27.053 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-12T17:10:27.054 INFO:teuthology.task.ansible.out: 2021-02-12T17:10:27.096 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-12T17:10:27.200 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-12T17:10:27.232 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-12T17:10:27.340 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-12T17:10:27.380 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-12T17:10:27.498 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-12T17:10:27.520 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-12T17:10:27.646 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-12T17:10:27.679 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-12T17:10:27.794 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-12T17:10:27.816 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-12T17:10:27.933 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-12T17:10:27.966 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-12T17:10:28.083 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-12T17:10:28.104 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-12T17:10:28.230 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-12T17:10:28.253 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-12T17:10:28.380 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-12T17:10:28.402 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-12T17:10:28.528 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-12T17:10:28.550 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-12T17:10:28.676 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-12T17:10:28.698 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-12T17:10:28.825 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-12T17:10:28.837 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-12T17:10:28.965 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-12T17:10:28.998 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-12T17:10:29.119 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-12T17:10:29.142 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-12T17:10:29.270 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-12T17:10:29.293 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-12T17:10:29.423 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-12T17:10:29.446 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-02-12T17:10:29.586 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-02-12T17:10:30.460 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-12T17:10:30.554 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-12T17:10:30.639 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-12T17:10:30.713 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-12T17:10:30.777 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-12T17:10:30.863 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-12T17:10:30.864 INFO:teuthology.task.ansible.out: 2021-02-12T17:10:30.927 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-12T17:10:31.012 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-12T17:10:31.075 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-12T17:10:31.160 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-12T17:10:31.214 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-12T17:10:31.308 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-12T17:10:31.361 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-12T17:10:31.456 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-12T17:10:31.510 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-12T17:10:31.617 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-12T17:10:31.670 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-02-12T17:10:31.766 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-02-12T17:10:31.820 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-12T17:10:31.914 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-12T17:10:31.968 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-12T17:10:32.025 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:32 +0000 (0:00:08.121) 0:01:05.817 ******* 2021-02-12T17:10:32.063 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-12T17:10:32.118 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:32 +0000 (0:00:00.092) 0:01:05.910 ******* 2021-02-12T17:10:32.452 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-02-12T17:10:32.453 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "checksum": "5ebc9fcf8859a9c716ab10089a7bec7e44d29368", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "ee06ed012f51c2e3764171d4b9180349", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613149832.0517626-50738656306528/source", "state": "file", "uid": 0} 2021-02-12T17:10:32.509 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:32 +0000 (0:00:00.391) 0:01:06.301 ******* 2021-02-12T17:10:32.538 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "checksum": "5ebc9fcf8859a9c716ab10089a7bec7e44d29368", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "ee06ed012f51c2e3764171d4b9180349", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613149832.1416676-159480242627815/source", "state": "file", "uid": 0} 2021-02-12T17:10:32.539 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-02-12T17:10:32.541 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => { "msg": "Host gibba002.front.sepia.ceph.com is running CentOS 8.2 (Core)" } 2021-02-12T17:10:32.575 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:32 +0000 (0:00:00.065) 0:01:06.367 ******* 2021-02-12T17:10:32.606 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:32 +0000 (0:00:00.031) 0:01:06.398 ******* 2021-02-12T17:10:32.613 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-02-12T17:10:32.614 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-02-12T17:10:32.656 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:32 +0000 (0:00:00.049) 0:01:06.447 ******* 2021-02-12T17:10:32.664 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-02-12T17:10:32.665 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => { "msg": "Host gibba004.front.sepia.ceph.com is running CentOS 8.2 (Core)" } 2021-02-12T17:10:32.707 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:32 +0000 (0:00:00.051) 0:01:06.499 ******* 2021-02-12T17:10:32.713 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-02-12T17:10:32.715 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:32.751 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:32 +0000 (0:00:00.044) 0:01:06.543 ******* 2021-02-12T17:10:32.758 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-02-12T17:10:32.760 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-02-12T17:10:32.806 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:32 +0000 (0:00:00.054) 0:01:06.598 ******* 2021-02-12T17:10:32.845 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-02-12T17:10:32.846 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:32.883 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:32 +0000 (0:00:00.077) 0:01:06.675 ******* 2021-02-12T17:10:33.280 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-02-12T17:10:33.282 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.373946", "end": "2021-02-12 17:10:33.263623", "rc": 0, "start": "2021-02-12 17:10:32.889677", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-02-12T17:10:33.318 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:33 +0000 (0:00:00.434) 0:01:07.110 ******* 2021-02-12T17:10:33.356 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-02-12T17:10:33.357 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:33.400 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:33 +0000 (0:00:00.082) 0:01:07.192 ******* 2021-02-12T17:10:33.441 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-02-12T17:10:33.442 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:33.482 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:33 +0000 (0:00:00.081) 0:01:07.273 ******* 2021-02-12T17:10:33.488 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-02-12T17:10:33.488 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.436745", "end": "2021-02-12 17:10:33.461584", "rc": 0, "start": "2021-02-12 17:10:33.024839", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-02-12T17:10:33.535 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:33 +0000 (0:00:00.053) 0:01:07.327 ******* 2021-02-12T17:10:33.541 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-02-12T17:10:33.542 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:33.583 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:33 +0000 (0:00:00.047) 0:01:07.375 ******* 2021-02-12T17:10:33.592 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-02-12T17:10:33.594 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:33.633 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:33 +0000 (0:00:00.050) 0:01:07.425 ******* 2021-02-12T17:10:33.641 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-02-12T17:10:33.643 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:33.692 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:33 +0000 (0:00:00.058) 0:01:07.484 ******* 2021-02-12T17:10:33.700 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-02-12T17:10:33.702 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:33.741 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:33 +0000 (0:00:00.049) 0:01:07.533 ******* 2021-02-12T17:10:33.747 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-02-12T17:10:33.748 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:33.793 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:33 +0000 (0:00:00.052) 0:01:07.585 ******* 2021-02-12T17:10:33.800 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-02-12T17:10:33.800 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:33.839 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:33 +0000 (0:00:00.046) 0:01:07.631 ******* 2021-02-12T17:10:33.846 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-02-12T17:10:33.846 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:33.883 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:33 +0000 (0:00:00.043) 0:01:07.675 ******* 2021-02-12T17:10:33.890 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-02-12T17:10:33.891 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:33.927 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:33 +0000 (0:00:00.043) 0:01:07.719 ******* 2021-02-12T17:10:33.933 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-02-12T17:10:33.933 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-12T17:10:33.935 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-12T17:10:33.971 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:33 +0000 (0:00:00.043) 0:01:07.763 ******* 2021-02-12T17:10:33.977 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-02-12T17:10:33.979 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.012 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.041) 0:01:07.805 ******* 2021-02-12T17:10:34.018 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-02-12T17:10:34.020 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.055 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.042) 0:01:07.847 ******* 2021-02-12T17:10:34.067 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-02-12T17:10:34.069 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.102 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.046) 0:01:07.894 ******* 2021-02-12T17:10:34.108 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-02-12T17:10:34.109 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.145 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.043) 0:01:07.937 ******* 2021-02-12T17:10:34.153 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-02-12T17:10:34.153 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-12T17:10:34.154 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-12T17:10:34.189 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.043) 0:01:07.981 ******* 2021-02-12T17:10:34.196 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-02-12T17:10:34.197 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-12T17:10:34.232 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.042) 0:01:08.024 ******* 2021-02-12T17:10:34.238 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-02-12T17:10:34.240 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.274 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.042) 0:01:08.066 ******* 2021-02-12T17:10:34.280 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-02-12T17:10:34.280 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.317 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.043) 0:01:08.109 ******* 2021-02-12T17:10:34.324 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-02-12T17:10:34.325 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.369 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.051) 0:01:08.161 ******* 2021-02-12T17:10:34.376 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-02-12T17:10:34.377 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-12T17:10:34.415 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.046) 0:01:08.207 ******* 2021-02-12T17:10:34.421 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-02-12T17:10:34.423 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-12T17:10:34.469 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.052) 0:01:08.260 ******* 2021-02-12T17:10:34.476 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-02-12T17:10:34.477 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.525 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.057) 0:01:08.317 ******* 2021-02-12T17:10:34.533 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-02-12T17:10:34.534 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.576 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.051) 0:01:08.368 ******* 2021-02-12T17:10:34.582 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-02-12T17:10:34.584 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.627 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.050) 0:01:08.419 ******* 2021-02-12T17:10:34.634 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-02-12T17:10:34.636 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-12T17:10:34.675 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.047) 0:01:08.467 ******* 2021-02-12T17:10:34.683 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-02-12T17:10:34.684 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.737 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.062) 0:01:08.529 ******* 2021-02-12T17:10:34.743 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-02-12T17:10:34.745 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.788 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.050) 0:01:08.580 ******* 2021-02-12T17:10:34.794 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-02-12T17:10:34.795 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.828 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.040) 0:01:08.620 ******* 2021-02-12T17:10:34.835 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-02-12T17:10:34.836 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.870 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.041) 0:01:08.662 ******* 2021-02-12T17:10:34.876 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-02-12T17:10:34.877 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-12T17:10:34.912 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.041) 0:01:08.704 ******* 2021-02-12T17:10:34.918 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-02-12T17:10:34.920 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.953 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.041) 0:01:08.745 ******* 2021-02-12T17:10:34.959 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-12T17:10:34.961 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:34.998 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:34 +0000 (0:00:00.044) 0:01:08.790 ******* 2021-02-12T17:10:35.005 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-02-12T17:10:35.006 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.042 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.044) 0:01:08.834 ******* 2021-02-12T17:10:35.048 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-02-12T17:10:35.050 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.085 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.042) 0:01:08.877 ******* 2021-02-12T17:10:35.091 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-02-12T17:10:35.092 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-12T17:10:35.126 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.041) 0:01:08.918 ******* 2021-02-12T17:10:35.132 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-02-12T17:10:35.134 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.170 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.043) 0:01:08.962 ******* 2021-02-12T17:10:35.176 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-12T17:10:35.176 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.213 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.043) 0:01:09.005 ******* 2021-02-12T17:10:35.220 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-02-12T17:10:35.221 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.256 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.042) 0:01:09.048 ******* 2021-02-12T17:10:35.267 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-02-12T17:10:35.269 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.304 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.047) 0:01:09.095 ******* 2021-02-12T17:10:35.310 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-02-12T17:10:35.311 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.358 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.054) 0:01:09.150 ******* 2021-02-12T17:10:35.364 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-02-12T17:10:35.366 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.408 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.050) 0:01:09.200 ******* 2021-02-12T17:10:35.417 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-02-12T17:10:35.418 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.456 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.047) 0:01:09.248 ******* 2021-02-12T17:10:35.463 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-02-12T17:10:35.465 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.500 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.043) 0:01:09.292 ******* 2021-02-12T17:10:35.505 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-02-12T17:10:35.506 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-12T17:10:35.543 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.043) 0:01:09.335 ******* 2021-02-12T17:10:35.550 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-02-12T17:10:35.552 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.587 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.044) 0:01:09.379 ******* 2021-02-12T17:10:35.593 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-02-12T17:10:35.595 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.643 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.055) 0:01:09.435 ******* 2021-02-12T17:10:35.650 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-02-12T17:10:35.652 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.685 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.042) 0:01:09.477 ******* 2021-02-12T17:10:35.692 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-02-12T17:10:35.693 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.728 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.042) 0:01:09.520 ******* 2021-02-12T17:10:35.738 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-02-12T17:10:35.739 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-12T17:10:35.775 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.047) 0:01:09.567 ******* 2021-02-12T17:10:35.803 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.838 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.062) 0:01:09.630 ******* 2021-02-12T17:10:35.880 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:35.923 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.084) 0:01:09.715 ******* 2021-02-12T17:10:35.932 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-02-12T17:10:35.932 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-12T17:10:35.972 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:35 +0000 (0:00:00.048) 0:01:09.763 ******* 2021-02-12T17:10:36.106 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-12T17:10:36.151 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:36 +0000 (0:00:00.179) 0:01:09.943 ******* 2021-02-12T17:10:36.710 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-02-12T17:10:36.710 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-02-12T17:10:36.712 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-02-12T17:10:37.068 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-02-12T17:10:37.071 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-02-12T17:10:37.109 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:37 +0000 (0:00:00.957) 0:01:10.900 ******* 2021-02-12T17:10:37.141 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:37 +0000 (0:00:00.032) 0:01:10.933 ******* 2021-02-12T17:10:37.498 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-02-12T17:10:37.500 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-02-12T17:10:37.531 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-02-12T17:10:37.872 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-02-12T17:10:37.909 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:37 +0000 (0:00:00.767) 0:01:11.701 ******* 2021-02-12T17:10:37.917 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-02-12T17:10:37.957 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:37 +0000 (0:00:00.048) 0:01:11.749 ******* 2021-02-12T17:10:37.966 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-12T17:10:37.966 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.003 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.045) 0:01:11.795 ******* 2021-02-12T17:10:38.011 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.047 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.044) 0:01:11.839 ******* 2021-02-12T17:10:38.053 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-12T17:10:38.055 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.089 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.042) 0:01:11.881 ******* 2021-02-12T17:10:38.096 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.132 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.042) 0:01:11.924 ******* 2021-02-12T17:10:38.138 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-02-12T17:10:38.140 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.177 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.045) 0:01:11.969 ******* 2021-02-12T17:10:38.185 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.223 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.046) 0:01:12.015 ******* 2021-02-12T17:10:38.229 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-02-12T17:10:38.230 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.268 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.044) 0:01:12.060 ******* 2021-02-12T17:10:38.275 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.311 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.043) 0:01:12.103 ******* 2021-02-12T17:10:38.319 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-02-12T17:10:38.320 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.321 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.321 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.323 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.358 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.046) 0:01:12.150 ******* 2021-02-12T17:10:38.364 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.365 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.366 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.402 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.044) 0:01:12.194 ******* 2021-02-12T17:10:38.409 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-12T17:10:38.410 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.444 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.041) 0:01:12.236 ******* 2021-02-12T17:10:38.451 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.487 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.042) 0:01:12.279 ******* 2021-02-12T17:10:38.493 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.527 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.040) 0:01:12.319 ******* 2021-02-12T17:10:38.536 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.570 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.042) 0:01:12.362 ******* 2021-02-12T17:10:38.576 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-02-12T17:10:38.577 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.612 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.042) 0:01:12.404 ******* 2021-02-12T17:10:38.622 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.663 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.051) 0:01:12.455 ******* 2021-02-12T17:10:38.672 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-02-12T17:10:38.672 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.719 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.055) 0:01:12.511 ******* 2021-02-12T17:10:38.731 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.772 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.053) 0:01:12.564 ******* 2021-02-12T17:10:38.779 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-02-12T17:10:38.781 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.815 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.043) 0:01:12.607 ******* 2021-02-12T17:10:38.822 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:38.867 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:38 +0000 (0:00:00.051) 0:01:12.659 ******* 2021-02-12T17:10:39.518 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-02-12T17:10:39.520 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.551349", "end": "2021-02-12 17:10:39.500930", "rc": 0, "start": "2021-02-12 17:10:38.949581", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.493961", "end": "2021-02-12 17:10:39.501009", "rc": 0, "start": "2021-02-12 17:10:39.007048", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:10:39.558 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:39 +0000 (0:00:00.690) 0:01:13.349 ******* 2021-02-12T17:10:39.609 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:39 +0000 (0:00:00.051) 0:01:13.401 ******* 2021-02-12T17:10:45.759 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-02-12T17:10:45.760 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: krb5-workstation", "Installed: krb5-workstation-1.18.2-5.el8.x86_64", "Installed: krb5-libs-1.18.2-5.el8.x86_64", "Installed: libkadm5-1.18.2-5.el8.x86_64", "Removed: krb5-workstation-1.17-18.el8.x86_64", "Removed: libkadm5-1.17-18.el8.x86_64", "Removed: krb5-libs-1.17-18.el8.x86_64"]} 2021-02-12T17:10:45.795 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:45 +0000 (0:00:06.185) 0:01:19.587 ******* 2021-02-12T17:10:45.821 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-02-12T17:10:45.823 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:45.856 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:45 +0000 (0:00:00.060) 0:01:19.648 ******* 2021-02-12T17:10:45.882 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-02-12T17:10:45.884 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:45.926 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:45 +0000 (0:00:00.069) 0:01:19.718 ******* 2021-02-12T17:10:45.944 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-02-12T17:10:45.945 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: krb5-workstation", "Installed: krb5-workstation-1.18.2-5.el8.x86_64", "Installed: krb5-libs-1.18.2-5.el8.x86_64", "Installed: libkadm5-1.18.2-5.el8.x86_64", "Removed: krb5-workstation-1.17-18.el8.x86_64", "Removed: libkadm5-1.17-18.el8.x86_64", "Removed: krb5-libs-1.17-18.el8.x86_64"]} 2021-02-12T17:10:45.982 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:45 +0000 (0:00:00.056) 0:01:19.774 ******* 2021-02-12T17:10:45.989 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-02-12T17:10:45.989 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:46.028 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:46 +0000 (0:00:00.045) 0:01:19.820 ******* 2021-02-12T17:10:46.036 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-02-12T17:10:46.037 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:46.070 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:46 +0000 (0:00:00.042) 0:01:19.862 ******* 2021-02-12T17:10:46.076 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-02-12T17:10:46.078 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:46.112 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:46 +0000 (0:00:00.042) 0:01:19.904 ******* 2021-02-12T17:10:46.120 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-02-12T17:10:46.121 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:46.156 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:46 +0000 (0:00:00.043) 0:01:19.948 ******* 2021-02-12T17:10:46.182 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-02-12T17:10:46.183 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:46.221 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:46 +0000 (0:00:00.064) 0:01:20.013 ******* 2021-02-12T17:10:46.260 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:46.295 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:46 +0000 (0:00:00.073) 0:01:20.087 ******* 2021-02-12T17:10:46.470 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-02-12T17:10:46.471 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-02-12T17:10:46.505 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:46 +0000 (0:00:00.210) 0:01:20.297 ******* 2021-02-12T17:10:46.670 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-02-12T17:10:46.725 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:46 +0000 (0:00:00.219) 0:01:20.517 ******* 2021-02-12T17:10:49.208 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-02-12T17:10:49.210 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2021-02-12T17:10:49.244 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:49 +0000 (0:00:02.519) 0:01:23.036 ******* 2021-02-12T17:10:49.492 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2021-02-12T17:10:49.535 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:49 +0000 (0:00:00.290) 0:01:23.327 ******* 2021-02-12T17:10:49.647 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-12T17:10:49.649 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-02-12T17:10:49.973 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-02-12T17:10:50.006 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-02-12T17:10:50.320 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-02-12T17:10:50.771 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} Friday 12 February 2021 17:10:50 +0000 (0:00:00.835) 0:01:24.162 ******* TASK [common : Create /usr/libexec.] ******************************************* ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} Friday 12 February 2021 17:10:50 +0000 (0:00:00.210) 0:01:24.373 ******* TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [gibba004.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} Friday 12 February 2021 17:10:50 +0000 (0:00:00.120) 0:01:24.493 ******* 2021-02-12T17:10:50.856 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-02-12T17:10:50.856 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-12T17:10:50.893 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:50 +0000 (0:00:00.191) 0:01:24.685 ******* 2021-02-12T17:10:51.005 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-12T17:10:51.006 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": true, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "md5sum": "14041bf2666d8f8d277567958c7e9f69", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613149850.609184-268803813508847/source", "state": "file", "uid": 0} 2021-02-12T17:10:51.320 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": true, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "md5sum": "14041bf2666d8f8d277567958c7e9f69", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613149850.9153938-198714091142790/source", "state": "file", "uid": 0} 2021-02-12T17:10:51.342 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-02-12T17:10:51.653 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-02-12T17:10:51.675 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2021-02-12T17:10:51.713 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:51 +0000 (0:00:00.819) 0:01:25.504 ******* 2021-02-12T17:10:51.739 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-02-12T17:10:51.741 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:51.772 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:51 +0000 (0:00:00.059) 0:01:25.564 ******* 2021-02-12T17:10:51.799 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-02-12T17:10:51.801 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-02-12T17:10:51.833 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:51 +0000 (0:00:00.060) 0:01:25.625 ******* 2021-02-12T17:10:51.984 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-12T17:10:51.986 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2021-02-12T17:10:52.024 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:52 +0000 (0:00:00.190) 0:01:25.816 ******* 2021-02-12T17:10:52.030 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-02-12T17:10:52.031 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-02-12T17:10:52.066 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:52 +0000 (0:00:00.042) 0:01:25.858 ******* 2021-02-12T17:10:52.072 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-02-12T17:10:52.073 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:52.109 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:52 +0000 (0:00:00.042) 0:01:25.901 ******* 2021-02-12T17:10:52.116 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-02-12T17:10:52.117 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:52.118 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:52.129 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:52.130 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:52.163 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:52 +0000 (0:00:00.054) 0:01:25.955 ******* 2021-02-12T17:10:52.171 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-02-12T17:10:52.171 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-02-12T17:10:52.205 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:52 +0000 (0:00:00.042) 0:01:25.997 ******* 2021-02-12T17:10:52.367 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-02-12T17:10:52.368 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-02-12T17:10:52.403 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:52 +0000 (0:00:00.197) 0:01:26.195 ******* 2021-02-12T17:10:52.440 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-02-12T17:10:52.441 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:52.451 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:52.461 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:52.472 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:52.507 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:52 +0000 (0:00:00.104) 0:01:26.299 ******* 2021-02-12T17:10:52.928 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-02-12T17:10:52.930 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2021-02-12T17:10:52.965 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:52 +0000 (0:00:00.457) 0:01:26.757 ******* 2021-02-12T17:10:52.994 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-02-12T17:10:52.995 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:53.031 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:53 +0000 (0:00:00.065) 0:01:26.822 ******* 2021-02-12T17:10:53.299 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-02-12T17:10:53.300 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2021-02-12T17:10:53.334 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:53 +0000 (0:00:00.303) 0:01:27.126 ******* 2021-02-12T17:10:53.362 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-02-12T17:10:53.363 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:53.398 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:53 +0000 (0:00:00.063) 0:01:27.190 ******* 2021-02-12T17:10:53.404 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-02-12T17:10:53.405 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-02-12T17:10:53.439 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:53 +0000 (0:00:00.041) 0:01:27.231 ******* 2021-02-12T17:10:53.758 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-02-12T17:10:53.799 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:53 +0000 (0:00:00.359) 0:01:27.591 ******* 2021-02-12T17:10:53.805 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-02-12T17:10:53.805 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-02-12T17:10:53.841 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:53 +0000 (0:00:00.042) 0:01:27.633 ******* 2021-02-12T17:10:53.879 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-12T17:10:53.881 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:53.915 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:53 +0000 (0:00:00.073) 0:01:27.707 ******* 2021-02-12T17:10:54.078 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-02-12T17:10:54.080 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-12T17:10:54.112 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:54 +0000 (0:00:00.197) 0:01:27.904 ******* 2021-02-12T17:10:54.161 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-02-12T17:10:54.163 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-02-12T17:10:54.197 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:54 +0000 (0:00:00.084) 0:01:27.989 ******* 2021-02-12T17:10:54.236 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-12T17:10:54.237 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-02-12T17:10:54.276 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:54 +0000 (0:00:00.078) 0:01:28.068 ******* 2021-02-12T17:10:54.304 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-02-12T17:10:54.305 INFO:teuthology.task.ansible.out:fatal: [gibba002.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-02-12T17:10:54.343 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:54 +0000 (0:00:00.067) 0:01:28.135 ******* 2021-02-12T17:10:54.374 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-02-12T17:10:54.375 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:54.410 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:54 +0000 (0:00:00.067) 0:01:28.202 ******* 2021-02-12T17:10:54.438 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-02-12T17:10:54.439 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-12T17:10:54.476 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:54 +0000 (0:00:00.065) 0:01:28.268 ******* 2021-02-12T17:10:54.670 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-02-12T17:10:54.672 INFO:teuthology.task.ansible.out:fatal: [gibba004.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-02-12T17:10:54.704 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:54 +0000 (0:00:00.228) 0:01:28.496 ******* 2021-02-12T17:10:54.730 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-02-12T17:10:54.732 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:10:54.765 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:54 +0000 (0:00:00.060) 0:01:28.557 ******* 2021-02-12T17:10:54.771 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-02-12T17:10:54.772 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-02-12T17:10:54.809 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:54 +0000 (0:00:00.044) 0:01:28.601 ******* 2021-02-12T17:10:55.141 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-02-12T17:10:55.178 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:55 +0000 (0:00:00.369) 0:01:28.970 ******* 2021-02-12T17:10:55.500 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-02-12T17:10:55.501 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-02-12 17:09:06 UTC", "ActiveEnterTimestampMonotonic": "11593631", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount network.target sysinit.target local-fs.target nss-lookup.target basic.target system.slice -.mount systemd-journald.socket time-sync.target systemd-tmpfiles-setup.service tmp.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-02-12 17:09:06 UTC", "AssertTimestampMonotonic": "11593228", "Before": "multi-user.target plymouth-quit.service xdm.service shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-02-12 17:09:06 UTC", "ConditionTimestampMonotonic": "11593228", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "Con 2021-02-12T17:10:55.502 INFO:teuthology.task.ansible.out:trolGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1055", "ExecMainStartTimestamp": "Fri 2021-02-12 17:09:06 UTC", "ExecMainStartTimestampMonotonic": "11593616", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-02-12 17:09:06 UTC", "InactiveExitTimestampMonotonic": "11593631", "InvocationID": "36efd05ba20e4094b69894b79598697a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", " 2021-02-12T17:10:55.504 INFO:teuthology.task.ansible.out:LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127309", "LimitNPROCSoft": "127309", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127309", "LimitSIGPENDINGSoft": "127309", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1055", "MemoryAccounting": "yes", "MemoryCurrent": "1417216", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", 2021-02-12T17:10:55.505 INFO:teuthology.task.ansible.out: "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-02-12 17:09:06 UTC", "StateChangeTimestampMonotonic": "11593631", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203694", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-02-12 17:09:06 UTC", "WatchdogTimestampMonotonic": "11593631", "WatchdogUSec": "0"}} 2021-02-12T17:10:55.536 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:55 +0000 (0:00:00.357) 0:01:29.328 ******* 2021-02-12T17:10:55.545 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-02-12 17:09:11 UTC", "ActiveEnterTimestampMonotonic": "11507345", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target systemd-journald.socket network.target tmp.mount -.mount sysinit.target systemd-tmpfiles-setup.service nss-lookup.target system.slice local-fs.target time-sync.target var-run.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-02-12 17:09:11 UTC", "AssertTimestampMonotonic": "11506872", "Before": "xdm.service plymouth-quit.service shutdown.target getty@tty1.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-02-12 17:09:11 UTC", "ConditionTimestampMonotonic": "11506872", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "Con 2021-02-12T17:10:55.546 INFO:teuthology.task.ansible.out:trolGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1057", "ExecMainStartTimestamp": "Fri 2021-02-12 17:09:11 UTC", "ExecMainStartTimestampMonotonic": "11507326", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-02-12 17:09:11 UTC", "InactiveExitTimestampMonotonic": "11507345", "InvocationID": "eccef9ddb8874ab79198757c2ff11b0a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", " 2021-02-12T17:10:55.548 INFO:teuthology.task.ansible.out:LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127309", "LimitNPROCSoft": "127309", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127309", "LimitSIGPENDINGSoft": "127309", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1057", "MemoryAccounting": "yes", "MemoryCurrent": "1994752", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", 2021-02-12T17:10:55.549 INFO:teuthology.task.ansible.out: "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-02-12 17:09:11 UTC", "StateChangeTimestampMonotonic": "11507345", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203694", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-02-12 17:09:11 UTC", "WatchdogTimestampMonotonic": "11507344", "WatchdogUSec": "0"}} 2021-02-12T17:10:55.582 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:55 +0000 (0:00:00.046) 0:01:29.374 ******* 2021-02-12T17:10:55.726 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-02-12T17:10:55.727 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001120", "end": "2021-02-12 17:10:55.706812", "rc": 0, "start": "2021-02-12 17:10:55.705692", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-02-12T17:10:55.761 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:55 +0000 (0:00:00.179) 0:01:29.553 ******* 2021-02-12T17:10:55.769 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001094", "end": "2021-02-12 17:10:55.721211", "rc": 0, "start": "2021-02-12 17:10:55.720117", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-02-12T17:10:55.806 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:55 +0000 (0:00:00.044) 0:01:29.598 ******* 2021-02-12T17:10:58.057 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-02-12T17:10:58.057 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils", "Installed: python3-libsemanage-2.9-3.el8.x86_64", "Installed: libsemanage-2.9-3.el8.x86_64", "Removed: python3-libsemanage-2.9-2.el8.x86_64", "Removed: libsemanage-2.9-2.el8.x86_64"]} 2021-02-12T17:10:58.097 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:58 +0000 (0:00:02.290) 0:01:31.889 ******* 2021-02-12T17:10:58.336 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils", "Installed: python3-libsemanage-2.9-3.el8.x86_64", "Installed: libsemanage-2.9-3.el8.x86_64", "Removed: python3-libsemanage-2.9-2.el8.x86_64", "Removed: libsemanage-2.9-2.el8.x86_64"]} 2021-02-12T17:10:58.377 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:10:58 +0000 (0:00:00.279) 0:01:32.169 ******* 2021-02-12T17:11:23.412 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-02-12T17:11:23.414 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted", "Installed: selinux-policy-targeted-3.14.3-54.el8_3.2.noarch", "Installed: selinux-policy-3.14.3-54.el8_3.2.noarch", "Removed: selinux-policy-3.14.3-41.el8_2.8.noarch", "Removed: selinux-policy-targeted-3.14.3-41.el8_2.8.noarch"]} 2021-02-12T17:11:23.464 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:23 +0000 (0:00:25.087) 0:01:57.256 ******* 2021-02-12T17:11:23.683 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted", "Installed: selinux-policy-targeted-3.14.3-54.el8_3.2.noarch", "Installed: selinux-policy-3.14.3-54.el8_3.2.noarch", "Removed: selinux-policy-3.14.3-41.el8_2.8.noarch", "Removed: selinux-policy-targeted-3.14.3-41.el8_2.8.noarch"]} 2021-02-12T17:11:23.723 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:23 +0000 (0:00:00.258) 0:01:57.515 ******* 2021-02-12T17:11:24.045 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-02-12T17:11:24.046 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-02-12T17:11:24.079 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:24 +0000 (0:00:00.356) 0:01:57.871 ******* 2021-02-12T17:11:24.086 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-02-12T17:11:24.122 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:24 +0000 (0:00:00.042) 0:01:57.914 ******* 2021-02-12T17:11:34.200 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-02-12T17:11:34.202 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:09.966336", "end": "2021-02-12 17:11:34.184872", "failed_when_result": false, "rc": 0, "start": "2021-02-12 17:11:24.218536", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-02-12T17:11:34.236 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:34 +0000 (0:00:10.114) 0:02:08.028 ******* 2021-02-12T17:11:34.390 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:10.108927", "end": "2021-02-12 17:11:34.368248", "failed_when_result": false, "rc": 0, "start": "2021-02-12 17:11:24.259321", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-02-12T17:11:34.426 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:34 +0000 (0:00:00.189) 0:02:08.218 ******* 2021-02-12T17:11:34.632 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-02-12T17:11:34.633 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-02-12T17:11:34.669 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:34 +0000 (0:00:00.242) 0:02:08.461 ******* 2021-02-12T17:11:34.835 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-02-12T17:11:34.836 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.009124", "end": "2021-02-12 17:11:34.817899", "rc": 0, "start": "2021-02-12 17:11:34.808775", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:11:34.872 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:34 +0000 (0:00:00.202) 0:02:08.664 ******* 2021-02-12T17:11:34.889 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-02-12T17:11:34.889 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-02-12T17:11:34.927 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:34 +0000 (0:00:00.054) 0:02:08.719 ******* 2021-02-12T17:11:35.038 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.008004", "end": "2021-02-12 17:11:35.018106", "rc": 0, "start": "2021-02-12 17:11:35.010102", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:11:35.074 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:35 +0000 (0:00:00.146) 0:02:08.866 ******* 2021-02-12T17:11:35.101 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-02-12T17:11:35.101 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.009206", "end": "2021-02-12 17:11:35.079751", "rc": 0, "start": "2021-02-12 17:11:35.070545", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:11:35.137 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:35 +0000 (0:00:00.063) 0:02:08.929 ******* 2021-02-12T17:11:35.301 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-02-12T17:11:35.303 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.004694", "end": "2021-02-12 17:11:35.279879", "rc": 0, "start": "2021-02-12 17:11:35.275185", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:11:35.335 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:35 +0000 (0:00:00.198) 0:02:09.127 ******* 2021-02-12T17:11:45.140 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-02-12T17:11:45.142 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:09.905705", "end": "2021-02-12 17:11:45.118177", "rc": 0, "start": "2021-02-12 17:11:35.212472", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:11:45.176 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:45 +0000 (0:00:09.840) 0:02:18.968 ******* 2021-02-12T17:11:45.340 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-02-12T17:11:45.341 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-02-12T17:11:45.375 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:45 +0000 (0:00:00.198) 0:02:19.167 ******* 2021-02-12T17:11:45.401 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-02-12T17:11:45.403 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-02-12T17:11:45.437 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:45 +0000 (0:00:00.061) 0:02:19.229 ******* 2021-02-12T17:11:45.474 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-02-12T17:11:45.475 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-12T17:11:45.510 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:45 +0000 (0:00:00.073) 0:02:19.302 ******* 2021-02-12T17:11:45.549 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-02-12T17:11:45.550 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-02-12T17:11:45.587 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:45 +0000 (0:00:00.077) 0:02:19.379 ******* 2021-02-12T17:11:45.593 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-02-12T17:11:45.594 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:10.103082", "end": "2021-02-12 17:11:45.572136", "rc": 0, "start": "2021-02-12 17:11:35.469054", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:11:45.635 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:45 +0000 (0:00:00.047) 0:02:19.427 ******* 2021-02-12T17:11:45.654 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-02-12T17:11:45.655 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-12T17:11:45.690 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:45 +0000 (0:00:00.054) 0:02:19.482 ******* 2021-02-12T17:11:45.791 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-02-12T17:11:45.793 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-02-12T17:11:45.828 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:45 +0000 (0:00:00.138) 0:02:19.620 ******* 2021-02-12T17:11:45.845 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-02-12T17:11:45.846 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-02-12T17:11:45.879 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:45 +0000 (0:00:00.050) 0:02:19.671 ******* 2021-02-12T17:11:45.887 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [gibba002.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-02-12T17:11:45.924 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:45 +0000 (0:00:00.044) 0:02:19.716 ******* 2021-02-12T17:11:45.962 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-02-12T17:11:45.963 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-12T17:11:45.996 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:45 +0000 (0:00:00.071) 0:02:19.788 ******* 2021-02-12T17:11:46.033 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-02-12T17:11:46.034 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "name": "ubuntu", "state": "present", "system": false} TASK [testnode : Including major version specific variables.] ****************** ok: [gibba002.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": " 2021-02-12T17:11:46.036 INFO:teuthology.task.ansible.out:item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-02-12T17:11:46.069 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:46 +0000 (0:00:00.073) 0:02:19.861 ******* 2021-02-12T17:11:46.101 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:46 +0000 (0:00:00.032) 0:02:19.893 ******* 2021-02-12T17:11:46.106 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-02-12T17:11:46.108 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-12T17:11:46.142 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:46 +0000 (0:00:00.041) 0:02:19.934 ******* 2021-02-12T17:11:46.150 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-02-12T17:11:46.152 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:11:46.186 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:46 +0000 (0:00:00.043) 0:02:19.978 ******* 2021-02-12T17:11:46.214 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-02-12T17:11:46.216 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:11:46.249 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:46 +0000 (0:00:00.062) 0:02:20.041 ******* 2021-02-12T17:11:46.307 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-02-12T17:11:46.309 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-02-12T17:11:46.343 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:46 +0000 (0:00:00.094) 0:02:20.135 ******* 2021-02-12T17:11:46.425 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-02-12T17:11:46.426 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-02-12T17:11:46.464 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:46 +0000 (0:00:00.121) 0:02:20.256 ******* 2021-02-12T17:11:46.492 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-02-12T17:11:46.494 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "name": "ubuntu", "state": "present", "system": false} 2021-02-12T17:11:46.530 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:46 +0000 (0:00:00.066) 0:02:20.322 ******* 2021-02-12T17:11:46.559 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-02-12T17:11:46.560 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:11:46.594 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:46 +0000 (0:00:00.064) 0:02:20.386 ******* 2021-02-12T17:11:46.631 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-02-12T17:11:46.633 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:11:46.682 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:46 +0000 (0:00:00.088) 0:02:20.474 ******* 2021-02-12T17:11:46.970 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-02-12T17:11:46.972 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-02-12T17:11:47.004 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:47 +0000 (0:00:00.321) 0:02:20.796 ******* 2021-02-12T17:11:47.041 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-12T17:11:47.043 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-02-12T17:11:47.078 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:47 +0000 (0:00:00.074) 0:02:20.870 ******* 2021-02-12T17:11:47.105 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-02-12T17:11:47.106 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba004"}, "changed": false} 2021-02-12T17:11:47.140 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:47 +0000 (0:00:00.061) 0:02:20.931 ******* 2021-02-12T17:11:47.440 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-12T17:11:47.442 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-02-12T17:11:47.476 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:47 +0000 (0:00:00.336) 0:02:21.268 ******* 2021-02-12T17:11:47.513 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-02-12T17:11:47.514 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba002"}, "changed": false} 2021-02-12T17:11:47.547 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:47 +0000 (0:00:00.070) 0:02:21.339 ******* 2021-02-12T17:11:47.908 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-02-12T17:11:47.909 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba004.front.sepia.ceph.com", "ansible_hostname": "gibba004", "ansible_nodename": "gibba004"}, "changed": true, "name": "gibba004"} 2021-02-12T17:11:47.945 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:47 +0000 (0:00:00.398) 0:02:21.737 ******* 2021-02-12T17:11:48.025 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba002.front.sepia.ceph.com", "ansible_hostname": "gibba002", "ansible_nodename": "gibba002"}, "changed": true, "name": "gibba002"} 2021-02-12T17:11:48.074 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:48 +0000 (0:00:00.128) 0:02:21.866 ******* 2021-02-12T17:11:48.301 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-02-12T17:11:48.302 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-02-12T17:11:48.335 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:48 +0000 (0:00:00.261) 0:02:22.127 ******* 2021-02-12T17:11:48.436 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-02-12T17:11:48.475 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:48 +0000 (0:00:00.139) 0:02:22.267 ******* 2021-02-12T17:11:48.701 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-02-12T17:11:48.703 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-02-12T17:11:48.741 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:48 +0000 (0:00:00.265) 0:02:22.533 ******* 2021-02-12T17:11:48.831 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-02-12T17:11:48.869 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:48 +0000 (0:00:00.127) 0:02:22.661 ******* 2021-02-12T17:11:49.294 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-02-12T17:11:49.295 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-02-12T17:11:49.334 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:49 +0000 (0:00:00.465) 0:02:23.126 ******* 2021-02-12T17:11:49.406 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-02-12T17:11:49.440 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:49 +0000 (0:00:00.106) 0:02:23.232 ******* 2021-02-12T17:11:49.707 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-02-12T17:11:49.709 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-02-12T17:11:49.743 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:49 +0000 (0:00:00.302) 0:02:23.535 ******* 2021-02-12T17:11:49.823 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-02-12T17:11:49.858 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:49 +0000 (0:00:00.114) 0:02:23.650 ******* 2021-02-12T17:11:49.907 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-12T17:11:49.908 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-02-12T17:11:49.945 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:49 +0000 (0:00:00.086) 0:02:23.737 ******* 2021-02-12T17:11:50.015 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-02-12T17:11:50.054 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:50 +0000 (0:00:00.108) 0:02:23.846 ******* 2021-02-12T17:11:50.104 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-12T17:11:50.105 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-02-12T17:11:50.144 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:50 +0000 (0:00:00.090) 0:02:23.936 ******* 2021-02-12T17:11:50.214 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-02-12T17:11:50.250 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:50 +0000 (0:00:00.105) 0:02:24.042 ******* 2021-02-12T17:11:50.319 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-12T17:11:50.320 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1234, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-12T17:11:50.355 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:50 +0000 (0:00:00.105) 0:02:24.147 ******* 2021-02-12T17:11:50.425 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1234, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-12T17:11:50.460 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:50 +0000 (0:00:00.104) 0:02:24.251 ******* 2021-02-12T17:11:50.733 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-12T17:11:50.735 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-02-12T17:11:50.770 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:50 +0000 (0:00:00.310) 0:02:24.562 ******* 2021-02-12T17:11:50.829 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-02-12T17:11:50.864 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:50 +0000 (0:00:00.094) 0:02:24.656 ******* 2021-02-12T17:11:51.155 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-12T17:11:51.155 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-02-12T17:11:51.193 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:51 +0000 (0:00:00.328) 0:02:24.985 ******* 2021-02-12T17:11:51.244 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-02-12T17:11:51.281 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:51 +0000 (0:00:00.087) 0:02:25.073 ******* 2021-02-12T17:11:52.976 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-12T17:11:52.977 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2021-02-12T17:11:52.978 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.537386", "end": "2021-02-12 17:11:52.954186", "rc": 0, "start": "2021-02-12 17:11:51.416800", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:11:53.021 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:53 +0000 (0:00:01.740) 0:02:26.813 ******* 2021-02-12T17:11:53.028 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.633562", "end": "2021-02-12 17:11:52.967081", "rc": 0, "start": "2021-02-12 17:11:51.333519", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:11:53.063 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:53 +0000 (0:00:00.042) 0:02:26.855 ******* 2021-02-12T17:11:53.403 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-02-12T17:11:53.406 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-02-12T17:11:53.449 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-02-12T17:11:53.754 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-02-12T17:11:53.786 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-02-12T17:11:54.089 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-02-12T17:11:54.124 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:54 +0000 (0:00:01.061) 0:02:27.916 ******* 2021-02-12T17:11:54.132 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-02-12T17:11:54.181 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:54 +0000 (0:00:00.056) 0:02:27.973 ******* 2021-02-12T17:11:54.500 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-02-12T17:11:54.501 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-02-12T17:11:54.537 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:54 +0000 (0:00:00.355) 0:02:28.329 ******* 2021-02-12T17:11:54.575 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-02-12T17:11:54.618 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:54 +0000 (0:00:00.080) 0:02:28.410 ******* 2021-02-12T17:11:54.931 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-12T17:11:54.933 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-02-12T17:11:55.017 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-02-12T17:11:55.288 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-02-12T17:11:55.362 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-02-12T17:11:55.623 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-02-12T17:11:55.660 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:55 +0000 (0:00:01.042) 0:02:29.452 ******* 2021-02-12T17:11:55.687 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-12T17:11:55.722 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:55 +0000 (0:00:00.062) 0:02:29.514 ******* 2021-02-12T17:11:55.729 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-12T17:11:55.729 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-02-12T17:11:55.766 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:55 +0000 (0:00:00.043) 0:02:29.558 ******* 2021-02-12T17:11:55.772 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-02-12T17:11:55.774 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:11:55.810 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:55 +0000 (0:00:00.043) 0:02:29.602 ******* 2021-02-12T17:11:55.817 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-12T17:11:55.852 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:55 +0000 (0:00:00.042) 0:02:29.644 ******* 2021-02-12T17:11:55.858 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-02-12T17:11:55.858 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-02-12T17:11:55.859 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-12T17:11:55.894 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:55 +0000 (0:00:00.041) 0:02:29.686 ******* 2021-02-12T17:11:55.901 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-02-12T17:11:55.902 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:11:55.936 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:55 +0000 (0:00:00.041) 0:02:29.728 ******* 2021-02-12T17:11:55.942 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-02-12T17:11:55.944 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:11:55.978 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:55 +0000 (0:00:00.042) 0:02:29.770 ******* 2021-02-12T17:11:55.984 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-02-12T17:11:55.986 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-12T17:11:56.021 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:56 +0000 (0:00:00.042) 0:02:29.813 ******* 2021-02-12T17:11:56.027 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:11:56.029 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-02-12T17:11:56.063 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:56 +0000 (0:00:00.041) 0:02:29.855 ******* 2021-02-12T17:11:56.069 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-02-12T17:11:56.071 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:11:56.105 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:56 +0000 (0:00:00.042) 0:02:29.897 ******* 2021-02-12T17:11:56.111 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-02-12T17:11:56.113 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:11:56.147 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:56 +0000 (0:00:00.041) 0:02:29.939 ******* 2021-02-12T17:11:56.152 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:11:56.154 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-02-12T17:11:56.189 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:56 +0000 (0:00:00.042) 0:02:29.981 ******* 2021-02-12T17:11:56.197 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-02-12T17:11:56.199 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:11:56.234 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:56 +0000 (0:00:00.045) 0:02:30.026 ******* 2021-02-12T17:11:56.240 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-02-12T17:11:56.242 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:11:56.276 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:56 +0000 (0:00:00.042) 0:02:30.068 ******* 2021-02-12T17:11:56.313 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-02-12T17:11:56.314 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:11:56.347 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:56 +0000 (0:00:00.071) 0:02:30.139 ******* 2021-02-12T17:11:56.395 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-02-12T17:11:56.396 INFO:teuthology.task.ansible.out:fatal: [gibba002.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.005248", "end": "2021-02-12 17:11:56.375146", "msg": "non-zero return code", "rc": 1, "start": "2021-02-12 17:11:56.369898", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-02-12T17:11:56.435 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:56 +0000 (0:00:00.087) 0:02:30.227 ******* 2021-02-12T17:11:56.462 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-02-12T17:11:56.464 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:11:56.505 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:56 +0000 (0:00:00.070) 0:02:30.297 ******* 2021-02-12T17:11:56.511 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-02-12T17:11:56.512 INFO:teuthology.task.ansible.out:fatal: [gibba004.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.005190", "end": "2021-02-12 17:11:56.491489", "msg": "non-zero return code", "rc": 1, "start": "2021-02-12 17:11:56.486299", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-02-12T17:11:56.550 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:56 +0000 (0:00:00.044) 0:02:30.342 ******* 2021-02-12T17:11:56.578 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:11:56.613 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:56 +0000 (0:00:00.063) 0:02:30.405 ******* 2021-02-12T17:11:58.470 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-12T17:11:58.502 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64"]} 2021-02-12T17:11:58.504 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:58 +0000 (0:00:01.890) 0:02:32.296 ******* 2021-02-12T17:11:58.615 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64"]} 2021-02-12T17:11:58.652 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:11:58 +0000 (0:00:00.147) 0:02:32.444 ******* 2021-02-12T17:12:00.156 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-12T17:12:00.158 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2021-02-12T17:12:00.195 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:00 +0000 (0:00:01.542) 0:02:33.987 ******* 2021-02-12T17:12:00.401 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2021-02-12T17:12:00.436 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:00 +0000 (0:00:00.241) 0:02:34.228 ******* 2021-02-12T17:12:40.456 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-12T17:12:40.457 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: util-linux-2.32.1-24.el8.x86_64", "Installed: util-linux-user-2.32.1-24.el8.x86_64", "Installed: python3-libdnf-0.48.0-5.el8.x86_64", "Installed: libdnf-0.48.0-5.el8.x86_64", "Installed: python3-librepo-1.12.0-2.el8.x86_64", "Installed: boost-chrono-1.66.0-10.el8.x86_64", "Installed: xfsprogs-5.0.0-4.el8.x86_64", "Installed: libfdisk-2.32.1-24.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: gdb-8.2-12.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: nfs-utils-1:2.3.3-35.el8.x86_64", "Installed: gcc-8.3.1-5.1.el8.x86_64", "Installed: gdb-headless-8.2-12.el8.x86_64", "Installed: libuuid-2.32.1-24.el8.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: gcc-gdb-plugin-8.3.1-5.1.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: python3-virtualenv-15.1.0-19.module_el8.3.0+562+e162826a.noarch", "Installed: libgcc-8.3.1-5.1.el8.x86_64", "Installed: libgcrypt-1.8.5-4.el8.x86_64", "Installed: yum-utils-4.0.17-5.el8.noa 2021-02-12T17:12:40.458 INFO:teuthology.task.ansible.out:rch", "Installed: libgomp-8.3.1-5.1.el8.x86_64", "Installed: yum-4.2.23-4.el8.noarch", "Installed: perl-Git-2.27.0-1.el8.noarch", "Installed: boost-system-1.66.0-10.el8.x86_64", "Installed: boost-thread-1.66.0-10.el8.x86_64", "Installed: librepo-1.12.0-2.el8.x86_64", "Installed: podman-2.0.5-5.module_el8.3.0+512+b3b58dca.x86_64", "Installed: podman-catatonit-2.0.5-5.module_el8.3.0+512+b3b58dca.x86_64", "Installed: podman-docker-2.0.5-5.module_el8.3.0+512+b3b58dca.noarch", "Installed: dnf-4.2.23-4.el8.noarch", "Installed: dnf-data-4.2.23-4.el8.noarch", "Installed: dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: python3-nose-1.3.7-30.module_el8.3.0+562+e162826a.noarch", "Installed: libsmartcols-2.32.1-24.el8.x86_64", "Installed: openssl-1:1.1.1g-12.el8_3.x86_64", "Installed: lsof-4.93.2-1.el8.x86_64", "Installed: valgrind-1:3.16.0-2.el8.x86_64", "Installed: libblkid-2.32.1-24.el8.x86_64", "Installed: git-2.27.0-1.el8.x86_64", "Installed: openssl-libs-1:1.1.1g-12.el8_3.x86_64", "Installed: git-core-2.27.0-1.el8.x86_64", "Installed: git-core-doc-2.27.0-1.el8.noarch", "Installed: qemu-img-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: qemu-kvm-common-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: qemu-kvm-core-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: python3-hawkey-0.48.0-5.el8.x86_64", "Installed: cpp-8.3.1-5.1.el8.x86_64", "Installed: libmodulemd-2.9.4-2.el8.x86_64", "Installed: libmount-2.32.1-24.el8.x86_64", "Installed: python3-dnf-4.2.23-4.el8.noarch", "Installed: python3-dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: sysstat-11.7.3-5.el8.x86_64", "Installed: seavgabios-bin-1.13.0-2.module_el8.3.0+555+a55c8938.noarch", "Removed: python3-virtualenv-15.1.0-19.module_el8.1.0+245+c39af44f.noarch", "Removed: openssl-1:1.1.1c-15.el8.x86_64", "Removed: qemu-img-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: qemu-kvm-c 2021-02-12T17:12:40.460 INFO:teuthology.task.ansible.out:ommon-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: qemu-kvm-core-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: openssl-libs-1:1.1.1c-15.el8.x86_64", "Removed: librepo-1.11.0-2.el8.x86_64", "Removed: libsmartcols-2.32.1-22.el8.x86_64", "Removed: gcc-8.3.1-4.5.el8.x86_64", "Removed: gcc-gdb-plugin-8.3.1-4.5.el8.x86_64", "Removed: gdb-8.2-6.el8.x86_64", "Removed: gdb-headless-8.2-6.el8.x86_64", "Removed: seavgabios-bin-1.11.1-4.module_el8.1.0+248+298dec18.noarch", "Removed: boost-chrono-1.66.0-6.el8.x86_64", "Removed: git-2.18.2-2.el8_1.x86_64", "Removed: git-core-2.18.2-2.el8_1.x86_64", "Removed: git-core-doc-2.18.2-2.el8_1.noarch", "Removed: boost-system-1.66.0-6.el8.x86_64", "Removed: boost-thread-1.66.0-6.el8.x86_64", "Removed: libuuid-2.32.1-22.el8.x86_64", "Removed: podman-1.6.4-4.module_el8.1.0+298+41f9343a.x86_64", "Removed: podman-docker-1.6.4-4.module_el8.1.0+298+41f9343a.noarch", "Removed: podman-manpages-1.6.4-4.module_el8.1.0+298+41f9343a.noarch", "Removed: libblkid-2.32.1-22.el8.x86_64", "Removed: libdnf-0.35.1-9.el8_1.x86_64", "Removed: perl-Git-2.18.2-2.el8_1.noarch", "Removed: lsof-4.91-2.el8.x86_64", "Removed: cpp-8.3.1-4.5.el8.x86_64", "Removed: sysstat-11.7.3-2.el8.x86_64", "Removed: libfdisk-2.32.1-22.el8.x86_64", "Removed: python3-dnf-4.2.7-7.el8_1.noarch", "Removed: python3-dnf-plugins-core-4.0.8-3.el8.noarch", "Removed: libgcc-8.3.1-5.el8.0.2.x86_64", "Removed: libgcrypt-1.8.3-4.el8.x86_64", "Removed: python3-hawkey-0.35.1-9.el8_1.x86_64", "Removed: libgomp-8.3.1-4.5.el8.x86_64", "Removed: python3-libdnf-0.35.1-9.el8_1.x86_64", "Removed: python3-librepo-1.11.0-2.el8.x86_64", "Removed: util-linux-2.32.1-22.el8.x86_64", "Removed: util-linux-user-2.32.1-22.el8.x86_64", "Removed: valgrind-1:3.15.0-9.el8.x86_64", "Removed: python3-nose-1.3.7-30.module_el8.1.0+245+c39af44f.noarch", "Removed: dnf-4.2.7-7.el8_1.noarch", "Removed: dnf-data-4.2.7-7.el8_1.noarch", "Removed: libmount-2.32.1-22.el8.x86_64", "Removed: dnf-plug 2021-02-12T17:12:40.461 INFO:teuthology.task.ansible.out:ins-core-4.0.8-3.el8.noarch", "Removed: nfs-utils-1:2.3.3-26.el8.x86_64", "Removed: xfsprogs-5.0.0-2.el8.x86_64", "Removed: yum-4.2.7-7.el8_1.noarch", "Removed: yum-utils-4.0.8-3.el8.noarch"]} 2021-02-12T17:12:40.493 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:40 +0000 (0:00:40.056) 0:03:14.285 ******* 2021-02-12T17:12:40.531 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-02-12T17:12:40.532 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:40.569 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:40 +0000 (0:00:00.076) 0:03:14.361 ******* 2021-02-12T17:12:41.379 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-12T17:12:41.380 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-02-12T17:12:41.412 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:41 +0000 (0:00:00.842) 0:03:15.204 ******* 2021-02-12T17:12:41.450 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-12T17:12:41.451 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:41.485 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:41 +0000 (0:00:00.072) 0:03:15.277 ******* 2021-02-12T17:12:41.736 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-02-12T17:12:41.737 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice basic.target dbus.socket polkit.service dbus.service sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ipset.service ip6tables.service iptables.service ebtables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes 2021-02-12T17:12:41.738 INFO:teuthology.task.ansible.out:": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127309", "LimitNPROCSoft": "127309", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "Li 2021-02-12T17:12:41.740 INFO:teuthology.task.ansible.out:mitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127309", "LimitSIGPENDINGSoft": "127309", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWei 2021-02-12T17:12:41.741 INFO:teuthology.task.ansible.out:ght": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203694", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-12T17:12:41.773 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:41 +0000 (0:00:00.288) 0:03:15.565 ******* 2021-02-12T17:12:42.016 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [gibba002.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-02-12T17:12:42.051 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:42 +0000 (0:00:00.277) 0:03:15.843 ******* 2021-02-12T17:12:42.294 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-12T17:12:42.295 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: util-linux-2.32.1-24.el8.x86_64", "Installed: util-linux-user-2.32.1-24.el8.x86_64", "Installed: python3-libdnf-0.48.0-5.el8.x86_64", "Installed: libdnf-0.48.0-5.el8.x86_64", "Installed: python3-librepo-1.12.0-2.el8.x86_64", "Installed: boost-chrono-1.66.0-10.el8.x86_64", "Installed: xfsprogs-5.0.0-4.el8.x86_64", "Installed: libfdisk-2.32.1-24.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: gdb-8.2-12.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: nfs-utils-1:2.3.3-35.el8.x86_64", "Installed: gcc-8.3.1-5.1.el8.x86_64", "Installed: gdb-headless-8.2-12.el8.x86_64", "Installed: libuuid-2.32.1-24.el8.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: gcc-gdb-plugin-8.3.1-5.1.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: python3-virtualenv-15.1.0-19.module_el8.3.0+562+e162826a.noarch", "Installed: libgcc-8.3.1-5.1.el8.x86_64", "Installed: libgcrypt-1.8.5-4.el8.x86_64", "Installed: yum-utils-4.0.17-5.el8.noa 2021-02-12T17:12:42.296 INFO:teuthology.task.ansible.out:rch", "Installed: libgomp-8.3.1-5.1.el8.x86_64", "Installed: yum-4.2.23-4.el8.noarch", "Installed: perl-Git-2.27.0-1.el8.noarch", "Installed: boost-system-1.66.0-10.el8.x86_64", "Installed: boost-thread-1.66.0-10.el8.x86_64", "Installed: librepo-1.12.0-2.el8.x86_64", "Installed: podman-2.0.5-5.module_el8.3.0+512+b3b58dca.x86_64", "Installed: podman-catatonit-2.0.5-5.module_el8.3.0+512+b3b58dca.x86_64", "Installed: podman-docker-2.0.5-5.module_el8.3.0+512+b3b58dca.noarch", "Installed: dnf-4.2.23-4.el8.noarch", "Installed: dnf-data-4.2.23-4.el8.noarch", "Installed: dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: python3-nose-1.3.7-30.module_el8.3.0+562+e162826a.noarch", "Installed: libsmartcols-2.32.1-24.el8.x86_64", "Installed: openssl-1:1.1.1g-12.el8_3.x86_64", "Installed: lsof-4.93.2-1.el8.x86_64", "Installed: valgrind-1:3.16.0-2.el8.x86_64", "Installed: libblkid-2.32.1-24.el8.x86_64", "Installed: git-2.27.0-1.el8.x86_64", "Installed: openssl-libs-1:1.1.1g-12.el8_3.x86_64", "Installed: git-core-2.27.0-1.el8.x86_64", "Installed: git-core-doc-2.27.0-1.el8.noarch", "Installed: qemu-img-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: qemu-kvm-common-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: qemu-kvm-core-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: python3-hawkey-0.48.0-5.el8.x86_64", "Installed: cpp-8.3.1-5.1.el8.x86_64", "Installed: libmodulemd-2.9.4-2.el8.x86_64", "Installed: libmount-2.32.1-24.el8.x86_64", "Installed: python3-dnf-4.2.23-4.el8.noarch", "Installed: python3-dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: sysstat-11.7.3-5.el8.x86_64", "Installed: seavgabios-bin-1.13.0-2.module_el8.3.0+555+a55c8938.noarch", "Removed: python3-virtualenv-15.1.0-19.module_el8.1.0+245+c39af44f.noarch", "Removed: openssl-1:1.1.1c-15.el8.x86_64", "Removed: qemu-img-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: qemu-kvm-c 2021-02-12T17:12:42.298 INFO:teuthology.task.ansible.out:ommon-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: qemu-kvm-core-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: openssl-libs-1:1.1.1c-15.el8.x86_64", "Removed: librepo-1.11.0-2.el8.x86_64", "Removed: libsmartcols-2.32.1-22.el8.x86_64", "Removed: gcc-8.3.1-4.5.el8.x86_64", "Removed: gcc-gdb-plugin-8.3.1-4.5.el8.x86_64", "Removed: gdb-8.2-6.el8.x86_64", "Removed: gdb-headless-8.2-6.el8.x86_64", "Removed: seavgabios-bin-1.11.1-4.module_el8.1.0+248+298dec18.noarch", "Removed: boost-chrono-1.66.0-6.el8.x86_64", "Removed: git-2.18.2-2.el8_1.x86_64", "Removed: git-core-2.18.2-2.el8_1.x86_64", "Removed: git-core-doc-2.18.2-2.el8_1.noarch", "Removed: boost-system-1.66.0-6.el8.x86_64", "Removed: boost-thread-1.66.0-6.el8.x86_64", "Removed: libuuid-2.32.1-22.el8.x86_64", "Removed: podman-1.6.4-4.module_el8.1.0+298+41f9343a.x86_64", "Removed: podman-docker-1.6.4-4.module_el8.1.0+298+41f9343a.noarch", "Removed: podman-manpages-1.6.4-4.module_el8.1.0+298+41f9343a.noarch", "Removed: libblkid-2.32.1-22.el8.x86_64", "Removed: libdnf-0.35.1-9.el8_1.x86_64", "Removed: perl-Git-2.18.2-2.el8_1.noarch", "Removed: lsof-4.91-2.el8.x86_64", "Removed: cpp-8.3.1-4.5.el8.x86_64", "Removed: sysstat-11.7.3-2.el8.x86_64", "Removed: libfdisk-2.32.1-22.el8.x86_64", "Removed: python3-dnf-4.2.7-7.el8_1.noarch", "Removed: python3-dnf-plugins-core-4.0.8-3.el8.noarch", "Removed: libgcc-8.3.1-5.el8.0.2.x86_64", "Removed: libgcrypt-1.8.3-4.el8.x86_64", "Removed: python3-hawkey-0.35.1-9.el8_1.x86_64", "Removed: libgomp-8.3.1-4.5.el8.x86_64", "Removed: python3-libdnf-0.35.1-9.el8_1.x86_64", "Removed: python3-librepo-1.11.0-2.el8.x86_64", "Removed: util-linux-2.32.1-22.el8.x86_64", "Removed: util-linux-user-2.32.1-22.el8.x86_64", "Removed: valgrind-1:3.15.0-9.el8.x86_64", "Removed: python3-nose-1.3.7-30.module_el8.1.0+245+c39af44f.noarch", "Removed: dnf-4.2.7-7.el8_1.noarch", "Removed: dnf-data-4.2.7-7.el8_1.noarch", "Removed: libmount-2.32.1-22.el8.x86_64", "Removed: dnf-plug 2021-02-12T17:12:42.299 INFO:teuthology.task.ansible.out:ins-core-4.0.8-3.el8.noarch", "Removed: nfs-utils-1:2.3.3-26.el8.x86_64", "Removed: xfsprogs-5.0.0-2.el8.x86_64", "Removed: yum-4.2.7-7.el8_1.noarch", "Removed: yum-utils-4.0.8-3.el8.noarch"]} 2021-02-12T17:12:42.330 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:42 +0000 (0:00:00.279) 0:03:16.122 ******* 2021-02-12T17:12:42.370 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-02-12T17:12:42.371 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:42.407 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:42 +0000 (0:00:00.076) 0:03:16.199 ******* 2021-02-12T17:12:42.739 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-02-12T17:12:42.740 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-02-12T17:12:42.774 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:42 +0000 (0:00:00.367) 0:03:16.566 ******* 2021-02-12T17:12:42.811 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-02-12T17:12:42.813 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:42.846 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:42 +0000 (0:00:00.071) 0:03:16.638 ******* 2021-02-12T17:12:42.874 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-02-12T17:12:42.875 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:42.921 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:42 +0000 (0:00:00.074) 0:03:16.713 ******* 2021-02-12T17:12:42.949 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:42.984 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:42 +0000 (0:00:00.063) 0:03:16.776 ******* 2021-02-12T17:12:43.010 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-02-12T17:12:43.012 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:43.044 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.060) 0:03:16.836 ******* 2021-02-12T17:12:43.071 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-02-12T17:12:43.072 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:43.105 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.061) 0:03:16.897 ******* 2021-02-12T17:12:43.133 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:43.166 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.060) 0:03:16.958 ******* 2021-02-12T17:12:43.193 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-02-12T17:12:43.228 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.061) 0:03:17.020 ******* 2021-02-12T17:12:43.235 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-12T17:12:43.235 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-02-12T17:12:43.274 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.046) 0:03:17.066 ******* 2021-02-12T17:12:43.281 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-02-12T17:12:43.282 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:43.319 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.044) 0:03:17.111 ******* 2021-02-12T17:12:43.326 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-12T17:12:43.328 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:43.361 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.041) 0:03:17.153 ******* 2021-02-12T17:12:43.367 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-02-12T17:12:43.369 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:43.402 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.041) 0:03:17.194 ******* 2021-02-12T17:12:43.440 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-02-12T17:12:43.441 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [gibba002.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:43.475 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.072) 0:03:17.267 ******* 2021-02-12T17:12:43.503 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-02-12T17:12:43.505 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:43.540 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.064) 0:03:17.332 ******* 2021-02-12T17:12:43.568 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-02-12T17:12:43.604 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.064) 0:03:17.396 ******* 2021-02-12T17:12:43.612 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-02-12T17:12:43.613 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service sysinit.target system.slice dbus.service basic.target dbus.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target iptables.service ebtables.service ipset.service ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes 2021-02-12T17:12:43.614 INFO:teuthology.task.ansible.out:": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127309", "LimitNPROCSoft": "127309", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "Li 2021-02-12T17:12:43.616 INFO:teuthology.task.ansible.out:mitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127309", "LimitSIGPENDINGSoft": "127309", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket system.slice sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWei 2021-02-12T17:12:43.617 INFO:teuthology.task.ansible.out:ght": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203694", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-12T17:12:43.648 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.043) 0:03:17.440 ******* 2021-02-12T17:12:43.654 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-02-12T17:12:43.656 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:43.690 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.041) 0:03:17.482 ******* 2021-02-12T17:12:43.717 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-02-12T17:12:43.718 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:43.751 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.061) 0:03:17.543 ******* 2021-02-12T17:12:43.778 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-02-12T17:12:43.779 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:43.812 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.060) 0:03:17.604 ******* 2021-02-12T17:12:43.843 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-12T17:12:43.844 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:43.876 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.064) 0:03:17.668 ******* 2021-02-12T17:12:43.882 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-02-12T17:12:43.883 INFO:teuthology.task.ansible.out:fatal: [gibba004.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-02-12T17:12:43.921 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.044) 0:03:17.713 ******* 2021-02-12T17:12:43.929 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-02-12T17:12:43.930 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:43.968 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:43 +0000 (0:00:00.047) 0:03:17.760 ******* 2021-02-12T17:12:43.996 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.031 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.062) 0:03:17.823 ******* 2021-02-12T17:12:44.058 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-02-12T17:12:44.060 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.093 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.061) 0:03:17.885 ******* 2021-02-12T17:12:44.120 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-02-12T17:12:44.121 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.154 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.061) 0:03:17.946 ******* 2021-02-12T17:12:44.161 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-02-12T17:12:44.161 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-02-12T17:12:44.201 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.047) 0:03:17.993 ******* 2021-02-12T17:12:44.208 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-02-12T17:12:44.208 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.244 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.042) 0:03:18.036 ******* 2021-02-12T17:12:44.250 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-02-12T17:12:44.250 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.286 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.042) 0:03:18.078 ******* 2021-02-12T17:12:44.292 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-02-12T17:12:44.293 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.329 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.043) 0:03:18.121 ******* 2021-02-12T17:12:44.336 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-02-12T17:12:44.337 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.371 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.041) 0:03:18.163 ******* 2021-02-12T17:12:44.377 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-02-12T17:12:44.379 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.414 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.042) 0:03:18.206 ******* 2021-02-12T17:12:44.420 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-02-12T17:12:44.421 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.455 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.040) 0:03:18.247 ******* 2021-02-12T17:12:44.461 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-02-12T17:12:44.461 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.497 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.041) 0:03:18.289 ******* 2021-02-12T17:12:44.503 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-02-12T17:12:44.505 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.540 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.042) 0:03:18.332 ******* 2021-02-12T17:12:44.545 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-02-12T17:12:44.547 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.584 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.043) 0:03:18.376 ******* 2021-02-12T17:12:44.590 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-02-12T17:12:44.592 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.626 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.042) 0:03:18.418 ******* 2021-02-12T17:12:44.632 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-02-12T17:12:44.633 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.667 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.041) 0:03:18.459 ******* 2021-02-12T17:12:44.673 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-02-12T17:12:44.675 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.709 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.042) 0:03:18.501 ******* 2021-02-12T17:12:44.715 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-12T17:12:44.717 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.751 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.041) 0:03:18.543 ******* 2021-02-12T17:12:44.760 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-02-12T17:12:44.794 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.043) 0:03:18.586 ******* 2021-02-12T17:12:44.800 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-12T17:12:44.801 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.845 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.051) 0:03:18.637 ******* 2021-02-12T17:12:44.854 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-02-12T17:12:44.855 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.896 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.050) 0:03:18.688 ******* 2021-02-12T17:12:44.903 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-12T17:12:44.905 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.940 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.043) 0:03:18.732 ******* 2021-02-12T17:12:44.946 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-02-12T17:12:44.948 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:44.987 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:44 +0000 (0:00:00.047) 0:03:18.779 ******* 2021-02-12T17:12:44.996 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-12T17:12:44.997 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.054 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.067) 0:03:18.846 ******* 2021-02-12T17:12:45.061 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-02-12T17:12:45.061 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.063 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.103 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.048) 0:03:18.895 ******* 2021-02-12T17:12:45.109 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-12T17:12:45.111 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.147 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.044) 0:03:18.939 ******* 2021-02-12T17:12:45.154 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-02-12T17:12:45.155 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.193 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.045) 0:03:18.985 ******* 2021-02-12T17:12:45.194 INFO:teuthology.task.ansible.out: 2021-02-12T17:12:45.199 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-12T17:12:45.201 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.236 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.043) 0:03:19.028 ******* 2021-02-12T17:12:45.243 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-02-12T17:12:45.278 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.041) 0:03:19.070 ******* 2021-02-12T17:12:45.288 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-12T17:12:45.290 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.326 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.048) 0:03:19.118 ******* 2021-02-12T17:12:45.333 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-02-12T17:12:45.335 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.368 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.042) 0:03:19.160 ******* 2021-02-12T17:12:45.374 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-12T17:12:45.376 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.410 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.041) 0:03:19.202 ******* 2021-02-12T17:12:45.417 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-02-12T17:12:45.418 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.454 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.043) 0:03:19.246 ******* 2021-02-12T17:12:45.461 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:12:45.462 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.496 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.042) 0:03:19.288 ******* 2021-02-12T17:12:45.503 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-02-12T17:12:45.505 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.539 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.042) 0:03:19.331 ******* 2021-02-12T17:12:45.545 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-12T17:12:45.546 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.579 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.040) 0:03:19.371 ******* 2021-02-12T17:12:45.587 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-12T17:12:45.589 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.623 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.043) 0:03:19.415 ******* 2021-02-12T17:12:45.630 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-12T17:12:45.631 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.665 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.041) 0:03:19.457 ******* 2021-02-12T17:12:45.672 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-02-12T17:12:45.673 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.706 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.041) 0:03:19.498 ******* 2021-02-12T17:12:45.712 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-12T17:12:45.714 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.748 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.041) 0:03:19.540 ******* 2021-02-12T17:12:45.754 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-12T17:12:45.756 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.792 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.044) 0:03:19.584 ******* 2021-02-12T17:12:45.798 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-12T17:12:45.800 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.834 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.041) 0:03:19.626 ******* 2021-02-12T17:12:45.840 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-02-12T17:12:45.842 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.876 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.042) 0:03:19.668 ******* 2021-02-12T17:12:45.903 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-02-12T17:12:45.905 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:45.936 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:45 +0000 (0:00:00.060) 0:03:19.728 ******* 2021-02-12T17:12:45.971 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-02-12T17:12:45.973 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.005 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.068) 0:03:19.797 ******* 2021-02-12T17:12:46.011 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-12T17:12:46.012 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-02-12T17:12:46.066 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.061) 0:03:19.858 ******* 2021-02-12T17:12:46.076 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-02-12T17:12:46.077 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.120 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.054) 0:03:19.912 ******* 2021-02-12T17:12:46.149 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-02-12T17:12:46.151 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.183 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.062) 0:03:19.975 ******* 2021-02-12T17:12:46.210 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-02-12T17:12:46.211 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.251 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.067) 0:03:20.043 ******* 2021-02-12T17:12:46.258 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-12T17:12:46.258 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-12T17:12:46.297 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.046) 0:03:20.089 ******* 2021-02-12T17:12:46.304 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-02-12T17:12:46.305 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.344 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.046) 0:03:20.136 ******* 2021-02-12T17:12:46.373 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-02-12T17:12:46.374 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.410 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.065) 0:03:20.202 ******* 2021-02-12T17:12:46.440 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-12T17:12:46.442 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.487 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.077) 0:03:20.279 ******* 2021-02-12T17:12:46.496 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-12T17:12:46.497 INFO:teuthology.task.ansible.out:[WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. 2021-02-12T17:12:46.498 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-02-12T17:12:46.539 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.052) 0:03:20.331 ******* 2021-02-12T17:12:46.548 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-12T17:12:46.549 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.585 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.045) 0:03:20.377 ******* 2021-02-12T17:12:46.592 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-12T17:12:46.593 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.628 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.043) 0:03:20.420 ******* 2021-02-12T17:12:46.635 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-12T17:12:46.637 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.671 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.042) 0:03:20.463 ******* 2021-02-12T17:12:46.677 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-12T17:12:46.679 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.712 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.041) 0:03:20.504 ******* 2021-02-12T17:12:46.719 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-12T17:12:46.720 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.753 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.041) 0:03:20.545 ******* 2021-02-12T17:12:46.760 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-12T17:12:46.761 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.796 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.042) 0:03:20.588 ******* 2021-02-12T17:12:46.802 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-12T17:12:46.804 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.838 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.041) 0:03:20.630 ******* 2021-02-12T17:12:46.844 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-12T17:12:46.844 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.880 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.042) 0:03:20.672 ******* 2021-02-12T17:12:46.886 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-12T17:12:46.887 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.925 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.044) 0:03:20.717 ******* 2021-02-12T17:12:46.931 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-12T17:12:46.933 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:46.968 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:46 +0000 (0:00:00.043) 0:03:20.760 ******* 2021-02-12T17:12:46.975 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-12T17:12:46.976 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.010 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.042) 0:03:20.802 ******* 2021-02-12T17:12:47.017 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-12T17:12:47.018 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.058 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.047) 0:03:20.850 ******* 2021-02-12T17:12:47.064 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-12T17:12:47.066 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.100 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.042) 0:03:20.892 ******* 2021-02-12T17:12:47.106 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-12T17:12:47.108 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.144 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.043) 0:03:20.936 ******* 2021-02-12T17:12:47.151 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:12:47.152 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.190 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.046) 0:03:20.982 ******* 2021-02-12T17:12:47.196 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-12T17:12:47.197 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.232 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.042) 0:03:21.024 ******* 2021-02-12T17:12:47.239 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-12T17:12:47.240 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.274 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.041) 0:03:21.066 ******* 2021-02-12T17:12:47.280 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-12T17:12:47.281 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.318 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.043) 0:03:21.110 ******* 2021-02-12T17:12:47.325 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-12T17:12:47.326 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.360 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.041) 0:03:21.152 ******* 2021-02-12T17:12:47.366 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-02-12T17:12:47.367 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.401 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.040) 0:03:21.193 ******* 2021-02-12T17:12:47.407 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-12T17:12:47.408 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.444 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.043) 0:03:21.236 ******* 2021-02-12T17:12:47.450 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-02-12T17:12:47.452 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.485 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.041) 0:03:21.277 ******* 2021-02-12T17:12:47.492 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-12T17:12:47.493 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.530 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.045) 0:03:21.322 ******* 2021-02-12T17:12:47.537 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-12T17:12:47.538 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.577 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.046) 0:03:21.369 ******* 2021-02-12T17:12:47.606 INFO:teuthology.task.ansible.out: 2021-02-12T17:12:47.607 INFO:teuthology.task.ansible.out:TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.640 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.062) 0:03:21.432 ******* 2021-02-12T17:12:47.667 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-02-12T17:12:47.668 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.702 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.061) 0:03:21.494 ******* 2021-02-12T17:12:47.709 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-12T17:12:47.709 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-02-12T17:12:47.746 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.044) 0:03:21.538 ******* 2021-02-12T17:12:47.752 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-02-12T17:12:47.754 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.807 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.060) 0:03:21.599 ******* 2021-02-12T17:12:47.844 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-02-12T17:12:47.845 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:47.885 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.078) 0:03:21.677 ******* 2021-02-12T17:12:47.912 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-02-12T17:12:47.914 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-12T17:12:47.951 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.066) 0:03:21.743 ******* 2021-02-12T17:12:47.985 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:47 +0000 (0:00:00.034) 0:03:21.777 ******* 2021-02-12T17:12:47.992 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-02-12T17:12:47.993 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.028 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.042) 0:03:21.820 ******* 2021-02-12T17:12:48.057 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-02-12T17:12:48.059 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.092 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.063) 0:03:21.884 ******* 2021-02-12T17:12:48.122 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-02-12T17:12:48.124 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.158 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.065) 0:03:21.950 ******* 2021-02-12T17:12:48.165 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-12T17:12:48.167 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-02-12T17:12:48.201 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.043) 0:03:21.994 ******* 2021-02-12T17:12:48.210 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-02-12T17:12:48.211 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.246 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.044) 0:03:22.038 ******* 2021-02-12T17:12:48.254 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-12T17:12:48.255 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.296 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.049) 0:03:22.088 ******* 2021-02-12T17:12:48.302 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-02-12T17:12:48.304 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.340 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.043) 0:03:22.131 ******* 2021-02-12T17:12:48.350 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.388 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.048) 0:03:22.180 ******* 2021-02-12T17:12:48.395 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:12:48.397 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-12T17:12:48.432 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.044) 0:03:22.224 ******* 2021-02-12T17:12:48.441 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-12T17:12:48.442 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.477 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.044) 0:03:22.269 ******* 2021-02-12T17:12:48.485 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-12T17:12:48.485 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.497 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-02-12T17:12:48.498 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.508 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-12T17:12:48.510 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba002.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.543 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.066) 0:03:22.335 ******* 2021-02-12T17:12:48.550 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.551 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.552 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.595 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.051) 0:03:22.387 ******* 2021-02-12T17:12:48.603 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-12T17:12:48.604 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.653 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.057) 0:03:22.444 ******* 2021-02-12T17:12:48.685 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-12T17:12:48.686 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.721 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.068) 0:03:22.513 ******* 2021-02-12T17:12:48.759 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-12T17:12:48.760 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.801 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.079) 0:03:22.593 ******* 2021-02-12T17:12:48.828 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-12T17:12:48.829 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.868 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.067) 0:03:22.660 ******* 2021-02-12T17:12:48.876 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-12T17:12:48.877 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004046", "end": "2021-02-12 17:12:48.803716", "rc": 0, "start": "2021-02-12 17:12:48.799670", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/bin/teuthology-lock"]} 2021-02-12T17:12:48.925 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.056) 0:03:22.717 ******* 2021-02-12T17:12:48.932 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-12T17:12:48.933 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:48.968 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:48 +0000 (0:00:00.043) 0:03:22.760 ******* 2021-02-12T17:12:48.977 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-02-12T17:12:48.979 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.017 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.048) 0:03:22.809 ******* 2021-02-12T17:12:49.025 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-02-12T17:12:49.026 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.063 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.046) 0:03:22.855 ******* 2021-02-12T17:12:49.070 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-02-12T17:12:49.072 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.111 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.047) 0:03:22.903 ******* 2021-02-12T17:12:49.117 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-02-12T17:12:49.119 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.157 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.046) 0:03:22.949 ******* 2021-02-12T17:12:49.165 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-02-12T17:12:49.166 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.210 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.052) 0:03:23.002 ******* 2021-02-12T17:12:49.218 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-12T17:12:49.220 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.260 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.050) 0:03:23.052 ******* 2021-02-12T17:12:49.269 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-02-12T17:12:49.271 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.306 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.045) 0:03:23.098 ******* 2021-02-12T17:12:49.313 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-12T17:12:49.315 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.359 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.053) 0:03:23.151 ******* 2021-02-12T17:12:49.387 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-02-12T17:12:49.388 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.426 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.066) 0:03:23.218 ******* 2021-02-12T17:12:49.453 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-02-12T17:12:49.455 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.494 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.067) 0:03:23.286 ******* 2021-02-12T17:12:49.533 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-02-12T17:12:49.535 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.582 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.088) 0:03:23.374 ******* 2021-02-12T17:12:49.623 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-02-12T17:12:49.625 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.671 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.089) 0:03:23.463 ******* 2021-02-12T17:12:49.709 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-02-12T17:12:49.711 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.749 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.078) 0:03:23.541 ******* 2021-02-12T17:12:49.777 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-02-12T17:12:49.778 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.816 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.066) 0:03:23.608 ******* 2021-02-12T17:12:49.844 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-02-12T17:12:49.845 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.890 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.073) 0:03:23.682 ******* 2021-02-12T17:12:49.919 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-02-12T17:12:49.920 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:49.953 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:49 +0000 (0:00:00.062) 0:03:23.745 ******* 2021-02-12T17:12:49.980 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:50.021 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:50 +0000 (0:00:00.068) 0:03:23.813 ******* 2021-02-12T17:12:50.059 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:12:50.061 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-12T17:12:50.103 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:50 +0000 (0:00:00.081) 0:03:23.895 ******* 2021-02-12T17:12:50.141 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-12T17:12:50.142 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:50.152 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-02-12T17:12:50.163 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:50.174 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:50.176 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:50.186 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:50.187 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-12T17:12:50.229 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:50 +0000 (0:00:00.125) 0:03:24.020 ******* 2021-02-12T17:12:50.446 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-12T17:12:50.447 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.002774", "end": "2021-02-12 17:12:50.419562", "rc": 0, "start": "2021-02-12 17:12:50.416788", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/bin/teuthology-lock"]} 2021-02-12T17:12:50.484 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:50 +0000 (0:00:00.255) 0:03:24.276 ******* 2021-02-12T17:12:50.511 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-02-12T17:12:50.513 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:50.550 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:50 +0000 (0:00:00.066) 0:03:24.342 ******* 2021-02-12T17:12:50.597 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-02-12T17:12:50.599 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:50.635 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:50 +0000 (0:00:00.084) 0:03:24.427 ******* 2021-02-12T17:12:50.662 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-02-12T17:12:50.664 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:50.704 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:50 +0000 (0:00:00.067) 0:03:24.494 ******* 2021-02-12T17:12:50.739 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-02-12T17:12:50.741 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:50.781 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:50 +0000 (0:00:00.078) 0:03:24.573 ******* 2021-02-12T17:12:54.292 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-02-12T17:12:54.293 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper", "Installed: device-mapper-event-8:1.02.171-5.el8.x86_64", "Installed: lvm2-8:2.03.09-5.el8.x86_64", "Installed: device-mapper-event-libs-8:1.02.171-5.el8.x86_64", "Installed: lvm2-libs-8:2.03.09-5.el8.x86_64", "Installed: device-mapper-libs-8:1.02.171-5.el8.x86_64", "Installed: device-mapper-8:1.02.171-5.el8.x86_64", "Removed: device-mapper-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-libs-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-libs-8:1.02.169-3.el8.x86_64", "Removed: lvm2-8:2.03.08-3.el8.x86_64", "Removed: lvm2-libs-8:2.03.08-3.el8.x86_64"]} 2021-02-12T17:12:54.328 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:54 +0000 (0:00:03.546) 0:03:28.120 ******* 2021-02-12T17:12:54.377 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-12T17:12:54.379 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356166656, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137736, 'block_used': 12957372, 'inode_total': 61054976, 'inode_available': 60986368, 'inode_used': 68608, 'uuid': '63a0b9b1-68a2-4793-bb97-99bc41c88009'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137736, "block_size": 4096, "block_total": 240095108, "block_used": 12957372, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986368, "inode_total": 61054976, "inode_used": 68608, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356166656, "size_total": 983429562368, "uuid": "63a0b9b1-68a2-4793-bb97-99bc41c88009"}} 2021-02-12T17:12:54.414 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:54 +0000 (0:00:00.086) 0:03:28.206 ******* 2021-02-12T17:12:54.580 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-12T17:12:54.582 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.003692", "end": "2021-02-12 17:12:54.554858", "rc": 0, "start": "2021-02-12 17:12:54.551166", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:12:54.615 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:54 +0000 (0:00:00.200) 0:03:28.407 ******* 2021-02-12T17:12:54.652 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-02-12T17:12:54.654 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356166656, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137736, 'block_used': 12957372, 'inode_total': 61054976, 'inode_available': 60986368, 'inode_used': 68608, 'uuid': '63a0b9b1-68a2-4793-bb97-99bc41c88009'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137736, "block_size": 4096, "block_total": 240095108, "block_used": 12957372, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986368, "inode_total": 61054976, "inode_used": 68608, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356166656, "size_total": 983429562368, "uuid": "63a0b9b1-68a2-4793-bb97-99bc41c88009"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:54.689 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:54 +0000 (0:00:00.073) 0:03:28.481 ******* 2021-02-12T17:12:54.716 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-02-12T17:12:54.749 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:54 +0000 (0:00:00.060) 0:03:28.541 ******* 2021-02-12T17:12:55.529 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-02-12T17:12:55.530 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper", "Installed: device-mapper-event-8:1.02.171-5.el8.x86_64", "Installed: lvm2-8:2.03.09-5.el8.x86_64", "Installed: device-mapper-event-libs-8:1.02.171-5.el8.x86_64", "Installed: lvm2-libs-8:2.03.09-5.el8.x86_64", "Installed: device-mapper-libs-8:1.02.171-5.el8.x86_64", "Installed: device-mapper-8:1.02.171-5.el8.x86_64", "Removed: device-mapper-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-libs-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-libs-8:1.02.169-3.el8.x86_64", "Removed: lvm2-8:2.03.08-3.el8.x86_64", "Removed: lvm2-libs-8:2.03.08-3.el8.x86_64"]} 2021-02-12T17:12:55.565 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:55 +0000 (0:00:00.815) 0:03:29.357 ******* 2021-02-12T17:12:55.603 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-12T17:12:55.605 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356158464, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137734, 'block_used': 12957374, 'inode_total': 61054976, 'inode_available': 60986368, 'inode_used': 68608, 'uuid': '63a0b9b1-68a2-4793-bb97-99bc41c88009'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137734, "block_size": 4096, "block_total": 240095108, "block_used": 12957374, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986368, "inode_total": 61054976, "inode_used": 68608, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356158464, "size_total": 983429562368, "uuid": "63a0b9b1-68a2-4793-bb97-99bc41c88009"}} 2021-02-12T17:12:55.639 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:55 +0000 (0:00:00.074) 0:03:29.431 ******* 2021-02-12T17:12:55.803 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-12T17:12:55.805 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.003553", "end": "2021-02-12 17:12:55.784417", "rc": 0, "start": "2021-02-12 17:12:55.780864", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:12:55.838 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:55 +0000 (0:00:00.198) 0:03:29.630 ******* 2021-02-12T17:12:55.875 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-02-12T17:12:55.877 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356158464, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137734, 'block_used': 12957374, 'inode_total': 61054976, 'inode_available': 60986368, 'inode_used': 68608, 'uuid': '63a0b9b1-68a2-4793-bb97-99bc41c88009'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137734, "block_size": 4096, "block_total": 240095108, "block_used": 12957374, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986368, "inode_total": 61054976, "inode_used": 68608, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356158464, "size_total": 983429562368, "uuid": "63a0b9b1-68a2-4793-bb97-99bc41c88009"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:12:55.913 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:55 +0000 (0:00:00.075) 0:03:29.705 ******* 2021-02-12T17:12:55.942 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-02-12T17:12:55.976 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:12:55 +0000 (0:00:00.062) 0:03:29.768 ******* 2021-02-12T17:12:56.380 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-12T17:12:56.381 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVluUFpcKDUXnTa538I2YYGiJEyM7JFaVyF6'], 'uuids': ['ef111c2d-4823-478d-bbc5-50de0fcf7e00'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.451843", "end": "2021-02-12 17:12:56.358427", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVluUFpcKDUXnTa538I2YYGiJEyM7JFaVyF6"], "labels": [], "masters": [], "uuids": ["ef111c2d-4823-478d-bbc5-50de0fcf7e00"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:12:54.906584", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-12T17:12:57.589 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-aEvRsm-8Dk8-oT9A-Nh3Q-KjVo-KDze-dnsKT7', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200008B375A', 'nvme-nvme.8086-50484b4d393230303030384233373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEL1K375GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '732585168', 'sectorsize': '512', 'size': '349.32 GB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.065466", "end": "2021-02-12 17:12:57.569328", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-aEvRsm-8Dk8-oT9A-Nh3Q-KjVo-KDze-dnsKT7", "nvme-INTEL_SSDPEL1K375GA_PHKM9200008B375A", "nvme-nvme.8086-50484b4d393230303030384233373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:12:56.503862", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now par 2021-02-12T17:12:57.591 INFO:teuthology.task.ansible.out:tition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-12T17:12:57.714 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hd1oG33Fbe6SkQcZsXxj6dQVxlCEDnAeOZ'], 'uuids': ['e137bded-17fc-4c34-a3e3-21babe913113'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.505460", "end": "2021-02-12 17:12:57.691886", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hd1oG33Fbe6SkQcZsXxj6dQVxlCEDnAeOZ"], "labels": [], "masters": [], "uuids": ["e137bded-17fc-4c34-a3e3-21babe913113"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:12:56.186426", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-12T17:12:58.791 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVluiD7rp7SPmTcxg3RQYQZyvZoNmCicHph3'], 'uuids': ['7cfd216e-9285-4fa5-865c-d95d96549c5a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '27262976', 'sectorsize': '512', 'size': '13.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.056318", "end": "2021-02-12 17:12:58.768291", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVluiD7rp7SPmTcxg3RQYQZyvZoNmCicHph3"], "labels": [], "masters": [], "uuids": ["7cfd216e-9285-4fa5-865c-d95d96549c5a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:12:57.711973", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-12T17:12:58.941 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-eKvOEN-8ceT-bxOX-pihS-FcGC-cdaB-cnAzth', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400JX375A', 'nvme-nvme.8086-50484b4d3931333430304a5833373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEL1K375GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '732585168', 'sectorsize': '512', 'size': '349.32 GB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.080607", "end": "2021-02-12 17:12:58.922175", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-eKvOEN-8ceT-bxOX-pihS-FcGC-cdaB-cnAzth", "nvme-INTEL_SSDPEL1K375GA_PHKM913400JX375A", "nvme-nvme.8086-50484b4d3931333430304a5833373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:12:57.841568", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now par 2021-02-12T17:12:58.942 INFO:teuthology.task.ansible.out:tition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-12T17:12:59.990 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVluzkqbaUYl86VWpgoBTJ4d4fBFaoZxhLWY'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.049221", "end": "2021-02-12 17:12:59.958674", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVluzkqbaUYl86VWpgoBTJ4d4fBFaoZxhLWY"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:12:58.909453", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-12T17:13:00.139 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdm0CeduIsuF9N6YrqK3eNAC0RC0AkeUme'], 'uuids': ['f39c0653-a009-4e74-a3b5-2ffd5ba0c8f7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '27262976', 'sectorsize': '512', 'size': '13.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.046758", "end": "2021-02-12 17:13:00.114229", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdm0CeduIsuF9N6YrqK3eNAC0RC0AkeUme"], "labels": [], "masters": [], "uuids": ["f39c0653-a009-4e74-a3b5-2ffd5ba0c8f7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:12:59.067471", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-12T17:13:01.178 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVlu0XxXQoWRUk6Gi4nABZMU3RwQlIMxuNcK'], 'uuids': ['c329f863-cc57-42e9-8e9d-13e055c89b2a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.053930", "end": "2021-02-12 17:13:01.160362", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVlu0XxXQoWRUk6Gi4nABZMU3RwQlIMxuNcK"], "labels": [], "masters": [], "uuids": ["c329f863-cc57-42e9-8e9d-13e055c89b2a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:00.106432", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-12T17:13:01.191 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9IXK25PF6XF', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9IXK25PF6XF', 'scsi-350000399ac701b81', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF', 'wwn-0x50000399ac701b81'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'TOSHIBA MG04ACA1', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Y9IXK25PF6XF', 'removable': '0', 'support_discard': '0', 'wwn': '0x50000399ac701b81', 'partitions': {'sda1': {'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9IXK25PF6XF-part1', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF-part1', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9IXK25PF6XF-part1', 'scsi-350000399ac701b81-part1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF-part1', 'wwn-0x50000399ac701b81-part1'], 'uuids': ['63a0b9b1-68a2-4793-bb97-99bc41c88009'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '63a0b9b1-68a2-4793-bb97-99bc41c88009', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9IXK25PF6XF", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF", "scsi-1ATA_TOSHIBA_MG04ACA100N_Y9IXK25PF6XF", "scsi-350000399ac701b81", "scsi-SATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF", "wwn-0x50000399ac701b81"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9IXK25PF6XF-part1", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF-part1", "scsi-1ATA_TOSHI 2021-02-12T17:13:01.192 INFO:teuthology.task.ansible.out:BA_MG04ACA100N_Y9IXK25PF6XF-part1", "scsi-350000399ac701b81-part1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF-part1", "wwn-0x50000399ac701b81-part1"], "labels": [], "masters": [], "uuids": ["63a0b9b1-68a2-4793-bb97-99bc41c88009"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "63a0b9b1-68a2-4793-bb97-99bc41c88009"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9IXK25PF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ac701b81"}}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:01.329 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdgQdCaRE9Xz1uURpzeevxQM0cOrzVJS0w'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.050493", "end": "2021-02-12 17:13:01.306968", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdgQdCaRE9Xz1uURpzeevxQM0cOrzVJS0w"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:00.256475", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-12T17:13:02.394 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVlumrp0H9xHGqLkQo4OZq2shdfT4d5kIlwp'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.054429", "end": "2021-02-12 17:13:02.369271", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVlumrp0H9xHGqLkQo4OZq2shdfT4d5kIlwp"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:01.314842", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-12T17:13:02.437 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:02 +0000 (0:00:06.461) 0:03:36.229 ******* 2021-02-12T17:13:02.551 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdEsgYvzT1YjA9KiwtjJsoiXdvLp1LkQOv'], 'uuids': ['bb17d182-ac9b-4371-af85-4fbe1c1b8dca'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.070501", "end": "2021-02-12 17:13:02.524354", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdEsgYvzT1YjA9KiwtjJsoiXdvLp1LkQOv"], "labels": [], "masters": [], "uuids": ["bb17d182-ac9b-4371-af85-4fbe1c1b8dca"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:01.453853", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-12T17:13:02.552 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF', 'scsi-350000399ab9813ce', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF', 'wwn-0x50000399ab9813ce'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'TOSHIBA MG04ACA1', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Y9I6K2K0F6XF', 'removable': '0', 'support_discard': '0', 'wwn': '0x50000399ab9813ce', 'partitions': {'sda1': {'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF-part1', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF-part1', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF-part1', 'scsi-350000399ab9813ce-part1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF-part1', 'wwn-0x50000399ab9813ce-part1'], 'uuids': ['63a0b9b1-68a2-4793-bb97-99bc41c88009'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '63a0b9b1-68a2-4793-bb97-99bc41c88009', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF", "scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF", "scsi-350000399ab9813ce", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF", "wwn-0x50000399ab9813ce"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF-part1", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF-part1", "scsi-1ATA_TOSHI 2021-02-12T17:13:02.554 INFO:teuthology.task.ansible.out:BA_MG04ACA100N_Y9I6K2K0F6XF-part1", "scsi-350000399ab9813ce-part1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF-part1", "wwn-0x50000399ab9813ce-part1"], "labels": [], "masters": [], "uuids": ["63a0b9b1-68a2-4793-bb97-99bc41c88009"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "63a0b9b1-68a2-4793-bb97-99bc41c88009"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2K0F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813ce"}}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:03.695 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-12T17:13:03.696 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVluUFpcKDUXnTa538I2YYGiJEyM7JFaVyF6'], 'uuids': ['ef111c2d-4823-478d-bbc5-50de0fcf7e00'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:01.079199", "end": "2021-02-12 17:13:03.671639", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVluUFpcKDUXnTa538I2YYGiJEyM7JFaVyF6"], "labels": [], "masters": [], "uuids": ["ef111c2d-4823-478d-bbc5-50de0fcf7e00"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:02.592440", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0759705 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0759705 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:03.760 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-12T17:13:03.761 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdZ4artrZmJHB2RHhFNd6YAJJvp0c2CQ7y'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.062625", "end": "2021-02-12 17:13:03.740694", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdZ4artrZmJHB2RHhFNd6YAJJvp0c2CQ7y"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:02.678069", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-12T17:13:03.805 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:03 +0000 (0:00:01.368) 0:03:37.597 ******* 2021-02-12T17:13:03.869 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-12T17:13:03.869 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-aEvRsm-8Dk8-oT9A-Nh3Q-KjVo-KDze-dnsKT7', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200008B375A', 'nvme-nvme.8086-50484b4d393230303030384233373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEL1K375GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '732585168', 'sectorsize': '512', 'size': '349.32 GB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.024728", "end": "2021-02-12 17:13:03.845295", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-aEvRsm-8Dk8-oT9A-Nh3Q-KjVo-KDze-dnsKT7", "nvme-INTEL_SSDPEL1K375GA_PHKM9200008B375A", "nvme-nvme.8086-50484b4d393230303030384233373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:03.820567", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0230201 s, 5.0 GB/s", "stderr_lines": ["1 2021-02-12T17:13:03.871 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0230201 s, 5.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:04.071 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hd1oG33Fbe6SkQcZsXxj6dQVxlCEDnAeOZ'], 'uuids': ['e137bded-17fc-4c34-a3e3-21babe913113'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078100", "end": "2021-02-12 17:13:04.047728", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hd1oG33Fbe6SkQcZsXxj6dQVxlCEDnAeOZ"], "labels": [], "masters": [], "uuids": ["e137bded-17fc-4c34-a3e3-21babe913113"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:03.969628", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0764433 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0764433 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:04.093 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVluiD7rp7SPmTcxg3RQYQZyvZoNmCicHph3'], 'uuids': ['7cfd216e-9285-4fa5-865c-d95d96549c5a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '27262976', 'sectorsize': '512', 'size': '13.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.077965", "end": "2021-02-12 17:13:04.073063", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVluiD7rp7SPmTcxg3RQYQZyvZoNmCicHph3"], "labels": [], "masters": [], "uuids": ["7cfd216e-9285-4fa5-865c-d95d96549c5a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:03.995098", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0761817 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0761817 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:04.242 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-eKvOEN-8ceT-bxOX-pihS-FcGC-cdaB-cnAzth', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400JX375A', 'nvme-nvme.8086-50484b4d3931333430304a5833373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEL1K375GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '732585168', 'sectorsize': '512', 'size': '349.32 GB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.024696", "end": "2021-02-12 17:13:04.216377", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-eKvOEN-8ceT-bxOX-pihS-FcGC-cdaB-cnAzth", "nvme-INTEL_SSDPEL1K375GA_PHKM913400JX375A", "nvme-nvme.8086-50484b4d3931333430304a5833373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:04.191681", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0229954 s, 5.0 GB/s", "stderr_lines": ["1 2021-02-12T17:13:04.243 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0229954 s, 5.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:04.318 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVluzkqbaUYl86VWpgoBTJ4d4fBFaoZxhLWY'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.078678", "end": "2021-02-12 17:13:04.294780", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVluzkqbaUYl86VWpgoBTJ4d4fBFaoZxhLWY"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:04.216102", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0769793 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0769793 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:04.555 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVlu0XxXQoWRUk6Gi4nABZMU3RwQlIMxuNcK'], 'uuids': ['c329f863-cc57-42e9-8e9d-13e055c89b2a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.077673", "end": "2021-02-12 17:13:04.525787", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVlu0XxXQoWRUk6Gi4nABZMU3RwQlIMxuNcK"], "labels": [], "masters": [], "uuids": ["c329f863-cc57-42e9-8e9d-13e055c89b2a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:04.448114", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0759594 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0759594 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:04.561 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9IXK25PF6XF', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9IXK25PF6XF', 'scsi-350000399ac701b81', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF', 'wwn-0x50000399ac701b81'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'TOSHIBA MG04ACA1', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Y9IXK25PF6XF', 'removable': '0', 'support_discard': '0', 'wwn': '0x50000399ac701b81', 'partitions': {'sda1': {'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9IXK25PF6XF-part1', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF-part1', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9IXK25PF6XF-part1', 'scsi-350000399ac701b81-part1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF-part1', 'wwn-0x50000399ac701b81-part1'], 'uuids': ['63a0b9b1-68a2-4793-bb97-99bc41c88009'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '63a0b9b1-68a2-4793-bb97-99bc41c88009', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9IXK25PF6XF", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF", "scsi-1ATA_TOSHIBA_MG04ACA100N_Y9IXK25PF6XF", "scsi-350000399ac701b81", "scsi-SATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF", "wwn-0x50000399ac701b81"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9IXK25PF6XF-part1", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF-part1", "scsi-1ATA_TOSHI 2021-02-12T17:13:04.562 INFO:teuthology.task.ansible.out:BA_MG04ACA100N_Y9IXK25PF6XF-part1", "scsi-350000399ac701b81-part1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9IXK25PF6XF-part1", "wwn-0x50000399ac701b81-part1"], "labels": [], "masters": [], "uuids": ["63a0b9b1-68a2-4793-bb97-99bc41c88009"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "63a0b9b1-68a2-4793-bb97-99bc41c88009"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9IXK25PF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ac701b81"}}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:04.807 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVlumrp0H9xHGqLkQo4OZq2shdfT4d5kIlwp'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078039", "end": "2021-02-12 17:13:04.787588", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-j4rne07pe1WI2aNuMocVe9DcmFbIDVlumrp0H9xHGqLkQo4OZq2shdfT4d5kIlwp"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:04.709549", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0763576 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0763576 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:04.850 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:04 +0000 (0:00:01.045) 0:03:38.642 ******* 2021-02-12T17:13:05.105 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-02-12T17:13:05.106 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.067348", "end": "2021-02-12 17:13:05.080269", "rc": 0, "start": "2021-02-12 17:13:05.012921", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:05.140 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:05 +0000 (0:00:00.289) 0:03:38.932 ******* 2021-02-12T17:13:05.347 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-02-12T17:13:05.348 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.047423", "end": "2021-02-12 17:13:05.324000", "rc": 0, "start": "2021-02-12 17:13:05.276577", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:05.381 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:05 +0000 (0:00:00.241) 0:03:39.173 ******* 2021-02-12T17:13:05.409 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-12T17:13:05.446 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:05 +0000 (0:00:00.064) 0:03:39.238 ******* 2021-02-12T17:13:05.472 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-02-12T17:13:05.474 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:05.509 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:05 +0000 (0:00:00.063) 0:03:39.301 ******* 2021-02-12T17:13:05.516 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-12T17:13:05.517 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdm0CeduIsuF9N6YrqK3eNAC0RC0AkeUme'], 'uuids': ['f39c0653-a009-4e74-a3b5-2ffd5ba0c8f7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '27262976', 'sectorsize': '512', 'size': '13.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:01.079015", "end": "2021-02-12 17:13:05.456841", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdm0CeduIsuF9N6YrqK3eNAC0RC0AkeUme"], "labels": [], "masters": [], "uuids": ["f39c0653-a009-4e74-a3b5-2ffd5ba0c8f7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:04.377826", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0758151 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0758151 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:05.540 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:05.573 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:05 +0000 (0:00:00.063) 0:03:39.365 ******* 2021-02-12T17:13:05.600 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-12T17:13:05.602 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:05.639 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:05 +0000 (0:00:00.066) 0:03:39.431 ******* 2021-02-12T17:13:05.666 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-02-12T17:13:05.667 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:05.702 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:05 +0000 (0:00:00.063) 0:03:39.494 ******* 2021-02-12T17:13:05.858 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-02-12T17:13:05.860 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-12T17:13:05.894 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:05 +0000 (0:00:00.191) 0:03:39.686 ******* 2021-02-12T17:13:05.932 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-12T17:13:05.933 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356166656, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137736, 'block_used': 12957372, 'inode_total': 61054976, 'inode_available': 60986368, 'inode_used': 68608, 'uuid': '63a0b9b1-68a2-4793-bb97-99bc41c88009'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137736, "block_size": 4096, "block_total": 240095108, "block_used": 12957372, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986368, "inode_total": 61054976, "inode_used": 68608, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356166656, "size_total": 983429562368, "uuid": "63a0b9b1-68a2-4793-bb97-99bc41c88009"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:05.968 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:05 +0000 (0:00:00.073) 0:03:39.759 ******* 2021-02-12T17:13:05.995 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-02-12T17:13:05.996 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:06.029 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:06 +0000 (0:00:00.061) 0:03:39.821 ******* 2021-02-12T17:13:06.068 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:13:06.069 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:06.104 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:06 +0000 (0:00:00.074) 0:03:39.896 ******* 2021-02-12T17:13:06.143 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:13:06.144 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:06.180 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:06 +0000 (0:00:00.076) 0:03:39.972 ******* 2021-02-12T17:13:06.207 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-02-12T17:13:06.209 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:06.244 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:06 +0000 (0:00:00.063) 0:03:40.036 ******* 2021-02-12T17:13:06.271 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-02-12T17:13:06.273 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:06.309 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:06 +0000 (0:00:00.065) 0:03:40.101 ******* 2021-02-12T17:13:06.337 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-02-12T17:13:06.338 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:06.372 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:06 +0000 (0:00:00.062) 0:03:40.164 ******* 2021-02-12T17:13:06.695 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-12T17:13:06.696 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdgQdCaRE9Xz1uURpzeevxQM0cOrzVJS0w'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:01.078878", "end": "2021-02-12 17:13:06.677421", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdgQdCaRE9Xz1uURpzeevxQM0cOrzVJS0w"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:05.598543", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0756934 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0756934 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:06.921 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdEsgYvzT1YjA9KiwtjJsoiXdvLp1LkQOv'], 'uuids': ['bb17d182-ac9b-4371-af85-4fbe1c1b8dca'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.077378", "end": "2021-02-12 17:13:06.897853", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdEsgYvzT1YjA9KiwtjJsoiXdvLp1LkQOv"], "labels": [], "masters": [], "uuids": ["bb17d182-ac9b-4371-af85-4fbe1c1b8dca"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:06.820475", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0757392 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0757392 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:06.933 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF', 'scsi-350000399ab9813ce', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF', 'wwn-0x50000399ab9813ce'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'TOSHIBA MG04ACA1', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Y9I6K2K0F6XF', 'removable': '0', 'support_discard': '0', 'wwn': '0x50000399ab9813ce', 'partitions': {'sda1': {'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF-part1', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF-part1', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF-part1', 'scsi-350000399ab9813ce-part1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF-part1', 'wwn-0x50000399ab9813ce-part1'], 'uuids': ['63a0b9b1-68a2-4793-bb97-99bc41c88009'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '63a0b9b1-68a2-4793-bb97-99bc41c88009', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF", "scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF", "scsi-350000399ab9813ce", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF", "wwn-0x50000399ab9813ce"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K0F6XF-part1", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF-part1", "scsi-1ATA_TOSHI 2021-02-12T17:13:06.934 INFO:teuthology.task.ansible.out:BA_MG04ACA100N_Y9I6K2K0F6XF-part1", "scsi-350000399ab9813ce-part1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K0F6XF-part1", "wwn-0x50000399ab9813ce-part1"], "labels": [], "masters": [], "uuids": ["63a0b9b1-68a2-4793-bb97-99bc41c88009"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "63a0b9b1-68a2-4793-bb97-99bc41c88009"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2K0F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813ce"}}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:07.019 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-02-12T17:13:07.020 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-12T17:13:07.056 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:07 +0000 (0:00:00.683) 0:03:40.848 ******* 2021-02-12T17:13:07.620 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-12T17:13:07.622 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-12T17:13:07.914 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-12T17:13:08.147 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-12T17:13:08.148 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdZ4artrZmJHB2RHhFNd6YAJJvp0c2CQ7y'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:01.079144", "end": "2021-02-12 17:13:08.129086", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-TUDGotbhLsrGGKnjr1D1jorqpPg2p0hdZ4artrZmJHB2RHhFNd6YAJJvp0c2CQ7y"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-12 17:13:07.049942", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0759641 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0759641 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:08.198 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:08 +0000 (0:00:01.141) 0:03:41.990 ******* 2021-02-12T17:13:08.215 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-12T17:13:08.216 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-12T17:13:08.426 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-02-12T17:13:08.427 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.072781", "end": "2021-02-12 17:13:08.406013", "rc": 0, "start": "2021-02-12 17:13:08.333232", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:08.460 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:08 +0000 (0:00:00.261) 0:03:42.252 ******* 2021-02-12T17:13:08.489 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-12T17:13:08.490 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-12T17:13:08.672 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-02-12T17:13:08.673 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.057309", "end": "2021-02-12 17:13:08.654766", "rc": 0, "start": "2021-02-12 17:13:08.597457", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:08.705 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:08 +0000 (0:00:00.244) 0:03:42.497 ******* 2021-02-12T17:13:08.732 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-12T17:13:08.770 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:08 +0000 (0:00:00.064) 0:03:42.562 ******* 2021-02-12T17:13:08.779 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-12T17:13:08.779 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-12T17:13:08.816 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:08 +0000 (0:00:00.046) 0:03:42.608 ******* 2021-02-12T17:13:08.823 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-02-12T17:13:08.824 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:08.862 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:08 +0000 (0:00:00.045) 0:03:42.654 ******* 2021-02-12T17:13:08.888 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-02-12T17:13:08.890 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:08.923 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:08 +0000 (0:00:00.061) 0:03:42.715 ******* 2021-02-12T17:13:08.951 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-12T17:13:08.952 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:08.992 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:08 +0000 (0:00:00.068) 0:03:42.784 ******* 2021-02-12T17:13:08.999 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-12T17:13:09.000 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-12T17:13:09.036 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:09 +0000 (0:00:00.044) 0:03:42.828 ******* 2021-02-12T17:13:09.043 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-02-12T17:13:09.045 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:09.080 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:09 +0000 (0:00:00.043) 0:03:42.872 ******* 2021-02-12T17:13:09.213 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-12T17:13:09.214 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-12T17:13:09.236 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-02-12T17:13:09.238 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-12T17:13:09.273 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:09 +0000 (0:00:00.192) 0:03:43.065 ******* 2021-02-12T17:13:09.310 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-12T17:13:09.312 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356158464, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137734, 'block_used': 12957374, 'inode_total': 61054976, 'inode_available': 60986368, 'inode_used': 68608, 'uuid': '63a0b9b1-68a2-4793-bb97-99bc41c88009'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137734, "block_size": 4096, "block_total": 240095108, "block_used": 12957374, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986368, "inode_total": 61054976, "inode_used": 68608, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356158464, "size_total": 983429562368, "uuid": "63a0b9b1-68a2-4793-bb97-99bc41c88009"}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:09.345 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:09 +0000 (0:00:00.072) 0:03:43.137 ******* 2021-02-12T17:13:09.362 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-12T17:13:09.363 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-12T17:13:09.374 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-02-12T17:13:09.376 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:09.409 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:09 +0000 (0:00:00.063) 0:03:43.201 ******* 2021-02-12T17:13:09.437 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:13:09.439 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:09.480 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:09 +0000 (0:00:00.070) 0:03:43.272 ******* 2021-02-12T17:13:09.501 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-12T17:13:09.502 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-12T17:13:09.525 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:13:09.527 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:09.575 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:09 +0000 (0:00:00.094) 0:03:43.367 ******* 2021-02-12T17:13:09.607 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-02-12T17:13:09.608 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:09.643 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:09 +0000 (0:00:00.068) 0:03:43.435 ******* 2021-02-12T17:13:09.659 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-12T17:13:09.661 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-12T17:13:09.672 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:09.675 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-02-12T17:13:09.676 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:09.709 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:09 +0000 (0:00:00.066) 0:03:43.501 ******* 2021-02-12T17:13:09.745 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:09 +0000 (0:00:00.035) 0:03:43.536 ******* 2021-02-12T17:13:09.751 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-02-12T17:13:09.753 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:09.789 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:09 +0000 (0:00:00.044) 0:03:43.581 ******* 2021-02-12T17:13:09.796 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-02-12T17:13:09.797 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:09.842 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:09 +0000 (0:00:00.053) 0:03:43.634 ******* 2021-02-12T17:13:09.852 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-02-12T17:13:09.854 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:09.897 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:09 +0000 (0:00:00.054) 0:03:43.689 ******* 2021-02-12T17:13:10.062 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-02-12T17:13:10.063 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-12T17:13:10.114 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:10 +0000 (0:00:00.217) 0:03:43.906 ******* 2021-02-12T17:13:10.157 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-02-12T17:13:10.158 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-02-12T17:13:10.200 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:10 +0000 (0:00:00.085) 0:03:43.992 ******* 2021-02-12T17:13:10.241 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-02-12T17:13:10.242 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-12T17:13:10.281 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:10 +0000 (0:00:00.081) 0:03:44.073 ******* 2021-02-12T17:13:10.589 INFO:teuthology.task.ansible.out: 2021-02-12T17:13:10.590 INFO:teuthology.task.ansible.out:TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-12T17:13:10.655 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-02-12T17:13:10.657 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true} 2021-02-12T17:13:10.692 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:10 +0000 (0:00:00.410) 0:03:44.484 ******* 2021-02-12T17:13:10.857 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-12T17:13:10.858 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-12T17:13:11.131 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-12T17:13:11.195 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-02-12T17:13:11.196 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-12T17:13:11.233 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:11 +0000 (0:00:00.541) 0:03:45.025 ******* 2021-02-12T17:13:11.271 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-02-12T17:13:11.273 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:11.310 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:11 +0000 (0:00:00.076) 0:03:45.102 ******* 2021-02-12T17:13:11.337 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-02-12T17:13:11.338 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:11.370 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:11 +0000 (0:00:00.060) 0:03:45.162 ******* 2021-02-12T17:13:11.397 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-12T17:13:11.399 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:11.438 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:11 +0000 (0:00:00.067) 0:03:45.230 ******* 2021-02-12T17:13:11.445 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-12T17:13:11.446 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-12T17:13:11.457 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-12T17:13:11.459 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:11.493 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:11 +0000 (0:00:00.055) 0:03:45.285 ******* 2021-02-12T17:13:11.534 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:11.578 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:11 +0000 (0:00:00.084) 0:03:45.370 ******* 2021-02-12T17:13:11.606 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-02-12T17:13:11.607 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:11.648 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:11 +0000 (0:00:00.069) 0:03:45.440 ******* 2021-02-12T17:13:11.676 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-02-12T17:13:11.678 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:11.713 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:11 +0000 (0:00:00.065) 0:03:45.505 ******* 2021-02-12T17:13:11.720 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-12T17:13:11.720 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-12T17:13:11.770 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:11 +0000 (0:00:00.057) 0:03:45.562 ******* 2021-02-12T17:13:11.777 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-02-12T17:13:11.778 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:11.813 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:11 +0000 (0:00:00.042) 0:03:45.605 ******* 2021-02-12T17:13:11.840 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-02-12T17:13:11.841 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:11.875 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:11 +0000 (0:00:00.062) 0:03:45.667 ******* 2021-02-12T17:13:11.902 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-02-12T17:13:11.903 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:11.937 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:11 +0000 (0:00:00.062) 0:03:45.729 ******* 2021-02-12T17:13:11.944 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-12T17:13:11.946 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-12T17:13:11.980 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:11 +0000 (0:00:00.043) 0:03:45.772 ******* 2021-02-12T17:13:11.987 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-02-12T17:13:11.988 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:12.024 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:12 +0000 (0:00:00.043) 0:03:45.816 ******* 2021-02-12T17:13:12.052 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-02-12T17:13:12.053 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:12.089 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:12 +0000 (0:00:00.065) 0:03:45.881 ******* 2021-02-12T17:13:12.118 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-02-12T17:13:12.120 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:12.164 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:12 +0000 (0:00:00.074) 0:03:45.956 ******* 2021-02-12T17:13:12.172 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-12T17:13:12.172 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-12T17:13:12.194 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-02-12T17:13:12.196 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:12.229 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:12 +0000 (0:00:00.065) 0:03:46.021 ******* 2021-02-12T17:13:12.267 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:12.308 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:12 +0000 (0:00:00.079) 0:03:46.100 ******* 2021-02-12T17:13:12.315 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-12T17:13:12.315 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-12T17:13:12.453 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-12T17:13:12.601 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-12T17:13:12.612 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:12.651 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:12 +0000 (0:00:00.342) 0:03:46.443 ******* 2021-02-12T17:13:12.678 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-02-12T17:13:12.679 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-02-12T17:13:12.681 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:12.714 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:12 +0000 (0:00:00.063) 0:03:46.506 ******* 2021-02-12T17:13:12.749 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:12 +0000 (0:00:00.034) 0:03:46.541 ******* 2021-02-12T17:13:12.776 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-02-12T17:13:12.777 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:12.821 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:12 +0000 (0:00:00.071) 0:03:46.613 ******* 2021-02-12T17:13:12.959 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-02-12T17:13:12.962 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-02-12 17:09:06 UTC", "ActiveEnterTimestampMonotonic": "11190332", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount ntpdate.service systemd-tmpfiles-setup.service tmp.mount ntpd.service sysinit.target system.slice sntp.service systemd-journald.socket basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-02-12 17:09:04 UTC", "AssertTimestampMonotonic": "9474251", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-02-12 17:09:04 UTC", "ConditionTimestampMonotonic": "9474236", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ntpd.service systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", 2021-02-12T17:13:12.963 INFO:teuthology.task.ansible.out:"DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1024", "ExecMainStartTimestamp": "Fri 2021-02-12 17:09:06 UTC", "ExecMainStartTimestampMonotonic": "11161817", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-02-12 17:09:04 UTC", "InactiveExitTimestampMonotonic": "9506478", "InvocationID": "43e3f9c2568d428c89db899b2eee8219", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", 2021-02-12T17:13:12.966 INFO:teuthology.task.ansible.out:"LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127309", "LimitNPROCSoft": "127309", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127309", "LimitSIGPENDINGSoft": "127309", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1024", "MemoryAccounting": "yes", "MemoryCurrent": "3997696", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly 2021-02-12T17:13:12.967 INFO:teuthology.task.ansible.out:": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-02-12 17:09:06 UTC", "StateChangeTimestampMonotonic": "11190332", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203694", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-02-12 17:09:06 UTC", "WatchdogTimestampMonotonic": "11161824", "WatchdogUSec": "0"}} 2021-02-12T17:13:13.005 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.184) 0:03:46.797 ******* 2021-02-12T17:13:13.012 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-02-12T17:13:13.014 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-12T17:13:13.049 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.044) 0:03:46.841 ******* 2021-02-12T17:13:13.056 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:13:13.058 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-12T17:13:13.094 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.044) 0:03:46.886 ******* 2021-02-12T17:13:13.101 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-02-12T17:13:13.102 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-02-12T17:13:13.140 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.045) 0:03:46.932 ******* 2021-02-12T17:13:13.146 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:13:13.147 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-02-12T17:13:13.189 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.048) 0:03:46.980 ******* 2021-02-12T17:13:13.218 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-02-12T17:13:13.220 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:13.256 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.067) 0:03:47.048 ******* 2021-02-12T17:13:13.284 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-02-12T17:13:13.285 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:13.318 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.061) 0:03:47.110 ******* 2021-02-12T17:13:13.325 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-02-12T17:13:13.326 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true} 2021-02-12T17:13:13.361 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.042) 0:03:47.153 ******* 2021-02-12T17:13:13.367 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-02-12T17:13:13.369 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:13.403 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.042) 0:03:47.195 ******* 2021-02-12T17:13:13.567 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-02-12T17:13:13.568 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-02-12T17:13:13.605 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.201) 0:03:47.397 ******* 2021-02-12T17:13:13.624 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-02-12T17:13:13.625 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-12T17:13:13.673 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.067) 0:03:47.465 ******* 2021-02-12T17:13:13.704 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-02-12T17:13:13.706 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:13.744 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.070) 0:03:47.536 ******* 2021-02-12T17:13:13.771 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-02-12T17:13:13.773 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:13.808 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.063) 0:03:47.600 ******* 2021-02-12T17:13:13.835 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:13.873 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.064) 0:03:47.665 ******* 2021-02-12T17:13:13.899 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-12T17:13:13.901 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:13.934 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.060) 0:03:47.725 ******* 2021-02-12T17:13:13.961 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:13.995 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:13 +0000 (0:00:00.062) 0:03:47.787 ******* 2021-02-12T17:13:14.012 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-02-12T17:13:14.012 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-02-12T17:13:14.049 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:14 +0000 (0:00:00.053) 0:03:47.841 ******* 2021-02-12T17:13:14.057 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-02-12T17:13:14.059 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:14.094 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:14 +0000 (0:00:00.045) 0:03:47.886 ******* 2021-02-12T17:13:14.123 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-02-12T17:13:14.124 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:14.160 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:14 +0000 (0:00:00.065) 0:03:47.952 ******* 2021-02-12T17:13:14.188 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-02-12T17:13:14.189 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:14.226 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:14 +0000 (0:00:00.066) 0:03:48.018 ******* 2021-02-12T17:13:14.254 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-02-12T17:13:14.255 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:14.290 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:14 +0000 (0:00:00.064) 0:03:48.082 ******* 2021-02-12T17:13:14.318 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:14.354 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:14 +0000 (0:00:00.063) 0:03:48.146 ******* 2021-02-12T17:13:14.381 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:14.416 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:14 +0000 (0:00:00.061) 0:03:48.208 ******* 2021-02-12T17:13:14.443 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-02-12T17:13:14.444 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:14.480 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:14 +0000 (0:00:00.064) 0:03:48.272 ******* 2021-02-12T17:13:14.506 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-02-12T17:13:14.508 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:14.540 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:14 +0000 (0:00:00.059) 0:03:48.332 ******* 2021-02-12T17:13:14.566 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-02-12T17:13:14.567 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:14.607 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:14 +0000 (0:00:00.067) 0:03:48.399 ******* 2021-02-12T17:13:14.646 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-02-12T17:13:14.647 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:14.679 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:14 +0000 (0:00:00.071) 0:03:48.471 ******* 2021-02-12T17:13:15.048 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-02-12T17:13:15.049 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-02-12T17:13:15.093 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:15 +0000 (0:00:00.413) 0:03:48.885 ******* 2021-02-12T17:13:15.227 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-02-12T17:13:15.228 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-02-12T17:13:15.268 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:15 +0000 (0:00:00.175) 0:03:49.060 ******* 2021-02-12T17:13:15.296 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-02-12T17:13:15.297 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:15.331 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:15 +0000 (0:00:00.062) 0:03:49.123 ******* 2021-02-12T17:13:15.339 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-02-12T17:13:15.340 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-02-12 17:09:11 UTC", "ActiveEnterTimestampMonotonic": "11229396", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpd.service sntp.service ntpdate.service system.slice systemd-tmpfiles-setup.service tmp.mount sysinit.target basic.target systemd-journald.socket -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-02-12 17:09:09 UTC", "AssertTimestampMonotonic": "9608618", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-02-12 17:09:09 UTC", "ConditionTimestampMonotonic": "9608603", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", 2021-02-12T17:13:15.342 INFO:teuthology.task.ansible.out:"DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "996", "ExecMainStartTimestamp": "Fri 2021-02-12 17:09:11 UTC", "ExecMainStartTimestampMonotonic": "11147683", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-02-12 17:09:09 UTC", "InactiveExitTimestampMonotonic": "9622449", "InvocationID": "d03dcad98ee245f4b9b5fbdde6684f75", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", " 2021-02-12T17:13:15.343 INFO:teuthology.task.ansible.out:LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127309", "LimitNPROCSoft": "127309", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127309", "LimitSIGPENDINGSoft": "127309", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "996", "MemoryAccounting": "yes", "MemoryCurrent": "4157440", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": 2021-02-12T17:13:15.344 INFO:teuthology.task.ansible.out: "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-02-12 17:09:11 UTC", "StateChangeTimestampMonotonic": "11229396", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203694", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2021-02-12 17:09:11 UTC", "WatchdogTimestampMonotonic": "11147690", "WatchdogUSec": "0"}} 2021-02-12T17:13:15.377 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:15 +0000 (0:00:00.046) 0:03:49.169 ******* 2021-02-12T17:13:15.384 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [gibba002.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-02-12T17:13:15.418 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:15 +0000 (0:00:00.041) 0:03:49.210 ******* 2021-02-12T17:13:15.425 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:13:15.427 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-12T17:13:15.480 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:15 +0000 (0:00:00.061) 0:03:49.272 ******* 2021-02-12T17:13:15.510 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:13:15.512 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-02-12T17:13:15.545 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:15 +0000 (0:00:00.065) 0:03:49.337 ******* 2021-02-12T17:13:15.575 INFO:teuthology.task.ansible.out: 2021-02-12T17:13:15.576 INFO:teuthology.task.ansible.out:TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:15.577 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-12T17:13:15.609 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:15 +0000 (0:00:00.064) 0:03:49.401 ******* 2021-02-12T17:13:15.643 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:15 +0000 (0:00:00.033) 0:03:49.435 ******* 2021-02-12T17:13:15.650 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-02-12T17:13:15.652 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:15.692 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:15 +0000 (0:00:00.048) 0:03:49.484 ******* 2021-02-12T17:13:15.701 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-02-12T17:13:15.703 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:15.739 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:15 +0000 (0:00:00.047) 0:03:49.531 ******* 2021-02-12T17:13:15.746 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-02-12T17:13:15.747 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-12T17:13:15.781 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:15 +0000 (0:00:00.041) 0:03:49.573 ******* 2021-02-12T17:13:15.788 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-02-12T17:13:15.789 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:15.831 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:15 +0000 (0:00:00.050) 0:03:49.623 ******* 2021-02-12T17:13:15.840 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-02-12T17:13:15.840 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:15.882 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:15 +0000 (0:00:00.051) 0:03:49.674 ******* 2021-02-12T17:13:15.990 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-02-12T17:13:15.991 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-02-12T17:13:16.024 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:16 +0000 (0:00:00.142) 0:03:49.816 ******* 2021-02-12T17:13:16.041 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-02-12T17:13:16.043 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-12T17:13:16.078 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:16 +0000 (0:00:00.053) 0:03:49.870 ******* 2021-02-12T17:13:16.231 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-02-12T17:13:16.233 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-12T17:13:16.281 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:16 +0000 (0:00:00.202) 0:03:50.073 ******* 2021-02-12T17:13:16.309 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-02-12T17:13:16.311 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.354 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:16 +0000 (0:00:00.073) 0:03:50.146 ******* 2021-02-12T17:13:16.394 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-02-12T17:13:16.395 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.407 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.409 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.419 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.420 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.454 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:16 +0000 (0:00:00.099) 0:03:50.246 ******* 2021-02-12T17:13:16.461 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-02-12T17:13:16.461 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-02-12T17:13:16.497 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:16 +0000 (0:00:00.043) 0:03:50.289 ******* 2021-02-12T17:13:16.505 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-02-12T17:13:16.505 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.506 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.506 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.519 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.521 INFO:teuthology.task.ansible.out: skipping: [gibba002.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.561 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:16 +0000 (0:00:00.063) 0:03:50.353 ******* 2021-02-12T17:13:16.588 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.623 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:16 +0000 (0:00:00.062) 0:03:50.415 ******* 2021-02-12T17:13:16.661 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.696 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:16 +0000 (0:00:00.072) 0:03:50.488 ******* 2021-02-12T17:13:16.723 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.759 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:16 +0000 (0:00:00.063) 0:03:50.551 ******* 2021-02-12T17:13:16.786 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-02-12T17:13:16.788 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.833 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:16 +0000 (0:00:00.073) 0:03:50.625 ******* 2021-02-12T17:13:16.864 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-02-12T17:13:16.866 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.901 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:16 +0000 (0:00:00.068) 0:03:50.693 ******* 2021-02-12T17:13:16.928 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-12T17:13:16.930 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:16.969 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:16 +0000 (0:00:00.067) 0:03:50.761 ******* 2021-02-12T17:13:17.007 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-02-12T17:13:17.008 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:17.047 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:17 +0000 (0:00:00.077) 0:03:50.839 ******* 2021-02-12T17:13:17.074 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-12T17:13:17.075 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:17.108 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:17 +0000 (0:00:00.061) 0:03:50.900 ******* 2021-02-12T17:13:17.283 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-12T17:13:17.284 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.003116", "end": "2021-02-12 17:13:17.257356", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-12 17:13:17.254240", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:17.336 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-02-12T17:13:17.337 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-02-12T17:13:17.379 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:17 +0000 (0:00:00.271) 0:03:51.171 ******* 2021-02-12T17:13:17.408 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:17.444 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:17 +0000 (0:00:00.064) 0:03:51.236 ******* 2021-02-12T17:13:17.450 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-12T17:13:17.451 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001923", "end": "2021-02-12 17:13:17.403590", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-12 17:13:17.401667", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:17.474 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-02-12T17:13:17.515 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:17 +0000 (0:00:00.071) 0:03:51.307 ******* 2021-02-12T17:13:17.563 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-12T17:13:17.565 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001790", "end": "2021-02-12 17:13:17.541837", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-12 17:13:17.540047", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:17.660 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-02-12T17:13:17.662 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-12T17:13:17.698 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:17 +0000 (0:00:00.182) 0:03:51.490 ******* 2021-02-12T17:13:17.718 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-12T17:13:17.719 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.002046", "end": "2021-02-12 17:13:17.678490", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-12 17:13:17.676444", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:17.766 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:17 +0000 (0:00:00.068) 0:03:51.558 ******* 2021-02-12T17:13:17.775 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:17.812 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:17 +0000 (0:00:00.045) 0:03:51.604 ******* 2021-02-12T17:13:17.818 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-12T17:13:17.857 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:17 +0000 (0:00:00.044) 0:03:51.649 ******* 2021-02-12T17:13:17.865 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-12T17:13:17.905 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:17 +0000 (0:00:00.048) 0:03:51.697 ******* 2021-02-12T17:13:17.933 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-02-12T17:13:17.934 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:17.967 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:17 +0000 (0:00:00.061) 0:03:51.759 ******* 2021-02-12T17:13:18.015 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-02-12T17:13:18.017 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-02-12T17:13:18.122 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-02-12T17:13:18.123 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-12T17:13:18.164 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:18 +0000 (0:00:00.197) 0:03:51.956 ******* 2021-02-12T17:13:18.328 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-02-12T17:13:18.330 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-12T17:13:18.374 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:18 +0000 (0:00:00.209) 0:03:52.166 ******* 2021-02-12T17:13:18.401 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-02-12T17:13:18.402 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:18.441 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:18 +0000 (0:00:00.067) 0:03:52.233 ******* 2021-02-12T17:13:18.478 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-02-12T17:13:18.480 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba004.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-02-12T17:13:18.491 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-02-12T17:13:18.493 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-02-12T17:13:18.527 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:18 +0000 (0:00:00.085) 0:03:52.319 ******* 2021-02-12T17:13:18.565 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-02-12T17:13:18.566 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:18.576 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:18.587 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:18.587 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:18.598 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:18.635 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:18 +0000 (0:00:00.108) 0:03:52.427 ******* 2021-02-12T17:13:18.662 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-12T17:13:18.663 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:18.698 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:18 +0000 (0:00:00.062) 0:03:52.490 ******* 2021-02-12T17:13:18.725 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-02-12T17:13:18.727 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:18.764 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:18 +0000 (0:00:00.065) 0:03:52.556 ******* 2021-02-12T17:13:18.791 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-02-12T17:13:18.792 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:18.837 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:18 +0000 (0:00:00.073) 0:03:52.629 ******* 2021-02-12T17:13:18.867 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-02-12T17:13:18.868 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:18.902 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:18 +0000 (0:00:00.065) 0:03:52.694 ******* 2021-02-12T17:13:18.929 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-02-12T17:13:18.931 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:18.966 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:18 +0000 (0:00:00.063) 0:03:52.758 ******* 2021-02-12T17:13:18.993 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-12T17:13:18.994 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:19.031 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:19 +0000 (0:00:00.064) 0:03:52.823 ******* 2021-02-12T17:13:19.058 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:19.094 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:19 +0000 (0:00:00.062) 0:03:52.886 ******* 2021-02-12T17:13:19.120 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-12T17:13:19.122 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:19.155 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:19 +0000 (0:00:00.061) 0:03:52.947 ******* 2021-02-12T17:13:19.157 INFO:teuthology.task.ansible.out: 2021-02-12T17:13:19.340 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-12T17:13:19.342 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.003070", "end": "2021-02-12 17:13:19.298220", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-12 17:13:19.295150", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:19.479 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001868", "end": "2021-02-12 17:13:19.447776", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-12 17:13:19.445908", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:19.616 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001780", "end": "2021-02-12 17:13:19.585150", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-12 17:13:19.583370", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:19.764 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.001985", "end": "2021-02-12 17:13:19.735015", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-12 17:13:19.733030", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:19.799 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:19 +0000 (0:00:00.643) 0:03:53.591 ******* 2021-02-12T17:13:19.826 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-12T17:13:19.880 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:19 +0000 (0:00:00.080) 0:03:53.672 ******* 2021-02-12T17:13:20.036 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-02-12T17:13:20.037 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-02-12T17:13:20.142 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-02-12T17:13:20.177 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:20 +0000 (0:00:00.297) 0:03:53.969 ******* 2021-02-12T17:13:20.228 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:20 +0000 (0:00:00.050) 0:03:54.020 ******* 2021-02-12T17:13:20.746 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-02-12T17:13:20.747 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] 2021-02-12T17:13:20.799 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] 2021-02-12T17:13:20.839 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:20 +0000 (0:00:00.610) 0:03:54.631 ******* 2021-02-12T17:13:20.876 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:20.912 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:20 +0000 (0:00:00.073) 0:03:54.704 ******* 2021-02-12T17:13:20.946 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:20 +0000 (0:00:00.033) 0:03:54.738 ******* 2021-02-12T17:13:20.953 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-12T17:13:20.954 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-02-12T17:13:20.993 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:20 +0000 (0:00:00.046) 0:03:54.785 ******* 2021-02-12T17:13:21.001 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-12T17:13:21.002 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:21.037 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:21 +0000 (0:00:00.044) 0:03:54.829 ******* 2021-02-12T17:13:21.044 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-02-12T17:13:21.046 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-02-12T17:13:21.082 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:21 +0000 (0:00:00.044) 0:03:54.874 ******* 2021-02-12T17:13:21.088 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-12T17:13:21.088 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-02-12T17:13:21.130 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:21 +0000 (0:00:00.048) 0:03:54.922 ******* 2021-02-12T17:13:21.168 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-02-12T17:13:21.169 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-02-12T17:13:21.205 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:21 +0000 (0:00:00.074) 0:03:54.997 ******* 2021-02-12T17:13:21.872 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** ok: [gibba002.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: podman", "Installed: podman-docker"]} 2021-02-12T17:13:21.931 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:21 +0000 (0:00:00.726) 0:03:55.723 ******* 2021-02-12T17:13:21.962 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-12T17:13:21.963 INFO:teuthology.task.ansible.out:ok: [gibba002.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-02-12T17:13:22.001 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:21 +0000 (0:00:00.069) 0:03:55.792 ******* 2021-02-12T17:13:22.017 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-02-12T17:13:22.018 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: podman", "Installed: podman-docker"]} 2021-02-12T17:13:22.062 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:22 +0000 (0:00:00.061) 0:03:55.854 ******* 2021-02-12T17:13:22.068 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-12T17:13:22.069 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:22.117 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:22 +0000 (0:00:00.054) 0:03:55.909 ******* 2021-02-12T17:13:22.123 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-12T17:13:22.125 INFO:teuthology.task.ansible.out:ok: [gibba004.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-02-12T17:13:22.162 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:22 +0000 (0:00:00.045) 0:03:55.954 ******* 2021-02-12T17:13:22.189 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-12T17:13:22.191 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:22.229 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:22 +0000 (0:00:00.066) 0:03:56.021 ******* 2021-02-12T17:13:22.300 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-02-12T17:13:22.302 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-12T17:13:22.418 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-12T17:13:22.450 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-12T17:13:22.491 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:22 +0000 (0:00:00.262) 0:03:56.283 ******* 2021-02-12T17:13:22.571 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-12T17:13:22.621 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:22 +0000 (0:00:00.130) 0:03:56.413 ******* 2021-02-12T17:13:22.933 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-02-12T17:13:22.934 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613150002.5298612-65614463518212/source", "state": "file", "uid": 0} 2021-02-12T17:13:23.062 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613150002.6657672-92244448023320/source", "state": "file", "uid": 0} 2021-02-12T17:13:23.325 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613150002.939859-172286162404962/source", "state": "file", "uid": 0} 2021-02-12T17:13:23.362 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:23 +0000 (0:00:00.741) 0:03:57.154 ******* 2021-02-12T17:13:23.466 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613150003.0768352-272901157354114/source", "state": "file", "uid": 0} 2021-02-12T17:13:23.508 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:23 +0000 (0:00:00.145) 0:03:57.300 ******* 2021-02-12T17:13:25.806 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-02-12T17:13:25.808 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-ofnf4c3h-build\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nInstalling collected packages: toml, docopt, registries-conf-ctl\n Running setup.py install for docopt: started\n Running setup.py install for docopt: finished with status 'done'\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-ofnf4c3h-build", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.p 2021-02-12T17:13:25.809 INFO:teuthology.task.ansible.out:ythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Installing collected packages: toml, docopt, registries-conf-ctl", " Running setup.py install for docopt: started", " Running setup.py install for docopt: finished with status 'done'", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-02-12T17:13:25.843 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:25 +0000 (0:00:02.335) 0:03:59.635 ******* 2021-02-12T17:13:25.873 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-02-12T17:13:25.874 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:25.922 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:25 +0000 (0:00:00.078) 0:03:59.714 ******* 2021-02-12T17:13:25.923 INFO:teuthology.task.ansible.out: 2021-02-12T17:13:25.950 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-02-12T17:13:25.952 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : Install registries-conf-ctl] **************************** changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-nalw2ekk-build\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nInstalling collected packages: toml, docopt, registries-conf-ctl\n Running setup.py install for docopt: started\n Running setup.py install for docopt: finished with status 'done'\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-nalw2ekk-build", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.or 2021-02-12T17:13:25.953 INFO:teuthology.task.ansible.out:g/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Installing collected packages: toml, docopt, registries-conf-ctl", " Running setup.py install for docopt: started", " Running setup.py install for docopt: finished with status 'done'", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-02-12T17:13:25.994 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:25 +0000 (0:00:00.072) 0:03:59.786 ******* 2021-02-12T17:13:26.034 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:26 +0000 (0:00:00.038) 0:03:59.825 ******* 2021-02-12T17:13:26.073 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-02-12T17:13:26.073 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:26.111 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:26 +0000 (0:00:00.077) 0:03:59.903 ******* 2021-02-12T17:13:26.150 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-02-12T17:13:26.151 INFO:teuthology.task.ansible.out:skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:26.194 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:26 +0000 (0:00:00.082) 0:03:59.986 ******* 2021-02-12T17:13:26.275 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-02-12T17:13:26.277 INFO:teuthology.task.ansible.out:changed: [gibba002.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.122013", "end": "2021-02-12 17:13:26.252975", "rc": 0, "start": "2021-02-12 17:13:26.130962", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:26.313 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:26 +0000 (0:00:00.119) 0:04:00.105 ******* 2021-02-12T17:13:26.352 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-02-12T17:13:26.354 INFO:teuthology.task.ansible.out:skipping: [gibba002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:26.482 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-02-12T17:13:26.483 INFO:teuthology.task.ansible.out:changed: [gibba004.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.124904", "end": "2021-02-12 17:13:26.464538", "rc": 0, "start": "2021-02-12 17:13:26.339634", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-12T17:13:26.525 INFO:teuthology.task.ansible.out:Friday 12 February 2021 17:13:26 +0000 (0:00:00.211) 0:04:00.317 ******* 2021-02-12T17:13:26.563 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* skipping: [gibba004.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-12T17:13:26.676 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-02-12T17:13:26.681 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-02-12T17:13:26.685 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* 2021-02-12T17:13:26.686 INFO:teuthology.task.ansible.out:gibba002.front.sepia.ceph.com : ok=126 changed=46 unreachable=0 failed=0 skipped=184 rescued=0 ignored=3 gibba004.front.sepia.ceph.com : ok=126 changed=46 unreachable=0 failed=0 skipped=184 rescued=0 ignored=3 Friday 12 February 2021 17:13:26 +0000 (0:00:00.160) 0:04:00.477 ******* =============================================================================== testnode : Install packages -------------------------------------------- 40.06s users : Create all admin users with sudo access. ----------------------- 25.62s common : nrpe - Ensure SELinux policy is up to date -------------------- 25.09s users : Update authorized_keys using the keys repo --------------------- 22.93s common : nrpe - Remove SELinux policy package -------------------------- 10.11s common : nrpe - Load SELinux policy package ----------------------------- 9.84s users : Remove revoked users -------------------------------------------- 8.12s testnode : Zap all non-root disks --------------------------------------- 6.46s common : Install Kerberos Packages (RedHat) ----------------------------- 6.19s testnode : Make sure rpm dependencies are installed --------------------- 3.55s common : Make sure smartmontools is installed --------------------------- 2.52s container-host : Install registries-conf-ctl ---------------------------- 2.34s common : nrpe - Install SELinux dependencies ---------------------------- 2.29s testnode : Ensure ceph packages are not present. ------------------------ 1.89s testnode : Rebuild rpmdb ------------------------------------------------ 1.74s users : Update authorized_keys for each user with literal keys ---------- 1.69s testnode : Ensure ceph dependency packages are not present. ------------- 1.54s Gathering Facts --------------------------------------------------------- 1.41s testnode : Configure local mirrorlists ---------------------------------- 1.06s testnode : Blow away lingering OSD data and FSIDs - 2021-02-12T17:13:26.688 INFO:teuthology.task.ansible.out:---------------------- 1.05s 2021-02-12T17:13:27.069 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@gibba002.front.sepia.ceph.com'), Remote(name='ubuntu@gibba004.front.sepia.ceph.com')] 2021-02-12T17:13:27.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-12T17:13:27.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-12T17:13:27.140 DEBUG:teuthology.orchestra.run.gibba002:> true 2021-02-12T17:13:27.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-12T17:13:27.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-12T17:13:27.284 DEBUG:teuthology.orchestra.run.gibba004:> true 2021-02-12T17:13:27.366 INFO:teuthology.run_tasks:Running task clock... 2021-02-12T17:13:27.377 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-02-12T17:13:27.378 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-12T17:13:27.379 DEBUG:teuthology.orchestra.run.gibba002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-12T17:13:27.404 INFO:teuthology.orchestra.run.gibba002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-02-12T17:13:27.415 INFO:teuthology.orchestra.run.gibba002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-02-12T17:13:27.444 INFO:teuthology.orchestra.run.gibba002.stderr:sudo: ntpd: command not found 2021-02-12T17:13:27.452 INFO:teuthology.orchestra.run.gibba002.stdout:506 Cannot talk to daemon 2021-02-12T17:13:27.463 INFO:teuthology.orchestra.run.gibba002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-02-12T17:13:27.475 INFO:teuthology.orchestra.run.gibba002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-02-12T17:13:27.525 INFO:teuthology.orchestra.run.gibba002.stderr:bash: ntpq: command not found 2021-02-12T17:13:27.529 INFO:teuthology.orchestra.run.gibba002.stdout:210 Number of sources = 4 2021-02-12T17:13:27.529 INFO:teuthology.orchestra.run.gibba002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-02-12T17:13:27.529 INFO:teuthology.orchestra.run.gibba002.stdout:=============================================================================== 2021-02-12T17:13:27.529 INFO:teuthology.orchestra.run.gibba002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-12T17:13:27.529 INFO:teuthology.orchestra.run.gibba002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-12T17:13:27.529 INFO:teuthology.orchestra.run.gibba002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-12T17:13:27.529 INFO:teuthology.orchestra.run.gibba002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-12T17:13:27.529 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-12T17:13:27.530 DEBUG:teuthology.orchestra.run.gibba004:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-12T17:13:27.554 INFO:teuthology.orchestra.run.gibba004.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-02-12T17:13:27.565 INFO:teuthology.orchestra.run.gibba004.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-02-12T17:13:27.617 INFO:teuthology.orchestra.run.gibba004.stderr:sudo: ntpd: command not found 2021-02-12T17:13:27.625 INFO:teuthology.orchestra.run.gibba004.stdout:506 Cannot talk to daemon 2021-02-12T17:13:27.637 INFO:teuthology.orchestra.run.gibba004.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-02-12T17:13:27.648 INFO:teuthology.orchestra.run.gibba004.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-02-12T17:13:27.708 INFO:teuthology.orchestra.run.gibba004.stderr:bash: ntpq: command not found 2021-02-12T17:13:27.711 INFO:teuthology.orchestra.run.gibba004.stdout:210 Number of sources = 4 2021-02-12T17:13:27.711 INFO:teuthology.orchestra.run.gibba004.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-02-12T17:13:27.711 INFO:teuthology.orchestra.run.gibba004.stdout:=============================================================================== 2021-02-12T17:13:27.711 INFO:teuthology.orchestra.run.gibba004.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-12T17:13:27.711 INFO:teuthology.orchestra.run.gibba004.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-12T17:13:27.711 INFO:teuthology.orchestra.run.gibba004.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-12T17:13:27.711 INFO:teuthology.orchestra.run.gibba004.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-12T17:13:27.712 INFO:teuthology.run_tasks:Running task install... 2021-02-12T17:13:28.100 DEBUG:teuthology.task.install:project ceph 2021-02-12T17:13:28.100 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '4819f209edcf86cf21724c2e068d1a90ce8b9945'}} 2021-02-12T17:13:28.100 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '4819f209edcf86cf21724c2e068d1a90ce8b9945'} 2021-02-12T17:13:28.100 INFO:teuthology.task.install:Using flavor: basic 2021-02-12T17:13:28.106 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-02-12T17:13:28.106 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2021-02-12T17:13:28.107 DEBUG:teuthology.orchestra.run.gibba002:> sudo lsb_release -is 2021-02-12T17:13:28.134 INFO:teuthology.orchestra.run.gibba002.stdout:CentOS 2021-02-12T17:13:28.134 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-12T17:13:28.135 DEBUG:teuthology.orchestra.run.gibba004:> sudo lsb_release -is 2021-02-12T17:13:28.135 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4819f209edcf86cf21724c2e068d1a90ce8b9945', 'tag': None, 'wait_for_package': False} 2021-02-12T17:13:28.135 DEBUG:teuthology.orchestra.run.gibba002:> sudo lsb_release -is 2021-02-12T17:13:28.161 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS 2021-02-12T17:13:28.162 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-12T17:13:28.162 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4819f209edcf86cf21724c2e068d1a90ce8b9945', 'tag': None, 'wait_for_package': False} 2021-02-12T17:13:28.163 DEBUG:teuthology.orchestra.run.gibba004:> sudo lsb_release -is 2021-02-12T17:13:28.200 INFO:teuthology.orchestra.run.gibba002.stdout:CentOS 2021-02-12T17:13:28.201 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-12T17:13:28.202 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4819f209edcf86cf21724c2e068d1a90ce8b9945 2021-02-12T17:13:28.238 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS 2021-02-12T17:13:28.239 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-12T17:13:28.239 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4819f209edcf86cf21724c2e068d1a90ce8b9945 2021-02-12T17:13:28.373 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/master/4819f209edcf86cf21724c2e068d1a90ce8b9945/centos/8/flavors/default/ 2021-02-12T17:13:28.374 INFO:teuthology.task.install.rpm:Package version is 17.0.0-720.g4819f209 2021-02-12T17:13:28.412 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/master/4819f209edcf86cf21724c2e068d1a90ce8b9945/centos/8/flavors/default/ 2021-02-12T17:13:28.412 INFO:teuthology.task.install.rpm:Package version is 17.0.0-720.g4819f209 2021-02-12T17:13:28.508 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/master/4819f209edcf86cf21724c2e068d1a90ce8b9945/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/master/4819f209edcf86cf21724c2e068d1a90ce8b9945/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/master/4819f209edcf86cf21724c2e068d1a90ce8b9945/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-02-12T17:13:28.508 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:13:28.509 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-02-12T17:13:28.529 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2021-02-12T17:13:28.529 DEBUG:teuthology.orchestra.run.gibba002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4819f209edcf86cf21724c2e068d1a90ce8b9945/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-02-12T17:13:28.583 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/master/4819f209edcf86cf21724c2e068d1a90ce8b9945/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/master/4819f209edcf86cf21724c2e068d1a90ce8b9945/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/master/4819f209edcf86cf21724c2e068d1a90ce8b9945/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-02-12T17:13:28.584 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:13:28.584 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-02-12T17:13:28.591 DEBUG:teuthology.orchestra.run.gibba002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-02-12T17:13:28.606 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2021-02-12T17:13:28.606 DEBUG:teuthology.orchestra.run.gibba004:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4819f209edcf86cf21724c2e068d1a90ce8b9945/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-02-12T17:13:28.658 DEBUG:teuthology.orchestra.run.gibba002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-02-12T17:13:28.667 DEBUG:teuthology.orchestra.run.gibba004:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-02-12T17:13:28.718 INFO:teuthology.orchestra.run.gibba002.stdout:check_obsoletes = 1 2021-02-12T17:13:28.719 DEBUG:teuthology.orchestra.run.gibba002:> sudo yum clean all 2021-02-12T17:13:28.735 DEBUG:teuthology.orchestra.run.gibba004:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-02-12T17:13:28.793 INFO:teuthology.orchestra.run.gibba004.stdout:check_obsoletes = 1 2021-02-12T17:13:28.794 DEBUG:teuthology.orchestra.run.gibba004:> sudo yum clean all 2021-02-12T17:13:28.984 INFO:teuthology.orchestra.run.gibba002.stdout:107 files removed 2021-02-12T17:13:29.003 DEBUG:teuthology.orchestra.run.gibba002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2021-02-12T17:13:29.054 INFO:teuthology.orchestra.run.gibba004.stdout:107 files removed 2021-02-12T17:13:29.073 DEBUG:teuthology.orchestra.run.gibba004:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2021-02-12T17:13:29.996 INFO:teuthology.orchestra.run.gibba002.stdout:ceph packages for x86_64 101 kB/s | 73 kB 00:00 2021-02-12T17:13:30.083 INFO:teuthology.orchestra.run.gibba004.stdout:ceph packages for x86_64 99 kB/s | 73 kB 00:00 2021-02-12T17:13:30.296 INFO:teuthology.orchestra.run.gibba002.stdout:ceph noarch packages 56 kB/s | 15 kB 00:00 2021-02-12T17:13:30.329 INFO:teuthology.orchestra.run.gibba004.stdout:ceph noarch packages 69 kB/s | 15 kB 00:00 2021-02-12T17:13:30.519 INFO:teuthology.orchestra.run.gibba002.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2021-02-12T17:13:30.553 INFO:teuthology.orchestra.run.gibba004.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2021-02-12T17:13:30.684 INFO:teuthology.orchestra.run.gibba002.stdout:CentOS-8 - AppStream 42 MB/s | 6.3 MB 00:00 2021-02-12T17:13:30.724 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS-8 - AppStream 41 MB/s | 6.3 MB 00:00 2021-02-12T17:13:31.518 INFO:teuthology.orchestra.run.gibba002.stdout:CentOS-8 - Base 27 MB/s | 2.3 MB 00:00 2021-02-12T17:13:31.582 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS-8 - Base 27 MB/s | 2.3 MB 00:00 2021-02-12T17:13:31.877 INFO:teuthology.orchestra.run.gibba002.stdout:CentOS-8 - Extras 123 kB/s | 8.6 kB 00:00 2021-02-12T17:13:31.930 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS-8 - Extras 137 kB/s | 8.6 kB 00:00 2021-02-12T17:13:32.333 INFO:teuthology.orchestra.run.gibba002.stdout:Extra Packages for Enterprise Linux 21 MB/s | 8.9 MB 00:00 2021-02-12T17:13:32.460 INFO:teuthology.orchestra.run.gibba004.stdout:Extra Packages for Enterprise Linux 18 MB/s | 8.9 MB 00:00 2021-02-12T17:13:33.698 INFO:teuthology.orchestra.run.gibba002.stdout:lab-extras 3.8 MB/s | 24 kB 00:00 2021-02-12T17:13:33.823 INFO:teuthology.orchestra.run.gibba004.stdout:lab-extras 5.0 MB/s | 24 kB 00:00 2021-02-12T17:13:34.504 INFO:teuthology.orchestra.run.gibba002.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2021-02-12T17:13:34.505 INFO:teuthology.orchestra.run.gibba002.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2021-02-12T17:13:34.508 INFO:teuthology.orchestra.run.gibba002.stdout:Package NetworkManager-1:1.22.8-4.el8.x86_64 is already installed. 2021-02-12T17:13:34.508 INFO:teuthology.orchestra.run.gibba002.stdout:Package iproute-5.3.0-1.el8.x86_64 is already installed. 2021-02-12T17:13:34.509 INFO:teuthology.orchestra.run.gibba002.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2021-02-12T17:13:34.509 INFO:teuthology.orchestra.run.gibba002.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2021-02-12T17:13:34.510 INFO:teuthology.orchestra.run.gibba002.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2021-02-12T17:13:34.510 INFO:teuthology.orchestra.run.gibba002.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2021-02-12T17:13:34.511 INFO:teuthology.orchestra.run.gibba002.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2021-02-12T17:13:34.615 INFO:teuthology.orchestra.run.gibba002.stdout:Dependencies resolved. 2021-02-12T17:13:34.630 INFO:teuthology.orchestra.run.gibba002.stdout:===================================================================================================== 2021-02-12T17:13:34.630 INFO:teuthology.orchestra.run.gibba002.stdout: Package Arch Version Repository Size 2021-02-12T17:13:34.630 INFO:teuthology.orchestra.run.gibba002.stdout:===================================================================================================== 2021-02-12T17:13:34.630 INFO:teuthology.orchestra.run.gibba002.stdout:Installing: 2021-02-12T17:13:34.630 INFO:teuthology.orchestra.run.gibba002.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2021-02-12T17:13:34.630 INFO:teuthology.orchestra.run.gibba002.stdout: ceph x86_64 2:17.0.0-720.g4819f209.el8 ceph 6.4 k 2021-02-12T17:13:34.630 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-base x86_64 2:17.0.0-720.g4819f209.el8 ceph 5.9 M 2021-02-12T17:13:34.630 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-fuse x86_64 2:17.0.0-720.g4819f209.el8 ceph 875 k 2021-02-12T17:13:34.630 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-720.g4819f209.el8 ceph 161 k 2021-02-12T17:13:34.631 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mgr x86_64 2:17.0.0-720.g4819f209.el8 ceph 1.5 M 2021-02-12T17:13:34.631 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mgr-cephadm noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 79 k 2021-02-12T17:13:34.631 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mgr-dashboard noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 2.6 M 2021-02-12T17:13:34.631 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 8.6 M 2021-02-12T17:13:34.631 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mgr-rook noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 28 k 2021-02-12T17:13:34.631 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-radosgw x86_64 2:17.0.0-720.g4819f209.el8 ceph 12 M 2021-02-12T17:13:34.631 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-test x86_64 2:17.0.0-720.g4819f209.el8 ceph 51 M 2021-02-12T17:13:34.631 INFO:teuthology.orchestra.run.gibba002.stdout: cephadm noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 69 k 2021-02-12T17:13:34.631 INFO:teuthology.orchestra.run.gibba002.stdout: cephfs-mirror x86_64 2:17.0.0-720.g4819f209.el8 ceph 216 k 2021-02-12T17:13:34.631 INFO:teuthology.orchestra.run.gibba002.stdout: cephfs-top noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 13 k 2021-02-12T17:13:34.631 INFO:teuthology.orchestra.run.gibba002.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 CentOS-Base 58 k 2021-02-12T17:13:34.631 INFO:teuthology.orchestra.run.gibba002.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2021-02-12T17:13:34.632 INFO:teuthology.orchestra.run.gibba002.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-Base 19 k 2021-02-12T17:13:34.632 INFO:teuthology.orchestra.run.gibba002.stdout: libcephfs-devel x86_64 2:17.0.0-720.g4819f209.el8 ceph 24 k 2021-02-12T17:13:34.632 INFO:teuthology.orchestra.run.gibba002.stdout: libcephfs2 x86_64 2:17.0.0-720.g4819f209.el8 ceph 792 k 2021-02-12T17:13:34.632 INFO:teuthology.orchestra.run.gibba002.stdout: librados-devel x86_64 2:17.0.0-720.g4819f209.el8 ceph 131 k 2021-02-12T17:13:34.632 INFO:teuthology.orchestra.run.gibba002.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2021-02-12T17:13:34.632 INFO:teuthology.orchestra.run.gibba002.stdout: libuuid-devel x86_64 2.32.1-24.el8 CentOS-Base 96 k 2021-02-12T17:13:34.632 INFO:teuthology.orchestra.run.gibba002.stdout: openssl-devel x86_64 1:1.1.1g-12.el8_3 CentOS-Base 2.3 M 2021-02-12T17:13:34.632 INFO:teuthology.orchestra.run.gibba002.stdout: python3-cephfs x86_64 2:17.0.0-720.g4819f209.el8 ceph 186 k 2021-02-12T17:13:34.632 INFO:teuthology.orchestra.run.gibba002.stdout: python3-rados x86_64 2:17.0.0-720.g4819f209.el8 ceph 387 k 2021-02-12T17:13:34.632 INFO:teuthology.orchestra.run.gibba002.stdout: python3-rbd x86_64 2:17.0.0-720.g4819f209.el8 ceph 368 k 2021-02-12T17:13:34.633 INFO:teuthology.orchestra.run.gibba002.stdout: python3-rgw x86_64 2:17.0.0-720.g4819f209.el8 ceph 114 k 2021-02-12T17:13:34.633 INFO:teuthology.orchestra.run.gibba002.stdout: rbd-fuse x86_64 2:17.0.0-720.g4819f209.el8 ceph 88 k 2021-02-12T17:13:34.633 INFO:teuthology.orchestra.run.gibba002.stdout: rbd-mirror x86_64 2:17.0.0-720.g4819f209.el8 ceph 3.7 M 2021-02-12T17:13:34.633 INFO:teuthology.orchestra.run.gibba002.stdout: rbd-nbd x86_64 2:17.0.0-720.g4819f209.el8 ceph 171 k 2021-02-12T17:13:34.633 INFO:teuthology.orchestra.run.gibba002.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 CentOS-Base 69 k 2021-02-12T17:13:34.633 INFO:teuthology.orchestra.run.gibba002.stdout:Upgrading: 2021-02-12T17:13:34.633 INFO:teuthology.orchestra.run.gibba002.stdout: NetworkManager x86_64 1:1.26.0-12.el8_3 CentOS-Base 2.4 M 2021-02-12T17:13:34.633 INFO:teuthology.orchestra.run.gibba002.stdout: NetworkManager-libnm x86_64 1:1.26.0-12.el8_3 CentOS-Base 1.8 M 2021-02-12T17:13:34.633 INFO:teuthology.orchestra.run.gibba002.stdout: NetworkManager-team x86_64 1:1.26.0-12.el8_3 CentOS-Base 142 k 2021-02-12T17:13:34.634 INFO:teuthology.orchestra.run.gibba002.stdout: NetworkManager-tui x86_64 1:1.26.0-12.el8_3 CentOS-Base 320 k 2021-02-12T17:13:34.634 INFO:teuthology.orchestra.run.gibba002.stdout: e2fsprogs x86_64 1.45.6-1.el8 CentOS-Base 1.0 M 2021-02-12T17:13:34.634 INFO:teuthology.orchestra.run.gibba002.stdout: e2fsprogs-libs x86_64 1.45.6-1.el8 CentOS-Base 233 k 2021-02-12T17:13:34.634 INFO:teuthology.orchestra.run.gibba002.stdout: elfutils-libelf x86_64 0.180-1.el8 CentOS-Base 215 k 2021-02-12T17:13:34.634 INFO:teuthology.orchestra.run.gibba002.stdout: elfutils-libs x86_64 0.180-1.el8 CentOS-Base 293 k 2021-02-12T17:13:34.634 INFO:teuthology.orchestra.run.gibba002.stdout: iproute x86_64 5.3.0-5.el8 CentOS-Base 665 k 2021-02-12T17:13:34.634 INFO:teuthology.orchestra.run.gibba002.stdout: libcom_err x86_64 1.45.6-1.el8 CentOS-Base 49 k 2021-02-12T17:13:34.634 INFO:teuthology.orchestra.run.gibba002.stdout: librados2 x86_64 2:17.0.0-720.g4819f209.el8 ceph 3.7 M 2021-02-12T17:13:34.635 INFO:teuthology.orchestra.run.gibba002.stdout: librbd1 x86_64 2:17.0.0-720.g4819f209.el8 ceph 3.2 M 2021-02-12T17:13:34.635 INFO:teuthology.orchestra.run.gibba002.stdout: libselinux x86_64 2.9-4.el8_3 CentOS-Base 165 k 2021-02-12T17:13:34.635 INFO:teuthology.orchestra.run.gibba002.stdout: libselinux-utils x86_64 2.9-4.el8_3 CentOS-Base 242 k 2021-02-12T17:13:34.635 INFO:teuthology.orchestra.run.gibba002.stdout: libss x86_64 1.45.6-1.el8 CentOS-Base 53 k 2021-02-12T17:13:34.635 INFO:teuthology.orchestra.run.gibba002.stdout: pcre2 x86_64 10.32-2.el8 CentOS-Base 246 k 2021-02-12T17:13:34.635 INFO:teuthology.orchestra.run.gibba002.stdout: python3-libselinux x86_64 2.9-4.el8_3 CentOS-Base 283 k 2021-02-12T17:13:34.635 INFO:teuthology.orchestra.run.gibba002.stdout: zlib x86_64 1.2.11-16.el8_2 CentOS-Base 102 k 2021-02-12T17:13:34.635 INFO:teuthology.orchestra.run.gibba002.stdout:Installing dependencies: 2021-02-12T17:13:34.635 INFO:teuthology.orchestra.run.gibba002.stdout: automake noarch 1.16.1-6.el8 CentOS-AppStream 713 k 2021-02-12T17:13:34.635 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-common x86_64 2:17.0.0-720.g4819f209.el8 ceph 24 M 2021-02-12T17:13:34.636 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-grafana-dashboards noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 24 k 2021-02-12T17:13:34.636 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mds x86_64 2:17.0.0-720.g4819f209.el8 ceph 2.4 M 2021-02-12T17:13:34.636 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mgr-modules-core noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 222 k 2021-02-12T17:13:34.636 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mon x86_64 2:17.0.0-720.g4819f209.el8 ceph 4.9 M 2021-02-12T17:13:34.636 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-osd x86_64 2:17.0.0-720.g4819f209.el8 ceph 18 M 2021-02-12T17:13:34.636 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-prometheus-alerts noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 8.9 k 2021-02-12T17:13:34.636 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-selinux x86_64 2:17.0.0-720.g4819f209.el8 ceph 25 k 2021-02-12T17:13:34.636 INFO:teuthology.orchestra.run.gibba002.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-02-12T17:13:34.636 INFO:teuthology.orchestra.run.gibba002.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-02-12T17:13:34.637 INFO:teuthology.orchestra.run.gibba002.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2021-02-12T17:13:34.637 INFO:teuthology.orchestra.run.gibba002.stdout: gperftools-libs x86_64 2.8-1.el8 epel 306 k 2021-02-12T17:13:34.637 INFO:teuthology.orchestra.run.gibba002.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-02-12T17:13:34.637 INFO:teuthology.orchestra.run.gibba002.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 CentOS-Base 48 k 2021-02-12T17:13:34.637 INFO:teuthology.orchestra.run.gibba002.stdout: krb5-devel x86_64 1.18.2-5.el8 CentOS-Base 558 k 2021-02-12T17:13:34.637 INFO:teuthology.orchestra.run.gibba002.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-02-12T17:13:34.637 INFO:teuthology.orchestra.run.gibba002.stdout: libcom_err-devel x86_64 1.45.6-1.el8 CentOS-Base 38 k 2021-02-12T17:13:34.637 INFO:teuthology.orchestra.run.gibba002.stdout: libgfortran x86_64 8.3.1-5.1.el8 CentOS-Base 639 k 2021-02-12T17:13:34.637 INFO:teuthology.orchestra.run.gibba002.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-02-12T17:13:34.637 INFO:teuthology.orchestra.run.gibba002.stdout: libquadmath x86_64 8.3.1-5.1.el8 CentOS-Base 169 k 2021-02-12T17:13:34.637 INFO:teuthology.orchestra.run.gibba002.stdout: librabbitmq x86_64 0.9.0-2.el8 CentOS-Base 47 k 2021-02-12T17:13:34.638 INFO:teuthology.orchestra.run.gibba002.stdout: libradosstriper1 x86_64 2:17.0.0-720.g4819f209.el8 ceph 481 k 2021-02-12T17:13:34.638 INFO:teuthology.orchestra.run.gibba002.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-02-12T17:13:34.638 INFO:teuthology.orchestra.run.gibba002.stdout: librgw2 x86_64 2:17.0.0-720.g4819f209.el8 ceph 4.0 M 2021-02-12T17:13:34.638 INFO:teuthology.orchestra.run.gibba002.stdout: libselinux-devel x86_64 2.9-4.el8_3 CentOS-Base 199 k 2021-02-12T17:13:34.638 INFO:teuthology.orchestra.run.gibba002.stdout: libsepol-devel x86_64 2.9-1.el8 CentOS-Base 86 k 2021-02-12T17:13:34.638 INFO:teuthology.orchestra.run.gibba002.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-02-12T17:13:34.638 INFO:teuthology.orchestra.run.gibba002.stdout: libverto-devel x86_64 0.3.0-5.el8 CentOS-Base 18 k 2021-02-12T17:13:34.639 INFO:teuthology.orchestra.run.gibba002.stdout: libxslt x86_64 1.1.32-5.el8 CentOS-Base 250 k 2021-02-12T17:13:34.639 INFO:teuthology.orchestra.run.gibba002.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-02-12T17:13:34.639 INFO:teuthology.orchestra.run.gibba002.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-02-12T17:13:34.639 INFO:teuthology.orchestra.run.gibba002.stdout: openblas x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-02-12T17:13:34.639 INFO:teuthology.orchestra.run.gibba002.stdout: openblas-threads x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-02-12T17:13:34.639 INFO:teuthology.orchestra.run.gibba002.stdout: pcre2-devel x86_64 10.32-2.el8 CentOS-Base 605 k 2021-02-12T17:13:34.639 INFO:teuthology.orchestra.run.gibba002.stdout: pcre2-utf16 x86_64 10.32-2.el8 CentOS-Base 229 k 2021-02-12T17:13:34.639 INFO:teuthology.orchestra.run.gibba002.stdout: pcre2-utf32 x86_64 10.32-2.el8 CentOS-Base 220 k 2021-02-12T17:13:34.639 INFO:teuthology.orchestra.run.gibba002.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-02-12T17:13:34.639 INFO:teuthology.orchestra.run.gibba002.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-02-12T17:13:34.639 INFO:teuthology.orchestra.run.gibba002.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-02-12T17:13:34.639 INFO:teuthology.orchestra.run.gibba002.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-02-12T17:13:34.639 INFO:teuthology.orchestra.run.gibba002.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-02-12T17:13:34.640 INFO:teuthology.orchestra.run.gibba002.stdout: python3-ceph-argparse x86_64 2:17.0.0-720.g4819f209.el8 ceph 44 k 2021-02-12T17:13:34.640 INFO:teuthology.orchestra.run.gibba002.stdout: python3-ceph-common x86_64 2:17.0.0-720.g4819f209.el8 ceph 77 k 2021-02-12T17:13:34.640 INFO:teuthology.orchestra.run.gibba002.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-02-12T17:13:34.640 INFO:teuthology.orchestra.run.gibba002.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-02-12T17:13:34.640 INFO:teuthology.orchestra.run.gibba002.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-02-12T17:13:34.640 INFO:teuthology.orchestra.run.gibba002.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-02-12T17:13:34.640 INFO:teuthology.orchestra.run.gibba002.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-02-12T17:13:34.640 INFO:teuthology.orchestra.run.gibba002.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-02-12T17:13:34.640 INFO:teuthology.orchestra.run.gibba002.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-02-12T17:13:34.640 INFO:teuthology.orchestra.run.gibba002.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-02-12T17:13:34.640 INFO:teuthology.orchestra.run.gibba002.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-02-12T17:13:34.640 INFO:teuthology.orchestra.run.gibba002.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-02-12T17:13:34.640 INFO:teuthology.orchestra.run.gibba002.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-02-12T17:13:34.641 INFO:teuthology.orchestra.run.gibba002.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-02-12T17:13:34.641 INFO:teuthology.orchestra.run.gibba002.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-02-12T17:13:34.641 INFO:teuthology.orchestra.run.gibba002.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-02-12T17:13:34.641 INFO:teuthology.orchestra.run.gibba002.stdout: python3-lxml x86_64 4.2.3-1.el8 CentOS-AppStream 1.5 M 2021-02-12T17:13:34.641 INFO:teuthology.orchestra.run.gibba002.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-02-12T17:13:34.641 INFO:teuthology.orchestra.run.gibba002.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-02-12T17:13:34.641 INFO:teuthology.orchestra.run.gibba002.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-02-12T17:13:34.641 INFO:teuthology.orchestra.run.gibba002.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-02-12T17:13:34.641 INFO:teuthology.orchestra.run.gibba002.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-02-12T17:13:34.641 INFO:teuthology.orchestra.run.gibba002.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-02-12T17:13:34.641 INFO:teuthology.orchestra.run.gibba002.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-02-12T17:13:34.641 INFO:teuthology.orchestra.run.gibba002.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-02-12T17:13:34.641 INFO:teuthology.orchestra.run.gibba002.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-02-12T17:13:34.642 INFO:teuthology.orchestra.run.gibba002.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-02-12T17:13:34.642 INFO:teuthology.orchestra.run.gibba002.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-02-12T17:13:34.642 INFO:teuthology.orchestra.run.gibba002.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-02-12T17:13:34.642 INFO:teuthology.orchestra.run.gibba002.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-02-12T17:13:34.642 INFO:teuthology.orchestra.run.gibba002.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-02-12T17:13:34.642 INFO:teuthology.orchestra.run.gibba002.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-02-12T17:13:34.642 INFO:teuthology.orchestra.run.gibba002.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-02-12T17:13:34.642 INFO:teuthology.orchestra.run.gibba002.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-02-12T17:13:34.642 INFO:teuthology.orchestra.run.gibba002.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-02-12T17:13:34.642 INFO:teuthology.orchestra.run.gibba002.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-02-12T17:13:34.642 INFO:teuthology.orchestra.run.gibba002.stdout: python3-scipy x86_64 1.0.0-20.module_el8.3.0+562+e162826a CentOS-AppStream 15 M 2021-02-12T17:13:34.642 INFO:teuthology.orchestra.run.gibba002.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-02-12T17:13:34.643 INFO:teuthology.orchestra.run.gibba002.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-02-12T17:13:34.643 INFO:teuthology.orchestra.run.gibba002.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-02-12T17:13:34.643 INFO:teuthology.orchestra.run.gibba002.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-02-12T17:13:34.643 INFO:teuthology.orchestra.run.gibba002.stdout: python3-urllib3 noarch 1.24.2-4.el8 CentOS-Base 176 k 2021-02-12T17:13:34.643 INFO:teuthology.orchestra.run.gibba002.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-02-12T17:13:34.643 INFO:teuthology.orchestra.run.gibba002.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-02-12T17:13:34.643 INFO:teuthology.orchestra.run.gibba002.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-02-12T17:13:34.643 INFO:teuthology.orchestra.run.gibba002.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-02-12T17:13:34.643 INFO:teuthology.orchestra.run.gibba002.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-02-12T17:13:34.643 INFO:teuthology.orchestra.run.gibba002.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-02-12T17:13:34.643 INFO:teuthology.orchestra.run.gibba002.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-02-12T17:13:34.643 INFO:teuthology.orchestra.run.gibba002.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-02-12T17:13:34.644 INFO:teuthology.orchestra.run.gibba002.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-02-12T17:13:34.644 INFO:teuthology.orchestra.run.gibba002.stdout: zlib-devel x86_64 1.2.11-16.el8_2 CentOS-Base 57 k 2021-02-12T17:13:34.644 INFO:teuthology.orchestra.run.gibba002.stdout:Installing weak dependencies: 2021-02-12T17:13:34.644 INFO:teuthology.orchestra.run.gibba002.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-02-12T17:13:34.644 INFO:teuthology.orchestra.run.gibba002.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-02-12T17:13:34.644 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:13:34.644 INFO:teuthology.orchestra.run.gibba002.stdout:Transaction Summary 2021-02-12T17:13:34.644 INFO:teuthology.orchestra.run.gibba002.stdout:===================================================================================================== 2021-02-12T17:13:34.644 INFO:teuthology.orchestra.run.gibba002.stdout:Install 128 Packages 2021-02-12T17:13:34.645 INFO:teuthology.orchestra.run.gibba002.stdout:Upgrade 18 Packages 2021-02-12T17:13:34.645 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:13:34.645 INFO:teuthology.orchestra.run.gibba004.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2021-02-12T17:13:34.646 INFO:teuthology.orchestra.run.gibba004.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2021-02-12T17:13:34.646 INFO:teuthology.orchestra.run.gibba002.stdout:Total download size: 208 M 2021-02-12T17:13:34.646 INFO:teuthology.orchestra.run.gibba002.stdout:Downloading Packages: 2021-02-12T17:13:34.646 INFO:teuthology.orchestra.run.gibba004.stdout:Package NetworkManager-1:1.22.8-4.el8.x86_64 is already installed. 2021-02-12T17:13:34.647 INFO:teuthology.orchestra.run.gibba004.stdout:Package iproute-5.3.0-1.el8.x86_64 is already installed. 2021-02-12T17:13:34.647 INFO:teuthology.orchestra.run.gibba004.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2021-02-12T17:13:34.647 INFO:teuthology.orchestra.run.gibba004.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2021-02-12T17:13:34.648 INFO:teuthology.orchestra.run.gibba004.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2021-02-12T17:13:34.649 INFO:teuthology.orchestra.run.gibba004.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2021-02-12T17:13:34.649 INFO:teuthology.orchestra.run.gibba004.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2021-02-12T17:13:34.755 INFO:teuthology.orchestra.run.gibba004.stdout:Dependencies resolved. 2021-02-12T17:13:34.776 INFO:teuthology.orchestra.run.gibba004.stdout:===================================================================================================== 2021-02-12T17:13:34.777 INFO:teuthology.orchestra.run.gibba004.stdout: Package Arch Version Repository Size 2021-02-12T17:13:34.777 INFO:teuthology.orchestra.run.gibba004.stdout:===================================================================================================== 2021-02-12T17:13:34.777 INFO:teuthology.orchestra.run.gibba004.stdout:Installing: 2021-02-12T17:13:34.777 INFO:teuthology.orchestra.run.gibba004.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2021-02-12T17:13:34.777 INFO:teuthology.orchestra.run.gibba004.stdout: ceph x86_64 2:17.0.0-720.g4819f209.el8 ceph 6.4 k 2021-02-12T17:13:34.777 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-base x86_64 2:17.0.0-720.g4819f209.el8 ceph 5.9 M 2021-02-12T17:13:34.777 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-fuse x86_64 2:17.0.0-720.g4819f209.el8 ceph 875 k 2021-02-12T17:13:34.777 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-720.g4819f209.el8 ceph 161 k 2021-02-12T17:13:34.777 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mgr x86_64 2:17.0.0-720.g4819f209.el8 ceph 1.5 M 2021-02-12T17:13:34.777 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mgr-cephadm noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 79 k 2021-02-12T17:13:34.777 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mgr-dashboard noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 2.6 M 2021-02-12T17:13:34.777 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 8.6 M 2021-02-12T17:13:34.778 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mgr-rook noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 28 k 2021-02-12T17:13:34.778 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-radosgw x86_64 2:17.0.0-720.g4819f209.el8 ceph 12 M 2021-02-12T17:13:34.778 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-test x86_64 2:17.0.0-720.g4819f209.el8 ceph 51 M 2021-02-12T17:13:34.778 INFO:teuthology.orchestra.run.gibba004.stdout: cephadm noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 69 k 2021-02-12T17:13:34.778 INFO:teuthology.orchestra.run.gibba004.stdout: cephfs-mirror x86_64 2:17.0.0-720.g4819f209.el8 ceph 216 k 2021-02-12T17:13:34.778 INFO:teuthology.orchestra.run.gibba004.stdout: cephfs-top noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 13 k 2021-02-12T17:13:34.778 INFO:teuthology.orchestra.run.gibba004.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 CentOS-Base 58 k 2021-02-12T17:13:34.778 INFO:teuthology.orchestra.run.gibba004.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2021-02-12T17:13:34.778 INFO:teuthology.orchestra.run.gibba004.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-Base 19 k 2021-02-12T17:13:34.778 INFO:teuthology.orchestra.run.gibba004.stdout: libcephfs-devel x86_64 2:17.0.0-720.g4819f209.el8 ceph 24 k 2021-02-12T17:13:34.778 INFO:teuthology.orchestra.run.gibba004.stdout: libcephfs2 x86_64 2:17.0.0-720.g4819f209.el8 ceph 792 k 2021-02-12T17:13:34.778 INFO:teuthology.orchestra.run.gibba004.stdout: librados-devel x86_64 2:17.0.0-720.g4819f209.el8 ceph 131 k 2021-02-12T17:13:34.779 INFO:teuthology.orchestra.run.gibba004.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2021-02-12T17:13:34.779 INFO:teuthology.orchestra.run.gibba004.stdout: libuuid-devel x86_64 2.32.1-24.el8 CentOS-Base 96 k 2021-02-12T17:13:34.779 INFO:teuthology.orchestra.run.gibba004.stdout: openssl-devel x86_64 1:1.1.1g-12.el8_3 CentOS-Base 2.3 M 2021-02-12T17:13:34.779 INFO:teuthology.orchestra.run.gibba004.stdout: python3-cephfs x86_64 2:17.0.0-720.g4819f209.el8 ceph 186 k 2021-02-12T17:13:34.779 INFO:teuthology.orchestra.run.gibba004.stdout: python3-rados x86_64 2:17.0.0-720.g4819f209.el8 ceph 387 k 2021-02-12T17:13:34.779 INFO:teuthology.orchestra.run.gibba004.stdout: python3-rbd x86_64 2:17.0.0-720.g4819f209.el8 ceph 368 k 2021-02-12T17:13:34.779 INFO:teuthology.orchestra.run.gibba004.stdout: python3-rgw x86_64 2:17.0.0-720.g4819f209.el8 ceph 114 k 2021-02-12T17:13:34.779 INFO:teuthology.orchestra.run.gibba004.stdout: rbd-fuse x86_64 2:17.0.0-720.g4819f209.el8 ceph 88 k 2021-02-12T17:13:34.779 INFO:teuthology.orchestra.run.gibba004.stdout: rbd-mirror x86_64 2:17.0.0-720.g4819f209.el8 ceph 3.7 M 2021-02-12T17:13:34.779 INFO:teuthology.orchestra.run.gibba004.stdout: rbd-nbd x86_64 2:17.0.0-720.g4819f209.el8 ceph 171 k 2021-02-12T17:13:34.779 INFO:teuthology.orchestra.run.gibba004.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 CentOS-Base 69 k 2021-02-12T17:13:34.779 INFO:teuthology.orchestra.run.gibba004.stdout:Upgrading: 2021-02-12T17:13:34.779 INFO:teuthology.orchestra.run.gibba004.stdout: NetworkManager x86_64 1:1.26.0-12.el8_3 CentOS-Base 2.4 M 2021-02-12T17:13:34.780 INFO:teuthology.orchestra.run.gibba004.stdout: NetworkManager-libnm x86_64 1:1.26.0-12.el8_3 CentOS-Base 1.8 M 2021-02-12T17:13:34.780 INFO:teuthology.orchestra.run.gibba004.stdout: NetworkManager-team x86_64 1:1.26.0-12.el8_3 CentOS-Base 142 k 2021-02-12T17:13:34.780 INFO:teuthology.orchestra.run.gibba004.stdout: NetworkManager-tui x86_64 1:1.26.0-12.el8_3 CentOS-Base 320 k 2021-02-12T17:13:34.780 INFO:teuthology.orchestra.run.gibba004.stdout: e2fsprogs x86_64 1.45.6-1.el8 CentOS-Base 1.0 M 2021-02-12T17:13:34.780 INFO:teuthology.orchestra.run.gibba004.stdout: e2fsprogs-libs x86_64 1.45.6-1.el8 CentOS-Base 233 k 2021-02-12T17:13:34.780 INFO:teuthology.orchestra.run.gibba004.stdout: elfutils-libelf x86_64 0.180-1.el8 CentOS-Base 215 k 2021-02-12T17:13:34.780 INFO:teuthology.orchestra.run.gibba004.stdout: elfutils-libs x86_64 0.180-1.el8 CentOS-Base 293 k 2021-02-12T17:13:34.780 INFO:teuthology.orchestra.run.gibba004.stdout: iproute x86_64 5.3.0-5.el8 CentOS-Base 665 k 2021-02-12T17:13:34.780 INFO:teuthology.orchestra.run.gibba004.stdout: libcom_err x86_64 1.45.6-1.el8 CentOS-Base 49 k 2021-02-12T17:13:34.780 INFO:teuthology.orchestra.run.gibba004.stdout: librados2 x86_64 2:17.0.0-720.g4819f209.el8 ceph 3.7 M 2021-02-12T17:13:34.780 INFO:teuthology.orchestra.run.gibba004.stdout: librbd1 x86_64 2:17.0.0-720.g4819f209.el8 ceph 3.2 M 2021-02-12T17:13:34.780 INFO:teuthology.orchestra.run.gibba004.stdout: libselinux x86_64 2.9-4.el8_3 CentOS-Base 165 k 2021-02-12T17:13:34.780 INFO:teuthology.orchestra.run.gibba004.stdout: libselinux-utils x86_64 2.9-4.el8_3 CentOS-Base 242 k 2021-02-12T17:13:34.781 INFO:teuthology.orchestra.run.gibba004.stdout: libss x86_64 1.45.6-1.el8 CentOS-Base 53 k 2021-02-12T17:13:34.781 INFO:teuthology.orchestra.run.gibba004.stdout: pcre2 x86_64 10.32-2.el8 CentOS-Base 246 k 2021-02-12T17:13:34.781 INFO:teuthology.orchestra.run.gibba004.stdout: python3-libselinux x86_64 2.9-4.el8_3 CentOS-Base 283 k 2021-02-12T17:13:34.781 INFO:teuthology.orchestra.run.gibba004.stdout: zlib x86_64 1.2.11-16.el8_2 CentOS-Base 102 k 2021-02-12T17:13:34.781 INFO:teuthology.orchestra.run.gibba004.stdout:Installing dependencies: 2021-02-12T17:13:34.781 INFO:teuthology.orchestra.run.gibba004.stdout: automake noarch 1.16.1-6.el8 CentOS-AppStream 713 k 2021-02-12T17:13:34.781 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-common x86_64 2:17.0.0-720.g4819f209.el8 ceph 24 M 2021-02-12T17:13:34.781 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-grafana-dashboards noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 24 k 2021-02-12T17:13:34.781 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mds x86_64 2:17.0.0-720.g4819f209.el8 ceph 2.4 M 2021-02-12T17:13:34.781 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mgr-modules-core noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 222 k 2021-02-12T17:13:34.781 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mon x86_64 2:17.0.0-720.g4819f209.el8 ceph 4.9 M 2021-02-12T17:13:34.781 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-osd x86_64 2:17.0.0-720.g4819f209.el8 ceph 18 M 2021-02-12T17:13:34.781 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-prometheus-alerts noarch 2:17.0.0-720.g4819f209.el8 ceph-noarch 8.9 k 2021-02-12T17:13:34.782 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-selinux x86_64 2:17.0.0-720.g4819f209.el8 ceph 25 k 2021-02-12T17:13:34.782 INFO:teuthology.orchestra.run.gibba004.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-02-12T17:13:34.782 INFO:teuthology.orchestra.run.gibba004.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-02-12T17:13:34.782 INFO:teuthology.orchestra.run.gibba004.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2021-02-12T17:13:34.782 INFO:teuthology.orchestra.run.gibba004.stdout: gperftools-libs x86_64 2.8-1.el8 epel 306 k 2021-02-12T17:13:34.782 INFO:teuthology.orchestra.run.gibba004.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-02-12T17:13:34.782 INFO:teuthology.orchestra.run.gibba004.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 CentOS-Base 48 k 2021-02-12T17:13:34.782 INFO:teuthology.orchestra.run.gibba004.stdout: krb5-devel x86_64 1.18.2-5.el8 CentOS-Base 558 k 2021-02-12T17:13:34.782 INFO:teuthology.orchestra.run.gibba004.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-02-12T17:13:34.782 INFO:teuthology.orchestra.run.gibba004.stdout: libcom_err-devel x86_64 1.45.6-1.el8 CentOS-Base 38 k 2021-02-12T17:13:34.782 INFO:teuthology.orchestra.run.gibba004.stdout: libgfortran x86_64 8.3.1-5.1.el8 CentOS-Base 639 k 2021-02-12T17:13:34.782 INFO:teuthology.orchestra.run.gibba004.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-02-12T17:13:34.782 INFO:teuthology.orchestra.run.gibba004.stdout: libquadmath x86_64 8.3.1-5.1.el8 CentOS-Base 169 k 2021-02-12T17:13:34.783 INFO:teuthology.orchestra.run.gibba004.stdout: librabbitmq x86_64 0.9.0-2.el8 CentOS-Base 47 k 2021-02-12T17:13:34.783 INFO:teuthology.orchestra.run.gibba004.stdout: libradosstriper1 x86_64 2:17.0.0-720.g4819f209.el8 ceph 481 k 2021-02-12T17:13:34.783 INFO:teuthology.orchestra.run.gibba004.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-02-12T17:13:34.783 INFO:teuthology.orchestra.run.gibba004.stdout: librgw2 x86_64 2:17.0.0-720.g4819f209.el8 ceph 4.0 M 2021-02-12T17:13:34.783 INFO:teuthology.orchestra.run.gibba004.stdout: libselinux-devel x86_64 2.9-4.el8_3 CentOS-Base 199 k 2021-02-12T17:13:34.783 INFO:teuthology.orchestra.run.gibba004.stdout: libsepol-devel x86_64 2.9-1.el8 CentOS-Base 86 k 2021-02-12T17:13:34.783 INFO:teuthology.orchestra.run.gibba004.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-02-12T17:13:34.783 INFO:teuthology.orchestra.run.gibba004.stdout: libverto-devel x86_64 0.3.0-5.el8 CentOS-Base 18 k 2021-02-12T17:13:34.783 INFO:teuthology.orchestra.run.gibba004.stdout: libxslt x86_64 1.1.32-5.el8 CentOS-Base 250 k 2021-02-12T17:13:34.784 INFO:teuthology.orchestra.run.gibba004.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-02-12T17:13:34.784 INFO:teuthology.orchestra.run.gibba004.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-02-12T17:13:34.784 INFO:teuthology.orchestra.run.gibba004.stdout: openblas x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-02-12T17:13:34.784 INFO:teuthology.orchestra.run.gibba004.stdout: openblas-threads x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-02-12T17:13:34.784 INFO:teuthology.orchestra.run.gibba004.stdout: pcre2-devel x86_64 10.32-2.el8 CentOS-Base 605 k 2021-02-12T17:13:34.784 INFO:teuthology.orchestra.run.gibba004.stdout: pcre2-utf16 x86_64 10.32-2.el8 CentOS-Base 229 k 2021-02-12T17:13:34.784 INFO:teuthology.orchestra.run.gibba004.stdout: pcre2-utf32 x86_64 10.32-2.el8 CentOS-Base 220 k 2021-02-12T17:13:34.784 INFO:teuthology.orchestra.run.gibba004.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-02-12T17:13:34.784 INFO:teuthology.orchestra.run.gibba004.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-02-12T17:13:34.785 INFO:teuthology.orchestra.run.gibba004.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-02-12T17:13:34.785 INFO:teuthology.orchestra.run.gibba004.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-02-12T17:13:34.785 INFO:teuthology.orchestra.run.gibba004.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-02-12T17:13:34.785 INFO:teuthology.orchestra.run.gibba004.stdout: python3-ceph-argparse x86_64 2:17.0.0-720.g4819f209.el8 ceph 44 k 2021-02-12T17:13:34.785 INFO:teuthology.orchestra.run.gibba004.stdout: python3-ceph-common x86_64 2:17.0.0-720.g4819f209.el8 ceph 77 k 2021-02-12T17:13:34.785 INFO:teuthology.orchestra.run.gibba004.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-02-12T17:13:34.785 INFO:teuthology.orchestra.run.gibba004.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-02-12T17:13:34.785 INFO:teuthology.orchestra.run.gibba004.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-02-12T17:13:34.785 INFO:teuthology.orchestra.run.gibba004.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-02-12T17:13:34.785 INFO:teuthology.orchestra.run.gibba004.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-02-12T17:13:34.785 INFO:teuthology.orchestra.run.gibba004.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-02-12T17:13:34.785 INFO:teuthology.orchestra.run.gibba004.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-02-12T17:13:34.786 INFO:teuthology.orchestra.run.gibba004.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-02-12T17:13:34.786 INFO:teuthology.orchestra.run.gibba004.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-02-12T17:13:34.786 INFO:teuthology.orchestra.run.gibba004.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-02-12T17:13:34.786 INFO:teuthology.orchestra.run.gibba004.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-02-12T17:13:34.786 INFO:teuthology.orchestra.run.gibba004.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-02-12T17:13:34.786 INFO:teuthology.orchestra.run.gibba004.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-02-12T17:13:34.786 INFO:teuthology.orchestra.run.gibba004.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-02-12T17:13:34.786 INFO:teuthology.orchestra.run.gibba004.stdout: python3-lxml x86_64 4.2.3-1.el8 CentOS-AppStream 1.5 M 2021-02-12T17:13:34.786 INFO:teuthology.orchestra.run.gibba004.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-02-12T17:13:34.786 INFO:teuthology.orchestra.run.gibba004.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-02-12T17:13:34.786 INFO:teuthology.orchestra.run.gibba004.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-02-12T17:13:34.786 INFO:teuthology.orchestra.run.gibba004.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-02-12T17:13:34.787 INFO:teuthology.orchestra.run.gibba004.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-02-12T17:13:34.787 INFO:teuthology.orchestra.run.gibba004.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-02-12T17:13:34.787 INFO:teuthology.orchestra.run.gibba004.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-02-12T17:13:34.787 INFO:teuthology.orchestra.run.gibba004.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-02-12T17:13:34.787 INFO:teuthology.orchestra.run.gibba004.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-02-12T17:13:34.787 INFO:teuthology.orchestra.run.gibba004.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-02-12T17:13:34.787 INFO:teuthology.orchestra.run.gibba004.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-02-12T17:13:34.787 INFO:teuthology.orchestra.run.gibba004.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-02-12T17:13:34.787 INFO:teuthology.orchestra.run.gibba004.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-02-12T17:13:34.787 INFO:teuthology.orchestra.run.gibba004.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-02-12T17:13:34.787 INFO:teuthology.orchestra.run.gibba004.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-02-12T17:13:34.787 INFO:teuthology.orchestra.run.gibba004.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-02-12T17:13:34.787 INFO:teuthology.orchestra.run.gibba004.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-02-12T17:13:34.787 INFO:teuthology.orchestra.run.gibba004.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-02-12T17:13:34.788 INFO:teuthology.orchestra.run.gibba004.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-02-12T17:13:34.788 INFO:teuthology.orchestra.run.gibba004.stdout: python3-scipy x86_64 1.0.0-20.module_el8.3.0+562+e162826a CentOS-AppStream 15 M 2021-02-12T17:13:34.788 INFO:teuthology.orchestra.run.gibba004.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-02-12T17:13:34.788 INFO:teuthology.orchestra.run.gibba004.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-02-12T17:13:34.788 INFO:teuthology.orchestra.run.gibba004.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-02-12T17:13:34.788 INFO:teuthology.orchestra.run.gibba004.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-02-12T17:13:34.788 INFO:teuthology.orchestra.run.gibba004.stdout: python3-urllib3 noarch 1.24.2-4.el8 CentOS-Base 176 k 2021-02-12T17:13:34.788 INFO:teuthology.orchestra.run.gibba004.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-02-12T17:13:34.788 INFO:teuthology.orchestra.run.gibba004.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-02-12T17:13:34.788 INFO:teuthology.orchestra.run.gibba004.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-02-12T17:13:34.788 INFO:teuthology.orchestra.run.gibba004.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-02-12T17:13:34.788 INFO:teuthology.orchestra.run.gibba004.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-02-12T17:13:34.788 INFO:teuthology.orchestra.run.gibba004.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-02-12T17:13:34.789 INFO:teuthology.orchestra.run.gibba004.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-02-12T17:13:34.789 INFO:teuthology.orchestra.run.gibba004.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-02-12T17:13:34.789 INFO:teuthology.orchestra.run.gibba004.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-02-12T17:13:34.789 INFO:teuthology.orchestra.run.gibba004.stdout: zlib-devel x86_64 1.2.11-16.el8_2 CentOS-Base 57 k 2021-02-12T17:13:34.789 INFO:teuthology.orchestra.run.gibba004.stdout:Installing weak dependencies: 2021-02-12T17:13:34.789 INFO:teuthology.orchestra.run.gibba004.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-02-12T17:13:34.789 INFO:teuthology.orchestra.run.gibba004.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-02-12T17:13:34.789 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:13:34.789 INFO:teuthology.orchestra.run.gibba004.stdout:Transaction Summary 2021-02-12T17:13:34.789 INFO:teuthology.orchestra.run.gibba004.stdout:===================================================================================================== 2021-02-12T17:13:34.789 INFO:teuthology.orchestra.run.gibba004.stdout:Install 128 Packages 2021-02-12T17:13:34.789 INFO:teuthology.orchestra.run.gibba004.stdout:Upgrade 18 Packages 2021-02-12T17:13:34.790 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:13:34.790 INFO:teuthology.orchestra.run.gibba004.stdout:Total download size: 208 M 2021-02-12T17:13:34.790 INFO:teuthology.orchestra.run.gibba004.stdout:Downloading Packages: 2021-02-12T17:13:34.911 INFO:teuthology.orchestra.run.gibba002.stdout:(1/146): ceph-17.0.0-720.g4819f209.el8.x86_64.r 24 kB/s | 6.4 kB 00:00 2021-02-12T17:13:35.003 INFO:teuthology.orchestra.run.gibba004.stdout:(1/146): ceph-17.0.0-720.g4819f209.el8.x86_64.r 30 kB/s | 6.4 kB 00:00 2021-02-12T17:13:36.008 INFO:teuthology.orchestra.run.gibba002.stdout:(2/146): ceph-fuse-17.0.0-720.g4819f209.el8.x86 798 kB/s | 875 kB 00:01 2021-02-12T17:13:36.151 INFO:teuthology.orchestra.run.gibba002.stdout:(3/146): ceph-immutable-object-cache-17.0.0-720 1.1 MB/s | 161 kB 00:00 2021-02-12T17:13:37.135 INFO:teuthology.orchestra.run.gibba004.stdout:(2/146): ceph-fuse-17.0.0-720.g4819f209.el8.x86 410 kB/s | 875 kB 00:02 2021-02-12T17:13:37.451 INFO:teuthology.orchestra.run.gibba004.stdout:(3/146): ceph-immutable-object-cache-17.0.0-720 510 kB/s | 161 kB 00:00 2021-02-12T17:13:37.982 INFO:teuthology.orchestra.run.gibba002.stdout:(4/146): ceph-base-17.0.0-720.g4819f209.el8.x86 1.8 MB/s | 5.9 MB 00:03 2021-02-12T17:13:38.671 INFO:teuthology.orchestra.run.gibba002.stdout:(5/146): ceph-mds-17.0.0-720.g4819f209.el8.x86_ 968 kB/s | 2.4 MB 00:02 2021-02-12T17:13:38.750 INFO:teuthology.orchestra.run.gibba002.stdout:(6/146): ceph-mgr-17.0.0-720.g4819f209.el8.x86_ 2.0 MB/s | 1.5 MB 00:00 2021-02-12T17:13:40.514 INFO:teuthology.orchestra.run.gibba004.stdout:(4/146): ceph-mds-17.0.0-720.g4819f209.el8.x86_ 796 kB/s | 2.4 MB 00:03 2021-02-12T17:13:41.583 INFO:teuthology.orchestra.run.gibba004.stdout:(5/146): ceph-base-17.0.0-720.g4819f209.el8.x86 893 kB/s | 5.9 MB 00:06 2021-02-12T17:13:41.918 INFO:teuthology.orchestra.run.gibba004.stdout:(6/146): ceph-mgr-17.0.0-720.g4819f209.el8.x86_ 1.1 MB/s | 1.5 MB 00:01 2021-02-12T17:13:42.220 INFO:teuthology.orchestra.run.gibba002.stdout:(7/146): ceph-mon-17.0.0-720.g4819f209.el8.x86_ 1.4 MB/s | 4.9 MB 00:03 2021-02-12T17:13:43.988 INFO:teuthology.orchestra.run.gibba004.stdout:(7/146): ceph-mon-17.0.0-720.g4819f209.el8.x86_ 2.1 MB/s | 4.9 MB 00:02 2021-02-12T17:13:44.626 INFO:teuthology.orchestra.run.gibba002.stdout:(8/146): ceph-osd-17.0.0-720.g4819f209.el8.x86_ 3.1 MB/s | 18 MB 00:05 2021-02-12T17:13:44.653 INFO:teuthology.orchestra.run.gibba002.stdout:(9/146): ceph-selinux-17.0.0-720.g4819f209.el8. 917 kB/s | 25 kB 00:00 2021-02-12T17:13:45.141 INFO:teuthology.orchestra.run.gibba002.stdout:(10/146): ceph-common-17.0.0-720.g4819f209.el8. 2.3 MB/s | 24 MB 00:10 2021-02-12T17:13:45.206 INFO:teuthology.orchestra.run.gibba002.stdout:(11/146): cephfs-mirror-17.0.0-720.g4819f209.el 3.2 MB/s | 216 kB 00:00 2021-02-12T17:13:45.238 INFO:teuthology.orchestra.run.gibba002.stdout:(12/146): libcephfs-devel-17.0.0-720.g4819f209. 766 kB/s | 24 kB 00:00 2021-02-12T17:13:45.420 INFO:teuthology.orchestra.run.gibba002.stdout:(13/146): libcephfs2-17.0.0-720.g4819f209.el8.x 4.3 MB/s | 792 kB 00:00 2021-02-12T17:13:45.456 INFO:teuthology.orchestra.run.gibba002.stdout:(14/146): librados-devel-17.0.0-720.g4819f209.e 3.6 MB/s | 131 kB 00:00 2021-02-12T17:13:45.569 INFO:teuthology.orchestra.run.gibba002.stdout:(15/146): libradosstriper1-17.0.0-720.g4819f209 4.2 MB/s | 481 kB 00:00 2021-02-12T17:13:45.935 INFO:teuthology.orchestra.run.gibba002.stdout:(16/146): ceph-radosgw-17.0.0-720.g4819f209.el8 3.3 MB/s | 12 MB 00:03 2021-02-12T17:13:46.046 INFO:teuthology.orchestra.run.gibba002.stdout:(17/146): python3-ceph-argparse-17.0.0-720.g481 1.1 MB/s | 44 kB 00:00 2021-02-12T17:13:46.046 INFO:teuthology.orchestra.run.gibba002.stdout:(18/146): python3-ceph-common-17.0.0-720.g4819f 2.0 MB/s | 77 kB 00:00 2021-02-12T17:13:46.053 INFO:teuthology.orchestra.run.gibba002.stdout:(19/146): python3-cephfs-17.0.0-720.g4819f209.e 4.3 MB/s | 186 kB 00:00 2021-02-12T17:13:46.137 INFO:teuthology.orchestra.run.gibba002.stdout:(20/146): python3-rados-17.0.0-720.g4819f209.el 4.5 MB/s | 387 kB 00:00 2021-02-12T17:13:46.222 INFO:teuthology.orchestra.run.gibba002.stdout:(21/146): python3-rbd-17.0.0-720.g4819f209.el8. 4.2 MB/s | 368 kB 00:00 2021-02-12T17:13:46.263 INFO:teuthology.orchestra.run.gibba002.stdout:(22/146): python3-rgw-17.0.0-720.g4819f209.el8. 2.8 MB/s | 114 kB 00:00 2021-02-12T17:13:46.303 INFO:teuthology.orchestra.run.gibba002.stdout:(23/146): rbd-fuse-17.0.0-720.g4819f209.el8.x86 2.2 MB/s | 88 kB 00:00 2021-02-12T17:13:46.518 INFO:teuthology.orchestra.run.gibba002.stdout:(24/146): librgw2-17.0.0-720.g4819f209.el8.x86_ 4.2 MB/s | 4.0 MB 00:00 2021-02-12T17:13:46.560 INFO:teuthology.orchestra.run.gibba002.stdout:(25/146): rbd-nbd-17.0.0-720.g4819f209.el8.x86_ 4.0 MB/s | 171 kB 00:00 2021-02-12T17:13:46.584 INFO:teuthology.orchestra.run.gibba002.stdout:(26/146): ceph-grafana-dashboards-17.0.0-720.g4 1.0 MB/s | 24 kB 00:00 2021-02-12T17:13:46.612 INFO:teuthology.orchestra.run.gibba002.stdout:(27/146): ceph-mgr-cephadm-17.0.0-720.g4819f209 2.8 MB/s | 79 kB 00:00 2021-02-12T17:13:46.627 INFO:teuthology.orchestra.run.gibba004.stdout:(8/146): ceph-osd-17.0.0-720.g4819f209.el8.x86_ 3.8 MB/s | 18 MB 00:04 2021-02-12T17:13:46.663 INFO:teuthology.orchestra.run.gibba004.stdout:(9/146): ceph-selinux-17.0.0-720.g4819f209.el8. 688 kB/s | 25 kB 00:00 2021-02-12T17:13:46.803 INFO:teuthology.orchestra.run.gibba004.stdout:(10/146): ceph-common-17.0.0-720.g4819f209.el8. 2.0 MB/s | 24 MB 00:12 2021-02-12T17:13:46.896 INFO:teuthology.orchestra.run.gibba004.stdout:(11/146): cephfs-mirror-17.0.0-720.g4819f209.el 2.3 MB/s | 216 kB 00:00 2021-02-12T17:13:46.939 INFO:teuthology.orchestra.run.gibba004.stdout:(12/146): libcephfs-devel-17.0.0-720.g4819f209. 559 kB/s | 24 kB 00:00 2021-02-12T17:13:46.956 INFO:teuthology.orchestra.run.gibba002.stdout:(28/146): rbd-mirror-17.0.0-720.g4819f209.el8.x 5.6 MB/s | 3.7 MB 00:00 2021-02-12T17:13:47.178 INFO:teuthology.orchestra.run.gibba004.stdout:(13/146): libcephfs2-17.0.0-720.g4819f209.el8.x 3.2 MB/s | 792 kB 00:00 2021-02-12T17:13:47.229 INFO:teuthology.orchestra.run.gibba004.stdout:(14/146): librados-devel-17.0.0-720.g4819f209.e 2.5 MB/s | 131 kB 00:00 2021-02-12T17:13:47.237 INFO:teuthology.orchestra.run.gibba002.stdout:(29/146): ceph-mgr-dashboard-17.0.0-720.g4819f2 4.2 MB/s | 2.6 MB 00:00 2021-02-12T17:13:47.333 INFO:teuthology.orchestra.run.gibba002.stdout:(30/146): ceph-mgr-modules-core-17.0.0-720.g481 2.3 MB/s | 222 kB 00:00 2021-02-12T17:13:47.342 INFO:teuthology.orchestra.run.gibba004.stdout:(15/146): ceph-radosgw-17.0.0-720.g4819f209.el8 3.7 MB/s | 12 MB 00:03 2021-02-12T17:13:47.369 INFO:teuthology.orchestra.run.gibba002.stdout:(31/146): ceph-mgr-rook-17.0.0-720.g4819f209.el 776 kB/s | 28 kB 00:00 2021-02-12T17:13:47.381 INFO:teuthology.orchestra.run.gibba004.stdout:(16/146): libradosstriper1-17.0.0-720.g4819f209 3.1 MB/s | 481 kB 00:00 2021-02-12T17:13:47.414 INFO:teuthology.orchestra.run.gibba002.stdout:(32/146): ceph-prometheus-alerts-17.0.0-720.g48 201 kB/s | 8.9 kB 00:00 2021-02-12T17:13:47.423 INFO:teuthology.orchestra.run.gibba004.stdout:(17/146): python3-ceph-argparse-17.0.0-720.g481 1.0 MB/s | 44 kB 00:00 2021-02-12T17:13:47.458 INFO:teuthology.orchestra.run.gibba002.stdout:(33/146): cephadm-17.0.0-720.g4819f209.el8.noar 1.5 MB/s | 69 kB 00:00 2021-02-12T17:13:47.470 INFO:teuthology.orchestra.run.gibba004.stdout:(18/146): python3-ceph-common-17.0.0-720.g4819f 1.6 MB/s | 77 kB 00:00 2021-02-12T17:13:47.502 INFO:teuthology.orchestra.run.gibba002.stdout:(34/146): cephfs-top-17.0.0-720.g4819f209.el8.n 291 kB/s | 13 kB 00:00 2021-02-12T17:13:47.518 INFO:teuthology.orchestra.run.gibba004.stdout:(19/146): python3-cephfs-17.0.0-720.g4819f209.e 3.7 MB/s | 186 kB 00:00 2021-02-12T17:13:47.541 INFO:teuthology.orchestra.run.gibba002.stdout:(35/146): automake-1.16.1-6.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2021-02-12T17:13:47.549 INFO:teuthology.orchestra.run.gibba002.stdout:(36/146): bison-3.0.4-10.el8.x86_64.rpm 80 MB/s | 688 kB 00:00 2021-02-12T17:13:47.553 INFO:teuthology.orchestra.run.gibba002.stdout:(37/146): flex-2.6.1-9.el8.x86_64.rpm 74 MB/s | 320 kB 00:00 2021-02-12T17:13:47.556 INFO:teuthology.orchestra.run.gibba002.stdout:(38/146): jq-1.5-12.el8.x86_64.rpm 53 MB/s | 161 kB 00:00 2021-02-12T17:13:47.561 INFO:teuthology.orchestra.run.gibba002.stdout:(39/146): librdkafka-0.11.4-1.el8.x86_64.rpm 76 MB/s | 353 kB 00:00 2021-02-12T17:13:47.569 INFO:teuthology.orchestra.run.gibba002.stdout:(40/146): libtool-2.4.6-25.el8.x86_64.rpm 84 MB/s | 709 kB 00:00 2021-02-12T17:13:47.573 INFO:teuthology.orchestra.run.gibba002.stdout:(41/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 69 MB/s | 259 kB 00:00 2021-02-12T17:13:47.576 INFO:teuthology.orchestra.run.gibba002.stdout:(42/146): oniguruma-6.8.2-2.el8.x86_64.rpm 68 MB/s | 187 kB 00:00 2021-02-12T17:13:47.624 INFO:teuthology.orchestra.run.gibba002.stdout:(43/146): openblas-0.3.3-5.el8.x86_64.rpm 89 MB/s | 4.3 MB 00:00 2021-02-12T17:13:47.658 INFO:teuthology.orchestra.run.gibba004.stdout:(20/146): python3-rados-17.0.0-720.g4819f209.el 2.7 MB/s | 387 kB 00:00 2021-02-12T17:13:47.673 INFO:teuthology.orchestra.run.gibba002.stdout:(44/146): openblas-threads-0.3.3-5.el8.x86_64.r 89 MB/s | 4.3 MB 00:00 2021-02-12T17:13:47.727 INFO:teuthology.orchestra.run.gibba002.stdout:(45/146): python3-babel-2.5.1-5.el8.noarch.rpm 89 MB/s | 4.8 MB 00:00 2021-02-12T17:13:47.730 INFO:teuthology.orchestra.run.gibba002.stdout:(46/146): python3-html5lib-0.999999999-6.el8.no 65 MB/s | 214 kB 00:00 2021-02-12T17:13:47.737 INFO:teuthology.orchestra.run.gibba002.stdout:(47/146): python3-jinja2-2.10.1-2.el8_0.noarch. 82 MB/s | 538 kB 00:00 2021-02-12T17:13:47.738 INFO:teuthology.orchestra.run.gibba002.stdout:(48/146): python3-jsonpatch-1.21-2.el8.noarch.r 26 MB/s | 27 kB 00:00 2021-02-12T17:13:47.739 INFO:teuthology.orchestra.run.gibba002.stdout:(49/146): python3-jsonpointer-1.10-11.el8.noarc 19 MB/s | 20 kB 00:00 2021-02-12T17:13:47.757 INFO:teuthology.orchestra.run.gibba002.stdout:(50/146): python3-lxml-4.2.3-1.el8.x86_64.rpm 85 MB/s | 1.5 MB 00:00 2021-02-12T17:13:47.758 INFO:teuthology.orchestra.run.gibba004.stdout:(21/146): python3-rbd-17.0.0-720.g4819f209.el8. 3.6 MB/s | 368 kB 00:00 2021-02-12T17:13:47.759 INFO:teuthology.orchestra.run.gibba002.stdout:(51/146): python3-mako-1.0.6-13.el8.noarch.rpm 52 MB/s | 157 kB 00:00 2021-02-12T17:13:47.761 INFO:teuthology.orchestra.run.gibba002.stdout:(52/146): python3-markupsafe-0.23-19.el8.x86_64 33 MB/s | 39 kB 00:00 2021-02-12T17:13:47.803 INFO:teuthology.orchestra.run.gibba002.stdout:(53/146): python3-numpy-1.14.3-9.el8.x86_64.rpm 89 MB/s | 3.7 MB 00:00 2021-02-12T17:13:47.806 INFO:teuthology.orchestra.run.gibba002.stdout:(54/146): python3-numpy-f2py-1.14.3-9.el8.x86_6 69 MB/s | 225 kB 00:00 2021-02-12T17:13:47.808 INFO:teuthology.orchestra.run.gibba004.stdout:(22/146): python3-rgw-17.0.0-720.g4819f209.el8. 2.3 MB/s | 114 kB 00:00 2021-02-12T17:13:47.808 INFO:teuthology.orchestra.run.gibba002.stdout:(55/146): python3-prettytable-0.7.2-14.el8.noar 36 MB/s | 44 kB 00:00 2021-02-12T17:13:47.810 INFO:teuthology.orchestra.run.gibba002.stdout:(56/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 58 MB/s | 126 kB 00:00 2021-02-12T17:13:47.812 INFO:teuthology.orchestra.run.gibba002.stdout:(57/146): python3-pyasn1-modules-0.3.7-6.el8.no 56 MB/s | 110 kB 00:00 2021-02-12T17:13:47.813 INFO:teuthology.orchestra.run.gibba002.stdout:(58/146): python3-pytz-2017.2-9.el8.noarch.rpm 40 MB/s | 54 kB 00:00 2021-02-12T17:13:47.856 INFO:teuthology.orchestra.run.gibba004.stdout:(23/146): rbd-fuse-17.0.0-720.g4819f209.el8.x86 1.8 MB/s | 88 kB 00:00 2021-02-12T17:13:48.036 INFO:teuthology.orchestra.run.gibba002.stdout:(59/146): python3-scipy-1.0.0-20.module_el8.3.0 65 MB/s | 15 MB 00:00 2021-02-12T17:13:48.037 INFO:teuthology.orchestra.run.gibba002.stdout:(60/146): python3-webencodings-0.5.1-6.el8.noar 20 MB/s | 27 kB 00:00 2021-02-12T17:13:48.043 INFO:teuthology.orchestra.run.gibba002.stdout:(61/146): python3-werkzeug-0.12.2-4.el8.noarch. 79 MB/s | 457 kB 00:00 2021-02-12T17:13:48.047 INFO:teuthology.orchestra.run.gibba002.stdout:(62/146): socat-1.7.3.3-2.el8.x86_64.rpm 75 MB/s | 302 kB 00:00 2021-02-12T17:13:48.049 INFO:teuthology.orchestra.run.gibba002.stdout:(63/146): elfutils-libelf-devel-0.180-1.el8.x86 29 MB/s | 58 kB 00:00 2021-02-12T17:13:48.051 INFO:teuthology.orchestra.run.gibba002.stdout:(64/146): fuse-2.9.7-12.el8.x86_64.rpm 49 MB/s | 82 kB 00:00 2021-02-12T17:13:48.052 INFO:teuthology.orchestra.run.gibba002.stdout:(65/146): fuse-common-3.2.1-12.el8.x86_64.rpm 21 MB/s | 21 kB 00:00 2021-02-12T17:13:48.053 INFO:teuthology.orchestra.run.gibba002.stdout:(66/146): keyutils-libs-devel-1.5.10-6.el8.x86_ 36 MB/s | 48 kB 00:00 2021-02-12T17:13:48.060 INFO:teuthology.orchestra.run.gibba002.stdout:(67/146): krb5-devel-1.18.2-5.el8.x86_64.rpm 81 MB/s | 558 kB 00:00 2021-02-12T17:13:48.061 INFO:teuthology.orchestra.run.gibba002.stdout:(68/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 18 MB/s | 19 kB 00:00 2021-02-12T17:13:48.062 INFO:teuthology.orchestra.run.gibba002.stdout:(69/146): libcom_err-devel-1.45.6-1.el8.x86_64. 35 MB/s | 38 kB 00:00 2021-02-12T17:13:48.070 INFO:teuthology.orchestra.run.gibba002.stdout:(70/146): libgfortran-8.3.1-5.1.el8.x86_64.rpm 83 MB/s | 639 kB 00:00 2021-02-12T17:13:48.073 INFO:teuthology.orchestra.run.gibba002.stdout:(71/146): libquadmath-8.3.1-5.1.el8.x86_64.rpm 65 MB/s | 169 kB 00:00 2021-02-12T17:13:48.074 INFO:teuthology.orchestra.run.gibba002.stdout:(72/146): librabbitmq-0.9.0-2.el8.x86_64.rpm 38 MB/s | 47 kB 00:00 2021-02-12T17:13:48.077 INFO:teuthology.orchestra.run.gibba002.stdout:(73/146): libselinux-devel-2.9-4.el8_3.x86_64.r 67 MB/s | 199 kB 00:00 2021-02-12T17:13:48.079 INFO:teuthology.orchestra.run.gibba002.stdout:(74/146): libsepol-devel-2.9-1.el8.x86_64.rpm 51 MB/s | 86 kB 00:00 2021-02-12T17:13:48.080 INFO:teuthology.orchestra.run.gibba002.stdout:(75/146): libuuid-devel-2.32.1-24.el8.x86_64.rp 54 MB/s | 96 kB 00:00 2021-02-12T17:13:48.082 INFO:teuthology.orchestra.run.gibba002.stdout:(76/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 16 MB/s | 18 kB 00:00 2021-02-12T17:13:48.085 INFO:teuthology.orchestra.run.gibba002.stdout:(77/146): libxslt-1.1.32-5.el8.x86_64.rpm 73 MB/s | 250 kB 00:00 2021-02-12T17:13:48.112 INFO:teuthology.orchestra.run.gibba002.stdout:(78/146): openssl-devel-1.1.1g-12.el8_3.x86_64. 89 MB/s | 2.3 MB 00:00 2021-02-12T17:13:48.119 INFO:teuthology.orchestra.run.gibba002.stdout:(79/146): pcre2-devel-10.32-2.el8.x86_64.rpm 81 MB/s | 605 kB 00:00 2021-02-12T17:13:48.122 INFO:teuthology.orchestra.run.gibba002.stdout:(80/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 68 MB/s | 229 kB 00:00 2021-02-12T17:13:48.126 INFO:teuthology.orchestra.run.gibba002.stdout:(81/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 68 MB/s | 220 kB 00:00 2021-02-12T17:13:48.128 INFO:teuthology.orchestra.run.gibba002.stdout:(82/146): python3-chardet-3.0.4-7.el8.noarch.rp 68 MB/s | 195 kB 00:00 2021-02-12T17:13:48.130 INFO:teuthology.orchestra.run.gibba002.stdout:(83/146): python3-jwt-1.6.1-2.el8.noarch.rpm 35 MB/s | 43 kB 00:00 2021-02-12T17:13:48.133 INFO:teuthology.orchestra.run.gibba002.stdout:(84/146): python3-oauthlib-2.1.0-1.el8.noarch.r 61 MB/s | 155 kB 00:00 2021-02-12T17:13:48.134 INFO:teuthology.orchestra.run.gibba002.stdout:(85/146): python3-pysocks-1.6.8-3.el8.noarch.rp 30 MB/s | 34 kB 00:00 2021-02-12T17:13:48.136 INFO:teuthology.orchestra.run.gibba002.stdout:(86/146): python3-requests-2.20.0-2.1.el8_1.noa 59 MB/s | 123 kB 00:00 2021-02-12T17:13:48.137 INFO:teuthology.orchestra.run.gibba002.stdout:(87/146): python3-requests-oauthlib-1.0.0-1.el8 35 MB/s | 43 kB 00:00 2021-02-12T17:13:48.140 INFO:teuthology.orchestra.run.gibba002.stdout:(88/146): python3-urllib3-1.24.2-4.el8.noarch.r 66 MB/s | 176 kB 00:00 2021-02-12T17:13:48.141 INFO:teuthology.orchestra.run.gibba002.stdout:(89/146): xfsprogs-devel-5.0.0-4.el8.x86_64.rpm 45 MB/s | 69 kB 00:00 2021-02-12T17:13:48.143 INFO:teuthology.orchestra.run.gibba002.stdout:(90/146): zlib-devel-1.2.11-16.el8_2.x86_64.rpm 38 MB/s | 57 kB 00:00 2021-02-12T17:13:48.242 INFO:teuthology.orchestra.run.gibba002.stdout:(91/146): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2021-02-12T17:13:48.282 INFO:teuthology.orchestra.run.gibba002.stdout:(92/146): gperftools-libs-2.8-1.el8.x86_64.rpm 7.4 MB/s | 306 kB 00:00 2021-02-12T17:13:48.303 INFO:teuthology.orchestra.run.gibba002.stdout:(93/146): leveldb-1.22-1.el8.x86_64.rpm 8.5 MB/s | 181 kB 00:00 2021-02-12T17:13:48.323 INFO:teuthology.orchestra.run.gibba002.stdout:(94/146): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2021-02-12T17:13:48.344 INFO:teuthology.orchestra.run.gibba002.stdout:(95/146): libunwind-1.3.1-3.el8.x86_64.rpm 3.7 MB/s | 75 kB 00:00 2021-02-12T17:13:48.364 INFO:teuthology.orchestra.run.gibba002.stdout:(96/146): python3-apipkg-1.5-6.el8.noarch.rpm 1.0 MB/s | 21 kB 00:00 2021-02-12T17:13:48.384 INFO:teuthology.orchestra.run.gibba002.stdout:(97/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.1 MB/s | 44 kB 00:00 2021-02-12T17:13:48.405 INFO:teuthology.orchestra.run.gibba002.stdout:(98/146): python3-beautifulsoup4-4.6.3-2.el8.1. 8.9 MB/s | 185 kB 00:00 2021-02-12T17:13:48.420 INFO:teuthology.orchestra.run.gibba004.stdout:(24/146): librgw2-17.0.0-720.g4819f209.el8.x86_ 3.7 MB/s | 4.0 MB 00:01 2021-02-12T17:13:48.424 INFO:teuthology.orchestra.run.gibba002.stdout:(99/146): python3-cachetools-3.1.1-4.el8.noarch 1.6 MB/s | 33 kB 00:00 2021-02-12T17:13:48.449 INFO:teuthology.orchestra.run.gibba002.stdout:(100/146): ceph-mgr-diskprediction-local-17.0.0 5.8 MB/s | 8.6 MB 00:01 2021-02-12T17:13:48.449 INFO:teuthology.orchestra.run.gibba002.stdout:(101/146): python3-certifi-2018.10.15-7.el8.noa 669 kB/s | 16 kB 00:00 2021-02-12T17:13:48.467 INFO:teuthology.orchestra.run.gibba004.stdout:(25/146): rbd-nbd-17.0.0-720.g4819f209.el8.x86_ 3.6 MB/s | 171 kB 00:00 2021-02-12T17:13:48.489 INFO:teuthology.orchestra.run.gibba002.stdout:(102/146): python3-cherrypy-18.4.0-1.el8.noarch 9.4 MB/s | 384 kB 00:00 2021-02-12T17:13:48.509 INFO:teuthology.orchestra.run.gibba004.stdout:(26/146): ceph-grafana-dashboards-17.0.0-720.g4 572 kB/s | 24 kB 00:00 2021-02-12T17:13:48.509 INFO:teuthology.orchestra.run.gibba002.stdout:(103/146): python3-cssselect-0.9.2-10.el8.noarc 2.0 MB/s | 40 kB 00:00 2021-02-12T17:13:48.530 INFO:teuthology.orchestra.run.gibba002.stdout:(104/146): python3-cheroot-8.5.2-1.el8.noarch.r 2.1 MB/s | 173 kB 00:00 2021-02-12T17:13:48.547 INFO:teuthology.orchestra.run.gibba002.stdout:(105/146): python3-google-auth-1.1.1-10.el8.noa 4.7 MB/s | 81 kB 00:00 2021-02-12T17:13:48.549 INFO:teuthology.orchestra.run.gibba002.stdout:(106/146): python3-execnet-1.7.1-1.el8.noarch.r 8.8 MB/s | 355 kB 00:00 2021-02-12T17:13:48.552 INFO:teuthology.orchestra.run.gibba004.stdout:(27/146): ceph-mgr-cephadm-17.0.0-720.g4819f209 1.8 MB/s | 79 kB 00:00 2021-02-12T17:13:48.563 INFO:teuthology.orchestra.run.gibba002.stdout:(107/146): python3-jaraco-6.2-6.el8.noarch.rpm 677 kB/s | 11 kB 00:00 2021-02-12T17:13:48.569 INFO:teuthology.orchestra.run.gibba002.stdout:(108/146): python3-jaraco-functools-2.0-4.el8.n 885 kB/s | 18 kB 00:00 2021-02-12T17:13:48.589 INFO:teuthology.orchestra.run.gibba002.stdout:(109/146): python3-logutils-0.3.5-11.el8.noarch 2.4 MB/s | 49 kB 00:00 2021-02-12T17:13:48.609 INFO:teuthology.orchestra.run.gibba002.stdout:(110/146): python3-more-itertools-7.2.0-3.el8.n 2.9 MB/s | 59 kB 00:00 2021-02-12T17:13:48.631 INFO:teuthology.orchestra.run.gibba002.stdout:(111/146): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2021-02-12T17:13:48.646 INFO:teuthology.orchestra.run.gibba002.stdout:(112/146): python3-kubernetes-11.0.0-6.el8.noar 14 MB/s | 1.2 MB 00:00 2021-02-12T17:13:48.651 INFO:teuthology.orchestra.run.gibba002.stdout:(113/146): python3-portend-2.6-1.el8.noarch.rpm 799 kB/s | 16 kB 00:00 2021-02-12T17:13:48.663 INFO:teuthology.orchestra.run.gibba002.stdout:(114/146): python3-remoto-1.1.4-4.el8.noarch.rp 2.8 MB/s | 48 kB 00:00 2021-02-12T17:13:48.671 INFO:teuthology.orchestra.run.gibba002.stdout:(115/146): python3-repoze-lru-0.7-6.el8.noarch. 1.7 MB/s | 34 kB 00:00 2021-02-12T17:13:48.680 INFO:teuthology.orchestra.run.gibba002.stdout:(116/146): python3-routes-2.4.1-12.el8.noarch.r 11 MB/s | 196 kB 00:00 2021-02-12T17:13:48.691 INFO:teuthology.orchestra.run.gibba002.stdout:(117/146): python3-rsa-3.4.2-16.el8.noarch.rpm 3.6 MB/s | 73 kB 00:00 2021-02-12T17:13:48.696 INFO:teuthology.orchestra.run.gibba002.stdout:(118/146): python3-simplegeneric-0.8.1-17.el8.n 1.1 MB/s | 19 kB 00:00 2021-02-12T17:13:48.711 INFO:teuthology.orchestra.run.gibba002.stdout:(119/146): python3-singledispatch-3.4.0.3-18.el 1.2 MB/s | 24 kB 00:00 2021-02-12T17:13:48.713 INFO:teuthology.orchestra.run.gibba002.stdout:(120/146): python3-tempora-1.14.1-5.el8.noarch. 1.7 MB/s | 29 kB 00:00 2021-02-12T17:13:48.731 INFO:teuthology.orchestra.run.gibba002.stdout:(121/146): python3-waitress-1.2.1-2.el8.1.noarc 13 MB/s | 241 kB 00:00 2021-02-12T17:13:48.731 INFO:teuthology.orchestra.run.gibba002.stdout:(122/146): python3-trustme-0.6.0-4.el8.noarch.r 1.3 MB/s | 27 kB 00:00 2021-02-12T17:13:48.749 INFO:teuthology.orchestra.run.gibba002.stdout:(123/146): python3-webob-1.8.5-1.el8.1.noarch.r 14 MB/s | 251 kB 00:00 2021-02-12T17:13:48.751 INFO:teuthology.orchestra.run.gibba002.stdout:(124/146): python3-websocket-client-0.56.0-5.el 3.0 MB/s | 61 kB 00:00 2021-02-12T17:13:48.766 INFO:teuthology.orchestra.run.gibba002.stdout:(125/146): python3-webtest-2.0.33-1.el8.noarch. 4.9 MB/s | 85 kB 00:00 2021-02-12T17:13:48.771 INFO:teuthology.orchestra.run.gibba002.stdout:(126/146): python3-zc-lockfile-2.0-2.el8.noarch 1.1 MB/s | 23 kB 00:00 2021-02-12T17:13:48.783 INFO:teuthology.orchestra.run.gibba002.stdout:(127/146): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.1 MB/s | 69 kB 00:00 2021-02-12T17:13:48.948 INFO:teuthology.orchestra.run.gibba004.stdout:(28/146): rbd-mirror-17.0.0-720.g4819f209.el8.x 3.3 MB/s | 3.7 MB 00:01 2021-02-12T17:13:49.638 INFO:teuthology.orchestra.run.gibba004.stdout:(29/146): ceph-mgr-dashboard-17.0.0-720.g4819f2 2.4 MB/s | 2.6 MB 00:01 2021-02-12T17:13:49.777 INFO:teuthology.orchestra.run.gibba004.stdout:(30/146): ceph-mgr-modules-core-17.0.0-720.g481 1.6 MB/s | 222 kB 00:00 2021-02-12T17:13:49.846 INFO:teuthology.orchestra.run.gibba004.stdout:(31/146): ceph-mgr-rook-17.0.0-720.g4819f209.el 410 kB/s | 28 kB 00:00 2021-02-12T17:13:49.914 INFO:teuthology.orchestra.run.gibba004.stdout:(32/146): ceph-prometheus-alerts-17.0.0-720.g48 132 kB/s | 8.9 kB 00:00 2021-02-12T17:13:49.984 INFO:teuthology.orchestra.run.gibba004.stdout:(33/146): cephadm-17.0.0-720.g4819f209.el8.noar 976 kB/s | 69 kB 00:00 2021-02-12T17:13:50.054 INFO:teuthology.orchestra.run.gibba004.stdout:(34/146): cephfs-top-17.0.0-720.g4819f209.el8.n 183 kB/s | 13 kB 00:00 2021-02-12T17:13:50.091 INFO:teuthology.orchestra.run.gibba004.stdout:(35/146): automake-1.16.1-6.el8.noarch.rpm 19 MB/s | 713 kB 00:00 2021-02-12T17:13:50.099 INFO:teuthology.orchestra.run.gibba004.stdout:(36/146): bison-3.0.4-10.el8.x86_64.rpm 82 MB/s | 688 kB 00:00 2021-02-12T17:13:50.104 INFO:teuthology.orchestra.run.gibba004.stdout:(37/146): flex-2.6.1-9.el8.x86_64.rpm 74 MB/s | 320 kB 00:00 2021-02-12T17:13:50.106 INFO:teuthology.orchestra.run.gibba004.stdout:(38/146): jq-1.5-12.el8.x86_64.rpm 64 MB/s | 161 kB 00:00 2021-02-12T17:13:50.111 INFO:teuthology.orchestra.run.gibba004.stdout:(39/146): librdkafka-0.11.4-1.el8.x86_64.rpm 72 MB/s | 353 kB 00:00 2021-02-12T17:13:50.112 INFO:teuthology.orchestra.run.gibba002.stdout:(128/146): librados2-17.0.0-720.g4819f209.el8.x 2.7 MB/s | 3.7 MB 00:01 2021-02-12T17:13:50.122 INFO:teuthology.orchestra.run.gibba004.stdout:(40/146): libtool-2.4.6-25.el8.x86_64.rpm 64 MB/s | 709 kB 00:00 2021-02-12T17:13:50.140 INFO:teuthology.orchestra.run.gibba004.stdout:(41/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 14 MB/s | 259 kB 00:00 2021-02-12T17:13:50.145 INFO:teuthology.orchestra.run.gibba004.stdout:(42/146): oniguruma-6.8.2-2.el8.x86_64.rpm 39 MB/s | 187 kB 00:00 2021-02-12T17:13:50.147 INFO:teuthology.orchestra.run.gibba002.stdout:(129/146): NetworkManager-1.26.0-12.el8_3.x86_6 69 MB/s | 2.4 MB 00:00 2021-02-12T17:13:50.175 INFO:teuthology.orchestra.run.gibba002.stdout:(130/146): NetworkManager-libnm-1.26.0-12.el8_3 65 MB/s | 1.8 MB 00:00 2021-02-12T17:13:50.179 INFO:teuthology.orchestra.run.gibba002.stdout:(131/146): NetworkManager-team-1.26.0-12.el8_3. 35 MB/s | 142 kB 00:00 2021-02-12T17:13:50.185 INFO:teuthology.orchestra.run.gibba002.stdout:(132/146): NetworkManager-tui-1.26.0-12.el8_3.x 48 MB/s | 320 kB 00:00 2021-02-12T17:13:50.201 INFO:teuthology.orchestra.run.gibba002.stdout:(133/146): e2fsprogs-1.45.6-1.el8.x86_64.rpm 65 MB/s | 1.0 MB 00:00 2021-02-12T17:13:50.207 INFO:teuthology.orchestra.run.gibba002.stdout:(134/146): e2fsprogs-libs-1.45.6-1.el8.x86_64.r 40 MB/s | 233 kB 00:00 2021-02-12T17:13:50.212 INFO:teuthology.orchestra.run.gibba002.stdout:(135/146): elfutils-libelf-0.180-1.el8.x86_64.r 41 MB/s | 215 kB 00:00 2021-02-12T17:13:50.219 INFO:teuthology.orchestra.run.gibba002.stdout:(136/146): elfutils-libs-0.180-1.el8.x86_64.rpm 42 MB/s | 293 kB 00:00 2021-02-12T17:13:50.231 INFO:teuthology.orchestra.run.gibba002.stdout:(137/146): iproute-5.3.0-5.el8.x86_64.rpm 53 MB/s | 665 kB 00:00 2021-02-12T17:13:50.233 INFO:teuthology.orchestra.run.gibba002.stdout:(138/146): libcom_err-1.45.6-1.el8.x86_64.rpm 36 MB/s | 49 kB 00:00 2021-02-12T17:13:50.235 INFO:teuthology.orchestra.run.gibba002.stdout:(139/146): libselinux-2.9-4.el8_3.x86_64.rpm 65 MB/s | 165 kB 00:00 2021-02-12T17:13:50.239 INFO:teuthology.orchestra.run.gibba002.stdout:(140/146): libselinux-utils-2.9-4.el8_3.x86_64. 71 MB/s | 242 kB 00:00 2021-02-12T17:13:50.239 INFO:teuthology.orchestra.run.gibba004.stdout:(43/146): openblas-0.3.3-5.el8.x86_64.rpm 45 MB/s | 4.3 MB 00:00 2021-02-12T17:13:50.240 INFO:teuthology.orchestra.run.gibba002.stdout:(141/146): libss-1.45.6-1.el8.x86_64.rpm 40 MB/s | 53 kB 00:00 2021-02-12T17:13:50.246 INFO:teuthology.orchestra.run.gibba002.stdout:(142/146): pcre2-10.32-2.el8.x86_64.rpm 39 MB/s | 246 kB 00:00 2021-02-12T17:13:50.253 INFO:teuthology.orchestra.run.gibba002.stdout:(143/146): python3-libselinux-2.9-4.el8_3.x86_6 40 MB/s | 283 kB 00:00 2021-02-12T17:13:50.259 INFO:teuthology.orchestra.run.gibba002.stdout:(144/146): zlib-1.2.11-16.el8_2.x86_64.rpm 19 MB/s | 102 kB 00:00 2021-02-12T17:13:50.295 INFO:teuthology.orchestra.run.gibba004.stdout:(44/146): openblas-threads-0.3.3-5.el8.x86_64.r 78 MB/s | 4.3 MB 00:00 2021-02-12T17:13:50.348 INFO:teuthology.orchestra.run.gibba004.stdout:(45/146): python3-babel-2.5.1-5.el8.noarch.rpm 90 MB/s | 4.8 MB 00:00 2021-02-12T17:13:50.352 INFO:teuthology.orchestra.run.gibba004.stdout:(46/146): python3-html5lib-0.999999999-6.el8.no 63 MB/s | 214 kB 00:00 2021-02-12T17:13:50.359 INFO:teuthology.orchestra.run.gibba004.stdout:(47/146): python3-jinja2-2.10.1-2.el8_0.noarch. 80 MB/s | 538 kB 00:00 2021-02-12T17:13:50.360 INFO:teuthology.orchestra.run.gibba004.stdout:(48/146): python3-jsonpatch-1.21-2.el8.noarch.r 23 MB/s | 27 kB 00:00 2021-02-12T17:13:50.361 INFO:teuthology.orchestra.run.gibba004.stdout:(49/146): python3-jsonpointer-1.10-11.el8.noarc 19 MB/s | 20 kB 00:00 2021-02-12T17:13:50.378 INFO:teuthology.orchestra.run.gibba004.stdout:(50/146): python3-lxml-4.2.3-1.el8.x86_64.rpm 88 MB/s | 1.5 MB 00:00 2021-02-12T17:13:50.381 INFO:teuthology.orchestra.run.gibba004.stdout:(51/146): python3-mako-1.0.6-13.el8.noarch.rpm 60 MB/s | 157 kB 00:00 2021-02-12T17:13:50.382 INFO:teuthology.orchestra.run.gibba004.stdout:(52/146): python3-markupsafe-0.23-19.el8.x86_64 35 MB/s | 39 kB 00:00 2021-02-12T17:13:50.424 INFO:teuthology.orchestra.run.gibba004.stdout:(53/146): python3-numpy-1.14.3-9.el8.x86_64.rpm 90 MB/s | 3.7 MB 00:00 2021-02-12T17:13:50.427 INFO:teuthology.orchestra.run.gibba004.stdout:(54/146): python3-numpy-f2py-1.14.3-9.el8.x86_6 64 MB/s | 225 kB 00:00 2021-02-12T17:13:50.428 INFO:teuthology.orchestra.run.gibba004.stdout:(55/146): python3-prettytable-0.7.2-14.el8.noar 38 MB/s | 44 kB 00:00 2021-02-12T17:13:50.430 INFO:teuthology.orchestra.run.gibba004.stdout:(56/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 61 MB/s | 126 kB 00:00 2021-02-12T17:13:50.432 INFO:teuthology.orchestra.run.gibba004.stdout:(57/146): python3-pyasn1-modules-0.3.7-6.el8.no 59 MB/s | 110 kB 00:00 2021-02-12T17:13:50.434 INFO:teuthology.orchestra.run.gibba004.stdout:(58/146): python3-pytz-2017.2-9.el8.noarch.rpm 42 MB/s | 54 kB 00:00 2021-02-12T17:13:50.654 INFO:teuthology.orchestra.run.gibba004.stdout:(59/146): python3-scipy-1.0.0-20.module_el8.3.0 66 MB/s | 15 MB 00:00 2021-02-12T17:13:50.655 INFO:teuthology.orchestra.run.gibba004.stdout:(60/146): python3-webencodings-0.5.1-6.el8.noar 19 MB/s | 27 kB 00:00 2021-02-12T17:13:50.661 INFO:teuthology.orchestra.run.gibba004.stdout:(61/146): python3-werkzeug-0.12.2-4.el8.noarch. 78 MB/s | 457 kB 00:00 2021-02-12T17:13:50.665 INFO:teuthology.orchestra.run.gibba004.stdout:(62/146): socat-1.7.3.3-2.el8.x86_64.rpm 74 MB/s | 302 kB 00:00 2021-02-12T17:13:50.667 INFO:teuthology.orchestra.run.gibba004.stdout:(63/146): elfutils-libelf-devel-0.180-1.el8.x86 42 MB/s | 58 kB 00:00 2021-02-12T17:13:50.669 INFO:teuthology.orchestra.run.gibba004.stdout:(64/146): fuse-2.9.7-12.el8.x86_64.rpm 49 MB/s | 82 kB 00:00 2021-02-12T17:13:50.670 INFO:teuthology.orchestra.run.gibba004.stdout:(65/146): fuse-common-3.2.1-12.el8.x86_64.rpm 21 MB/s | 21 kB 00:00 2021-02-12T17:13:50.671 INFO:teuthology.orchestra.run.gibba004.stdout:(66/146): keyutils-libs-devel-1.5.10-6.el8.x86_ 36 MB/s | 48 kB 00:00 2021-02-12T17:13:50.678 INFO:teuthology.orchestra.run.gibba004.stdout:(67/146): krb5-devel-1.18.2-5.el8.x86_64.rpm 82 MB/s | 558 kB 00:00 2021-02-12T17:13:50.679 INFO:teuthology.orchestra.run.gibba004.stdout:(68/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 18 MB/s | 19 kB 00:00 2021-02-12T17:13:50.680 INFO:teuthology.orchestra.run.gibba004.stdout:(69/146): libcom_err-devel-1.45.6-1.el8.x86_64. 29 MB/s | 38 kB 00:00 2021-02-12T17:13:50.688 INFO:teuthology.orchestra.run.gibba004.stdout:(70/146): libgfortran-8.3.1-5.1.el8.x86_64.rpm 82 MB/s | 639 kB 00:00 2021-02-12T17:13:50.691 INFO:teuthology.orchestra.run.gibba004.stdout:(71/146): libquadmath-8.3.1-5.1.el8.x86_64.rpm 67 MB/s | 169 kB 00:00 2021-02-12T17:13:50.692 INFO:teuthology.orchestra.run.gibba004.stdout:(72/146): librabbitmq-0.9.0-2.el8.x86_64.rpm 38 MB/s | 47 kB 00:00 2021-02-12T17:13:50.695 INFO:teuthology.orchestra.run.gibba004.stdout:(73/146): libselinux-devel-2.9-4.el8_3.x86_64.r 71 MB/s | 199 kB 00:00 2021-02-12T17:13:50.697 INFO:teuthology.orchestra.run.gibba004.stdout:(74/146): libsepol-devel-2.9-1.el8.x86_64.rpm 54 MB/s | 86 kB 00:00 2021-02-12T17:13:50.698 INFO:teuthology.orchestra.run.gibba004.stdout:(75/146): libuuid-devel-2.32.1-24.el8.x86_64.rp 56 MB/s | 96 kB 00:00 2021-02-12T17:13:50.700 INFO:teuthology.orchestra.run.gibba004.stdout:(76/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 17 MB/s | 18 kB 00:00 2021-02-12T17:13:50.703 INFO:teuthology.orchestra.run.gibba004.stdout:(77/146): libxslt-1.1.32-5.el8.x86_64.rpm 73 MB/s | 250 kB 00:00 2021-02-12T17:13:50.729 INFO:teuthology.orchestra.run.gibba004.stdout:(78/146): openssl-devel-1.1.1g-12.el8_3.x86_64. 90 MB/s | 2.3 MB 00:00 2021-02-12T17:13:50.737 INFO:teuthology.orchestra.run.gibba004.stdout:(79/146): pcre2-devel-10.32-2.el8.x86_64.rpm 73 MB/s | 605 kB 00:00 2021-02-12T17:13:50.741 INFO:teuthology.orchestra.run.gibba004.stdout:(80/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 69 MB/s | 229 kB 00:00 2021-02-12T17:13:50.744 INFO:teuthology.orchestra.run.gibba004.stdout:(81/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 74 MB/s | 220 kB 00:00 2021-02-12T17:13:50.747 INFO:teuthology.orchestra.run.gibba004.stdout:(82/146): python3-chardet-3.0.4-7.el8.noarch.rp 70 MB/s | 195 kB 00:00 2021-02-12T17:13:50.748 INFO:teuthology.orchestra.run.gibba004.stdout:(83/146): python3-jwt-1.6.1-2.el8.noarch.rpm 39 MB/s | 43 kB 00:00 2021-02-12T17:13:50.750 INFO:teuthology.orchestra.run.gibba004.stdout:(84/146): python3-oauthlib-2.1.0-1.el8.noarch.r 66 MB/s | 155 kB 00:00 2021-02-12T17:13:50.751 INFO:teuthology.orchestra.run.gibba004.stdout:(85/146): python3-pysocks-1.6.8-3.el8.noarch.rp 31 MB/s | 34 kB 00:00 2021-02-12T17:13:50.754 INFO:teuthology.orchestra.run.gibba004.stdout:(86/146): python3-requests-2.20.0-2.1.el8_1.noa 57 MB/s | 123 kB 00:00 2021-02-12T17:13:50.755 INFO:teuthology.orchestra.run.gibba004.stdout:(87/146): python3-requests-oauthlib-1.0.0-1.el8 34 MB/s | 43 kB 00:00 2021-02-12T17:13:50.758 INFO:teuthology.orchestra.run.gibba004.stdout:(88/146): python3-urllib3-1.24.2-4.el8.noarch.r 68 MB/s | 176 kB 00:00 2021-02-12T17:13:50.759 INFO:teuthology.orchestra.run.gibba004.stdout:(89/146): xfsprogs-devel-5.0.0-4.el8.x86_64.rpm 50 MB/s | 69 kB 00:00 2021-02-12T17:13:50.761 INFO:teuthology.orchestra.run.gibba004.stdout:(90/146): zlib-devel-1.2.11-16.el8_2.x86_64.rpm 41 MB/s | 57 kB 00:00 2021-02-12T17:13:50.861 INFO:teuthology.orchestra.run.gibba004.stdout:(91/146): fmt-6.2.1-1.el8.x86_64.rpm 1.1 MB/s | 116 kB 00:00 2021-02-12T17:13:50.901 INFO:teuthology.orchestra.run.gibba004.stdout:(92/146): gperftools-libs-2.8-1.el8.x86_64.rpm 7.5 MB/s | 306 kB 00:00 2021-02-12T17:13:50.922 INFO:teuthology.orchestra.run.gibba004.stdout:(93/146): leveldb-1.22-1.el8.x86_64.rpm 8.4 MB/s | 181 kB 00:00 2021-02-12T17:13:50.942 INFO:teuthology.orchestra.run.gibba004.stdout:(94/146): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2021-02-12T17:13:50.962 INFO:teuthology.orchestra.run.gibba004.stdout:(95/146): libunwind-1.3.1-3.el8.x86_64.rpm 3.7 MB/s | 75 kB 00:00 2021-02-12T17:13:50.983 INFO:teuthology.orchestra.run.gibba004.stdout:(96/146): python3-apipkg-1.5-6.el8.noarch.rpm 1.0 MB/s | 21 kB 00:00 2021-02-12T17:13:51.003 INFO:teuthology.orchestra.run.gibba004.stdout:(97/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.1 MB/s | 44 kB 00:00 2021-02-12T17:13:51.024 INFO:teuthology.orchestra.run.gibba004.stdout:(98/146): python3-beautifulsoup4-4.6.3-2.el8.1. 8.6 MB/s | 185 kB 00:00 2021-02-12T17:13:51.045 INFO:teuthology.orchestra.run.gibba004.stdout:(99/146): python3-cachetools-3.1.1-4.el8.noarch 1.6 MB/s | 33 kB 00:00 2021-02-12T17:13:51.065 INFO:teuthology.orchestra.run.gibba004.stdout:(100/146): python3-certifi-2018.10.15-7.el8.noa 830 kB/s | 16 kB 00:00 2021-02-12T17:13:51.086 INFO:teuthology.orchestra.run.gibba004.stdout:(101/146): python3-cheroot-8.5.2-1.el8.noarch.r 8.0 MB/s | 173 kB 00:00 2021-02-12T17:13:51.126 INFO:teuthology.orchestra.run.gibba004.stdout:(102/146): python3-cherrypy-18.4.0-1.el8.noarch 9.4 MB/s | 384 kB 00:00 2021-02-12T17:13:51.146 INFO:teuthology.orchestra.run.gibba004.stdout:(103/146): python3-cssselect-0.9.2-10.el8.noarc 2.0 MB/s | 40 kB 00:00 2021-02-12T17:13:51.186 INFO:teuthology.orchestra.run.gibba004.stdout:(104/146): python3-execnet-1.7.1-1.el8.noarch.r 8.7 MB/s | 355 kB 00:00 2021-02-12T17:13:51.206 INFO:teuthology.orchestra.run.gibba004.stdout:(105/146): python3-google-auth-1.1.1-10.el8.noa 3.9 MB/s | 81 kB 00:00 2021-02-12T17:13:51.226 INFO:teuthology.orchestra.run.gibba004.stdout:(106/146): python3-jaraco-6.2-6.el8.noarch.rpm 556 kB/s | 11 kB 00:00 2021-02-12T17:13:51.247 INFO:teuthology.orchestra.run.gibba004.stdout:(107/146): python3-jaraco-functools-2.0-4.el8.n 878 kB/s | 18 kB 00:00 2021-02-12T17:13:51.346 INFO:teuthology.orchestra.run.gibba004.stdout:(108/146): python3-kubernetes-11.0.0-6.el8.noar 12 MB/s | 1.2 MB 00:00 2021-02-12T17:13:51.366 INFO:teuthology.orchestra.run.gibba004.stdout:(109/146): python3-logutils-0.3.5-11.el8.noarch 2.4 MB/s | 49 kB 00:00 2021-02-12T17:13:51.387 INFO:teuthology.orchestra.run.gibba004.stdout:(110/146): python3-more-itertools-7.2.0-3.el8.n 2.8 MB/s | 59 kB 00:00 2021-02-12T17:13:51.408 INFO:teuthology.orchestra.run.gibba004.stdout:(111/146): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2021-02-12T17:13:51.429 INFO:teuthology.orchestra.run.gibba004.stdout:(112/146): python3-portend-2.6-1.el8.noarch.rpm 784 kB/s | 16 kB 00:00 2021-02-12T17:13:51.449 INFO:teuthology.orchestra.run.gibba004.stdout:(113/146): python3-remoto-1.1.4-4.el8.noarch.rp 2.3 MB/s | 48 kB 00:00 2021-02-12T17:13:51.469 INFO:teuthology.orchestra.run.gibba004.stdout:(114/146): python3-repoze-lru-0.7-6.el8.noarch. 1.7 MB/s | 34 kB 00:00 2021-02-12T17:13:51.490 INFO:teuthology.orchestra.run.gibba004.stdout:(115/146): python3-routes-2.4.1-12.el8.noarch.r 9.1 MB/s | 196 kB 00:00 2021-02-12T17:13:51.511 INFO:teuthology.orchestra.run.gibba004.stdout:(116/146): python3-rsa-3.4.2-16.el8.noarch.rpm 3.5 MB/s | 73 kB 00:00 2021-02-12T17:13:51.531 INFO:teuthology.orchestra.run.gibba004.stdout:(117/146): python3-simplegeneric-0.8.1-17.el8.n 934 kB/s | 19 kB 00:00 2021-02-12T17:13:51.551 INFO:teuthology.orchestra.run.gibba004.stdout:(118/146): python3-singledispatch-3.4.0.3-18.el 1.2 MB/s | 24 kB 00:00 2021-02-12T17:13:51.571 INFO:teuthology.orchestra.run.gibba004.stdout:(119/146): python3-tempora-1.14.1-5.el8.noarch. 1.4 MB/s | 29 kB 00:00 2021-02-12T17:13:51.592 INFO:teuthology.orchestra.run.gibba004.stdout:(120/146): python3-trustme-0.6.0-4.el8.noarch.r 1.3 MB/s | 27 kB 00:00 2021-02-12T17:13:51.613 INFO:teuthology.orchestra.run.gibba004.stdout:(121/146): python3-waitress-1.2.1-2.el8.1.noarc 11 MB/s | 241 kB 00:00 2021-02-12T17:13:51.635 INFO:teuthology.orchestra.run.gibba004.stdout:(122/146): python3-webob-1.8.5-1.el8.1.noarch.r 11 MB/s | 251 kB 00:00 2021-02-12T17:13:51.656 INFO:teuthology.orchestra.run.gibba004.stdout:(123/146): python3-websocket-client-0.56.0-5.el 2.9 MB/s | 61 kB 00:00 2021-02-12T17:13:51.677 INFO:teuthology.orchestra.run.gibba004.stdout:(124/146): python3-webtest-2.0.33-1.el8.noarch. 4.1 MB/s | 85 kB 00:00 2021-02-12T17:13:51.697 INFO:teuthology.orchestra.run.gibba004.stdout:(125/146): python3-zc-lockfile-2.0-2.el8.noarch 1.1 MB/s | 23 kB 00:00 2021-02-12T17:13:51.717 INFO:teuthology.orchestra.run.gibba004.stdout:(126/146): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.4 MB/s | 69 kB 00:00 2021-02-12T17:13:52.193 INFO:teuthology.orchestra.run.gibba002.stdout:(145/146): ceph-test-17.0.0-720.g4819f209.el8.x 6.7 MB/s | 51 MB 00:07 2021-02-12T17:13:52.222 INFO:teuthology.orchestra.run.gibba004.stdout:(127/146): ceph-test-17.0.0-720.g4819f209.el8.x 9.1 MB/s | 51 MB 00:05 2021-02-12T17:13:52.361 INFO:teuthology.orchestra.run.gibba004.stdout:(128/146): ceph-mgr-diskprediction-local-17.0.0 2.5 MB/s | 8.6 MB 00:03 2021-02-12T17:13:52.389 INFO:teuthology.orchestra.run.gibba004.stdout:(129/146): NetworkManager-1.26.0-12.el8_3.x86_6 87 MB/s | 2.4 MB 00:00 2021-02-12T17:13:52.409 INFO:teuthology.orchestra.run.gibba004.stdout:(130/146): NetworkManager-libnm-1.26.0-12.el8_3 87 MB/s | 1.8 MB 00:00 2021-02-12T17:13:52.412 INFO:teuthology.orchestra.run.gibba004.stdout:(131/146): NetworkManager-team-1.26.0-12.el8_3. 61 MB/s | 142 kB 00:00 2021-02-12T17:13:52.419 INFO:teuthology.orchestra.run.gibba004.stdout:(132/146): librbd1-17.0.0-720.g4819f209.el8.x86 16 MB/s | 3.2 MB 00:00 2021-02-12T17:13:52.420 INFO:teuthology.orchestra.run.gibba004.stdout:(133/146): NetworkManager-tui-1.26.0-12.el8_3.x 37 MB/s | 320 kB 00:00 2021-02-12T17:13:52.427 INFO:teuthology.orchestra.run.gibba004.stdout:(134/146): e2fsprogs-libs-1.45.6-1.el8.x86_64.r 63 MB/s | 233 kB 00:00 2021-02-12T17:13:52.439 INFO:teuthology.orchestra.run.gibba004.stdout:(135/146): elfutils-libelf-0.180-1.el8.x86_64.r 18 MB/s | 215 kB 00:00 2021-02-12T17:13:52.443 INFO:teuthology.orchestra.run.gibba004.stdout:(136/146): elfutils-libs-0.180-1.el8.x86_64.rpm 76 MB/s | 293 kB 00:00 2021-02-12T17:13:52.452 INFO:teuthology.orchestra.run.gibba004.stdout:(137/146): iproute-5.3.0-5.el8.x86_64.rpm 73 MB/s | 665 kB 00:00 2021-02-12T17:13:52.454 INFO:teuthology.orchestra.run.gibba004.stdout:(138/146): libcom_err-1.45.6-1.el8.x86_64.rpm 36 MB/s | 49 kB 00:00 2021-02-12T17:13:52.457 INFO:teuthology.orchestra.run.gibba004.stdout:(139/146): libselinux-2.9-4.el8_3.x86_64.rpm 54 MB/s | 165 kB 00:00 2021-02-12T17:13:52.461 INFO:teuthology.orchestra.run.gibba004.stdout:(140/146): libselinux-utils-2.9-4.el8_3.x86_64. 65 MB/s | 242 kB 00:00 2021-02-12T17:13:52.463 INFO:teuthology.orchestra.run.gibba004.stdout:(141/146): libss-1.45.6-1.el8.x86_64.rpm 27 MB/s | 53 kB 00:00 2021-02-12T17:13:52.467 INFO:teuthology.orchestra.run.gibba004.stdout:(142/146): pcre2-10.32-2.el8.x86_64.rpm 63 MB/s | 246 kB 00:00 2021-02-12T17:13:52.471 INFO:teuthology.orchestra.run.gibba004.stdout:(143/146): python3-libselinux-2.9-4.el8_3.x86_6 64 MB/s | 283 kB 00:00 2021-02-12T17:13:52.474 INFO:teuthology.orchestra.run.gibba004.stdout:(144/146): zlib-1.2.11-16.el8_2.x86_64.rpm 43 MB/s | 102 kB 00:00 2021-02-12T17:13:52.479 INFO:teuthology.orchestra.run.gibba004.stdout:(145/146): e2fsprogs-1.45.6-1.el8.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2021-02-12T17:13:52.750 INFO:teuthology.orchestra.run.gibba002.stdout:(146/146): librbd1-17.0.0-720.g4819f209.el8.x86 834 kB/s | 3.2 MB 00:03 2021-02-12T17:13:52.752 INFO:teuthology.orchestra.run.gibba002.stdout:-------------------------------------------------------------------------------- 2021-02-12T17:13:52.752 INFO:teuthology.orchestra.run.gibba002.stdout:Total 11 MB/s | 208 MB 00:18 2021-02-12T17:13:52.761 INFO:teuthology.orchestra.run.gibba004.stdout:(146/146): librados2-17.0.0-720.g4819f209.el8.x 3.5 MB/s | 3.7 MB 00:01 2021-02-12T17:13:52.764 INFO:teuthology.orchestra.run.gibba004.stdout:-------------------------------------------------------------------------------- 2021-02-12T17:13:52.765 INFO:teuthology.orchestra.run.gibba004.stdout:Total 12 MB/s | 208 MB 00:17 2021-02-12T17:13:52.800 INFO:teuthology.orchestra.run.gibba002.stdout:Running transaction check 2021-02-12T17:13:52.813 INFO:teuthology.orchestra.run.gibba004.stdout:Running transaction check 2021-02-12T17:13:52.966 INFO:teuthology.orchestra.run.gibba002.stdout:Transaction check succeeded. 2021-02-12T17:13:52.966 INFO:teuthology.orchestra.run.gibba002.stdout:Running transaction test 2021-02-12T17:13:52.978 INFO:teuthology.orchestra.run.gibba004.stdout:Transaction check succeeded. 2021-02-12T17:13:52.978 INFO:teuthology.orchestra.run.gibba004.stdout:Running transaction test 2021-02-12T17:13:53.997 INFO:teuthology.orchestra.run.gibba002.stdout:Transaction test succeeded. 2021-02-12T17:13:53.999 INFO:teuthology.orchestra.run.gibba002.stdout:Running transaction 2021-02-12T17:13:54.026 INFO:teuthology.orchestra.run.gibba004.stdout:Transaction test succeeded. 2021-02-12T17:13:54.028 INFO:teuthology.orchestra.run.gibba004.stdout:Running transaction 2021-02-12T17:13:58.994 INFO:teuthology.orchestra.run.gibba002.stdout: Preparing : 1/1 2021-02-12T17:13:59.028 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: zlib-1.2.11-16.el8_2.x86_64 1/1 2021-02-12T17:13:59.207 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : zlib-1.2.11-16.el8_2.x86_64 1/164 2021-02-12T17:13:59.327 INFO:teuthology.orchestra.run.gibba004.stdout: Preparing : 1/1 2021-02-12T17:13:59.363 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: zlib-1.2.11-16.el8_2.x86_64 1/1 2021-02-12T17:13:59.408 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/164 2021-02-12T17:13:59.527 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : zlib-1.2.11-16.el8_2.x86_64 1/164 2021-02-12T17:13:59.548 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : libcom_err-1.45.6-1.el8.x86_64 3/164 2021-02-12T17:13:59.595 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: libcom_err-1.45.6-1.el8.x86_64 3/164 2021-02-12T17:13:59.736 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/164 2021-02-12T17:13:59.778 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/164 2021-02-12T17:13:59.885 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : libcom_err-1.45.6-1.el8.x86_64 3/164 2021-02-12T17:13:59.934 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: libcom_err-1.45.6-1.el8.x86_64 3/164 2021-02-12T17:13:59.990 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : leveldb-1.22-1.el8.x86_64 5/164 2021-02-12T17:14:00.139 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 6/164 2021-02-12T17:14:00.140 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/164 2021-02-12T17:14:00.187 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 6/164 2021-02-12T17:14:00.335 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : leveldb-1.22-1.el8.x86_64 5/164 2021-02-12T17:14:00.366 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 7/164 2021-02-12T17:14:00.485 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 6/164 2021-02-12T17:14:00.540 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/164 2021-02-12T17:14:00.559 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 6/164 2021-02-12T17:14:00.736 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 7/164 2021-02-12T17:14:00.841 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/164 2021-02-12T17:14:00.926 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/164 2021-02-12T17:14:01.006 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : librados2-2:17.0.0-720.g4819f209.el8.x86_64 9/164 2021-02-12T17:14:01.256 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/164 2021-02-12T17:14:01.276 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: librados2-2:17.0.0-720.g4819f209.el8.x86_64 9/164 2021-02-12T17:14:01.414 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : librbd1-2:17.0.0-720.g4819f209.el8.x86_64 10/164 2021-02-12T17:14:01.468 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : librados2-2:17.0.0-720.g4819f209.el8.x86_64 9/164 2021-02-12T17:14:01.521 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: librbd1-2:17.0.0-720.g4819f209.el8.x86_64 10/164 2021-02-12T17:14:01.698 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : libcephfs2-2:17.0.0-720.g4819f209.el8.x86_64 11/164 2021-02-12T17:14:01.742 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: librados2-2:17.0.0-720.g4819f209.el8.x86_64 9/164 2021-02-12T17:14:01.782 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: libcephfs2-2:17.0.0-720.g4819f209.el8.x86_64 11/164 2021-02-12T17:14:01.935 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : librbd1-2:17.0.0-720.g4819f209.el8.x86_64 10/164 2021-02-12T17:14:02.042 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: librbd1-2:17.0.0-720.g4819f209.el8.x86_64 10/164 2021-02-12T17:14:02.209 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-rados-2:17.0.0-720.g4819f209.el8.x86_64 12/164 2021-02-12T17:14:02.218 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : libcephfs2-2:17.0.0-720.g4819f209.el8.x86_64 11/164 2021-02-12T17:14:02.305 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: libcephfs2-2:17.0.0-720.g4819f209.el8.x86_64 11/164 2021-02-12T17:14:02.348 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : librgw2-2:17.0.0-720.g4819f209.el8.x86_64 13/164 2021-02-12T17:14:02.424 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: librgw2-2:17.0.0-720.g4819f209.el8.x86_64 13/164 2021-02-12T17:14:02.641 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : elfutils-libelf-0.180-1.el8.x86_64 14/164 2021-02-12T17:14:02.751 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-rados-2:17.0.0-720.g4819f209.el8.x86_64 12/164 2021-02-12T17:14:02.831 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : pcre2-10.32-2.el8.x86_64 15/164 2021-02-12T17:14:02.918 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : librgw2-2:17.0.0-720.g4819f209.el8.x86_64 13/164 2021-02-12T17:14:02.999 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : libselinux-2.9-4.el8_3.x86_64 16/164 2021-02-12T17:14:03.000 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: librgw2-2:17.0.0-720.g4819f209.el8.x86_64 13/164 2021-02-12T17:14:03.025 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: libselinux-2.9-4.el8_3.x86_64 16/164 2021-02-12T17:14:03.192 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : elfutils-libelf-0.180-1.el8.x86_64 14/164 2021-02-12T17:14:03.207 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/164 2021-02-12T17:14:03.371 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 18/164 2021-02-12T17:14:03.376 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : pcre2-10.32-2.el8.x86_64 15/164 2021-02-12T17:14:03.515 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : libradosstriper1-2:17.0.0-720.g4819f209.el8.x86_ 19/164 2021-02-12T17:14:03.553 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : libselinux-2.9-4.el8_3.x86_64 16/164 2021-02-12T17:14:03.563 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: libradosstriper1-2:17.0.0-720.g4819f209.el8.x86_ 19/164 2021-02-12T17:14:03.577 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: libselinux-2.9-4.el8_3.x86_64 16/164 2021-02-12T17:14:03.751 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/164 2021-02-12T17:14:03.942 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 18/164 2021-02-12T17:14:04.048 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 20/164 2021-02-12T17:14:04.085 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : libradosstriper1-2:17.0.0-720.g4819f209.el8.x86_ 19/164 2021-02-12T17:14:04.136 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: libradosstriper1-2:17.0.0-720.g4819f209.el8.x86_ 19/164 2021-02-12T17:14:04.456 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-12.el8_3.x86_64 21/164 2021-02-12T17:14:04.515 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-12.el8_3.x86_64 21/164 2021-02-12T17:14:04.721 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: NetworkManager-1:1.26.0-12.el8_3.x86_64 22/164 2021-02-12T17:14:04.899 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 20/164 2021-02-12T17:14:04.957 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : NetworkManager-1:1.26.0-12.el8_3.x86_64 22/164 2021-02-12T17:14:05.309 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-12.el8_3.x86_64 21/164 2021-02-12T17:14:05.363 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: NetworkManager-1:1.26.0-12.el8_3.x86_64 22/164 2021-02-12T17:14:05.370 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-12.el8_3.x86_64 21/164 2021-02-12T17:14:05.561 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/164 2021-02-12T17:14:05.575 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: NetworkManager-1:1.26.0-12.el8_3.x86_64 22/164 2021-02-12T17:14:05.750 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/164 2021-02-12T17:14:05.835 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : NetworkManager-1:1.26.0-12.el8_3.x86_64 22/164 2021-02-12T17:14:05.942 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 25/164 2021-02-12T17:14:06.123 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 26/164 2021-02-12T17:14:06.226 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: NetworkManager-1:1.26.0-12.el8_3.x86_64 22/164 2021-02-12T17:14:06.232 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 26/164 2021-02-12T17:14:06.364 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 27/164 2021-02-12T17:14:06.390 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/164 2021-02-12T17:14:06.562 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/164 2021-02-12T17:14:06.754 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 27/164 2021-02-12T17:14:06.779 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 25/164 2021-02-12T17:14:06.898 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : openblas-0.3.3-5.el8.x86_64 28/164 2021-02-12T17:14:06.918 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 26/164 2021-02-12T17:14:07.021 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 26/164 2021-02-12T17:14:07.185 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 27/164 2021-02-12T17:14:07.292 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 28/164 2021-02-12T17:14:07.431 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 29/164 2021-02-12T17:14:07.584 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 27/164 2021-02-12T17:14:07.735 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : openblas-0.3.3-5.el8.x86_64 28/164 2021-02-12T17:14:07.963 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 29/164 2021-02-12T17:14:08.135 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 28/164 2021-02-12T17:14:08.237 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 30/164 2021-02-12T17:14:08.276 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 29/164 2021-02-12T17:14:08.442 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 31/164 2021-02-12T17:14:08.624 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 32/164 2021-02-12T17:14:08.813 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 29/164 2021-02-12T17:14:08.824 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 33/164 2021-02-12T17:14:08.969 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-ceph-common-2:17.0.0-720.g4819f209.el8.x 34/164 2021-02-12T17:14:09.079 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-ceph-argparse-2:17.0.0-720.g4819f209.el8 35/164 2021-02-12T17:14:09.114 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 30/164 2021-02-12T17:14:09.287 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-cephfs-2:17.0.0-720.g4819f209.el8.x86_64 36/164 2021-02-12T17:14:09.295 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 31/164 2021-02-12T17:14:09.519 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 32/164 2021-02-12T17:14:09.705 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 33/164 2021-02-12T17:14:09.881 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-ceph-common-2:17.0.0-720.g4819f209.el8.x 34/164 2021-02-12T17:14:09.991 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-ceph-argparse-2:17.0.0-720.g4819f209.el8 35/164 2021-02-12T17:14:10.024 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 37/164 2021-02-12T17:14:10.198 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-cephfs-2:17.0.0-720.g4819f209.el8.x86_64 36/164 2021-02-12T17:14:10.293 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 38/164 2021-02-12T17:14:10.502 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 39/164 2021-02-12T17:14:10.748 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 40/164 2021-02-12T17:14:10.936 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 37/164 2021-02-12T17:14:11.195 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 38/164 2021-02-12T17:14:11.439 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 39/164 2021-02-12T17:14:11.635 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 40/164 2021-02-12T17:14:12.195 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 40/164 2021-02-12T17:14:12.456 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-scipy-1.0.0-20.module_el8.3.0+562+e16282 41/164 2021-02-12T17:14:12.643 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 42/164 2021-02-12T17:14:12.891 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 43/164 2021-02-12T17:14:13.087 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 44/164 2021-02-12T17:14:13.099 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 40/164 2021-02-12T17:14:13.319 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 45/164 2021-02-12T17:14:13.401 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-scipy-1.0.0-20.module_el8.3.0+562+e16282 41/164 2021-02-12T17:14:13.524 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : libselinux-utils-2.9-4.el8_3.x86_64 46/164 2021-02-12T17:14:13.621 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 42/164 2021-02-12T17:14:13.716 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-rgw-2:17.0.0-720.g4819f209.el8.x86_64 47/164 2021-02-12T17:14:13.819 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 43/164 2021-02-12T17:14:13.891 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-rbd-2:17.0.0-720.g4819f209.el8.x86_64 48/164 2021-02-12T17:14:14.024 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 44/164 2021-02-12T17:14:14.051 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : librados-devel-2:17.0.0-720.g4819f209.el8.x86_64 49/164 2021-02-12T17:14:14.222 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/164 2021-02-12T17:14:14.238 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 45/164 2021-02-12T17:14:14.364 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : e2fsprogs-libs-1.45.6-1.el8.x86_64 51/164 2021-02-12T17:14:14.432 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: e2fsprogs-libs-1.45.6-1.el8.x86_64 51/164 2021-02-12T17:14:14.542 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : libselinux-utils-2.9-4.el8_3.x86_64 46/164 2021-02-12T17:14:14.581 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : libss-1.45.6-1.el8.x86_64 52/164 2021-02-12T17:14:14.720 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-rgw-2:17.0.0-720.g4819f209.el8.x86_64 47/164 2021-02-12T17:14:14.735 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: libss-1.45.6-1.el8.x86_64 52/164 2021-02-12T17:14:14.928 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-rbd-2:17.0.0-720.g4819f209.el8.x86_64 48/164 2021-02-12T17:14:14.945 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : e2fsprogs-1.45.6-1.el8.x86_64 53/164 2021-02-12T17:14:15.096 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : librados-devel-2:17.0.0-720.g4819f209.el8.x86_64 49/164 2021-02-12T17:14:15.153 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 54/164 2021-02-12T17:14:15.267 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/164 2021-02-12T17:14:15.378 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 55/164 2021-02-12T17:14:15.518 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : e2fsprogs-libs-1.45.6-1.el8.x86_64 51/164 2021-02-12T17:14:15.578 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 56/164 2021-02-12T17:14:15.578 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: e2fsprogs-libs-1.45.6-1.el8.x86_64 51/164 2021-02-12T17:14:15.726 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : libss-1.45.6-1.el8.x86_64 52/164 2021-02-12T17:14:15.753 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 57/164 2021-02-12T17:14:15.891 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: libss-1.45.6-1.el8.x86_64 52/164 2021-02-12T17:14:15.943 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 58/164 2021-02-12T17:14:16.114 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 59/164 2021-02-12T17:14:16.149 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : e2fsprogs-1.45.6-1.el8.x86_64 53/164 2021-02-12T17:14:16.297 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 60/164 2021-02-12T17:14:16.340 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 54/164 2021-02-12T17:14:16.494 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 61/164 2021-02-12T17:14:16.904 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 55/164 2021-02-12T17:14:16.904 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 56/164 2021-02-12T17:14:16.904 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 62/164 2021-02-12T17:14:16.905 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 63/164 2021-02-12T17:14:16.973 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 57/164 2021-02-12T17:14:17.001 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 64/164 2021-02-12T17:14:17.122 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 58/164 2021-02-12T17:14:17.181 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 65/164 2021-02-12T17:14:17.325 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 59/164 2021-02-12T17:14:17.377 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 66/164 2021-02-12T17:14:17.517 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 60/164 2021-02-12T17:14:17.599 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-portend-2.6-1.el8.noarch 67/164 2021-02-12T17:14:17.731 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 61/164 2021-02-12T17:14:17.806 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 68/164 2021-02-12T17:14:17.895 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 62/164 2021-02-12T17:14:17.987 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 69/164 2021-02-12T17:14:18.039 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 63/164 2021-02-12T17:14:18.175 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 70/164 2021-02-12T17:14:18.262 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 64/164 2021-02-12T17:14:18.374 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 71/164 2021-02-12T17:14:18.435 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 65/164 2021-02-12T17:14:18.572 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 72/164 2021-02-12T17:14:18.639 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 66/164 2021-02-12T17:14:18.794 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 73/164 2021-02-12T17:14:18.844 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-portend-2.6-1.el8.noarch 67/164 2021-02-12T17:14:19.034 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 68/164 2021-02-12T17:14:19.046 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 74/164 2021-02-12T17:14:19.265 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 69/164 2021-02-12T17:14:19.277 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 75/164 2021-02-12T17:14:19.454 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 70/164 2021-02-12T17:14:19.463 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 76/164 2021-02-12T17:14:19.705 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 77/164 2021-02-12T17:14:19.736 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 71/164 2021-02-12T17:14:19.903 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : gperftools-libs-2.8-1.el8.x86_64 78/164 2021-02-12T17:14:19.917 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 72/164 2021-02-12T17:14:20.117 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 79/164 2021-02-12T17:14:20.173 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 73/164 2021-02-12T17:14:20.340 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-urllib3-1.24.2-4.el8.noarch 80/164 2021-02-12T17:14:20.416 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 74/164 2021-02-12T17:14:20.561 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 81/164 2021-02-12T17:14:20.663 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 75/164 2021-02-12T17:14:20.755 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 82/164 2021-02-12T17:14:20.850 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 76/164 2021-02-12T17:14:21.099 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 77/164 2021-02-12T17:14:21.315 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : gperftools-libs-2.8-1.el8.x86_64 78/164 2021-02-12T17:14:21.554 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 79/164 2021-02-12T17:14:21.560 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 83/164 2021-02-12T17:14:21.768 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-urllib3-1.24.2-4.el8.noarch 80/164 2021-02-12T17:14:21.847 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 84/164 2021-02-12T17:14:22.015 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 81/164 2021-02-12T17:14:22.030 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 85/164 2021-02-12T17:14:22.217 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 82/164 2021-02-12T17:14:22.285 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 86/164 2021-02-12T17:14:22.483 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 87/164 2021-02-12T17:14:22.637 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 88/164 2021-02-12T17:14:22.797 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 89/164 2021-02-12T17:14:23.001 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 83/164 2021-02-12T17:14:23.041 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 90/164 2021-02-12T17:14:23.257 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : libselinux-devel-2.9-4.el8_3.x86_64 91/164 2021-02-12T17:14:23.292 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 84/164 2021-02-12T17:14:23.433 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 92/164 2021-02-12T17:14:23.517 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 85/164 2021-02-12T17:14:23.650 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 93/164 2021-02-12T17:14:23.650 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 94/164 2021-02-12T17:14:23.650 INFO:teuthology.orchestra.run.gibba002.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2021-02-12T17:14:23.650 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:14:23.788 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 86/164 2021-02-12T17:14:24.004 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 87/164 2021-02-12T17:14:24.067 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : fuse-2.9.7-12.el8.x86_64 95/164 2021-02-12T17:14:24.157 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 88/164 2021-02-12T17:14:24.256 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 96/164 2021-02-12T17:14:24.342 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 89/164 2021-02-12T17:14:24.517 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 97/164 2021-02-12T17:14:24.610 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 90/164 2021-02-12T17:14:24.709 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 98/164 2021-02-12T17:14:24.861 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : libselinux-devel-2.9-4.el8_3.x86_64 91/164 2021-02-12T17:14:25.011 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 92/164 2021-02-12T17:14:25.025 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 99/164 2021-02-12T17:14:25.262 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 93/164 2021-02-12T17:14:25.262 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 94/164 2021-02-12T17:14:25.262 INFO:teuthology.orchestra.run.gibba004.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2021-02-12T17:14:25.262 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:14:25.274 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 100/164 2021-02-12T17:14:25.550 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 101/164 2021-02-12T17:14:25.646 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : fuse-2.9.7-12.el8.x86_64 95/164 2021-02-12T17:14:25.779 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 102/164 2021-02-12T17:14:25.876 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 96/164 2021-02-12T17:14:25.932 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 103/164 2021-02-12T17:14:26.145 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 97/164 2021-02-12T17:14:26.362 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 98/164 2021-02-12T17:14:26.747 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 99/164 2021-02-12T17:14:27.014 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 100/164 2021-02-12T17:14:27.320 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 101/164 2021-02-12T17:14:27.616 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 102/164 2021-02-12T17:14:27.769 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 103/164 2021-02-12T17:14:28.664 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: ceph-common-2:17.0.0-720.g4819f209.el8.x86_64 104/164 2021-02-12T17:14:28.873 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-common-2:17.0.0-720.g4819f209.el8.x86_64 104/164 2021-02-12T17:14:29.386 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: ceph-common-2:17.0.0-720.g4819f209.el8.x86_64 104/164 2021-02-12T17:14:29.698 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-base-2:17.0.0-720.g4819f209.el8.x86_64 105/164 2021-02-12T17:14:29.785 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: ceph-base-2:17.0.0-720.g4819f209.el8.x86_64 105/164 2021-02-12T17:14:29.931 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-selinux-2:17.0.0-720.g4819f209.el8.x86_64 106/164 2021-02-12T17:14:30.449 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: ceph-common-2:17.0.0-720.g4819f209.el8.x86_64 104/164 2021-02-12T17:14:30.785 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-common-2:17.0.0-720.g4819f209.el8.x86_64 104/164 2021-02-12T17:14:31.303 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: ceph-common-2:17.0.0-720.g4819f209.el8.x86_64 104/164 2021-02-12T17:14:31.621 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-base-2:17.0.0-720.g4819f209.el8.x86_64 105/164 2021-02-12T17:14:31.710 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: ceph-base-2:17.0.0-720.g4819f209.el8.x86_64 105/164 2021-02-12T17:14:31.852 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-selinux-2:17.0.0-720.g4819f209.el8.x86_64 106/164 2021-02-12T17:14:40.005 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: ceph-selinux-2:17.0.0-720.g4819f209.el8.x86_64 106/164 2021-02-12T17:14:40.006 INFO:teuthology.orchestra.run.gibba002.stdout:skipping the directory /sys 2021-02-12T17:14:40.006 INFO:teuthology.orchestra.run.gibba002.stdout:skipping the directory /proc 2021-02-12T17:14:40.006 INFO:teuthology.orchestra.run.gibba002.stdout:skipping the directory /dev 2021-02-12T17:14:40.006 INFO:teuthology.orchestra.run.gibba002.stdout:skipping the directory /run 2021-02-12T17:14:40.006 INFO:teuthology.orchestra.run.gibba002.stdout:skipping the directory /mnt 2021-02-12T17:14:40.006 INFO:teuthology.orchestra.run.gibba002.stdout:skipping the directory /var/tmp 2021-02-12T17:14:40.006 INFO:teuthology.orchestra.run.gibba002.stdout:skipping the directory /home 2021-02-12T17:14:40.006 INFO:teuthology.orchestra.run.gibba002.stdout:skipping the directory /tmp 2021-02-12T17:14:40.006 INFO:teuthology.orchestra.run.gibba002.stdout:skipping the directory /dev 2021-02-12T17:14:40.006 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:14:40.356 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-mds-2:17.0.0-720.g4819f209.el8.x86_64 107/164 2021-02-12T17:14:40.684 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: ceph-mds-2:17.0.0-720.g4819f209.el8.x86_64 107/164 2021-02-12T17:14:41.218 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-mon-2:17.0.0-720.g4819f209.el8.x86_64 108/164 2021-02-12T17:14:41.918 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: ceph-selinux-2:17.0.0-720.g4819f209.el8.x86_64 106/164 2021-02-12T17:14:41.919 INFO:teuthology.orchestra.run.gibba004.stdout:skipping the directory /sys 2021-02-12T17:14:41.919 INFO:teuthology.orchestra.run.gibba004.stdout:skipping the directory /proc 2021-02-12T17:14:41.919 INFO:teuthology.orchestra.run.gibba004.stdout:skipping the directory /dev 2021-02-12T17:14:41.919 INFO:teuthology.orchestra.run.gibba004.stdout:skipping the directory /run 2021-02-12T17:14:41.919 INFO:teuthology.orchestra.run.gibba004.stdout:skipping the directory /mnt 2021-02-12T17:14:41.919 INFO:teuthology.orchestra.run.gibba004.stdout:skipping the directory /var/tmp 2021-02-12T17:14:41.919 INFO:teuthology.orchestra.run.gibba004.stdout:skipping the directory /home 2021-02-12T17:14:41.919 INFO:teuthology.orchestra.run.gibba004.stdout:skipping the directory /tmp 2021-02-12T17:14:41.919 INFO:teuthology.orchestra.run.gibba004.stdout:skipping the directory /dev 2021-02-12T17:14:41.919 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:14:42.269 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-mds-2:17.0.0-720.g4819f209.el8.x86_64 107/164 2021-02-12T17:14:42.377 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: ceph-mon-2:17.0.0-720.g4819f209.el8.x86_64 108/164 2021-02-12T17:14:42.581 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-osd-2:17.0.0-720.g4819f209.el8.x86_64 109/164 2021-02-12T17:14:42.596 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: ceph-mds-2:17.0.0-720.g4819f209.el8.x86_64 107/164 2021-02-12T17:14:42.603 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: ceph-osd-2:17.0.0-720.g4819f209.el8.x86_64 109/164 2021-02-12T17:14:42.778 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 110/164 2021-02-12T17:14:42.804 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-mon-2:17.0.0-720.g4819f209.el8.x86_64 108/164 2021-02-12T17:14:42.980 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 111/164 2021-02-12T17:14:43.139 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 112/164 2021-02-12T17:14:43.210 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 112/164 2021-02-12T17:14:43.464 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : jq-1.5-12.el8.x86_64 113/164 2021-02-12T17:14:43.673 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : automake-1.16.1-6.el8.noarch 114/164 2021-02-12T17:14:43.954 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: ceph-mon-2:17.0.0-720.g4819f209.el8.x86_64 108/164 2021-02-12T17:14:44.154 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-osd-2:17.0.0-720.g4819f209.el8.x86_64 109/164 2021-02-12T17:14:44.177 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: ceph-osd-2:17.0.0-720.g4819f209.el8.x86_64 109/164 2021-02-12T17:14:44.399 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 110/164 2021-02-12T17:14:44.609 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 111/164 2021-02-12T17:14:44.810 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 112/164 2021-02-12T17:14:44.859 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: cephadm-2:17.0.0-720.g4819f209.el8.noarch 115/164 2021-02-12T17:14:44.866 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 112/164 2021-02-12T17:14:45.015 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : cephadm-2:17.0.0-720.g4819f209.el8.noarch 115/164 2021-02-12T17:14:45.119 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-720.g4819f209.el 116/164 2021-02-12T17:14:45.134 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : jq-1.5-12.el8.x86_64 113/164 2021-02-12T17:14:45.296 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-720.g4819f209.e 117/164 2021-02-12T17:14:45.377 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : automake-1.16.1-6.el8.noarch 114/164 2021-02-12T17:14:45.498 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-720.g4819f209.el8.noar 118/164 2021-02-12T17:14:46.119 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-720.g4819f209.el8.noar 118/164 2021-02-12T17:14:46.347 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-720.g4819f209.el8.no 119/164 2021-02-12T17:14:46.592 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: cephadm-2:17.0.0-720.g4819f209.el8.noarch 115/164 2021-02-12T17:14:46.797 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : cephadm-2:17.0.0-720.g4819f209.el8.noarch 115/164 2021-02-12T17:14:46.890 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-720.g4819f209.el 116/164 2021-02-12T17:14:47.158 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-720.g4819f209.el8.no 119/164 2021-02-12T17:14:47.473 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-720.g4819 120/164 2021-02-12T17:14:47.750 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-720.g4819 120/164 2021-02-12T17:14:47.751 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-720.g4819f209.e 117/164 2021-02-12T17:14:47.856 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-720.g4819f209.el8 121/164 2021-02-12T17:14:47.993 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-720.g4819f209.el8.noar 118/164 2021-02-12T17:14:48.031 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-mgr-2:17.0.0-720.g4819f209.el8.x86_64 122/164 2021-02-12T17:14:48.052 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: ceph-mgr-2:17.0.0-720.g4819f209.el8.x86_64 122/164 2021-02-12T17:14:48.214 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-mgr-rook-2:17.0.0-720.g4819f209.el8.noarch 123/164 2021-02-12T17:14:48.224 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-720.g4819f209.el8.noarch 123/164 2021-02-12T17:14:48.379 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-2:17.0.0-720.g4819f209.el8.x86_64 124/164 2021-02-12T17:14:48.539 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : libtool-2.4.6-25.el8.x86_64 125/164 2021-02-12T17:14:48.601 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-720.g4819f209.el8.noar 118/164 2021-02-12T17:14:48.879 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-720.g4819f209.el8.no 119/164 2021-02-12T17:14:49.681 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-720.g4819f209.el8.no 119/164 2021-02-12T17:14:49.918 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-720.g4819 120/164 2021-02-12T17:14:49.992 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-720.g4819 120/164 2021-02-12T17:14:50.321 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-720.g4819f209.el8 121/164 2021-02-12T17:14:50.529 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-mgr-2:17.0.0-720.g4819f209.el8.x86_64 122/164 2021-02-12T17:14:50.550 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: ceph-mgr-2:17.0.0-720.g4819f209.el8.x86_64 122/164 2021-02-12T17:14:50.718 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-mgr-rook-2:17.0.0-720.g4819f209.el8.noarch 123/164 2021-02-12T17:14:50.728 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-720.g4819f209.el8.noarch 123/164 2021-02-12T17:14:50.892 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-2:17.0.0-720.g4819f209.el8.x86_64 124/164 2021-02-12T17:14:51.044 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : libtool-2.4.6-25.el8.x86_64 125/164 2021-02-12T17:14:52.014 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 125/164 2021-02-12T17:14:53.050 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-test-2:17.0.0-720.g4819f209.el8.x86_64 126/164 2021-02-12T17:14:53.289 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-radosgw-2:17.0.0-720.g4819f209.el8.x86_64 127/164 2021-02-12T17:14:53.369 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-720.g4819f209.el8.x86_64 127/164 2021-02-12T17:14:53.548 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : cephfs-mirror-2:17.0.0-720.g4819f209.el8.x86_64 128/164 2021-02-12T17:14:53.817 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-720.g4819f209.el8.x86_64 128/164 2021-02-12T17:14:54.031 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : rbd-mirror-2:17.0.0-720.g4819f209.el8.x86_64 129/164 2021-02-12T17:14:54.103 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: rbd-mirror-2:17.0.0-720.g4819f209.el8.x86_64 129/164 2021-02-12T17:14:54.491 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 125/164 2021-02-12T17:14:54.822 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-fuse-2:17.0.0-720.g4819f209.el8.x86_64 130/164 2021-02-12T17:14:55.106 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : openssl-devel-1:1.1.1g-12.el8_3.x86_64 131/164 2021-02-12T17:14:55.267 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 132/164 2021-02-12T17:14:55.509 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : libcephfs-devel-2:17.0.0-720.g4819f209.el8.x86_6 133/164 2021-02-12T17:14:55.539 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-test-2:17.0.0-720.g4819f209.el8.x86_64 126/164 2021-02-12T17:14:55.713 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : NetworkManager-team-1:1.26.0-12.el8_3.x86_64 134/164 2021-02-12T17:14:55.788 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-radosgw-2:17.0.0-720.g4819f209.el8.x86_64 127/164 2021-02-12T17:14:55.861 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-720.g4819f209.el8.x86_64 127/164 2021-02-12T17:14:55.918 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : NetworkManager-tui-1:1.26.0-12.el8_3.x86_64 135/164 2021-02-12T17:14:56.144 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : cephfs-mirror-2:17.0.0-720.g4819f209.el8.x86_64 128/164 2021-02-12T17:14:56.190 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 136/164 2021-02-12T17:14:56.413 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-720.g4819f209.el8.x86_64 128/164 2021-02-12T17:14:56.439 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : iproute-5.3.0-5.el8.x86_64 137/164 2021-02-12T17:14:56.619 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : rbd-mirror-2:17.0.0-720.g4819f209.el8.x86_64 129/164 2021-02-12T17:14:56.670 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : python3-libselinux-2.9-4.el8_3.x86_64 138/164 2021-02-12T17:14:56.691 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: rbd-mirror-2:17.0.0-720.g4819f209.el8.x86_64 129/164 2021-02-12T17:14:56.909 INFO:teuthology.orchestra.run.gibba002.stdout: Upgrading : elfutils-libs-0.180-1.el8.x86_64 139/164 2021-02-12T17:14:57.120 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : cephfs-top-2:17.0.0-720.g4819f209.el8.noarch 140/164 2021-02-12T17:14:57.343 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : rbd-fuse-2:17.0.0-720.g4819f209.el8.x86_64 141/164 2021-02-12T17:14:57.414 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-fuse-2:17.0.0-720.g4819f209.el8.x86_64 130/164 2021-02-12T17:14:57.567 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : rbd-nbd-2:17.0.0-720.g4819f209.el8.x86_64 142/164 2021-02-12T17:14:57.693 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : openssl-devel-1:1.1.1g-12.el8_3.x86_64 131/164 2021-02-12T17:14:57.808 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-720.g4819f2 143/164 2021-02-12T17:14:57.824 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-720.g4819f2 143/164 2021-02-12T17:14:57.896 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 132/164 2021-02-12T17:14:57.970 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 144/164 2021-02-12T17:14:58.121 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : libcephfs-devel-2:17.0.0-720.g4819f209.el8.x86_6 133/164 2021-02-12T17:14:58.148 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : flex-2.6.1-9.el8.x86_64 145/164 2021-02-12T17:14:58.207 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 145/164 2021-02-12T17:14:58.601 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : NetworkManager-team-1:1.26.0-12.el8_3.x86_64 134/164 2021-02-12T17:14:58.847 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : NetworkManager-tui-1:1.26.0-12.el8_3.x86_64 135/164 2021-02-12T17:14:59.187 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 136/164 2021-02-12T17:14:59.231 INFO:teuthology.orchestra.run.gibba002.stdout: Installing : bison-3.0.4-10.el8.x86_64 146/164 2021-02-12T17:14:59.269 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 146/164 2021-02-12T17:14:59.468 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : iproute-5.3.0-5.el8.x86_64 137/164 2021-02-12T17:14:59.549 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : NetworkManager-tui-1:1.22.8-4.el8.x86_64 147/164 2021-02-12T17:14:59.742 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : elfutils-libs-0.178-7.el8.x86_64 148/164 2021-02-12T17:14:59.745 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : python3-libselinux-2.9-4.el8_3.x86_64 138/164 2021-02-12T17:14:59.951 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : e2fsprogs-1.45.4-3.el8.x86_64 149/164 2021-02-12T17:14:59.990 INFO:teuthology.orchestra.run.gibba004.stdout: Upgrading : elfutils-libs-0.180-1.el8.x86_64 139/164 2021-02-12T17:15:00.159 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : libselinux-utils-2.9-3.el8.x86_64 150/164 2021-02-12T17:15:00.225 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : cephfs-top-2:17.0.0-720.g4819f209.el8.noarch 140/164 2021-02-12T17:15:00.358 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : iproute-5.3.0-1.el8.x86_64 151/164 2021-02-12T17:15:00.358 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 152/164 2021-02-12T17:15:00.439 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : rbd-fuse-2:17.0.0-720.g4819f209.el8.x86_64 141/164 2021-02-12T17:15:00.574 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 152/164 2021-02-12T17:15:00.575 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : e2fsprogs-libs-1.45.4-3.el8.x86_64 153/164 2021-02-12T17:15:00.672 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : rbd-nbd-2:17.0.0-720.g4819f209.el8.x86_64 142/164 2021-02-12T17:15:00.766 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: e2fsprogs-libs-1.45.4-3.el8.x86_64 153/164 2021-02-12T17:15:00.766 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : libss-1.45.4-3.el8.x86_64 154/164 2021-02-12T17:15:00.892 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-720.g4819f2 143/164 2021-02-12T17:15:00.907 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-720.g4819f2 143/164 2021-02-12T17:15:00.958 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: libss-1.45.4-3.el8.x86_64 154/164 2021-02-12T17:15:01.100 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 144/164 2021-02-12T17:15:01.124 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : python3-libselinux-2.9-3.el8.x86_64 155/164 2021-02-12T17:15:01.277 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : flex-2.6.1-9.el8.x86_64 145/164 2021-02-12T17:15:01.299 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : elfutils-libelf-0.178-7.el8.x86_64 156/164 2021-02-12T17:15:01.336 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 145/164 2021-02-12T17:15:01.458 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : NetworkManager-team-1:1.22.8-4.el8.x86_64 157/164 2021-02-12T17:15:01.465 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: NetworkManager-1:1.22.8-4.el8.x86_64 158/164 2021-02-12T17:15:01.466 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : NetworkManager-1:1.22.8-4.el8.x86_64 158/164 2021-02-12T17:15:01.560 INFO:teuthology.orchestra.run.gibba004.stdout: Installing : bison-3.0.4-10.el8.x86_64 146/164 2021-02-12T17:15:01.572 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 146/164 2021-02-12T17:15:01.695 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : NetworkManager-tui-1:1.22.8-4.el8.x86_64 147/164 2021-02-12T17:15:01.699 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: NetworkManager-1:1.22.8-4.el8.x86_64 158/164 2021-02-12T17:15:01.891 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : elfutils-libs-0.178-7.el8.x86_64 148/164 2021-02-12T17:15:01.893 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : libselinux-2.9-3.el8.x86_64 159/164 2021-02-12T17:15:02.059 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : pcre2-10.32-1.el8.x86_64 160/164 2021-02-12T17:15:02.059 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : NetworkManager-libnm-1:1.22.8-4.el8.x86_64 161/164 2021-02-12T17:15:02.155 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : e2fsprogs-1.45.4-3.el8.x86_64 149/164 2021-02-12T17:15:02.299 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: NetworkManager-libnm-1:1.22.8-4.el8.x86_64 161/164 2021-02-12T17:15:02.351 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : libselinux-utils-2.9-3.el8.x86_64 150/164 2021-02-12T17:15:02.482 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : zlib-1.2.11-13.el8.x86_64 162/164 2021-02-12T17:15:02.483 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : libcom_err-1.45.4-3.el8.x86_64 163/164 2021-02-12T17:15:02.587 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : iproute-5.3.0-1.el8.x86_64 151/164 2021-02-12T17:15:02.587 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 152/164 2021-02-12T17:15:02.675 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: libcom_err-1.45.4-3.el8.x86_64 163/164 2021-02-12T17:15:02.675 INFO:teuthology.orchestra.run.gibba002.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 164/164 2021-02-12T17:15:02.829 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 152/164 2021-02-12T17:15:02.829 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : e2fsprogs-libs-1.45.4-3.el8.x86_64 153/164 2021-02-12T17:15:03.062 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: e2fsprogs-libs-1.45.4-3.el8.x86_64 153/164 2021-02-12T17:15:03.062 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : libss-1.45.4-3.el8.x86_64 154/164 2021-02-12T17:15:03.270 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: libss-1.45.4-3.el8.x86_64 154/164 2021-02-12T17:15:03.330 INFO:teuthology.orchestra.run.gibba002.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 164/164 2021-02-12T17:15:03.330 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-2:17.0.0-720.g4819f209.el8.x86_64 1/164 2021-02-12T17:15:03.330 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-base-2:17.0.0-720.g4819f209.el8.x86_64 2/164 2021-02-12T17:15:03.330 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-common-2:17.0.0-720.g4819f209.el8.x86_64 3/164 2021-02-12T17:15:03.331 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-fuse-2:17.0.0-720.g4819f209.el8.x86_64 4/164 2021-02-12T17:15:03.331 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-720.g4819f2 5/164 2021-02-12T17:15:03.331 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-mds-2:17.0.0-720.g4819f209.el8.x86_64 6/164 2021-02-12T17:15:03.331 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-mgr-2:17.0.0-720.g4819f209.el8.x86_64 7/164 2021-02-12T17:15:03.331 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-mon-2:17.0.0-720.g4819f209.el8.x86_64 8/164 2021-02-12T17:15:03.331 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-osd-2:17.0.0-720.g4819f209.el8.x86_64 9/164 2021-02-12T17:15:03.332 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-radosgw-2:17.0.0-720.g4819f209.el8.x86_64 10/164 2021-02-12T17:15:03.332 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-selinux-2:17.0.0-720.g4819f209.el8.x86_64 11/164 2021-02-12T17:15:03.332 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-test-2:17.0.0-720.g4819f209.el8.x86_64 12/164 2021-02-12T17:15:03.332 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : cephfs-mirror-2:17.0.0-720.g4819f209.el8.x86_64 13/164 2021-02-12T17:15:03.332 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libcephfs-devel-2:17.0.0-720.g4819f209.el8.x86_6 14/164 2021-02-12T17:15:03.332 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libcephfs2-2:17.0.0-720.g4819f209.el8.x86_64 15/164 2021-02-12T17:15:03.332 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : librados-devel-2:17.0.0-720.g4819f209.el8.x86_64 16/164 2021-02-12T17:15:03.333 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libradosstriper1-2:17.0.0-720.g4819f209.el8.x86_ 17/164 2021-02-12T17:15:03.333 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : librgw2-2:17.0.0-720.g4819f209.el8.x86_64 18/164 2021-02-12T17:15:03.333 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-ceph-argparse-2:17.0.0-720.g4819f209.el8 19/164 2021-02-12T17:15:03.333 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-ceph-common-2:17.0.0-720.g4819f209.el8.x 20/164 2021-02-12T17:15:03.333 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-cephfs-2:17.0.0-720.g4819f209.el8.x86_64 21/164 2021-02-12T17:15:03.333 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-rados-2:17.0.0-720.g4819f209.el8.x86_64 22/164 2021-02-12T17:15:03.333 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-rbd-2:17.0.0-720.g4819f209.el8.x86_64 23/164 2021-02-12T17:15:03.333 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-rgw-2:17.0.0-720.g4819f209.el8.x86_64 24/164 2021-02-12T17:15:03.333 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : rbd-fuse-2:17.0.0-720.g4819f209.el8.x86_64 25/164 2021-02-12T17:15:03.333 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : rbd-mirror-2:17.0.0-720.g4819f209.el8.x86_64 26/164 2021-02-12T17:15:03.333 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : rbd-nbd-2:17.0.0-720.g4819f209.el8.x86_64 27/164 2021-02-12T17:15:03.333 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-720.g4819f209.e 28/164 2021-02-12T17:15:03.333 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-720.g4819f209.el8.noar 29/164 2021-02-12T17:15:03.351 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-720.g4819f209.el8.no 30/164 2021-02-12T17:15:03.351 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-720.g4819 31/164 2021-02-12T17:15:03.351 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-720.g4819f209.el8 32/164 2021-02-12T17:15:03.351 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-mgr-rook-2:17.0.0-720.g4819f209.el8.noarch 33/164 2021-02-12T17:15:03.351 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-720.g4819f209.el 34/164 2021-02-12T17:15:03.351 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : cephadm-2:17.0.0-720.g4819f209.el8.noarch 35/164 2021-02-12T17:15:03.351 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : cephfs-top-2:17.0.0-720.g4819f209.el8.noarch 36/164 2021-02-12T17:15:03.352 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : automake-1.16.1-6.el8.noarch 37/164 2021-02-12T17:15:03.352 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/164 2021-02-12T17:15:03.352 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/164 2021-02-12T17:15:03.352 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : jq-1.5-12.el8.x86_64 40/164 2021-02-12T17:15:03.352 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 41/164 2021-02-12T17:15:03.352 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/164 2021-02-12T17:15:03.352 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/164 2021-02-12T17:15:03.352 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 44/164 2021-02-12T17:15:03.352 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 45/164 2021-02-12T17:15:03.352 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 46/164 2021-02-12T17:15:03.352 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 47/164 2021-02-12T17:15:03.352 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 48/164 2021-02-12T17:15:03.352 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 49/164 2021-02-12T17:15:03.353 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 50/164 2021-02-12T17:15:03.353 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 51/164 2021-02-12T17:15:03.353 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 52/164 2021-02-12T17:15:03.353 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 53/164 2021-02-12T17:15:03.353 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 54/164 2021-02-12T17:15:03.353 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 55/164 2021-02-12T17:15:03.353 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 56/164 2021-02-12T17:15:03.353 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 57/164 2021-02-12T17:15:03.353 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 58/164 2021-02-12T17:15:03.353 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 59/164 2021-02-12T17:15:03.353 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 60/164 2021-02-12T17:15:03.353 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.3.0+562+e16282 61/164 2021-02-12T17:15:03.353 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 62/164 2021-02-12T17:15:03.353 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 63/164 2021-02-12T17:15:03.354 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 64/164 2021-02-12T17:15:03.354 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 65/164 2021-02-12T17:15:03.354 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 66/164 2021-02-12T17:15:03.354 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 67/164 2021-02-12T17:15:03.354 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 68/164 2021-02-12T17:15:03.354 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 69/164 2021-02-12T17:15:03.354 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 70/164 2021-02-12T17:15:03.354 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 71/164 2021-02-12T17:15:03.354 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 72/164 2021-02-12T17:15:03.354 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 73/164 2021-02-12T17:15:03.354 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 74/164 2021-02-12T17:15:03.354 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libselinux-devel-2.9-4.el8_3.x86_64 75/164 2021-02-12T17:15:03.355 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 76/164 2021-02-12T17:15:03.355 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 77/164 2021-02-12T17:15:03.355 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 78/164 2021-02-12T17:15:03.355 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 79/164 2021-02-12T17:15:03.355 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : openssl-devel-1:1.1.1g-12.el8_3.x86_64 80/164 2021-02-12T17:15:03.355 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/164 2021-02-12T17:15:03.355 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 82/164 2021-02-12T17:15:03.355 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 83/164 2021-02-12T17:15:03.355 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 84/164 2021-02-12T17:15:03.355 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 85/164 2021-02-12T17:15:03.356 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 86/164 2021-02-12T17:15:03.356 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 87/164 2021-02-12T17:15:03.356 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 88/164 2021-02-12T17:15:03.356 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 89/164 2021-02-12T17:15:03.356 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-urllib3-1.24.2-4.el8.noarch 90/164 2021-02-12T17:15:03.356 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 91/164 2021-02-12T17:15:03.356 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 92/164 2021-02-12T17:15:03.357 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 93/164 2021-02-12T17:15:03.357 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : gperftools-libs-2.8-1.el8.x86_64 94/164 2021-02-12T17:15:03.357 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : leveldb-1.22-1.el8.x86_64 95/164 2021-02-12T17:15:03.357 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 96/164 2021-02-12T17:15:03.357 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 97/164 2021-02-12T17:15:03.357 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 98/164 2021-02-12T17:15:03.358 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 99/164 2021-02-12T17:15:03.358 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 100/164 2021-02-12T17:15:03.358 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 101/164 2021-02-12T17:15:03.358 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 102/164 2021-02-12T17:15:03.358 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 103/164 2021-02-12T17:15:03.358 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 104/164 2021-02-12T17:15:03.358 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 105/164 2021-02-12T17:15:03.358 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 106/164 2021-02-12T17:15:03.358 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/164 2021-02-12T17:15:03.358 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/164 2021-02-12T17:15:03.359 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/164 2021-02-12T17:15:03.359 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/164 2021-02-12T17:15:03.359 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/164 2021-02-12T17:15:03.359 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/164 2021-02-12T17:15:03.359 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 113/164 2021-02-12T17:15:03.359 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-portend-2.6-1.el8.noarch 114/164 2021-02-12T17:15:03.359 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 115/164 2021-02-12T17:15:03.359 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/164 2021-02-12T17:15:03.359 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/164 2021-02-12T17:15:03.359 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 118/164 2021-02-12T17:15:03.359 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/164 2021-02-12T17:15:03.359 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/164 2021-02-12T17:15:03.360 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/164 2021-02-12T17:15:03.360 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/164 2021-02-12T17:15:03.360 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 123/164 2021-02-12T17:15:03.360 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/164 2021-02-12T17:15:03.360 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/164 2021-02-12T17:15:03.360 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/164 2021-02-12T17:15:03.360 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/164 2021-02-12T17:15:03.360 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 128/164 2021-02-12T17:15:03.361 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : librados2-2:17.0.0-720.g4819f209.el8.x86_64 129/164 2021-02-12T17:15:03.361 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/164 2021-02-12T17:15:03.361 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : librbd1-2:17.0.0-720.g4819f209.el8.x86_64 131/164 2021-02-12T17:15:03.361 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/164 2021-02-12T17:15:03.361 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : NetworkManager-1:1.26.0-12.el8_3.x86_64 133/164 2021-02-12T17:15:03.361 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : NetworkManager-1:1.22.8-4.el8.x86_64 134/164 2021-02-12T17:15:03.361 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : NetworkManager-libnm-1:1.26.0-12.el8_3.x86_64 135/164 2021-02-12T17:15:03.361 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : NetworkManager-libnm-1:1.22.8-4.el8.x86_64 136/164 2021-02-12T17:15:03.361 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : NetworkManager-team-1:1.26.0-12.el8_3.x86_64 137/164 2021-02-12T17:15:03.361 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : NetworkManager-team-1:1.22.8-4.el8.x86_64 138/164 2021-02-12T17:15:03.361 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : NetworkManager-tui-1:1.26.0-12.el8_3.x86_64 139/164 2021-02-12T17:15:03.361 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : NetworkManager-tui-1:1.22.8-4.el8.x86_64 140/164 2021-02-12T17:15:03.361 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : e2fsprogs-1.45.6-1.el8.x86_64 141/164 2021-02-12T17:15:03.361 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : e2fsprogs-1.45.4-3.el8.x86_64 142/164 2021-02-12T17:15:03.362 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : e2fsprogs-libs-1.45.6-1.el8.x86_64 143/164 2021-02-12T17:15:03.362 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : e2fsprogs-libs-1.45.4-3.el8.x86_64 144/164 2021-02-12T17:15:03.362 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : elfutils-libelf-0.180-1.el8.x86_64 145/164 2021-02-12T17:15:03.362 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : elfutils-libelf-0.178-7.el8.x86_64 146/164 2021-02-12T17:15:03.362 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : elfutils-libs-0.180-1.el8.x86_64 147/164 2021-02-12T17:15:03.362 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : elfutils-libs-0.178-7.el8.x86_64 148/164 2021-02-12T17:15:03.362 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : iproute-5.3.0-5.el8.x86_64 149/164 2021-02-12T17:15:03.362 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : iproute-5.3.0-1.el8.x86_64 150/164 2021-02-12T17:15:03.362 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libcom_err-1.45.6-1.el8.x86_64 151/164 2021-02-12T17:15:03.362 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libcom_err-1.45.4-3.el8.x86_64 152/164 2021-02-12T17:15:03.363 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libselinux-2.9-4.el8_3.x86_64 153/164 2021-02-12T17:15:03.363 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libselinux-2.9-3.el8.x86_64 154/164 2021-02-12T17:15:03.363 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libselinux-utils-2.9-4.el8_3.x86_64 155/164 2021-02-12T17:15:03.363 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libselinux-utils-2.9-3.el8.x86_64 156/164 2021-02-12T17:15:03.363 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libss-1.45.6-1.el8.x86_64 157/164 2021-02-12T17:15:03.363 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : libss-1.45.4-3.el8.x86_64 158/164 2021-02-12T17:15:03.363 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : pcre2-10.32-2.el8.x86_64 159/164 2021-02-12T17:15:03.363 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : pcre2-10.32-1.el8.x86_64 160/164 2021-02-12T17:15:03.364 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-libselinux-2.9-4.el8_3.x86_64 161/164 2021-02-12T17:15:03.364 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : python3-libselinux-2.9-3.el8.x86_64 162/164 2021-02-12T17:15:03.364 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : zlib-1.2.11-16.el8_2.x86_64 163/164 2021-02-12T17:15:03.487 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : python3-libselinux-2.9-3.el8.x86_64 155/164 2021-02-12T17:15:03.670 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : elfutils-libelf-0.178-7.el8.x86_64 156/164 2021-02-12T17:15:04.239 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : NetworkManager-team-1:1.22.8-4.el8.x86_64 157/164 2021-02-12T17:15:04.247 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: NetworkManager-1:1.22.8-4.el8.x86_64 158/164 2021-02-12T17:15:04.248 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : NetworkManager-1:1.22.8-4.el8.x86_64 158/164 2021-02-12T17:15:05.121 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: NetworkManager-1:1.22.8-4.el8.x86_64 158/164 2021-02-12T17:15:05.319 INFO:teuthology.orchestra.run.gibba002.stdout: Verifying : zlib-1.2.11-13.el8.x86_64 164/164 2021-02-12T17:15:05.319 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:05.319 INFO:teuthology.orchestra.run.gibba002.stdout:Upgraded: 2021-02-12T17:15:05.319 INFO:teuthology.orchestra.run.gibba002.stdout: NetworkManager-1:1.26.0-12.el8_3.x86_64 2021-02-12T17:15:05.319 INFO:teuthology.orchestra.run.gibba002.stdout: NetworkManager-libnm-1:1.26.0-12.el8_3.x86_64 2021-02-12T17:15:05.319 INFO:teuthology.orchestra.run.gibba002.stdout: NetworkManager-team-1:1.26.0-12.el8_3.x86_64 2021-02-12T17:15:05.320 INFO:teuthology.orchestra.run.gibba002.stdout: NetworkManager-tui-1:1.26.0-12.el8_3.x86_64 2021-02-12T17:15:05.320 INFO:teuthology.orchestra.run.gibba002.stdout: e2fsprogs-1.45.6-1.el8.x86_64 2021-02-12T17:15:05.320 INFO:teuthology.orchestra.run.gibba002.stdout: e2fsprogs-libs-1.45.6-1.el8.x86_64 2021-02-12T17:15:05.320 INFO:teuthology.orchestra.run.gibba002.stdout: elfutils-libelf-0.180-1.el8.x86_64 2021-02-12T17:15:05.320 INFO:teuthology.orchestra.run.gibba002.stdout: elfutils-libs-0.180-1.el8.x86_64 2021-02-12T17:15:05.320 INFO:teuthology.orchestra.run.gibba002.stdout: iproute-5.3.0-5.el8.x86_64 2021-02-12T17:15:05.320 INFO:teuthology.orchestra.run.gibba002.stdout: libcom_err-1.45.6-1.el8.x86_64 2021-02-12T17:15:05.320 INFO:teuthology.orchestra.run.gibba002.stdout: librados2-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.320 INFO:teuthology.orchestra.run.gibba002.stdout: librbd1-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.320 INFO:teuthology.orchestra.run.gibba002.stdout: libselinux-2.9-4.el8_3.x86_64 2021-02-12T17:15:05.320 INFO:teuthology.orchestra.run.gibba002.stdout: libselinux-utils-2.9-4.el8_3.x86_64 2021-02-12T17:15:05.320 INFO:teuthology.orchestra.run.gibba002.stdout: libss-1.45.6-1.el8.x86_64 2021-02-12T17:15:05.321 INFO:teuthology.orchestra.run.gibba002.stdout: pcre2-10.32-2.el8.x86_64 2021-02-12T17:15:05.321 INFO:teuthology.orchestra.run.gibba002.stdout: python3-libselinux-2.9-4.el8_3.x86_64 2021-02-12T17:15:05.321 INFO:teuthology.orchestra.run.gibba002.stdout: zlib-1.2.11-16.el8_2.x86_64 2021-02-12T17:15:05.321 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:05.321 INFO:teuthology.orchestra.run.gibba002.stdout:Installed: 2021-02-12T17:15:05.321 INFO:teuthology.orchestra.run.gibba002.stdout: automake-1.16.1-6.el8.noarch 2021-02-12T17:15:05.321 INFO:teuthology.orchestra.run.gibba002.stdout: bison-3.0.4-10.el8.x86_64 2021-02-12T17:15:05.321 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.321 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-base-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.321 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-common-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.321 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-fuse-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.321 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-grafana-dashboards-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:05.322 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-immutable-object-cache-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.322 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mds-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.322 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mgr-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.322 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mgr-cephadm-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:05.322 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mgr-dashboard-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:05.322 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mgr-diskprediction-local-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:05.322 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mgr-modules-core-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:05.322 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mgr-rook-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:05.322 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-mon-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.322 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-osd-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.322 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-prometheus-alerts-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:05.323 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-radosgw-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.323 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-selinux-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.323 INFO:teuthology.orchestra.run.gibba002.stdout: ceph-test-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.323 INFO:teuthology.orchestra.run.gibba002.stdout: cephadm-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:05.323 INFO:teuthology.orchestra.run.gibba002.stdout: cephfs-mirror-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.323 INFO:teuthology.orchestra.run.gibba002.stdout: cephfs-top-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:05.323 INFO:teuthology.orchestra.run.gibba002.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2021-02-12T17:15:05.323 INFO:teuthology.orchestra.run.gibba002.stdout: flex-2.6.1-9.el8.x86_64 2021-02-12T17:15:05.323 INFO:teuthology.orchestra.run.gibba002.stdout: fmt-6.2.1-1.el8.x86_64 2021-02-12T17:15:05.323 INFO:teuthology.orchestra.run.gibba002.stdout: fuse-2.9.7-12.el8.x86_64 2021-02-12T17:15:05.323 INFO:teuthology.orchestra.run.gibba002.stdout: fuse-common-3.2.1-12.el8.x86_64 2021-02-12T17:15:05.323 INFO:teuthology.orchestra.run.gibba002.stdout: gperftools-libs-2.8-1.el8.x86_64 2021-02-12T17:15:05.323 INFO:teuthology.orchestra.run.gibba002.stdout: jq-1.5-12.el8.x86_64 2021-02-12T17:15:05.324 INFO:teuthology.orchestra.run.gibba002.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2021-02-12T17:15:05.324 INFO:teuthology.orchestra.run.gibba002.stdout: krb5-devel-1.18.2-5.el8.x86_64 2021-02-12T17:15:05.324 INFO:teuthology.orchestra.run.gibba002.stdout: leveldb-1.22-1.el8.x86_64 2021-02-12T17:15:05.324 INFO:teuthology.orchestra.run.gibba002.stdout: libaio-devel-0.3.112-1.el8.x86_64 2021-02-12T17:15:05.324 INFO:teuthology.orchestra.run.gibba002.stdout: libcephfs-devel-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.324 INFO:teuthology.orchestra.run.gibba002.stdout: libcephfs2-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.324 INFO:teuthology.orchestra.run.gibba002.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2021-02-12T17:15:05.324 INFO:teuthology.orchestra.run.gibba002.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2021-02-12T17:15:05.325 INFO:teuthology.orchestra.run.gibba002.stdout: liboath-2.6.2-3.el8.x86_64 2021-02-12T17:15:05.325 INFO:teuthology.orchestra.run.gibba002.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2021-02-12T17:15:05.325 INFO:teuthology.orchestra.run.gibba002.stdout: librabbitmq-0.9.0-2.el8.x86_64 2021-02-12T17:15:05.325 INFO:teuthology.orchestra.run.gibba002.stdout: librados-devel-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.325 INFO:teuthology.orchestra.run.gibba002.stdout: libradosstriper1-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.325 INFO:teuthology.orchestra.run.gibba002.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-02-12T17:15:05.325 INFO:teuthology.orchestra.run.gibba002.stdout: librgw2-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.325 INFO:teuthology.orchestra.run.gibba002.stdout: libselinux-devel-2.9-4.el8_3.x86_64 2021-02-12T17:15:05.325 INFO:teuthology.orchestra.run.gibba002.stdout: libsepol-devel-2.9-1.el8.x86_64 2021-02-12T17:15:05.325 INFO:teuthology.orchestra.run.gibba002.stdout: libtool-2.4.6-25.el8.x86_64 2021-02-12T17:15:05.325 INFO:teuthology.orchestra.run.gibba002.stdout: libunwind-1.3.1-3.el8.x86_64 2021-02-12T17:15:05.325 INFO:teuthology.orchestra.run.gibba002.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2021-02-12T17:15:05.326 INFO:teuthology.orchestra.run.gibba002.stdout: libverto-devel-0.3.0-5.el8.x86_64 2021-02-12T17:15:05.326 INFO:teuthology.orchestra.run.gibba002.stdout: libxslt-1.1.32-5.el8.x86_64 2021-02-12T17:15:05.326 INFO:teuthology.orchestra.run.gibba002.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-02-12T17:15:05.326 INFO:teuthology.orchestra.run.gibba002.stdout: oniguruma-6.8.2-2.el8.x86_64 2021-02-12T17:15:05.326 INFO:teuthology.orchestra.run.gibba002.stdout: openblas-0.3.3-5.el8.x86_64 2021-02-12T17:15:05.326 INFO:teuthology.orchestra.run.gibba002.stdout: openblas-threads-0.3.3-5.el8.x86_64 2021-02-12T17:15:05.326 INFO:teuthology.orchestra.run.gibba002.stdout: openssl-devel-1:1.1.1g-12.el8_3.x86_64 2021-02-12T17:15:05.326 INFO:teuthology.orchestra.run.gibba002.stdout: pcre2-devel-10.32-2.el8.x86_64 2021-02-12T17:15:05.326 INFO:teuthology.orchestra.run.gibba002.stdout: pcre2-utf16-10.32-2.el8.x86_64 2021-02-12T17:15:05.326 INFO:teuthology.orchestra.run.gibba002.stdout: pcre2-utf32-10.32-2.el8.x86_64 2021-02-12T17:15:05.326 INFO:teuthology.orchestra.run.gibba002.stdout: python3-apipkg-1.5-6.el8.noarch 2021-02-12T17:15:05.326 INFO:teuthology.orchestra.run.gibba002.stdout: python3-babel-2.5.1-5.el8.noarch 2021-02-12T17:15:05.327 INFO:teuthology.orchestra.run.gibba002.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-02-12T17:15:05.327 INFO:teuthology.orchestra.run.gibba002.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-02-12T17:15:05.327 INFO:teuthology.orchestra.run.gibba002.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-02-12T17:15:05.327 INFO:teuthology.orchestra.run.gibba002.stdout: python3-ceph-argparse-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.327 INFO:teuthology.orchestra.run.gibba002.stdout: python3-ceph-common-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.327 INFO:teuthology.orchestra.run.gibba002.stdout: python3-cephfs-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.327 INFO:teuthology.orchestra.run.gibba002.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-02-12T17:15:05.327 INFO:teuthology.orchestra.run.gibba002.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-02-12T17:15:05.327 INFO:teuthology.orchestra.run.gibba002.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-02-12T17:15:05.327 INFO:teuthology.orchestra.run.gibba002.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-02-12T17:15:05.327 INFO:teuthology.orchestra.run.gibba002.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-02-12T17:15:05.327 INFO:teuthology.orchestra.run.gibba002.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-02-12T17:15:05.327 INFO:teuthology.orchestra.run.gibba002.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-02-12T17:15:05.328 INFO:teuthology.orchestra.run.gibba002.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-02-12T17:15:05.328 INFO:teuthology.orchestra.run.gibba002.stdout: python3-jaraco-6.2-6.el8.noarch 2021-02-12T17:15:05.328 INFO:teuthology.orchestra.run.gibba002.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-02-12T17:15:05.328 INFO:teuthology.orchestra.run.gibba002.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-02-12T17:15:05.328 INFO:teuthology.orchestra.run.gibba002.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-02-12T17:15:05.328 INFO:teuthology.orchestra.run.gibba002.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-02-12T17:15:05.328 INFO:teuthology.orchestra.run.gibba002.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-02-12T17:15:05.328 INFO:teuthology.orchestra.run.gibba002.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-02-12T17:15:05.328 INFO:teuthology.orchestra.run.gibba002.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-02-12T17:15:05.328 INFO:teuthology.orchestra.run.gibba002.stdout: python3-lxml-4.2.3-1.el8.x86_64 2021-02-12T17:15:05.328 INFO:teuthology.orchestra.run.gibba002.stdout: python3-mako-1.0.6-13.el8.noarch 2021-02-12T17:15:05.328 INFO:teuthology.orchestra.run.gibba002.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-02-12T17:15:05.328 INFO:teuthology.orchestra.run.gibba002.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-02-12T17:15:05.329 INFO:teuthology.orchestra.run.gibba002.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-02-12T17:15:05.329 INFO:teuthology.orchestra.run.gibba002.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-02-12T17:15:05.329 INFO:teuthology.orchestra.run.gibba002.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-02-12T17:15:05.329 INFO:teuthology.orchestra.run.gibba002.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-02-12T17:15:05.329 INFO:teuthology.orchestra.run.gibba002.stdout: python3-portend-2.6-1.el8.noarch 2021-02-12T17:15:05.329 INFO:teuthology.orchestra.run.gibba002.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-02-12T17:15:05.329 INFO:teuthology.orchestra.run.gibba002.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-02-12T17:15:05.329 INFO:teuthology.orchestra.run.gibba002.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-02-12T17:15:05.329 INFO:teuthology.orchestra.run.gibba002.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-02-12T17:15:05.329 INFO:teuthology.orchestra.run.gibba002.stdout: python3-pytz-2017.2-9.el8.noarch 2021-02-12T17:15:05.329 INFO:teuthology.orchestra.run.gibba002.stdout: python3-rados-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.329 INFO:teuthology.orchestra.run.gibba002.stdout: python3-rbd-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.330 INFO:teuthology.orchestra.run.gibba002.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-02-12T17:15:05.330 INFO:teuthology.orchestra.run.gibba002.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-02-12T17:15:05.330 INFO:teuthology.orchestra.run.gibba002.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-02-12T17:15:05.330 INFO:teuthology.orchestra.run.gibba002.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-02-12T17:15:05.330 INFO:teuthology.orchestra.run.gibba002.stdout: python3-rgw-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.330 INFO:teuthology.orchestra.run.gibba002.stdout: python3-routes-2.4.1-12.el8.noarch 2021-02-12T17:15:05.330 INFO:teuthology.orchestra.run.gibba002.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-02-12T17:15:05.330 INFO:teuthology.orchestra.run.gibba002.stdout: python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x86_64 2021-02-12T17:15:05.330 INFO:teuthology.orchestra.run.gibba002.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-02-12T17:15:05.330 INFO:teuthology.orchestra.run.gibba002.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-02-12T17:15:05.330 INFO:teuthology.orchestra.run.gibba002.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-02-12T17:15:05.331 INFO:teuthology.orchestra.run.gibba002.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-02-12T17:15:05.331 INFO:teuthology.orchestra.run.gibba002.stdout: python3-urllib3-1.24.2-4.el8.noarch 2021-02-12T17:15:05.331 INFO:teuthology.orchestra.run.gibba002.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-02-12T17:15:05.331 INFO:teuthology.orchestra.run.gibba002.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-02-12T17:15:05.331 INFO:teuthology.orchestra.run.gibba002.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-02-12T17:15:05.331 INFO:teuthology.orchestra.run.gibba002.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-02-12T17:15:05.331 INFO:teuthology.orchestra.run.gibba002.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-02-12T17:15:05.331 INFO:teuthology.orchestra.run.gibba002.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-02-12T17:15:05.331 INFO:teuthology.orchestra.run.gibba002.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-02-12T17:15:05.331 INFO:teuthology.orchestra.run.gibba002.stdout: rbd-fuse-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.331 INFO:teuthology.orchestra.run.gibba002.stdout: rbd-mirror-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.331 INFO:teuthology.orchestra.run.gibba002.stdout: rbd-nbd-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:05.331 INFO:teuthology.orchestra.run.gibba002.stdout: socat-1.7.3.3-2.el8.x86_64 2021-02-12T17:15:05.332 INFO:teuthology.orchestra.run.gibba002.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2021-02-12T17:15:05.332 INFO:teuthology.orchestra.run.gibba002.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-02-12T17:15:05.332 INFO:teuthology.orchestra.run.gibba002.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2021-02-12T17:15:05.332 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:05.332 INFO:teuthology.orchestra.run.gibba002.stdout:Complete! 2021-02-12T17:15:05.421 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : libselinux-2.9-3.el8.x86_64 159/164 2021-02-12T17:15:05.464 DEBUG:teuthology.parallel:result is None 2021-02-12T17:15:05.613 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : pcre2-10.32-1.el8.x86_64 160/164 2021-02-12T17:15:05.613 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : NetworkManager-libnm-1:1.22.8-4.el8.x86_64 161/164 2021-02-12T17:15:05.820 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: NetworkManager-libnm-1:1.22.8-4.el8.x86_64 161/164 2021-02-12T17:15:06.028 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : zlib-1.2.11-13.el8.x86_64 162/164 2021-02-12T17:15:06.028 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : libcom_err-1.45.4-3.el8.x86_64 163/164 2021-02-12T17:15:06.221 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: libcom_err-1.45.4-3.el8.x86_64 163/164 2021-02-12T17:15:06.221 INFO:teuthology.orchestra.run.gibba004.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 164/164 2021-02-12T17:15:06.916 INFO:teuthology.orchestra.run.gibba004.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 164/164 2021-02-12T17:15:06.916 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-2:17.0.0-720.g4819f209.el8.x86_64 1/164 2021-02-12T17:15:06.916 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-base-2:17.0.0-720.g4819f209.el8.x86_64 2/164 2021-02-12T17:15:06.916 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-common-2:17.0.0-720.g4819f209.el8.x86_64 3/164 2021-02-12T17:15:06.916 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-fuse-2:17.0.0-720.g4819f209.el8.x86_64 4/164 2021-02-12T17:15:06.916 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-720.g4819f2 5/164 2021-02-12T17:15:06.917 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-mds-2:17.0.0-720.g4819f209.el8.x86_64 6/164 2021-02-12T17:15:06.917 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-mgr-2:17.0.0-720.g4819f209.el8.x86_64 7/164 2021-02-12T17:15:06.917 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-mon-2:17.0.0-720.g4819f209.el8.x86_64 8/164 2021-02-12T17:15:06.917 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-osd-2:17.0.0-720.g4819f209.el8.x86_64 9/164 2021-02-12T17:15:06.917 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-radosgw-2:17.0.0-720.g4819f209.el8.x86_64 10/164 2021-02-12T17:15:06.917 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-selinux-2:17.0.0-720.g4819f209.el8.x86_64 11/164 2021-02-12T17:15:06.917 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-test-2:17.0.0-720.g4819f209.el8.x86_64 12/164 2021-02-12T17:15:06.917 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : cephfs-mirror-2:17.0.0-720.g4819f209.el8.x86_64 13/164 2021-02-12T17:15:06.917 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libcephfs-devel-2:17.0.0-720.g4819f209.el8.x86_6 14/164 2021-02-12T17:15:06.917 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libcephfs2-2:17.0.0-720.g4819f209.el8.x86_64 15/164 2021-02-12T17:15:06.917 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : librados-devel-2:17.0.0-720.g4819f209.el8.x86_64 16/164 2021-02-12T17:15:06.918 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libradosstriper1-2:17.0.0-720.g4819f209.el8.x86_ 17/164 2021-02-12T17:15:06.918 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : librgw2-2:17.0.0-720.g4819f209.el8.x86_64 18/164 2021-02-12T17:15:06.918 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-ceph-argparse-2:17.0.0-720.g4819f209.el8 19/164 2021-02-12T17:15:06.918 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-ceph-common-2:17.0.0-720.g4819f209.el8.x 20/164 2021-02-12T17:15:06.918 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-cephfs-2:17.0.0-720.g4819f209.el8.x86_64 21/164 2021-02-12T17:15:06.918 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-rados-2:17.0.0-720.g4819f209.el8.x86_64 22/164 2021-02-12T17:15:06.918 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-rbd-2:17.0.0-720.g4819f209.el8.x86_64 23/164 2021-02-12T17:15:06.918 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-rgw-2:17.0.0-720.g4819f209.el8.x86_64 24/164 2021-02-12T17:15:06.918 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : rbd-fuse-2:17.0.0-720.g4819f209.el8.x86_64 25/164 2021-02-12T17:15:06.918 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : rbd-mirror-2:17.0.0-720.g4819f209.el8.x86_64 26/164 2021-02-12T17:15:06.919 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : rbd-nbd-2:17.0.0-720.g4819f209.el8.x86_64 27/164 2021-02-12T17:15:06.919 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-720.g4819f209.e 28/164 2021-02-12T17:15:06.919 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-720.g4819f209.el8.noar 29/164 2021-02-12T17:15:06.919 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-720.g4819f209.el8.no 30/164 2021-02-12T17:15:06.919 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-720.g4819 31/164 2021-02-12T17:15:06.919 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-720.g4819f209.el8 32/164 2021-02-12T17:15:06.919 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-mgr-rook-2:17.0.0-720.g4819f209.el8.noarch 33/164 2021-02-12T17:15:06.919 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-720.g4819f209.el 34/164 2021-02-12T17:15:06.919 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : cephadm-2:17.0.0-720.g4819f209.el8.noarch 35/164 2021-02-12T17:15:06.919 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : cephfs-top-2:17.0.0-720.g4819f209.el8.noarch 36/164 2021-02-12T17:15:06.920 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : automake-1.16.1-6.el8.noarch 37/164 2021-02-12T17:15:06.920 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/164 2021-02-12T17:15:06.920 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/164 2021-02-12T17:15:06.920 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : jq-1.5-12.el8.x86_64 40/164 2021-02-12T17:15:06.920 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 41/164 2021-02-12T17:15:06.920 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/164 2021-02-12T17:15:06.920 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/164 2021-02-12T17:15:06.920 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 44/164 2021-02-12T17:15:06.920 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 45/164 2021-02-12T17:15:06.920 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 46/164 2021-02-12T17:15:06.920 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 47/164 2021-02-12T17:15:06.921 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 48/164 2021-02-12T17:15:06.921 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 49/164 2021-02-12T17:15:06.921 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 50/164 2021-02-12T17:15:06.921 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 51/164 2021-02-12T17:15:06.921 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 52/164 2021-02-12T17:15:06.921 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 53/164 2021-02-12T17:15:06.921 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 54/164 2021-02-12T17:15:06.921 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 55/164 2021-02-12T17:15:06.921 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 56/164 2021-02-12T17:15:06.921 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 57/164 2021-02-12T17:15:06.921 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 58/164 2021-02-12T17:15:06.921 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 59/164 2021-02-12T17:15:06.922 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 60/164 2021-02-12T17:15:06.922 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.3.0+562+e16282 61/164 2021-02-12T17:15:06.922 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 62/164 2021-02-12T17:15:06.922 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 63/164 2021-02-12T17:15:06.922 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 64/164 2021-02-12T17:15:06.922 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 65/164 2021-02-12T17:15:06.922 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 66/164 2021-02-12T17:15:06.922 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 67/164 2021-02-12T17:15:06.922 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 68/164 2021-02-12T17:15:06.922 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 69/164 2021-02-12T17:15:06.922 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 70/164 2021-02-12T17:15:06.923 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 71/164 2021-02-12T17:15:06.923 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 72/164 2021-02-12T17:15:06.923 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 73/164 2021-02-12T17:15:06.923 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 74/164 2021-02-12T17:15:06.923 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libselinux-devel-2.9-4.el8_3.x86_64 75/164 2021-02-12T17:15:06.923 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 76/164 2021-02-12T17:15:06.923 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 77/164 2021-02-12T17:15:06.923 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 78/164 2021-02-12T17:15:06.923 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 79/164 2021-02-12T17:15:06.923 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : openssl-devel-1:1.1.1g-12.el8_3.x86_64 80/164 2021-02-12T17:15:06.923 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/164 2021-02-12T17:15:06.923 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 82/164 2021-02-12T17:15:06.924 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 83/164 2021-02-12T17:15:06.924 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 84/164 2021-02-12T17:15:06.924 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 85/164 2021-02-12T17:15:06.924 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 86/164 2021-02-12T17:15:06.924 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 87/164 2021-02-12T17:15:06.924 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 88/164 2021-02-12T17:15:06.924 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 89/164 2021-02-12T17:15:06.924 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-urllib3-1.24.2-4.el8.noarch 90/164 2021-02-12T17:15:06.924 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 91/164 2021-02-12T17:15:06.924 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 92/164 2021-02-12T17:15:06.924 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 93/164 2021-02-12T17:15:06.924 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : gperftools-libs-2.8-1.el8.x86_64 94/164 2021-02-12T17:15:06.925 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : leveldb-1.22-1.el8.x86_64 95/164 2021-02-12T17:15:06.925 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 96/164 2021-02-12T17:15:06.925 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 97/164 2021-02-12T17:15:06.925 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 98/164 2021-02-12T17:15:06.925 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 99/164 2021-02-12T17:15:06.925 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 100/164 2021-02-12T17:15:06.925 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 101/164 2021-02-12T17:15:06.925 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 102/164 2021-02-12T17:15:06.925 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 103/164 2021-02-12T17:15:06.925 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 104/164 2021-02-12T17:15:06.925 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 105/164 2021-02-12T17:15:06.925 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 106/164 2021-02-12T17:15:06.926 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/164 2021-02-12T17:15:06.926 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/164 2021-02-12T17:15:06.926 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/164 2021-02-12T17:15:06.926 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/164 2021-02-12T17:15:06.926 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/164 2021-02-12T17:15:06.926 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/164 2021-02-12T17:15:06.926 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 113/164 2021-02-12T17:15:06.926 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-portend-2.6-1.el8.noarch 114/164 2021-02-12T17:15:06.926 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 115/164 2021-02-12T17:15:06.926 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/164 2021-02-12T17:15:06.926 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/164 2021-02-12T17:15:06.927 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 118/164 2021-02-12T17:15:06.927 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/164 2021-02-12T17:15:06.927 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/164 2021-02-12T17:15:06.927 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/164 2021-02-12T17:15:06.927 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/164 2021-02-12T17:15:06.927 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 123/164 2021-02-12T17:15:06.927 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/164 2021-02-12T17:15:06.927 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/164 2021-02-12T17:15:06.927 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/164 2021-02-12T17:15:06.927 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/164 2021-02-12T17:15:06.927 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 128/164 2021-02-12T17:15:06.927 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : librados2-2:17.0.0-720.g4819f209.el8.x86_64 129/164 2021-02-12T17:15:06.928 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/164 2021-02-12T17:15:06.928 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : librbd1-2:17.0.0-720.g4819f209.el8.x86_64 131/164 2021-02-12T17:15:06.928 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/164 2021-02-12T17:15:06.928 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : NetworkManager-1:1.26.0-12.el8_3.x86_64 133/164 2021-02-12T17:15:06.928 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : NetworkManager-1:1.22.8-4.el8.x86_64 134/164 2021-02-12T17:15:06.928 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : NetworkManager-libnm-1:1.26.0-12.el8_3.x86_64 135/164 2021-02-12T17:15:06.928 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : NetworkManager-libnm-1:1.22.8-4.el8.x86_64 136/164 2021-02-12T17:15:06.928 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : NetworkManager-team-1:1.26.0-12.el8_3.x86_64 137/164 2021-02-12T17:15:06.928 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : NetworkManager-team-1:1.22.8-4.el8.x86_64 138/164 2021-02-12T17:15:06.928 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : NetworkManager-tui-1:1.26.0-12.el8_3.x86_64 139/164 2021-02-12T17:15:06.928 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : NetworkManager-tui-1:1.22.8-4.el8.x86_64 140/164 2021-02-12T17:15:06.929 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : e2fsprogs-1.45.6-1.el8.x86_64 141/164 2021-02-12T17:15:06.929 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : e2fsprogs-1.45.4-3.el8.x86_64 142/164 2021-02-12T17:15:06.929 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : e2fsprogs-libs-1.45.6-1.el8.x86_64 143/164 2021-02-12T17:15:06.929 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : e2fsprogs-libs-1.45.4-3.el8.x86_64 144/164 2021-02-12T17:15:06.929 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : elfutils-libelf-0.180-1.el8.x86_64 145/164 2021-02-12T17:15:06.929 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : elfutils-libelf-0.178-7.el8.x86_64 146/164 2021-02-12T17:15:06.929 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : elfutils-libs-0.180-1.el8.x86_64 147/164 2021-02-12T17:15:06.929 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : elfutils-libs-0.178-7.el8.x86_64 148/164 2021-02-12T17:15:06.929 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : iproute-5.3.0-5.el8.x86_64 149/164 2021-02-12T17:15:06.929 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : iproute-5.3.0-1.el8.x86_64 150/164 2021-02-12T17:15:06.929 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libcom_err-1.45.6-1.el8.x86_64 151/164 2021-02-12T17:15:06.930 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libcom_err-1.45.4-3.el8.x86_64 152/164 2021-02-12T17:15:06.930 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libselinux-2.9-4.el8_3.x86_64 153/164 2021-02-12T17:15:06.930 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libselinux-2.9-3.el8.x86_64 154/164 2021-02-12T17:15:06.930 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libselinux-utils-2.9-4.el8_3.x86_64 155/164 2021-02-12T17:15:06.930 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libselinux-utils-2.9-3.el8.x86_64 156/164 2021-02-12T17:15:06.930 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libss-1.45.6-1.el8.x86_64 157/164 2021-02-12T17:15:06.930 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : libss-1.45.4-3.el8.x86_64 158/164 2021-02-12T17:15:06.930 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : pcre2-10.32-2.el8.x86_64 159/164 2021-02-12T17:15:06.930 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : pcre2-10.32-1.el8.x86_64 160/164 2021-02-12T17:15:06.930 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-libselinux-2.9-4.el8_3.x86_64 161/164 2021-02-12T17:15:06.931 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : python3-libselinux-2.9-3.el8.x86_64 162/164 2021-02-12T17:15:06.931 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : zlib-1.2.11-16.el8_2.x86_64 163/164 2021-02-12T17:15:08.837 INFO:teuthology.orchestra.run.gibba004.stdout: Verifying : zlib-1.2.11-13.el8.x86_64 164/164 2021-02-12T17:15:08.837 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:08.837 INFO:teuthology.orchestra.run.gibba004.stdout:Upgraded: 2021-02-12T17:15:08.837 INFO:teuthology.orchestra.run.gibba004.stdout: NetworkManager-1:1.26.0-12.el8_3.x86_64 2021-02-12T17:15:08.837 INFO:teuthology.orchestra.run.gibba004.stdout: NetworkManager-libnm-1:1.26.0-12.el8_3.x86_64 2021-02-12T17:15:08.837 INFO:teuthology.orchestra.run.gibba004.stdout: NetworkManager-team-1:1.26.0-12.el8_3.x86_64 2021-02-12T17:15:08.837 INFO:teuthology.orchestra.run.gibba004.stdout: NetworkManager-tui-1:1.26.0-12.el8_3.x86_64 2021-02-12T17:15:08.837 INFO:teuthology.orchestra.run.gibba004.stdout: e2fsprogs-1.45.6-1.el8.x86_64 2021-02-12T17:15:08.837 INFO:teuthology.orchestra.run.gibba004.stdout: e2fsprogs-libs-1.45.6-1.el8.x86_64 2021-02-12T17:15:08.837 INFO:teuthology.orchestra.run.gibba004.stdout: elfutils-libelf-0.180-1.el8.x86_64 2021-02-12T17:15:08.838 INFO:teuthology.orchestra.run.gibba004.stdout: elfutils-libs-0.180-1.el8.x86_64 2021-02-12T17:15:08.838 INFO:teuthology.orchestra.run.gibba004.stdout: iproute-5.3.0-5.el8.x86_64 2021-02-12T17:15:08.838 INFO:teuthology.orchestra.run.gibba004.stdout: libcom_err-1.45.6-1.el8.x86_64 2021-02-12T17:15:08.838 INFO:teuthology.orchestra.run.gibba004.stdout: librados2-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.838 INFO:teuthology.orchestra.run.gibba004.stdout: librbd1-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.838 INFO:teuthology.orchestra.run.gibba004.stdout: libselinux-2.9-4.el8_3.x86_64 2021-02-12T17:15:08.838 INFO:teuthology.orchestra.run.gibba004.stdout: libselinux-utils-2.9-4.el8_3.x86_64 2021-02-12T17:15:08.838 INFO:teuthology.orchestra.run.gibba004.stdout: libss-1.45.6-1.el8.x86_64 2021-02-12T17:15:08.838 INFO:teuthology.orchestra.run.gibba004.stdout: pcre2-10.32-2.el8.x86_64 2021-02-12T17:15:08.838 INFO:teuthology.orchestra.run.gibba004.stdout: python3-libselinux-2.9-4.el8_3.x86_64 2021-02-12T17:15:08.838 INFO:teuthology.orchestra.run.gibba004.stdout: zlib-1.2.11-16.el8_2.x86_64 2021-02-12T17:15:08.838 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:08.839 INFO:teuthology.orchestra.run.gibba004.stdout:Installed: 2021-02-12T17:15:08.839 INFO:teuthology.orchestra.run.gibba004.stdout: automake-1.16.1-6.el8.noarch 2021-02-12T17:15:08.839 INFO:teuthology.orchestra.run.gibba004.stdout: bison-3.0.4-10.el8.x86_64 2021-02-12T17:15:08.839 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.839 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-base-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.839 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-common-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.839 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-fuse-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.839 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-grafana-dashboards-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:08.839 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-immutable-object-cache-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.839 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mds-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.839 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mgr-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.839 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mgr-cephadm-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:08.840 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mgr-dashboard-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:08.840 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mgr-diskprediction-local-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:08.840 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mgr-modules-core-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:08.840 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mgr-rook-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:08.840 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-mon-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.840 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-osd-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.840 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-prometheus-alerts-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:08.840 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-radosgw-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.840 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-selinux-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.840 INFO:teuthology.orchestra.run.gibba004.stdout: ceph-test-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.840 INFO:teuthology.orchestra.run.gibba004.stdout: cephadm-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:08.840 INFO:teuthology.orchestra.run.gibba004.stdout: cephfs-mirror-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.840 INFO:teuthology.orchestra.run.gibba004.stdout: cephfs-top-2:17.0.0-720.g4819f209.el8.noarch 2021-02-12T17:15:08.841 INFO:teuthology.orchestra.run.gibba004.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2021-02-12T17:15:08.841 INFO:teuthology.orchestra.run.gibba004.stdout: flex-2.6.1-9.el8.x86_64 2021-02-12T17:15:08.841 INFO:teuthology.orchestra.run.gibba004.stdout: fmt-6.2.1-1.el8.x86_64 2021-02-12T17:15:08.841 INFO:teuthology.orchestra.run.gibba004.stdout: fuse-2.9.7-12.el8.x86_64 2021-02-12T17:15:08.841 INFO:teuthology.orchestra.run.gibba004.stdout: fuse-common-3.2.1-12.el8.x86_64 2021-02-12T17:15:08.841 INFO:teuthology.orchestra.run.gibba004.stdout: gperftools-libs-2.8-1.el8.x86_64 2021-02-12T17:15:08.841 INFO:teuthology.orchestra.run.gibba004.stdout: jq-1.5-12.el8.x86_64 2021-02-12T17:15:08.841 INFO:teuthology.orchestra.run.gibba004.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2021-02-12T17:15:08.841 INFO:teuthology.orchestra.run.gibba004.stdout: krb5-devel-1.18.2-5.el8.x86_64 2021-02-12T17:15:08.841 INFO:teuthology.orchestra.run.gibba004.stdout: leveldb-1.22-1.el8.x86_64 2021-02-12T17:15:08.841 INFO:teuthology.orchestra.run.gibba004.stdout: libaio-devel-0.3.112-1.el8.x86_64 2021-02-12T17:15:08.841 INFO:teuthology.orchestra.run.gibba004.stdout: libcephfs-devel-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.841 INFO:teuthology.orchestra.run.gibba004.stdout: libcephfs2-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.842 INFO:teuthology.orchestra.run.gibba004.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2021-02-12T17:15:08.842 INFO:teuthology.orchestra.run.gibba004.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2021-02-12T17:15:08.842 INFO:teuthology.orchestra.run.gibba004.stdout: liboath-2.6.2-3.el8.x86_64 2021-02-12T17:15:08.842 INFO:teuthology.orchestra.run.gibba004.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2021-02-12T17:15:08.842 INFO:teuthology.orchestra.run.gibba004.stdout: librabbitmq-0.9.0-2.el8.x86_64 2021-02-12T17:15:08.842 INFO:teuthology.orchestra.run.gibba004.stdout: librados-devel-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.842 INFO:teuthology.orchestra.run.gibba004.stdout: libradosstriper1-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.842 INFO:teuthology.orchestra.run.gibba004.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-02-12T17:15:08.842 INFO:teuthology.orchestra.run.gibba004.stdout: librgw2-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.842 INFO:teuthology.orchestra.run.gibba004.stdout: libselinux-devel-2.9-4.el8_3.x86_64 2021-02-12T17:15:08.842 INFO:teuthology.orchestra.run.gibba004.stdout: libsepol-devel-2.9-1.el8.x86_64 2021-02-12T17:15:08.843 INFO:teuthology.orchestra.run.gibba004.stdout: libtool-2.4.6-25.el8.x86_64 2021-02-12T17:15:08.843 INFO:teuthology.orchestra.run.gibba004.stdout: libunwind-1.3.1-3.el8.x86_64 2021-02-12T17:15:08.843 INFO:teuthology.orchestra.run.gibba004.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2021-02-12T17:15:08.843 INFO:teuthology.orchestra.run.gibba004.stdout: libverto-devel-0.3.0-5.el8.x86_64 2021-02-12T17:15:08.843 INFO:teuthology.orchestra.run.gibba004.stdout: libxslt-1.1.32-5.el8.x86_64 2021-02-12T17:15:08.843 INFO:teuthology.orchestra.run.gibba004.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-02-12T17:15:08.844 INFO:teuthology.orchestra.run.gibba004.stdout: oniguruma-6.8.2-2.el8.x86_64 2021-02-12T17:15:08.844 INFO:teuthology.orchestra.run.gibba004.stdout: openblas-0.3.3-5.el8.x86_64 2021-02-12T17:15:08.844 INFO:teuthology.orchestra.run.gibba004.stdout: openblas-threads-0.3.3-5.el8.x86_64 2021-02-12T17:15:08.844 INFO:teuthology.orchestra.run.gibba004.stdout: openssl-devel-1:1.1.1g-12.el8_3.x86_64 2021-02-12T17:15:08.844 INFO:teuthology.orchestra.run.gibba004.stdout: pcre2-devel-10.32-2.el8.x86_64 2021-02-12T17:15:08.844 INFO:teuthology.orchestra.run.gibba004.stdout: pcre2-utf16-10.32-2.el8.x86_64 2021-02-12T17:15:08.844 INFO:teuthology.orchestra.run.gibba004.stdout: pcre2-utf32-10.32-2.el8.x86_64 2021-02-12T17:15:08.844 INFO:teuthology.orchestra.run.gibba004.stdout: python3-apipkg-1.5-6.el8.noarch 2021-02-12T17:15:08.844 INFO:teuthology.orchestra.run.gibba004.stdout: python3-babel-2.5.1-5.el8.noarch 2021-02-12T17:15:08.845 INFO:teuthology.orchestra.run.gibba004.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-02-12T17:15:08.845 INFO:teuthology.orchestra.run.gibba004.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-02-12T17:15:08.845 INFO:teuthology.orchestra.run.gibba004.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-02-12T17:15:08.845 INFO:teuthology.orchestra.run.gibba004.stdout: python3-ceph-argparse-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.845 INFO:teuthology.orchestra.run.gibba004.stdout: python3-ceph-common-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.845 INFO:teuthology.orchestra.run.gibba004.stdout: python3-cephfs-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.845 INFO:teuthology.orchestra.run.gibba004.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-02-12T17:15:08.845 INFO:teuthology.orchestra.run.gibba004.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-02-12T17:15:08.845 INFO:teuthology.orchestra.run.gibba004.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-02-12T17:15:08.845 INFO:teuthology.orchestra.run.gibba004.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-02-12T17:15:08.845 INFO:teuthology.orchestra.run.gibba004.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-02-12T17:15:08.845 INFO:teuthology.orchestra.run.gibba004.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-02-12T17:15:08.846 INFO:teuthology.orchestra.run.gibba004.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-02-12T17:15:08.846 INFO:teuthology.orchestra.run.gibba004.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-02-12T17:15:08.846 INFO:teuthology.orchestra.run.gibba004.stdout: python3-jaraco-6.2-6.el8.noarch 2021-02-12T17:15:08.846 INFO:teuthology.orchestra.run.gibba004.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-02-12T17:15:08.846 INFO:teuthology.orchestra.run.gibba004.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-02-12T17:15:08.846 INFO:teuthology.orchestra.run.gibba004.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-02-12T17:15:08.846 INFO:teuthology.orchestra.run.gibba004.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-02-12T17:15:08.846 INFO:teuthology.orchestra.run.gibba004.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-02-12T17:15:08.846 INFO:teuthology.orchestra.run.gibba004.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-02-12T17:15:08.847 INFO:teuthology.orchestra.run.gibba004.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-02-12T17:15:08.847 INFO:teuthology.orchestra.run.gibba004.stdout: python3-lxml-4.2.3-1.el8.x86_64 2021-02-12T17:15:08.847 INFO:teuthology.orchestra.run.gibba004.stdout: python3-mako-1.0.6-13.el8.noarch 2021-02-12T17:15:08.847 INFO:teuthology.orchestra.run.gibba004.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-02-12T17:15:08.847 INFO:teuthology.orchestra.run.gibba004.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-02-12T17:15:08.847 INFO:teuthology.orchestra.run.gibba004.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-02-12T17:15:08.847 INFO:teuthology.orchestra.run.gibba004.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-02-12T17:15:08.847 INFO:teuthology.orchestra.run.gibba004.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-02-12T17:15:08.847 INFO:teuthology.orchestra.run.gibba004.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-02-12T17:15:08.847 INFO:teuthology.orchestra.run.gibba004.stdout: python3-portend-2.6-1.el8.noarch 2021-02-12T17:15:08.847 INFO:teuthology.orchestra.run.gibba004.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-02-12T17:15:08.847 INFO:teuthology.orchestra.run.gibba004.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-02-12T17:15:08.847 INFO:teuthology.orchestra.run.gibba004.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-02-12T17:15:08.848 INFO:teuthology.orchestra.run.gibba004.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-02-12T17:15:08.848 INFO:teuthology.orchestra.run.gibba004.stdout: python3-pytz-2017.2-9.el8.noarch 2021-02-12T17:15:08.848 INFO:teuthology.orchestra.run.gibba004.stdout: python3-rados-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.848 INFO:teuthology.orchestra.run.gibba004.stdout: python3-rbd-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.848 INFO:teuthology.orchestra.run.gibba004.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-02-12T17:15:08.848 INFO:teuthology.orchestra.run.gibba004.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-02-12T17:15:08.848 INFO:teuthology.orchestra.run.gibba004.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-02-12T17:15:08.848 INFO:teuthology.orchestra.run.gibba004.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-02-12T17:15:08.848 INFO:teuthology.orchestra.run.gibba004.stdout: python3-rgw-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.848 INFO:teuthology.orchestra.run.gibba004.stdout: python3-routes-2.4.1-12.el8.noarch 2021-02-12T17:15:08.848 INFO:teuthology.orchestra.run.gibba004.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-02-12T17:15:08.848 INFO:teuthology.orchestra.run.gibba004.stdout: python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x86_64 2021-02-12T17:15:08.848 INFO:teuthology.orchestra.run.gibba004.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-02-12T17:15:08.848 INFO:teuthology.orchestra.run.gibba004.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-02-12T17:15:08.849 INFO:teuthology.orchestra.run.gibba004.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-02-12T17:15:08.849 INFO:teuthology.orchestra.run.gibba004.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-02-12T17:15:08.849 INFO:teuthology.orchestra.run.gibba004.stdout: python3-urllib3-1.24.2-4.el8.noarch 2021-02-12T17:15:08.849 INFO:teuthology.orchestra.run.gibba004.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-02-12T17:15:08.849 INFO:teuthology.orchestra.run.gibba004.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-02-12T17:15:08.849 INFO:teuthology.orchestra.run.gibba004.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-02-12T17:15:08.849 INFO:teuthology.orchestra.run.gibba004.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-02-12T17:15:08.849 INFO:teuthology.orchestra.run.gibba004.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-02-12T17:15:08.849 INFO:teuthology.orchestra.run.gibba004.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-02-12T17:15:08.849 INFO:teuthology.orchestra.run.gibba004.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-02-12T17:15:08.849 INFO:teuthology.orchestra.run.gibba004.stdout: rbd-fuse-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.849 INFO:teuthology.orchestra.run.gibba004.stdout: rbd-mirror-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.849 INFO:teuthology.orchestra.run.gibba004.stdout: rbd-nbd-2:17.0.0-720.g4819f209.el8.x86_64 2021-02-12T17:15:08.850 INFO:teuthology.orchestra.run.gibba004.stdout: socat-1.7.3.3-2.el8.x86_64 2021-02-12T17:15:08.850 INFO:teuthology.orchestra.run.gibba004.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2021-02-12T17:15:08.850 INFO:teuthology.orchestra.run.gibba004.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-02-12T17:15:08.850 INFO:teuthology.orchestra.run.gibba004.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2021-02-12T17:15:08.850 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:08.850 INFO:teuthology.orchestra.run.gibba004.stdout:Complete! 2021-02-12T17:15:08.963 DEBUG:teuthology.parallel:result is None 2021-02-12T17:15:08.963 DEBUG:teuthology.orchestra.run.gibba002:> sudo lsb_release -is 2021-02-12T17:15:08.998 INFO:teuthology.orchestra.run.gibba002.stdout:CentOS 2021-02-12T17:15:08.999 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-12T17:15:08.999 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4819f209edcf86cf21724c2e068d1a90ce8b9945 2021-02-12T17:15:09.162 DEBUG:teuthology.orchestra.run.gibba002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-02-12T17:15:09.178 INFO:teuthology.orchestra.run.gibba002.stdout:17.0.0-720.g4819f209.el8 2021-02-12T17:15:09.179 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-720.g4819f209.el8 2021-02-12T17:15:09.179 INFO:teuthology.task.install:The correct ceph version 17.0.0-720.g4819f209 is installed. 2021-02-12T17:15:09.179 DEBUG:teuthology.orchestra.run.gibba004:> sudo lsb_release -is 2021-02-12T17:15:09.212 INFO:teuthology.orchestra.run.gibba004.stdout:CentOS 2021-02-12T17:15:09.213 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-12T17:15:09.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4819f209edcf86cf21724c2e068d1a90ce8b9945 2021-02-12T17:15:09.373 DEBUG:teuthology.orchestra.run.gibba004:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-02-12T17:15:09.389 INFO:teuthology.orchestra.run.gibba004.stdout:17.0.0-720.g4819f209.el8 2021-02-12T17:15:09.389 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-720.g4819f209.el8 2021-02-12T17:15:09.389 INFO:teuthology.task.install:The correct ceph version 17.0.0-720.g4819f209 is installed. 2021-02-12T17:15:09.390 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-02-12T17:15:09.390 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:09.390 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-12T17:15:09.411 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:09.411 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-12T17:15:09.450 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-02-12T17:15:09.450 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:09.450 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd of=/usr/bin/daemon-helper 2021-02-12T17:15:09.471 DEBUG:teuthology.orchestra.run.gibba002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-12T17:15:09.530 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:09.531 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd of=/usr/bin/daemon-helper 2021-02-12T17:15:09.550 DEBUG:teuthology.orchestra.run.gibba004:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-12T17:15:09.609 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-02-12T17:15:09.609 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:09.609 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-12T17:15:09.629 DEBUG:teuthology.orchestra.run.gibba002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-12T17:15:09.689 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:09.689 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-12T17:15:09.708 DEBUG:teuthology.orchestra.run.gibba004:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-12T17:15:09.768 INFO:teuthology.run_tasks:Running task ceph... 2021-02-12T17:15:09.830 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-02-12T17:15:09.830 DEBUG:teuthology.orchestra.run.gibba002:> sudo chmod 777 /var/log/ceph 2021-02-12T17:15:09.833 DEBUG:teuthology.orchestra.run.gibba004:> sudo chmod 777 /var/log/ceph 2021-02-12T17:15:09.852 INFO:tasks.ceph:Disabling ceph logrotate... 2021-02-12T17:15:09.852 DEBUG:teuthology.orchestra.run.gibba002:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-12T17:15:09.893 DEBUG:teuthology.orchestra.run.gibba004:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-12T17:15:09.912 INFO:tasks.ceph:Creating extra log directories... 2021-02-12T17:15:09.912 DEBUG:teuthology.orchestra.run.gibba002:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-12T17:15:09.953 DEBUG:teuthology.orchestra.run.gibba004:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-12T17:15:09.980 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2021-02-12T17:15:09.980 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2021-02-12T17:15:09.980 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2021-02-12T17:15:09.980 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:09.981 DEBUG:teuthology.orchestra.run.gibba002:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-02-12T17:15:10.020 DEBUG:teuthology.orchestra.run.gibba002:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-02-12T17:15:10.119 DEBUG:teuthology.orchestra.run.gibba002:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2021-02-12T17:15:10.162 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:10.162 DEBUG:teuthology.orchestra.run.gibba004:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-02-12T17:15:10.175 DEBUG:teuthology.orchestra.run.gibba004:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-02-12T17:15:10.273 DEBUG:teuthology.orchestra.run.gibba004:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2021-02-12T17:15:10.319 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-02-12T17:15:10.319 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-02-12T17:15:10.319 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2021-02-12_03:15:03-fs-master-distro-basic-gibba/5875490', 'branch': 'master', 'description': 'fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '5875490', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'gibba', 'name': 'teuthology-2021-02-12_03:15:03-fs-master-distro-basic-gibba', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.2', 'overrides': {'admin_socket': {'branch': 'master'}, 'ceph': {'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '4819f209edcf86cf21724c2e068d1a90ce8b9945'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'install': {'ceph': {'sha1': '4819f209edcf86cf21724c2e068d1a90ce8b9945'}}, 'kclient': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'master', 'sha1': '3016de877106ce6671c889d12c3ef9513a2cf899'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'git://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'sha1': '4819f209edcf86cf21724c2e068d1a90ce8b9945', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'master', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_3016de877106ce6671c889d12c3ef9513a2cf899/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph.git', 'suite_sha1': '3016de877106ce6671c889d12c3ef9513a2cf899', 'targets': {'gibba002.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLCdALlEEkciJNrzyj1shN8HBBnvdxxLimcJWtZ0se8LMCa58a0hc6732o+hNZ5RijCcm///+RStLhFrCa6DZdOXa2pJi+G4Ft06xgGTl71fLaUduKB4YoP35OLwu8xG3ZyXcn0EJFxzI7ZElwdU3EPjRoYXedoWvupgo6I5ZGgkKtuEzqMMmxSIGJXt3W4SHB8foPgFmCeDjMYcL56EFcU5u+Md0zxTcVHjTxQTf+grFPgluE4Ac7QGGiYhlc6nuhrxnncEDIerqC4xtgTq3rJhHzMbfEyplqdXMydW+HfVpM5cPwvIa8IqYRL87Q4FnsBwF/W1CskGOXNaIa0QHzPADsCZDcl7Pq3r+wl5VDy00gxlcLMcBP2LuRwnQMNhhrHPQJMoo9UcGCQRCOfcdD8T/M9bzdmwaV0oES2OrzgjwQn1rtJr6+4q/03BS+mRXRXPvCC4xuvEp9QLTenYAaNR/Vpc2EZq/9Nba1r8oFu9B48nJMBQhXMdg0uzv6nks=', 'gibba004.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6vzI2KWoAEnISt+HUd7CzHECsKnIXUzr7XqI/50AQgp+ndOK7wsUhOFmmqeLwdQ7UxOa2K8xqX2jZ4r3P2mBIH+3P/jqEe4bfnBNJwFVYsVwEqDXDdM6oCSY9ZpZv5UFhvbf+9IrTS4BzzR4CjWyx6K+VAFjUbxnCNIgIDQxT0FvkDmjG+pCHMI3PAVOlaH/vM3FQEQqnMgBFkY2lOJUP6hnxgDj4lMEt9rR+NVnXngHg1I9F2J9+7BSpN5FA2hSSzAgnt3vHJD1DPyO646u8odTJIkUHy0AhK4jeT7JfOS9x+10AyPZ5apzFncnzGDwb6xExfMJQQAbLuKyRs25BEwg1uswJALF0w/YrH5HBDHFTKFP4bsgkgSjVW/ykImlw/3asLM9A3jETc1xfaAklAGvVPNspu52KpSoYaSuPaVvhB3IUdmtuzkXOpc/+WyVCAMZOlcd0krSjadmbjk3Dgt7efO6BP5sn7mfohKAnp6f/yReX7e1osG5oiVLvpfc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '4819f209edcf86cf21724c2e068d1a90ce8b9945'}}, {'ceph': None}, {'ceph-fuse': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['fs/snaps']}}}], 'teuthology_branch': 'master', 'teuthology_sha1': '87d40f79d7da6caf6da06c190938773bf745140c', 'timestamp': '2021-02-12_03:15:03', 'tube': 'gibba', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.gibba.29737'} 2021-02-12T17:15:10.320 DEBUG:teuthology.orchestra.run.gibba002:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-02-12T17:15:10.322 DEBUG:teuthology.orchestra.run.gibba004:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-02-12T17:15:10.364 DEBUG:teuthology.orchestra.run.gibba002:> sudo install -d -m0777 -- /var/run/ceph 2021-02-12T17:15:10.373 DEBUG:teuthology.orchestra.run.gibba004:> sudo install -d -m0777 -- /var/run/ceph 2021-02-12T17:15:10.424 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:10.425 DEBUG:teuthology.orchestra.run.gibba002:> dd if=/scratch_devs of=/dev/stdout 2021-02-12T17:15:10.444 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-02-12T17:15:10.444 DEBUG:teuthology.orchestra.run.gibba002:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-02-12T17:15:10.496 INFO:teuthology.orchestra.run.gibba002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-02-12T17:15:10.496 INFO:teuthology.orchestra.run.gibba002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-12T17:15:10.496 INFO:teuthology.orchestra.run.gibba002.stdout:Device: 6h/6d Inode: 122987 Links: 1 2021-02-12T17:15:10.496 INFO:teuthology.orchestra.run.gibba002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-12T17:15:10.496 INFO:teuthology.orchestra.run.gibba002.stdout:Context: system_u:object_r:device_t:s0 2021-02-12T17:15:10.496 INFO:teuthology.orchestra.run.gibba002.stdout:Access: 2021-02-12 17:15:03.062007966 +0000 2021-02-12T17:15:10.496 INFO:teuthology.orchestra.run.gibba002.stdout:Modify: 2021-02-12 17:13:07.590724033 +0000 2021-02-12T17:15:10.496 INFO:teuthology.orchestra.run.gibba002.stdout:Change: 2021-02-12 17:13:07.590724033 +0000 2021-02-12T17:15:10.496 INFO:teuthology.orchestra.run.gibba002.stdout: Birth: - 2021-02-12T17:15:10.504 INFO:teuthology.orchestra.run.gibba002.stderr:1+0 records in 2021-02-12T17:15:10.504 INFO:teuthology.orchestra.run.gibba002.stderr:1+0 records out 2021-02-12T17:15:10.504 INFO:teuthology.orchestra.run.gibba002.stderr:512 bytes copied, 0.000217329 s, 2.4 MB/s 2021-02-12T17:15:10.506 DEBUG:teuthology.orchestra.run.gibba002:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-02-12T17:15:10.558 INFO:teuthology.orchestra.run.gibba002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-02-12T17:15:10.558 INFO:teuthology.orchestra.run.gibba002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-12T17:15:10.558 INFO:teuthology.orchestra.run.gibba002.stdout:Device: 6h/6d Inode: 121288 Links: 1 2021-02-12T17:15:10.558 INFO:teuthology.orchestra.run.gibba002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-12T17:15:10.558 INFO:teuthology.orchestra.run.gibba002.stdout:Context: system_u:object_r:device_t:s0 2021-02-12T17:15:10.559 INFO:teuthology.orchestra.run.gibba002.stdout:Access: 2021-02-12 17:15:03.063007967 +0000 2021-02-12T17:15:10.559 INFO:teuthology.orchestra.run.gibba002.stdout:Modify: 2021-02-12 17:13:07.889724082 +0000 2021-02-12T17:15:10.559 INFO:teuthology.orchestra.run.gibba002.stdout:Change: 2021-02-12 17:13:07.889724082 +0000 2021-02-12T17:15:10.559 INFO:teuthology.orchestra.run.gibba002.stdout: Birth: - 2021-02-12T17:15:10.566 INFO:teuthology.orchestra.run.gibba002.stderr:1+0 records in 2021-02-12T17:15:10.566 INFO:teuthology.orchestra.run.gibba002.stderr:1+0 records out 2021-02-12T17:15:10.567 INFO:teuthology.orchestra.run.gibba002.stderr:512 bytes copied, 0.000153503 s, 3.3 MB/s 2021-02-12T17:15:10.569 DEBUG:teuthology.orchestra.run.gibba002:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-02-12T17:15:10.621 INFO:teuthology.orchestra.run.gibba002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-02-12T17:15:10.621 INFO:teuthology.orchestra.run.gibba002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-12T17:15:10.621 INFO:teuthology.orchestra.run.gibba002.stdout:Device: 6h/6d Inode: 112159 Links: 1 2021-02-12T17:15:10.621 INFO:teuthology.orchestra.run.gibba002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-12T17:15:10.621 INFO:teuthology.orchestra.run.gibba002.stdout:Context: system_u:object_r:device_t:s0 2021-02-12T17:15:10.621 INFO:teuthology.orchestra.run.gibba002.stdout:Access: 2021-02-12 17:15:03.063007967 +0000 2021-02-12T17:15:10.621 INFO:teuthology.orchestra.run.gibba002.stdout:Modify: 2021-02-12 17:13:08.176724130 +0000 2021-02-12T17:15:10.621 INFO:teuthology.orchestra.run.gibba002.stdout:Change: 2021-02-12 17:13:08.176724130 +0000 2021-02-12T17:15:10.621 INFO:teuthology.orchestra.run.gibba002.stdout: Birth: - 2021-02-12T17:15:10.629 INFO:teuthology.orchestra.run.gibba002.stderr:1+0 records in 2021-02-12T17:15:10.629 INFO:teuthology.orchestra.run.gibba002.stderr:1+0 records out 2021-02-12T17:15:10.629 INFO:teuthology.orchestra.run.gibba002.stderr:512 bytes copied, 0.000166913 s, 3.1 MB/s 2021-02-12T17:15:10.631 DEBUG:teuthology.orchestra.run.gibba002:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-02-12T17:15:10.683 INFO:teuthology.orchestra.run.gibba002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-02-12T17:15:10.683 INFO:teuthology.orchestra.run.gibba002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-12T17:15:10.683 INFO:teuthology.orchestra.run.gibba002.stdout:Device: 6h/6d Inode: 112200 Links: 1 2021-02-12T17:15:10.683 INFO:teuthology.orchestra.run.gibba002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-12T17:15:10.683 INFO:teuthology.orchestra.run.gibba002.stdout:Context: system_u:object_r:device_t:s0 2021-02-12T17:15:10.683 INFO:teuthology.orchestra.run.gibba002.stdout:Access: 2021-02-12 17:15:03.063007967 +0000 2021-02-12T17:15:10.683 INFO:teuthology.orchestra.run.gibba002.stdout:Modify: 2021-02-12 17:13:08.457724176 +0000 2021-02-12T17:15:10.683 INFO:teuthology.orchestra.run.gibba002.stdout:Change: 2021-02-12 17:13:08.457724176 +0000 2021-02-12T17:15:10.683 INFO:teuthology.orchestra.run.gibba002.stdout: Birth: - 2021-02-12T17:15:10.690 INFO:teuthology.orchestra.run.gibba002.stderr:1+0 records in 2021-02-12T17:15:10.691 INFO:teuthology.orchestra.run.gibba002.stderr:1+0 records out 2021-02-12T17:15:10.691 INFO:teuthology.orchestra.run.gibba002.stderr:512 bytes copied, 0.000153593 s, 3.3 MB/s 2021-02-12T17:15:10.693 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-02-12T17:15:10.693 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:10.693 DEBUG:teuthology.orchestra.run.gibba004:> dd if=/scratch_devs of=/dev/stdout 2021-02-12T17:15:10.705 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-02-12T17:15:10.705 DEBUG:teuthology.orchestra.run.gibba004:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-02-12T17:15:10.757 INFO:teuthology.orchestra.run.gibba004.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-02-12T17:15:10.757 INFO:teuthology.orchestra.run.gibba004.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-12T17:15:10.757 INFO:teuthology.orchestra.run.gibba004.stdout:Device: 6h/6d Inode: 116690 Links: 1 2021-02-12T17:15:10.757 INFO:teuthology.orchestra.run.gibba004.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-12T17:15:10.757 INFO:teuthology.orchestra.run.gibba004.stdout:Context: system_u:object_r:device_t:s0 2021-02-12T17:15:10.757 INFO:teuthology.orchestra.run.gibba004.stdout:Access: 2021-02-12 17:15:06.622740413 +0000 2021-02-12T17:15:10.757 INFO:teuthology.orchestra.run.gibba004.stdout:Modify: 2021-02-12 17:13:10.561856303 +0000 2021-02-12T17:15:10.757 INFO:teuthology.orchestra.run.gibba004.stdout:Change: 2021-02-12 17:13:10.561856303 +0000 2021-02-12T17:15:10.757 INFO:teuthology.orchestra.run.gibba004.stdout: Birth: - 2021-02-12T17:15:10.765 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records in 2021-02-12T17:15:10.765 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records out 2021-02-12T17:15:10.765 INFO:teuthology.orchestra.run.gibba004.stderr:512 bytes copied, 0.000161433 s, 3.2 MB/s 2021-02-12T17:15:10.767 DEBUG:teuthology.orchestra.run.gibba004:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-02-12T17:15:10.820 INFO:teuthology.orchestra.run.gibba004.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-02-12T17:15:10.820 INFO:teuthology.orchestra.run.gibba004.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-12T17:15:10.821 INFO:teuthology.orchestra.run.gibba004.stdout:Device: 6h/6d Inode: 111285 Links: 1 2021-02-12T17:15:10.821 INFO:teuthology.orchestra.run.gibba004.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-12T17:15:10.821 INFO:teuthology.orchestra.run.gibba004.stdout:Context: system_u:object_r:device_t:s0 2021-02-12T17:15:10.821 INFO:teuthology.orchestra.run.gibba004.stdout:Access: 2021-02-12 17:15:06.622740413 +0000 2021-02-12T17:15:10.821 INFO:teuthology.orchestra.run.gibba004.stdout:Modify: 2021-02-12 17:13:10.833855821 +0000 2021-02-12T17:15:10.821 INFO:teuthology.orchestra.run.gibba004.stdout:Change: 2021-02-12 17:13:10.833855821 +0000 2021-02-12T17:15:10.821 INFO:teuthology.orchestra.run.gibba004.stdout: Birth: - 2021-02-12T17:15:10.828 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records in 2021-02-12T17:15:10.828 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records out 2021-02-12T17:15:10.828 INFO:teuthology.orchestra.run.gibba004.stderr:512 bytes copied, 9.9247e-05 s, 5.2 MB/s 2021-02-12T17:15:10.830 DEBUG:teuthology.orchestra.run.gibba004:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-02-12T17:15:10.883 INFO:teuthology.orchestra.run.gibba004.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-02-12T17:15:10.883 INFO:teuthology.orchestra.run.gibba004.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-12T17:15:10.883 INFO:teuthology.orchestra.run.gibba004.stdout:Device: 6h/6d Inode: 118988 Links: 1 2021-02-12T17:15:10.883 INFO:teuthology.orchestra.run.gibba004.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-12T17:15:10.883 INFO:teuthology.orchestra.run.gibba004.stdout:Context: system_u:object_r:device_t:s0 2021-02-12T17:15:10.884 INFO:teuthology.orchestra.run.gibba004.stdout:Access: 2021-02-12 17:15:06.622740413 +0000 2021-02-12T17:15:10.884 INFO:teuthology.orchestra.run.gibba004.stdout:Modify: 2021-02-12 17:13:11.107855336 +0000 2021-02-12T17:15:10.884 INFO:teuthology.orchestra.run.gibba004.stdout:Change: 2021-02-12 17:13:11.107855336 +0000 2021-02-12T17:15:10.884 INFO:teuthology.orchestra.run.gibba004.stdout: Birth: - 2021-02-12T17:15:10.891 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records in 2021-02-12T17:15:10.891 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records out 2021-02-12T17:15:10.891 INFO:teuthology.orchestra.run.gibba004.stderr:512 bytes copied, 0.000128072 s, 4.0 MB/s 2021-02-12T17:15:10.893 DEBUG:teuthology.orchestra.run.gibba004:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-02-12T17:15:10.945 INFO:teuthology.orchestra.run.gibba004.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-02-12T17:15:10.945 INFO:teuthology.orchestra.run.gibba004.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-12T17:15:10.945 INFO:teuthology.orchestra.run.gibba004.stdout:Device: 6h/6d Inode: 67471 Links: 1 2021-02-12T17:15:10.945 INFO:teuthology.orchestra.run.gibba004.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-12T17:15:10.945 INFO:teuthology.orchestra.run.gibba004.stdout:Context: system_u:object_r:device_t:s0 2021-02-12T17:15:10.946 INFO:teuthology.orchestra.run.gibba004.stdout:Access: 2021-02-12 17:15:06.622740413 +0000 2021-02-12T17:15:10.946 INFO:teuthology.orchestra.run.gibba004.stdout:Modify: 2021-02-12 17:13:11.376854859 +0000 2021-02-12T17:15:10.946 INFO:teuthology.orchestra.run.gibba004.stdout:Change: 2021-02-12 17:13:11.376854859 +0000 2021-02-12T17:15:10.946 INFO:teuthology.orchestra.run.gibba004.stdout: Birth: - 2021-02-12T17:15:10.953 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records in 2021-02-12T17:15:10.953 INFO:teuthology.orchestra.run.gibba004.stderr:1+0 records out 2021-02-12T17:15:10.953 INFO:teuthology.orchestra.run.gibba004.stderr:512 bytes copied, 0.000133495 s, 3.8 MB/s 2021-02-12T17:15:10.955 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-02-12T17:15:10.955 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@gibba002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@gibba004.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-02-12T17:15:10.955 INFO:tasks.ceph:Generating config... 2021-02-12T17:15:10.957 INFO:tasks.ceph:[client] client mount timeout = 600 2021-02-12T17:15:10.957 INFO:tasks.ceph:[client] debug client = 20 2021-02-12T17:15:10.957 INFO:tasks.ceph:[client] debug ms = 1 2021-02-12T17:15:10.957 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2021-02-12T17:15:10.957 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2021-02-12T17:15:10.957 INFO:tasks.ceph:[mds] debug mds = 20 2021-02-12T17:15:10.957 INFO:tasks.ceph:[mds] debug ms = 1 2021-02-12T17:15:10.957 INFO:tasks.ceph:[mds] mds bal frag = True 2021-02-12T17:15:10.957 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2021-02-12T17:15:10.958 INFO:tasks.ceph:[mds] mds bal merge size = 5 2021-02-12T17:15:10.958 INFO:tasks.ceph:[mds] mds bal split bits = 3 2021-02-12T17:15:10.958 INFO:tasks.ceph:[mds] mds bal split size = 100 2021-02-12T17:15:10.958 INFO:tasks.ceph:[mds] mds debug frag = True 2021-02-12T17:15:10.958 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2021-02-12T17:15:10.958 INFO:tasks.ceph:[mds] mds op complaint time = 180 2021-02-12T17:15:10.958 INFO:tasks.ceph:[mds] mds verify scatter = True 2021-02-12T17:15:10.958 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2021-02-12T17:15:10.958 INFO:tasks.ceph:[mds] ms inject delay max = 1 2021-02-12T17:15:10.958 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2021-02-12T17:15:10.958 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2021-02-12T17:15:10.958 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2021-02-12T17:15:10.959 INFO:tasks.ceph:[mds] osd op complaint time = 180 2021-02-12T17:15:10.959 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2021-02-12T17:15:10.959 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2021-02-12T17:15:10.959 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-02-12T17:15:10.959 INFO:tasks.ceph:[mgr] debug ms = 1 2021-02-12T17:15:10.959 INFO:tasks.ceph:[mon] debug mon = 20 2021-02-12T17:15:10.959 INFO:tasks.ceph:[mon] debug ms = 1 2021-02-12T17:15:10.959 INFO:tasks.ceph:[mon] debug paxos = 20 2021-02-12T17:15:10.959 INFO:tasks.ceph:[mon] mon op complaint time = 120 2021-02-12T17:15:10.959 INFO:tasks.ceph:[osd] bdev async discard = True 2021-02-12T17:15:10.959 INFO:tasks.ceph:[osd] bdev enable discard = True 2021-02-12T17:15:10.960 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2021-02-12T17:15:10.960 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-02-12T17:15:10.960 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-02-12T17:15:10.960 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-02-12T17:15:10.960 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-02-12T17:15:10.960 INFO:tasks.ceph:[osd] debug filestore = 20 2021-02-12T17:15:10.960 INFO:tasks.ceph:[osd] debug journal = 20 2021-02-12T17:15:10.960 INFO:tasks.ceph:[osd] debug ms = 20 2021-02-12T17:15:10.960 INFO:tasks.ceph:[osd] debug osd = 25 2021-02-12T17:15:10.960 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-02-12T17:15:10.960 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2021-02-12T17:15:10.960 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-02-12T17:15:10.961 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-02-12T17:15:10.961 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-02-12T17:15:10.961 INFO:tasks.ceph:[osd] ms inject delay max = 1 2021-02-12T17:15:10.961 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2021-02-12T17:15:10.961 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2021-02-12T17:15:10.961 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2021-02-12T17:15:10.961 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-02-12T17:15:10.961 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2021-02-12T17:15:10.961 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-02-12T17:15:10.961 INFO:tasks.ceph:[osd] osd op complaint time = 180 2021-02-12T17:15:10.961 INFO:tasks.ceph:Setting up mon.a... 2021-02-12T17:15:10.961 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-02-12T17:15:11.014 INFO:teuthology.orchestra.run.gibba002.stdout:creating /etc/ceph/ceph.keyring 2021-02-12T17:15:11.016 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-02-12T17:15:11.046 DEBUG:teuthology.orchestra.run.gibba002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-12T17:15:11.105 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.2.102'), ('mon.b', '172.21.2.104'), ('mon.c', '[v2:172.21.2.104:3301,v1:172.21.2.104:6790]')] 2021-02-12T17:15:11.106 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.2.102,172.21.2.104,[v2:172.21.2.104:3301,v1:172.21.2.104:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}} 2021-02-12T17:15:11.107 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:11.107 DEBUG:teuthology.orchestra.run.gibba002:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-02-12T17:15:11.157 DEBUG:teuthology.orchestra.run.gibba002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.2.102 --add b 172.21.2.104 --addv c '[v2:172.21.2.104:3301,v1:172.21.2.104:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2021-02-12T17:15:11.227 INFO:teuthology.orchestra.run.gibba002.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-02-12T17:15:11.227 INFO:teuthology.orchestra.run.gibba002.stdout:monmaptool: generated fsid 84d6d175-2ea1-4991-ab6d-aa08bc640524 2021-02-12T17:15:11.227 INFO:teuthology.orchestra.run.gibba002.stdout:epoch 0 2021-02-12T17:15:11.227 INFO:teuthology.orchestra.run.gibba002.stdout:fsid 84d6d175-2ea1-4991-ab6d-aa08bc640524 2021-02-12T17:15:11.227 INFO:teuthology.orchestra.run.gibba002.stdout:last_changed 2021-02-12T17:15:11.226677+0000 2021-02-12T17:15:11.227 INFO:teuthology.orchestra.run.gibba002.stdout:created 2021-02-12T17:15:11.226677+0000 2021-02-12T17:15:11.227 INFO:teuthology.orchestra.run.gibba002.stdout:min_mon_release 0 (unknown) 2021-02-12T17:15:11.228 INFO:teuthology.orchestra.run.gibba002.stdout:election_strategy: 1 2021-02-12T17:15:11.228 INFO:teuthology.orchestra.run.gibba002.stdout:0: [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] mon.a 2021-02-12T17:15:11.228 INFO:teuthology.orchestra.run.gibba002.stdout:1: [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] mon.b 2021-02-12T17:15:11.228 INFO:teuthology.orchestra.run.gibba002.stdout:2: [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] mon.c 2021-02-12T17:15:11.228 INFO:teuthology.orchestra.run.gibba002.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-02-12T17:15:11.229 DEBUG:teuthology.orchestra.run.gibba002:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-02-12T17:15:11.280 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 84d6d175-2ea1-4991-ab6d-aa08bc640524... 2021-02-12T17:15:11.281 DEBUG:teuthology.orchestra.run.gibba002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-12T17:15:11.323 DEBUG:teuthology.orchestra.run.gibba004:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-12T17:15:11.355 INFO:teuthology.orchestra.run.gibba002.stdout:[global] 2021-02-12T17:15:11.355 INFO:teuthology.orchestra.run.gibba002.stdout: chdir = "" 2021-02-12T17:15:11.355 INFO:teuthology.orchestra.run.gibba002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-12T17:15:11.355 INFO:teuthology.orchestra.run.gibba002.stdout: auth supported = cephx 2021-02-12T17:15:11.355 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.355 INFO:teuthology.orchestra.run.gibba002.stdout: filestore xattr use omap = true 2021-02-12T17:15:11.355 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.355 INFO:teuthology.orchestra.run.gibba002.stdout: mon clock drift allowed = 1.000 2021-02-12T17:15:11.355 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.355 INFO:teuthology.orchestra.run.gibba002.stdout: osd crush chooseleaf type = 0 2021-02-12T17:15:11.356 INFO:teuthology.orchestra.run.gibba002.stdout: auth debug = true 2021-02-12T17:15:11.356 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.356 INFO:teuthology.orchestra.run.gibba002.stdout: ms die on old message = true 2021-02-12T17:15:11.356 INFO:teuthology.orchestra.run.gibba002.stdout: ms die on bug = true 2021-02-12T17:15:11.356 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.356 INFO:teuthology.orchestra.run.gibba002.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-12T17:15:11.356 INFO:teuthology.orchestra.run.gibba002.stdout: mon pg warn max object skew = 0 2021-02-12T17:15:11.356 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.356 INFO:teuthology.orchestra.run.gibba002.stdout: # disable pg_autoscaler by default for new pools 2021-02-12T17:15:11.356 INFO:teuthology.orchestra.run.gibba002.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-12T17:15:11.356 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.356 INFO:teuthology.orchestra.run.gibba002.stdout: osd pool default size = 2 2021-02-12T17:15:11.356 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.357 INFO:teuthology.orchestra.run.gibba002.stdout: mon osd allow primary affinity = true 2021-02-12T17:15:11.357 INFO:teuthology.orchestra.run.gibba002.stdout: mon osd allow pg remap = true 2021-02-12T17:15:11.357 INFO:teuthology.orchestra.run.gibba002.stdout: mon warn on legacy crush tunables = false 2021-02-12T17:15:11.357 INFO:teuthology.orchestra.run.gibba002.stdout: mon warn on crush straw calc version zero = false 2021-02-12T17:15:11.357 INFO:teuthology.orchestra.run.gibba002.stdout: mon warn on no sortbitwise = false 2021-02-12T17:15:11.357 INFO:teuthology.orchestra.run.gibba002.stdout: mon warn on osd down out interval zero = false 2021-02-12T17:15:11.357 INFO:teuthology.orchestra.run.gibba002.stdout: mon warn on too few osds = false 2021-02-12T17:15:11.357 INFO:teuthology.orchestra.run.gibba002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-12T17:15:11.357 INFO:teuthology.orchestra.run.gibba002.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-12T17:15:11.357 INFO:teuthology.orchestra.run.gibba002.stdout: mon_allow_pool_size_one = true 2021-02-12T17:15:11.357 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.357 INFO:teuthology.orchestra.run.gibba002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-12T17:15:11.357 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.357 INFO:teuthology.orchestra.run.gibba002.stdout: osd default data pool replay window = 5 2021-02-12T17:15:11.358 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.358 INFO:teuthology.orchestra.run.gibba002.stdout: mon allow pool delete = true 2021-02-12T17:15:11.358 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.358 INFO:teuthology.orchestra.run.gibba002.stdout: mon cluster log file level = debug 2021-02-12T17:15:11.358 INFO:teuthology.orchestra.run.gibba002.stdout: debug asserts on shutdown = true 2021-02-12T17:15:11.358 INFO:teuthology.orchestra.run.gibba002.stdout: mon health detail to clog = false 2021-02-12T17:15:11.358 INFO:teuthology.orchestra.run.gibba002.stdout: mon host = "172.21.2.102,172.21.2.104,[v2:172.21.2.104:3301,v1:172.21.2.104:6790]" 2021-02-12T17:15:11.358 INFO:teuthology.orchestra.run.gibba002.stdout: fsid = 84d6d175-2ea1-4991-ab6d-aa08bc640524 2021-02-12T17:15:11.358 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.358 INFO:teuthology.orchestra.run.gibba002.stdout:[osd] 2021-02-12T17:15:11.359 INFO:teuthology.orchestra.run.gibba002.stdout: osd journal size = 100 2021-02-12T17:15:11.359 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.359 INFO:teuthology.orchestra.run.gibba002.stdout: osd scrub load threshold = 5.0 2021-02-12T17:15:11.359 INFO:teuthology.orchestra.run.gibba002.stdout: osd scrub max interval = 600 2021-02-12T17:15:11.359 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.359 INFO:teuthology.orchestra.run.gibba002.stdout: osd recover clone overlap = true 2021-02-12T17:15:11.359 INFO:teuthology.orchestra.run.gibba002.stdout: osd recovery max chunk = 1048576 2021-02-12T17:15:11.359 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.359 INFO:teuthology.orchestra.run.gibba002.stdout: osd debug shutdown = true 2021-02-12T17:15:11.359 INFO:teuthology.orchestra.run.gibba002.stdout: osd debug op order = true 2021-02-12T17:15:11.359 INFO:teuthology.orchestra.run.gibba002.stdout: osd debug verify stray on activate = true 2021-02-12T17:15:11.359 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.359 INFO:teuthology.orchestra.run.gibba002.stdout: osd open classes on start = true 2021-02-12T17:15:11.360 INFO:teuthology.orchestra.run.gibba002.stdout: osd debug pg log writeout = true 2021-02-12T17:15:11.360 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.360 INFO:teuthology.orchestra.run.gibba002.stdout: osd deep scrub update digest min age = 30 2021-02-12T17:15:11.360 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.360 INFO:teuthology.orchestra.run.gibba002.stdout: osd map max advance = 10 2021-02-12T17:15:11.360 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.360 INFO:teuthology.orchestra.run.gibba002.stdout: journal zero on create = true 2021-02-12T17:15:11.360 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.360 INFO:teuthology.orchestra.run.gibba002.stdout: filestore ondisk finisher threads = 3 2021-02-12T17:15:11.360 INFO:teuthology.orchestra.run.gibba002.stdout: filestore apply finisher threads = 3 2021-02-12T17:15:11.361 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.361 INFO:teuthology.orchestra.run.gibba002.stdout: bdev debug aio = true 2021-02-12T17:15:11.361 INFO:teuthology.orchestra.run.gibba002.stdout: osd debug misdirected ops = true 2021-02-12T17:15:11.361 INFO:teuthology.orchestra.run.gibba002.stdout: bdev async discard = True 2021-02-12T17:15:11.361 INFO:teuthology.orchestra.run.gibba002.stdout: bdev enable discard = True 2021-02-12T17:15:11.361 INFO:teuthology.orchestra.run.gibba002.stdout: bluestore allocator = bitmap 2021-02-12T17:15:11.361 INFO:teuthology.orchestra.run.gibba002.stdout: bluestore block size = 96636764160 2021-02-12T17:15:11.361 INFO:teuthology.orchestra.run.gibba002.stdout: bluestore fsck on mount = True 2021-02-12T17:15:11.361 INFO:teuthology.orchestra.run.gibba002.stdout: debug bluefs = 20 2021-02-12T17:15:11.361 INFO:teuthology.orchestra.run.gibba002.stdout: debug bluestore = 20 2021-02-12T17:15:11.362 INFO:teuthology.orchestra.run.gibba002.stdout: debug filestore = 20 2021-02-12T17:15:11.362 INFO:teuthology.orchestra.run.gibba002.stdout: debug journal = 20 2021-02-12T17:15:11.362 INFO:teuthology.orchestra.run.gibba002.stdout: debug ms = 20 2021-02-12T17:15:11.362 INFO:teuthology.orchestra.run.gibba002.stdout: debug osd = 25 2021-02-12T17:15:11.362 INFO:teuthology.orchestra.run.gibba002.stdout: debug rocksdb = 10 2021-02-12T17:15:11.362 INFO:teuthology.orchestra.run.gibba002.stdout: mon client directed command retry = 5 2021-02-12T17:15:11.362 INFO:teuthology.orchestra.run.gibba002.stdout: mon osd backfillfull_ratio = 0.85 2021-02-12T17:15:11.362 INFO:teuthology.orchestra.run.gibba002.stdout: mon osd full ratio = 0.9 2021-02-12T17:15:11.362 INFO:teuthology.orchestra.run.gibba002.stdout: mon osd nearfull ratio = 0.8 2021-02-12T17:15:11.362 INFO:teuthology.orchestra.run.gibba002.stdout: ms inject delay max = 1 2021-02-12T17:15:11.362 INFO:teuthology.orchestra.run.gibba002.stdout: ms inject delay probability = 0.005 2021-02-12T17:15:11.362 INFO:teuthology.orchestra.run.gibba002.stdout: ms inject delay type = client mds 2021-02-12T17:15:11.362 INFO:teuthology.orchestra.run.gibba002.stdout: ms inject socket failures = 2500 2021-02-12T17:15:11.363 INFO:teuthology.orchestra.run.gibba002.stdout: osd failsafe full ratio = 0.95 2021-02-12T17:15:11.363 INFO:teuthology.orchestra.run.gibba002.stdout: osd max markdown count = 1000 2021-02-12T17:15:11.363 INFO:teuthology.orchestra.run.gibba002.stdout: osd objectstore = bluestore 2021-02-12T17:15:11.363 INFO:teuthology.orchestra.run.gibba002.stdout: osd op complaint time = 180 2021-02-12T17:15:11.363 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.363 INFO:teuthology.orchestra.run.gibba002.stdout:[mgr] 2021-02-12T17:15:11.363 INFO:teuthology.orchestra.run.gibba002.stdout: debug ms = 1 2021-02-12T17:15:11.363 INFO:teuthology.orchestra.run.gibba002.stdout: debug mgr = 20 2021-02-12T17:15:11.363 INFO:teuthology.orchestra.run.gibba002.stdout: debug mon = 20 2021-02-12T17:15:11.363 INFO:teuthology.orchestra.run.gibba002.stdout: debug auth = 20 2021-02-12T17:15:11.363 INFO:teuthology.orchestra.run.gibba002.stdout: mon reweight min pgs per osd = 4 2021-02-12T17:15:11.363 INFO:teuthology.orchestra.run.gibba002.stdout: mon reweight min bytes per osd = 10 2021-02-12T17:15:11.363 INFO:teuthology.orchestra.run.gibba002.stdout: mgr/telemetry/nag = false 2021-02-12T17:15:11.364 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.364 INFO:teuthology.orchestra.run.gibba002.stdout:[mon] 2021-02-12T17:15:11.364 INFO:teuthology.orchestra.run.gibba002.stdout: debug ms = 1 2021-02-12T17:15:11.364 INFO:teuthology.orchestra.run.gibba002.stdout: debug mon = 20 2021-02-12T17:15:11.364 INFO:teuthology.orchestra.run.gibba002.stdout: debug paxos = 20 2021-02-12T17:15:11.364 INFO:teuthology.orchestra.run.gibba002.stdout: debug auth = 20 2021-02-12T17:15:11.364 INFO:teuthology.orchestra.run.gibba002.stdout: mon data avail warn = 5 2021-02-12T17:15:11.364 INFO:teuthology.orchestra.run.gibba002.stdout: mon mgr mkfs grace = 240 2021-02-12T17:15:11.364 INFO:teuthology.orchestra.run.gibba002.stdout: mon reweight min pgs per osd = 4 2021-02-12T17:15:11.364 INFO:teuthology.orchestra.run.gibba002.stdout: mon osd reporter subtree level = osd 2021-02-12T17:15:11.364 INFO:teuthology.orchestra.run.gibba002.stdout: mon osd prime pg temp = true 2021-02-12T17:15:11.365 INFO:teuthology.orchestra.run.gibba002.stdout: mon reweight min bytes per osd = 10 2021-02-12T17:15:11.365 INFO:teuthology.orchestra.run.gibba002.stdout: mon op complaint time = 120 2021-02-12T17:15:11.365 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:11.365 INFO:teuthology.orchestra.run.gibba002.stdout:[client] 2021-02-12T17:15:11.365 INFO:teuthology.orchestra.run.gibba002.stdout: rgw cache enabled = true 2021-02-12T17:15:11.365 INFO:teuthology.orchestra.run.gibba002.stdout: rgw enable ops log = true 2021-02-12T17:15:11.365 INFO:teuthology.orchestra.run.gibba002.stdout: rgw enable usage log = true 2021-02-12T17:15:11.365 INFO:teuthology.orchestra.run.gibba002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-12T17:15:11.365 INFO:teuthology.orchestra.run.gibba002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-12T17:15:11.365 INFO:teuthology.orchestra.run.gibba002.stdout: client mount timeout = 600 2021-02-12T17:15:11.365 INFO:teuthology.orchestra.run.gibba002.stdout: debug client = 20 2021-02-12T17:15:11.365 INFO:teuthology.orchestra.run.gibba002.stdout: debug ms = 1 2021-02-12T17:15:11.365 INFO:teuthology.orchestra.run.gibba002.stdout: rados mon op timeout = 15m 2021-02-12T17:15:11.366 INFO:teuthology.orchestra.run.gibba002.stdout: rados osd op timeout = 15m 2021-02-12T17:15:11.366 INFO:teuthology.orchestra.run.gibba002.stdout:[mon.a] 2021-02-12T17:15:11.366 INFO:teuthology.orchestra.run.gibba002.stdout:[mon.b] 2021-02-12T17:15:11.366 INFO:teuthology.orchestra.run.gibba002.stdout:[mon.c] 2021-02-12T17:15:11.366 INFO:teuthology.orchestra.run.gibba002.stdout:[mds.a] 2021-02-12T17:15:11.366 INFO:teuthology.orchestra.run.gibba002.stdout:[mds.c] 2021-02-12T17:15:11.366 INFO:teuthology.orchestra.run.gibba002.stdout:[mds.b] 2021-02-12T17:15:11.366 INFO:teuthology.orchestra.run.gibba002.stdout:[mds.d] 2021-02-12T17:15:11.366 INFO:teuthology.orchestra.run.gibba002.stdout:[mds] 2021-02-12T17:15:11.366 INFO:teuthology.orchestra.run.gibba002.stdout: debug mds = 20 2021-02-12T17:15:11.366 INFO:teuthology.orchestra.run.gibba002.stdout: debug ms = 1 2021-02-12T17:15:11.366 INFO:teuthology.orchestra.run.gibba002.stdout: mds bal frag = True 2021-02-12T17:15:11.366 INFO:teuthology.orchestra.run.gibba002.stdout: mds bal fragment size max = 10000 2021-02-12T17:15:11.367 INFO:teuthology.orchestra.run.gibba002.stdout: mds bal merge size = 5 2021-02-12T17:15:11.367 INFO:teuthology.orchestra.run.gibba002.stdout: mds bal split bits = 3 2021-02-12T17:15:11.367 INFO:teuthology.orchestra.run.gibba002.stdout: mds bal split size = 100 2021-02-12T17:15:11.367 INFO:teuthology.orchestra.run.gibba002.stdout: mds debug frag = True 2021-02-12T17:15:11.367 INFO:teuthology.orchestra.run.gibba002.stdout: mds debug scatterstat = True 2021-02-12T17:15:11.367 INFO:teuthology.orchestra.run.gibba002.stdout: mds op complaint time = 180 2021-02-12T17:15:11.367 INFO:teuthology.orchestra.run.gibba002.stdout: mds verify scatter = True 2021-02-12T17:15:11.367 INFO:teuthology.orchestra.run.gibba002.stdout: mon client directed command retry = 5 2021-02-12T17:15:11.367 INFO:teuthology.orchestra.run.gibba002.stdout: ms inject delay max = 1 2021-02-12T17:15:11.367 INFO:teuthology.orchestra.run.gibba002.stdout: ms inject delay probability = 0.005 2021-02-12T17:15:11.367 INFO:teuthology.orchestra.run.gibba002.stdout: ms inject delay type = client mds osd 2021-02-12T17:15:11.367 INFO:teuthology.orchestra.run.gibba002.stdout: ms inject socket failures = 2500 2021-02-12T17:15:11.367 INFO:teuthology.orchestra.run.gibba002.stdout: osd op complaint time = 180 2021-02-12T17:15:11.368 INFO:teuthology.orchestra.run.gibba002.stdout: rados mon op timeout = 15m 2021-02-12T17:15:11.368 INFO:teuthology.orchestra.run.gibba002.stdout: rados osd op timeout = 15m 2021-02-12T17:15:11.369 INFO:teuthology.orchestra.run.gibba004.stdout:[global] 2021-02-12T17:15:11.369 INFO:teuthology.orchestra.run.gibba004.stdout: chdir = "" 2021-02-12T17:15:11.369 INFO:teuthology.orchestra.run.gibba004.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-12T17:15:11.369 INFO:teuthology.orchestra.run.gibba004.stdout: auth supported = cephx 2021-02-12T17:15:11.369 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.369 INFO:teuthology.orchestra.run.gibba004.stdout: filestore xattr use omap = true 2021-02-12T17:15:11.370 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.370 INFO:teuthology.orchestra.run.gibba004.stdout: mon clock drift allowed = 1.000 2021-02-12T17:15:11.370 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.370 INFO:teuthology.orchestra.run.gibba004.stdout: osd crush chooseleaf type = 0 2021-02-12T17:15:11.370 INFO:teuthology.orchestra.run.gibba004.stdout: auth debug = true 2021-02-12T17:15:11.370 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.370 INFO:teuthology.orchestra.run.gibba004.stdout: ms die on old message = true 2021-02-12T17:15:11.370 INFO:teuthology.orchestra.run.gibba004.stdout: ms die on bug = true 2021-02-12T17:15:11.370 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.370 INFO:teuthology.orchestra.run.gibba004.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-12T17:15:11.370 INFO:teuthology.orchestra.run.gibba004.stdout: mon pg warn max object skew = 0 2021-02-12T17:15:11.370 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.370 INFO:teuthology.orchestra.run.gibba004.stdout: # disable pg_autoscaler by default for new pools 2021-02-12T17:15:11.371 INFO:teuthology.orchestra.run.gibba004.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-12T17:15:11.371 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.371 INFO:teuthology.orchestra.run.gibba004.stdout: osd pool default size = 2 2021-02-12T17:15:11.371 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.371 INFO:teuthology.orchestra.run.gibba004.stdout: mon osd allow primary affinity = true 2021-02-12T17:15:11.371 INFO:teuthology.orchestra.run.gibba004.stdout: mon osd allow pg remap = true 2021-02-12T17:15:11.371 INFO:teuthology.orchestra.run.gibba004.stdout: mon warn on legacy crush tunables = false 2021-02-12T17:15:11.371 INFO:teuthology.orchestra.run.gibba004.stdout: mon warn on crush straw calc version zero = false 2021-02-12T17:15:11.371 INFO:teuthology.orchestra.run.gibba004.stdout: mon warn on no sortbitwise = false 2021-02-12T17:15:11.371 INFO:teuthology.orchestra.run.gibba004.stdout: mon warn on osd down out interval zero = false 2021-02-12T17:15:11.371 INFO:teuthology.orchestra.run.gibba004.stdout: mon warn on too few osds = false 2021-02-12T17:15:11.371 INFO:teuthology.orchestra.run.gibba004.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-12T17:15:11.371 INFO:teuthology.orchestra.run.gibba004.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-12T17:15:11.371 INFO:teuthology.orchestra.run.gibba004.stdout: mon_allow_pool_size_one = true 2021-02-12T17:15:11.372 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.372 INFO:teuthology.orchestra.run.gibba004.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-12T17:15:11.372 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.372 INFO:teuthology.orchestra.run.gibba004.stdout: osd default data pool replay window = 5 2021-02-12T17:15:11.372 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.372 INFO:teuthology.orchestra.run.gibba004.stdout: mon allow pool delete = true 2021-02-12T17:15:11.372 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.372 INFO:teuthology.orchestra.run.gibba004.stdout: mon cluster log file level = debug 2021-02-12T17:15:11.372 INFO:teuthology.orchestra.run.gibba004.stdout: debug asserts on shutdown = true 2021-02-12T17:15:11.373 INFO:teuthology.orchestra.run.gibba004.stdout: mon health detail to clog = false 2021-02-12T17:15:11.373 INFO:teuthology.orchestra.run.gibba004.stdout: mon host = "172.21.2.102,172.21.2.104,[v2:172.21.2.104:3301,v1:172.21.2.104:6790]" 2021-02-12T17:15:11.373 INFO:teuthology.orchestra.run.gibba004.stdout: fsid = 84d6d175-2ea1-4991-ab6d-aa08bc640524 2021-02-12T17:15:11.373 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.373 INFO:teuthology.orchestra.run.gibba004.stdout:[osd] 2021-02-12T17:15:11.373 INFO:teuthology.orchestra.run.gibba004.stdout: osd journal size = 100 2021-02-12T17:15:11.373 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.373 INFO:teuthology.orchestra.run.gibba004.stdout: osd scrub load threshold = 5.0 2021-02-12T17:15:11.373 INFO:teuthology.orchestra.run.gibba004.stdout: osd scrub max interval = 600 2021-02-12T17:15:11.373 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.373 INFO:teuthology.orchestra.run.gibba004.stdout: osd recover clone overlap = true 2021-02-12T17:15:11.373 INFO:teuthology.orchestra.run.gibba004.stdout: osd recovery max chunk = 1048576 2021-02-12T17:15:11.373 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.373 INFO:teuthology.orchestra.run.gibba004.stdout: osd debug shutdown = true 2021-02-12T17:15:11.374 INFO:teuthology.orchestra.run.gibba004.stdout: osd debug op order = true 2021-02-12T17:15:11.374 INFO:teuthology.orchestra.run.gibba004.stdout: osd debug verify stray on activate = true 2021-02-12T17:15:11.374 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.374 INFO:teuthology.orchestra.run.gibba004.stdout: osd open classes on start = true 2021-02-12T17:15:11.374 INFO:teuthology.orchestra.run.gibba004.stdout: osd debug pg log writeout = true 2021-02-12T17:15:11.374 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.374 INFO:teuthology.orchestra.run.gibba004.stdout: osd deep scrub update digest min age = 30 2021-02-12T17:15:11.374 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.374 INFO:teuthology.orchestra.run.gibba004.stdout: osd map max advance = 10 2021-02-12T17:15:11.374 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.374 INFO:teuthology.orchestra.run.gibba004.stdout: journal zero on create = true 2021-02-12T17:15:11.374 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.374 INFO:teuthology.orchestra.run.gibba004.stdout: filestore ondisk finisher threads = 3 2021-02-12T17:15:11.375 INFO:teuthology.orchestra.run.gibba004.stdout: filestore apply finisher threads = 3 2021-02-12T17:15:11.375 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.375 INFO:teuthology.orchestra.run.gibba004.stdout: bdev debug aio = true 2021-02-12T17:15:11.375 INFO:teuthology.orchestra.run.gibba004.stdout: osd debug misdirected ops = true 2021-02-12T17:15:11.375 INFO:teuthology.orchestra.run.gibba004.stdout: bdev async discard = True 2021-02-12T17:15:11.375 INFO:teuthology.orchestra.run.gibba004.stdout: bdev enable discard = True 2021-02-12T17:15:11.375 INFO:teuthology.orchestra.run.gibba004.stdout: bluestore allocator = bitmap 2021-02-12T17:15:11.375 INFO:teuthology.orchestra.run.gibba004.stdout: bluestore block size = 96636764160 2021-02-12T17:15:11.375 INFO:teuthology.orchestra.run.gibba004.stdout: bluestore fsck on mount = True 2021-02-12T17:15:11.375 INFO:teuthology.orchestra.run.gibba004.stdout: debug bluefs = 20 2021-02-12T17:15:11.375 INFO:teuthology.orchestra.run.gibba004.stdout: debug bluestore = 20 2021-02-12T17:15:11.375 INFO:teuthology.orchestra.run.gibba004.stdout: debug filestore = 20 2021-02-12T17:15:11.375 INFO:teuthology.orchestra.run.gibba004.stdout: debug journal = 20 2021-02-12T17:15:11.375 INFO:teuthology.orchestra.run.gibba004.stdout: debug ms = 20 2021-02-12T17:15:11.376 INFO:teuthology.orchestra.run.gibba004.stdout: debug osd = 25 2021-02-12T17:15:11.376 INFO:teuthology.orchestra.run.gibba004.stdout: debug rocksdb = 10 2021-02-12T17:15:11.376 INFO:teuthology.orchestra.run.gibba004.stdout: mon client directed command retry = 5 2021-02-12T17:15:11.376 INFO:teuthology.orchestra.run.gibba004.stdout: mon osd backfillfull_ratio = 0.85 2021-02-12T17:15:11.376 INFO:teuthology.orchestra.run.gibba004.stdout: mon osd full ratio = 0.9 2021-02-12T17:15:11.376 INFO:teuthology.orchestra.run.gibba004.stdout: mon osd nearfull ratio = 0.8 2021-02-12T17:15:11.376 INFO:teuthology.orchestra.run.gibba004.stdout: ms inject delay max = 1 2021-02-12T17:15:11.376 INFO:teuthology.orchestra.run.gibba004.stdout: ms inject delay probability = 0.005 2021-02-12T17:15:11.376 INFO:teuthology.orchestra.run.gibba004.stdout: ms inject delay type = client mds 2021-02-12T17:15:11.376 INFO:teuthology.orchestra.run.gibba004.stdout: ms inject socket failures = 2500 2021-02-12T17:15:11.376 INFO:teuthology.orchestra.run.gibba004.stdout: osd failsafe full ratio = 0.95 2021-02-12T17:15:11.376 INFO:teuthology.orchestra.run.gibba004.stdout: osd max markdown count = 1000 2021-02-12T17:15:11.376 INFO:teuthology.orchestra.run.gibba004.stdout: osd objectstore = bluestore 2021-02-12T17:15:11.376 INFO:teuthology.orchestra.run.gibba004.stdout: osd op complaint time = 180 2021-02-12T17:15:11.377 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.377 INFO:teuthology.orchestra.run.gibba004.stdout:[mgr] 2021-02-12T17:15:11.377 INFO:teuthology.orchestra.run.gibba004.stdout: debug ms = 1 2021-02-12T17:15:11.377 INFO:teuthology.orchestra.run.gibba004.stdout: debug mgr = 20 2021-02-12T17:15:11.377 INFO:teuthology.orchestra.run.gibba004.stdout: debug mon = 20 2021-02-12T17:15:11.377 INFO:teuthology.orchestra.run.gibba004.stdout: debug auth = 20 2021-02-12T17:15:11.377 INFO:teuthology.orchestra.run.gibba004.stdout: mon reweight min pgs per osd = 4 2021-02-12T17:15:11.377 INFO:teuthology.orchestra.run.gibba004.stdout: mon reweight min bytes per osd = 10 2021-02-12T17:15:11.377 INFO:teuthology.orchestra.run.gibba004.stdout: mgr/telemetry/nag = false 2021-02-12T17:15:11.377 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.377 INFO:teuthology.orchestra.run.gibba004.stdout:[mon] 2021-02-12T17:15:11.377 INFO:teuthology.orchestra.run.gibba004.stdout: debug ms = 1 2021-02-12T17:15:11.377 INFO:teuthology.orchestra.run.gibba004.stdout: debug mon = 20 2021-02-12T17:15:11.377 INFO:teuthology.orchestra.run.gibba004.stdout: debug paxos = 20 2021-02-12T17:15:11.378 INFO:teuthology.orchestra.run.gibba004.stdout: debug auth = 20 2021-02-12T17:15:11.378 INFO:teuthology.orchestra.run.gibba004.stdout: mon data avail warn = 5 2021-02-12T17:15:11.378 INFO:teuthology.orchestra.run.gibba004.stdout: mon mgr mkfs grace = 240 2021-02-12T17:15:11.378 INFO:teuthology.orchestra.run.gibba004.stdout: mon reweight min pgs per osd = 4 2021-02-12T17:15:11.378 INFO:teuthology.orchestra.run.gibba004.stdout: mon osd reporter subtree level = osd 2021-02-12T17:15:11.378 INFO:teuthology.orchestra.run.gibba004.stdout: mon osd prime pg temp = true 2021-02-12T17:15:11.378 INFO:teuthology.orchestra.run.gibba004.stdout: mon reweight min bytes per osd = 10 2021-02-12T17:15:11.378 INFO:teuthology.orchestra.run.gibba004.stdout: mon op complaint time = 120 2021-02-12T17:15:11.378 INFO:teuthology.orchestra.run.gibba004.stdout: 2021-02-12T17:15:11.378 INFO:teuthology.orchestra.run.gibba004.stdout:[client] 2021-02-12T17:15:11.378 INFO:teuthology.orchestra.run.gibba004.stdout: rgw cache enabled = true 2021-02-12T17:15:11.378 INFO:teuthology.orchestra.run.gibba004.stdout: rgw enable ops log = true 2021-02-12T17:15:11.378 INFO:teuthology.orchestra.run.gibba004.stdout: rgw enable usage log = true 2021-02-12T17:15:11.378 INFO:teuthology.orchestra.run.gibba004.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-12T17:15:11.379 INFO:teuthology.orchestra.run.gibba004.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-12T17:15:11.379 INFO:teuthology.orchestra.run.gibba004.stdout: client mount timeout = 600 2021-02-12T17:15:11.379 INFO:teuthology.orchestra.run.gibba004.stdout: debug client = 20 2021-02-12T17:15:11.379 INFO:teuthology.orchestra.run.gibba004.stdout: debug ms = 1 2021-02-12T17:15:11.379 INFO:teuthology.orchestra.run.gibba004.stdout: rados mon op timeout = 15m 2021-02-12T17:15:11.379 INFO:teuthology.orchestra.run.gibba004.stdout: rados osd op timeout = 15m 2021-02-12T17:15:11.379 INFO:teuthology.orchestra.run.gibba004.stdout:[mon.a] 2021-02-12T17:15:11.379 INFO:teuthology.orchestra.run.gibba004.stdout:[mon.b] 2021-02-12T17:15:11.379 INFO:teuthology.orchestra.run.gibba004.stdout:[mon.c] 2021-02-12T17:15:11.380 INFO:teuthology.orchestra.run.gibba004.stdout:[mds.a] 2021-02-12T17:15:11.380 INFO:teuthology.orchestra.run.gibba004.stdout:[mds.c] 2021-02-12T17:15:11.380 INFO:teuthology.orchestra.run.gibba004.stdout:[mds.b] 2021-02-12T17:15:11.380 INFO:teuthology.orchestra.run.gibba004.stdout:[mds.d] 2021-02-12T17:15:11.380 INFO:teuthology.orchestra.run.gibba004.stdout:[mds] 2021-02-12T17:15:11.380 INFO:teuthology.orchestra.run.gibba004.stdout: debug mds = 20 2021-02-12T17:15:11.380 INFO:teuthology.orchestra.run.gibba004.stdout: debug ms = 1 2021-02-12T17:15:11.380 INFO:teuthology.orchestra.run.gibba004.stdout: mds bal frag = True 2021-02-12T17:15:11.380 INFO:teuthology.orchestra.run.gibba004.stdout: mds bal fragment size max = 10000 2021-02-12T17:15:11.380 INFO:teuthology.orchestra.run.gibba004.stdout: mds bal merge size = 5 2021-02-12T17:15:11.380 INFO:teuthology.orchestra.run.gibba004.stdout: mds bal split bits = 3 2021-02-12T17:15:11.380 INFO:teuthology.orchestra.run.gibba004.stdout: mds bal split size = 100 2021-02-12T17:15:11.381 INFO:teuthology.orchestra.run.gibba004.stdout: mds debug frag = True 2021-02-12T17:15:11.381 INFO:teuthology.orchestra.run.gibba004.stdout: mds debug scatterstat = True 2021-02-12T17:15:11.381 INFO:teuthology.orchestra.run.gibba004.stdout: mds op complaint time = 180 2021-02-12T17:15:11.381 INFO:teuthology.orchestra.run.gibba004.stdout: mds verify scatter = True 2021-02-12T17:15:11.381 INFO:teuthology.orchestra.run.gibba004.stdout: mon client directed command retry = 5 2021-02-12T17:15:11.381 INFO:teuthology.orchestra.run.gibba004.stdout: ms inject delay max = 1 2021-02-12T17:15:11.381 INFO:teuthology.orchestra.run.gibba004.stdout: ms inject delay probability = 0.005 2021-02-12T17:15:11.381 INFO:teuthology.orchestra.run.gibba004.stdout: ms inject delay type = client mds osd 2021-02-12T17:15:11.381 INFO:teuthology.orchestra.run.gibba004.stdout: ms inject socket failures = 2500 2021-02-12T17:15:11.381 INFO:teuthology.orchestra.run.gibba004.stdout: osd op complaint time = 180 2021-02-12T17:15:11.381 INFO:teuthology.orchestra.run.gibba004.stdout: rados mon op timeout = 15m 2021-02-12T17:15:11.381 INFO:teuthology.orchestra.run.gibba004.stdout: rados osd op timeout = 15m 2021-02-12T17:15:11.382 INFO:tasks.ceph:Creating admin key on mon.a... 2021-02-12T17:15:11.382 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-02-12T17:15:11.448 INFO:tasks.ceph:Copying monmap to all nodes... 2021-02-12T17:15:11.448 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:11.448 DEBUG:teuthology.orchestra.run.gibba002:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2021-02-12T17:15:11.499 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:11.499 DEBUG:teuthology.orchestra.run.gibba002:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2021-02-12T17:15:11.551 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba002.front.sepia.ceph.com 2021-02-12T17:15:11.551 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:11.551 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd of=/etc/ceph/ceph.keyring 2021-02-12T17:15:11.552 DEBUG:teuthology.orchestra.run.gibba002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-12T17:15:11.618 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:11.618 DEBUG:teuthology.orchestra.run.gibba002:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-02-12T17:15:11.669 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba004.front.sepia.ceph.com 2021-02-12T17:15:11.670 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:11.670 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd of=/etc/ceph/ceph.keyring 2021-02-12T17:15:11.670 DEBUG:teuthology.orchestra.run.gibba004:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-12T17:15:11.699 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:11.699 DEBUG:teuthology.orchestra.run.gibba004:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-02-12T17:15:11.751 INFO:tasks.ceph:Setting up mon nodes... 2021-02-12T17:15:11.751 INFO:tasks.ceph:Setting up mgr nodes... 2021-02-12T17:15:11.752 DEBUG:teuthology.orchestra.run.gibba002:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-02-12T17:15:11.789 INFO:teuthology.orchestra.run.gibba002.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-02-12T17:15:11.791 DEBUG:teuthology.orchestra.run.gibba004:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-02-12T17:15:11.897 INFO:teuthology.orchestra.run.gibba004.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-02-12T17:15:11.899 INFO:tasks.ceph:Setting up mds nodes... 2021-02-12T17:15:11.899 DEBUG:teuthology.orchestra.run.gibba002:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2021-02-12T17:15:11.937 INFO:teuthology.orchestra.run.gibba002.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2021-02-12T17:15:11.939 DEBUG:teuthology.orchestra.run.gibba002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2021-02-12T17:15:11.999 DEBUG:teuthology.orchestra.run.gibba002:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2021-02-12T17:15:12.076 INFO:teuthology.orchestra.run.gibba002.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2021-02-12T17:15:12.078 DEBUG:teuthology.orchestra.run.gibba002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2021-02-12T17:15:12.137 DEBUG:teuthology.orchestra.run.gibba004:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2021-02-12T17:15:12.175 INFO:teuthology.orchestra.run.gibba004.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2021-02-12T17:15:12.177 DEBUG:teuthology.orchestra.run.gibba004:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2021-02-12T17:15:12.237 DEBUG:teuthology.orchestra.run.gibba004:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2021-02-12T17:15:12.315 INFO:teuthology.orchestra.run.gibba004.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2021-02-12T17:15:12.316 DEBUG:teuthology.orchestra.run.gibba004:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2021-02-12T17:15:12.377 INFO:tasks.ceph_client:Setting up client nodes... 2021-02-12T17:15:12.377 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-02-12T17:15:12.407 INFO:teuthology.orchestra.run.gibba002.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-02-12T17:15:12.417 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-02-12T17:15:12.447 INFO:teuthology.orchestra.run.gibba004.stdout:creating /etc/ceph/ceph.client.1.keyring 2021-02-12T17:15:12.457 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-02-12T17:15:12.457 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@gibba002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@gibba004.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-02-12T17:15:12.457 DEBUG:teuthology.orchestra.run.gibba002:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-02-12T17:15:12.477 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-02-12T17:15:12.477 INFO:tasks.ceph:role: osd.0 2021-02-12T17:15:12.477 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba002.front.sepia.ceph.com 2021-02-12T17:15:12.478 DEBUG:teuthology.orchestra.run.gibba002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-02-12T17:15:12.536 INFO:teuthology.orchestra.run.gibba002.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-02-12T17:15:12.536 INFO:teuthology.orchestra.run.gibba002.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-12T17:15:12.536 INFO:teuthology.orchestra.run.gibba002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-12T17:15:12.536 INFO:teuthology.orchestra.run.gibba002.stdout: = reflink=1 2021-02-12T17:15:12.537 INFO:teuthology.orchestra.run.gibba002.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-12T17:15:12.537 INFO:teuthology.orchestra.run.gibba002.stdout: = sunit=0 swidth=0 blks 2021-02-12T17:15:12.537 INFO:teuthology.orchestra.run.gibba002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-12T17:15:12.537 INFO:teuthology.orchestra.run.gibba002.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-12T17:15:12.537 INFO:teuthology.orchestra.run.gibba002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-12T17:15:12.537 INFO:teuthology.orchestra.run.gibba002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-12T17:15:12.560 INFO:teuthology.orchestra.run.gibba002.stdout:Discarding blocks...Done. 2021-02-12T17:15:12.561 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba002.front.sepia.ceph.com -o noatime 2021-02-12T17:15:12.561 DEBUG:teuthology.orchestra.run.gibba002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-02-12T17:15:12.634 DEBUG:teuthology.orchestra.run.gibba002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-02-12T17:15:12.698 DEBUG:teuthology.orchestra.run.gibba002:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-02-12T17:15:12.757 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-02-12T17:15:12.758 INFO:tasks.ceph:role: osd.1 2021-02-12T17:15:12.758 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba002.front.sepia.ceph.com 2021-02-12T17:15:12.758 DEBUG:teuthology.orchestra.run.gibba002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-02-12T17:15:12.818 INFO:teuthology.orchestra.run.gibba002.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-02-12T17:15:12.818 INFO:teuthology.orchestra.run.gibba002.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-12T17:15:12.818 INFO:teuthology.orchestra.run.gibba002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-12T17:15:12.818 INFO:teuthology.orchestra.run.gibba002.stdout: = reflink=1 2021-02-12T17:15:12.818 INFO:teuthology.orchestra.run.gibba002.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-12T17:15:12.818 INFO:teuthology.orchestra.run.gibba002.stdout: = sunit=0 swidth=0 blks 2021-02-12T17:15:12.818 INFO:teuthology.orchestra.run.gibba002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-12T17:15:12.819 INFO:teuthology.orchestra.run.gibba002.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-12T17:15:12.819 INFO:teuthology.orchestra.run.gibba002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-12T17:15:12.819 INFO:teuthology.orchestra.run.gibba002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-12T17:15:12.842 INFO:teuthology.orchestra.run.gibba002.stdout:Discarding blocks...Done. 2021-02-12T17:15:12.843 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba002.front.sepia.ceph.com -o noatime 2021-02-12T17:15:12.844 DEBUG:teuthology.orchestra.run.gibba002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-02-12T17:15:12.916 DEBUG:teuthology.orchestra.run.gibba002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-02-12T17:15:12.978 DEBUG:teuthology.orchestra.run.gibba002:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-02-12T17:15:13.038 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-02-12T17:15:13.038 INFO:tasks.ceph:role: osd.2 2021-02-12T17:15:13.038 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba002.front.sepia.ceph.com 2021-02-12T17:15:13.038 DEBUG:teuthology.orchestra.run.gibba002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-02-12T17:15:13.097 INFO:teuthology.orchestra.run.gibba002.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-02-12T17:15:13.097 INFO:teuthology.orchestra.run.gibba002.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-12T17:15:13.097 INFO:teuthology.orchestra.run.gibba002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-12T17:15:13.097 INFO:teuthology.orchestra.run.gibba002.stdout: = reflink=1 2021-02-12T17:15:13.097 INFO:teuthology.orchestra.run.gibba002.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-12T17:15:13.098 INFO:teuthology.orchestra.run.gibba002.stdout: = sunit=0 swidth=0 blks 2021-02-12T17:15:13.098 INFO:teuthology.orchestra.run.gibba002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-12T17:15:13.098 INFO:teuthology.orchestra.run.gibba002.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-12T17:15:13.098 INFO:teuthology.orchestra.run.gibba002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-12T17:15:13.098 INFO:teuthology.orchestra.run.gibba002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-12T17:15:13.121 INFO:teuthology.orchestra.run.gibba002.stdout:Discarding blocks...Done. 2021-02-12T17:15:13.122 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba002.front.sepia.ceph.com -o noatime 2021-02-12T17:15:13.122 DEBUG:teuthology.orchestra.run.gibba002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-02-12T17:15:13.195 DEBUG:teuthology.orchestra.run.gibba002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-02-12T17:15:13.257 DEBUG:teuthology.orchestra.run.gibba002:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-02-12T17:15:13.317 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-02-12T17:15:13.317 INFO:tasks.ceph:role: osd.3 2021-02-12T17:15:13.317 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@gibba002.front.sepia.ceph.com 2021-02-12T17:15:13.317 DEBUG:teuthology.orchestra.run.gibba002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-02-12T17:15:13.376 INFO:teuthology.orchestra.run.gibba002.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5505024 blks 2021-02-12T17:15:13.376 INFO:teuthology.orchestra.run.gibba002.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-12T17:15:13.376 INFO:teuthology.orchestra.run.gibba002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-12T17:15:13.376 INFO:teuthology.orchestra.run.gibba002.stdout: = reflink=1 2021-02-12T17:15:13.376 INFO:teuthology.orchestra.run.gibba002.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-12T17:15:13.376 INFO:teuthology.orchestra.run.gibba002.stdout: = sunit=0 swidth=0 blks 2021-02-12T17:15:13.377 INFO:teuthology.orchestra.run.gibba002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-12T17:15:13.377 INFO:teuthology.orchestra.run.gibba002.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-12T17:15:13.377 INFO:teuthology.orchestra.run.gibba002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-12T17:15:13.377 INFO:teuthology.orchestra.run.gibba002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-12T17:15:13.399 INFO:teuthology.orchestra.run.gibba002.stdout:Discarding blocks...Done. 2021-02-12T17:15:13.400 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@gibba002.front.sepia.ceph.com -o noatime 2021-02-12T17:15:13.401 DEBUG:teuthology.orchestra.run.gibba002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-02-12T17:15:13.473 DEBUG:teuthology.orchestra.run.gibba002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-02-12T17:15:13.534 DEBUG:teuthology.orchestra.run.gibba002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-12T17:15:13.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:13.613+0000 7f14a5aed200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-02-12T17:15:13.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:13.613+0000 7f14a5aed200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-02-12T17:15:13.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:13.613+0000 7f14a5aed200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-02-12T17:15:13.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:13.613+0000 7f14a5aed200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-02-12T17:15:13.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:13.613+0000 7f14a5aed200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-02-12T17:15:13.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:13.614+0000 7f14a5aed200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-02-12T17:15:16.457 DEBUG:teuthology.orchestra.run.gibba002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-02-12T17:15:16.517 DEBUG:teuthology.orchestra.run.gibba002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-12T17:15:16.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:16.588+0000 7f26aa6b0200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-02-12T17:15:16.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:16.588+0000 7f26aa6b0200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-02-12T17:15:16.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:16.588+0000 7f26aa6b0200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-02-12T17:15:16.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:16.588+0000 7f26aa6b0200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-02-12T17:15:16.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:16.588+0000 7f26aa6b0200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-02-12T17:15:16.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:16.588+0000 7f26aa6b0200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-02-12T17:15:19.432 DEBUG:teuthology.orchestra.run.gibba002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-02-12T17:15:19.492 DEBUG:teuthology.orchestra.run.gibba002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-12T17:15:19.565 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:19.564+0000 7fc018dbb200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-02-12T17:15:19.566 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:19.564+0000 7fc018dbb200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-02-12T17:15:19.566 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:19.564+0000 7fc018dbb200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-02-12T17:15:19.566 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:19.564+0000 7fc018dbb200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-02-12T17:15:19.566 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:19.564+0000 7fc018dbb200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-02-12T17:15:19.566 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:19.565+0000 7fc018dbb200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-02-12T17:15:22.406 DEBUG:teuthology.orchestra.run.gibba002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-02-12T17:15:22.467 DEBUG:teuthology.orchestra.run.gibba002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-12T17:15:22.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:22.549+0000 7f308d27f200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-02-12T17:15:22.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:22.549+0000 7f308d27f200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-02-12T17:15:22.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:22.549+0000 7f308d27f200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-02-12T17:15:22.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:22.549+0000 7f308d27f200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-02-12T17:15:22.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:22.549+0000 7f308d27f200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-02-12T17:15:22.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:22.550+0000 7f308d27f200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-02-12T17:15:25.406 DEBUG:teuthology.orchestra.run.gibba002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-02-12T17:15:25.467 DEBUG:teuthology.orchestra.run.gibba004:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-02-12T17:15:25.488 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-02-12T17:15:25.488 INFO:tasks.ceph:role: osd.4 2021-02-12T17:15:25.488 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba004.front.sepia.ceph.com 2021-02-12T17:15:25.488 DEBUG:teuthology.orchestra.run.gibba004:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-02-12T17:15:25.549 INFO:teuthology.orchestra.run.gibba004.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-02-12T17:15:25.550 INFO:teuthology.orchestra.run.gibba004.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-12T17:15:25.550 INFO:teuthology.orchestra.run.gibba004.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-12T17:15:25.550 INFO:teuthology.orchestra.run.gibba004.stdout: = reflink=1 2021-02-12T17:15:25.550 INFO:teuthology.orchestra.run.gibba004.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-12T17:15:25.550 INFO:teuthology.orchestra.run.gibba004.stdout: = sunit=0 swidth=0 blks 2021-02-12T17:15:25.550 INFO:teuthology.orchestra.run.gibba004.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-12T17:15:25.550 INFO:teuthology.orchestra.run.gibba004.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-12T17:15:25.550 INFO:teuthology.orchestra.run.gibba004.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-12T17:15:25.550 INFO:teuthology.orchestra.run.gibba004.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-12T17:15:25.574 INFO:teuthology.orchestra.run.gibba004.stdout:Discarding blocks...Done. 2021-02-12T17:15:25.575 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba004.front.sepia.ceph.com -o noatime 2021-02-12T17:15:25.575 DEBUG:teuthology.orchestra.run.gibba004:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-02-12T17:15:25.649 DEBUG:teuthology.orchestra.run.gibba004:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-02-12T17:15:25.713 DEBUG:teuthology.orchestra.run.gibba004:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-02-12T17:15:25.772 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-02-12T17:15:25.772 INFO:tasks.ceph:role: osd.5 2021-02-12T17:15:25.772 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba004.front.sepia.ceph.com 2021-02-12T17:15:25.773 DEBUG:teuthology.orchestra.run.gibba004:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-02-12T17:15:25.832 INFO:teuthology.orchestra.run.gibba004.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-02-12T17:15:25.832 INFO:teuthology.orchestra.run.gibba004.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-12T17:15:25.832 INFO:teuthology.orchestra.run.gibba004.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-12T17:15:25.832 INFO:teuthology.orchestra.run.gibba004.stdout: = reflink=1 2021-02-12T17:15:25.832 INFO:teuthology.orchestra.run.gibba004.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-12T17:15:25.833 INFO:teuthology.orchestra.run.gibba004.stdout: = sunit=0 swidth=0 blks 2021-02-12T17:15:25.833 INFO:teuthology.orchestra.run.gibba004.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-12T17:15:25.833 INFO:teuthology.orchestra.run.gibba004.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-12T17:15:25.833 INFO:teuthology.orchestra.run.gibba004.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-12T17:15:25.833 INFO:teuthology.orchestra.run.gibba004.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-12T17:15:25.858 INFO:teuthology.orchestra.run.gibba004.stdout:Discarding blocks...Done. 2021-02-12T17:15:25.859 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba004.front.sepia.ceph.com -o noatime 2021-02-12T17:15:25.859 DEBUG:teuthology.orchestra.run.gibba004:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-02-12T17:15:25.931 DEBUG:teuthology.orchestra.run.gibba004:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-02-12T17:15:25.993 DEBUG:teuthology.orchestra.run.gibba004:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-02-12T17:15:26.052 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-02-12T17:15:26.052 INFO:tasks.ceph:role: osd.6 2021-02-12T17:15:26.052 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba004.front.sepia.ceph.com 2021-02-12T17:15:26.053 DEBUG:teuthology.orchestra.run.gibba004:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-02-12T17:15:26.112 INFO:teuthology.orchestra.run.gibba004.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-02-12T17:15:26.112 INFO:teuthology.orchestra.run.gibba004.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-12T17:15:26.112 INFO:teuthology.orchestra.run.gibba004.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-12T17:15:26.112 INFO:teuthology.orchestra.run.gibba004.stdout: = reflink=1 2021-02-12T17:15:26.112 INFO:teuthology.orchestra.run.gibba004.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-12T17:15:26.112 INFO:teuthology.orchestra.run.gibba004.stdout: = sunit=0 swidth=0 blks 2021-02-12T17:15:26.112 INFO:teuthology.orchestra.run.gibba004.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-12T17:15:26.113 INFO:teuthology.orchestra.run.gibba004.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-12T17:15:26.113 INFO:teuthology.orchestra.run.gibba004.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-12T17:15:26.113 INFO:teuthology.orchestra.run.gibba004.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-12T17:15:26.136 INFO:teuthology.orchestra.run.gibba004.stdout:Discarding blocks...Done. 2021-02-12T17:15:26.137 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba004.front.sepia.ceph.com -o noatime 2021-02-12T17:15:26.137 DEBUG:teuthology.orchestra.run.gibba004:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-02-12T17:15:26.209 DEBUG:teuthology.orchestra.run.gibba004:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-02-12T17:15:26.271 DEBUG:teuthology.orchestra.run.gibba004:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-02-12T17:15:26.331 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-02-12T17:15:26.331 INFO:tasks.ceph:role: osd.7 2021-02-12T17:15:26.331 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@gibba004.front.sepia.ceph.com 2021-02-12T17:15:26.331 DEBUG:teuthology.orchestra.run.gibba004:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-02-12T17:15:26.390 INFO:teuthology.orchestra.run.gibba004.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5505024 blks 2021-02-12T17:15:26.390 INFO:teuthology.orchestra.run.gibba004.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-12T17:15:26.390 INFO:teuthology.orchestra.run.gibba004.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-12T17:15:26.391 INFO:teuthology.orchestra.run.gibba004.stdout: = reflink=1 2021-02-12T17:15:26.391 INFO:teuthology.orchestra.run.gibba004.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-12T17:15:26.391 INFO:teuthology.orchestra.run.gibba004.stdout: = sunit=0 swidth=0 blks 2021-02-12T17:15:26.391 INFO:teuthology.orchestra.run.gibba004.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-12T17:15:26.391 INFO:teuthology.orchestra.run.gibba004.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-12T17:15:26.391 INFO:teuthology.orchestra.run.gibba004.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-12T17:15:26.392 INFO:teuthology.orchestra.run.gibba004.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-12T17:15:26.413 INFO:teuthology.orchestra.run.gibba004.stdout:Discarding blocks...Done. 2021-02-12T17:15:26.414 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@gibba004.front.sepia.ceph.com -o noatime 2021-02-12T17:15:26.414 DEBUG:teuthology.orchestra.run.gibba004:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-02-12T17:15:26.486 DEBUG:teuthology.orchestra.run.gibba004:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-02-12T17:15:26.548 DEBUG:teuthology.orchestra.run.gibba004:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-12T17:15:26.634 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:26.632+0000 7fcba050a200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-02-12T17:15:26.634 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:26.632+0000 7fcba050a200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-02-12T17:15:26.634 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:26.632+0000 7fcba050a200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-02-12T17:15:26.634 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:26.632+0000 7fcba050a200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-02-12T17:15:26.635 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:26.632+0000 7fcba050a200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-02-12T17:15:26.635 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:26.632+0000 7fcba050a200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-02-12T17:15:29.487 DEBUG:teuthology.orchestra.run.gibba004:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-02-12T17:15:29.507 DEBUG:teuthology.orchestra.run.gibba004:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-12T17:15:29.579 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:29.577+0000 7fb6487ed200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-02-12T17:15:29.579 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:29.577+0000 7fb6487ed200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-02-12T17:15:29.579 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:29.577+0000 7fb6487ed200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-02-12T17:15:29.579 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:29.577+0000 7fb6487ed200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-02-12T17:15:29.579 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:29.577+0000 7fb6487ed200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-02-12T17:15:29.580 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:29.577+0000 7fb6487ed200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-02-12T17:15:32.422 DEBUG:teuthology.orchestra.run.gibba004:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-02-12T17:15:32.483 DEBUG:teuthology.orchestra.run.gibba004:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-12T17:15:32.555 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:32.552+0000 7f6d8110c200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-02-12T17:15:32.555 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:32.552+0000 7f6d8110c200 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-02-12T17:15:32.555 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:32.552+0000 7f6d8110c200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-02-12T17:15:32.555 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:32.552+0000 7f6d8110c200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-02-12T17:15:32.555 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:32.552+0000 7f6d8110c200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-02-12T17:15:32.555 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:32.553+0000 7f6d8110c200 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2021-02-12T17:15:35.405 DEBUG:teuthology.orchestra.run.gibba004:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-02-12T17:15:35.467 DEBUG:teuthology.orchestra.run.gibba004:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-12T17:15:35.540 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:35.538+0000 7faa7c71e200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-02-12T17:15:35.540 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:35.538+0000 7faa7c71e200 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-02-12T17:15:35.541 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:35.538+0000 7faa7c71e200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-02-12T17:15:35.541 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:35.538+0000 7faa7c71e200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-02-12T17:15:35.541 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:35.538+0000 7faa7c71e200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-02-12T17:15:35.541 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:35.538+0000 7faa7c71e200 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2021-02-12T17:15:38.387 DEBUG:teuthology.orchestra.run.gibba004:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-02-12T17:15:38.448 INFO:tasks.ceph:Reading keys from all nodes... 2021-02-12T17:15:38.448 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:38.449 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2021-02-12T17:15:38.469 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:38.469 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2021-02-12T17:15:38.529 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:38.529 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2021-02-12T17:15:38.589 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:38.589 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2021-02-12T17:15:38.648 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:38.648 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2021-02-12T17:15:38.707 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:38.708 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2021-02-12T17:15:38.767 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:38.768 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2021-02-12T17:15:38.828 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:38.828 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2021-02-12T17:15:38.849 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:38.849 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2021-02-12T17:15:38.909 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:38.909 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2021-02-12T17:15:38.968 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:38.969 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2021-02-12T17:15:39.028 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:39.028 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2021-02-12T17:15:39.087 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:39.087 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2021-02-12T17:15:39.147 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:39.147 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2021-02-12T17:15:39.207 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:39.207 DEBUG:teuthology.orchestra.run.gibba002:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2021-02-12T17:15:39.219 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:39.219 DEBUG:teuthology.orchestra.run.gibba004:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2021-02-12T17:15:39.259 INFO:tasks.ceph:Adding keys to all mons... 2021-02-12T17:15:39.259 DEBUG:teuthology.orchestra.run.gibba002:> sudo tee -a /etc/ceph/ceph.keyring 2021-02-12T17:15:39.262 DEBUG:teuthology.orchestra.run.gibba004:> sudo tee -a /etc/ceph/ceph.keyring 2021-02-12T17:15:39.302 INFO:teuthology.orchestra.run.gibba002.stdout:[mgr.y] 2021-02-12T17:15:39.302 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQCftyZgrlUGLxAAdvSG9iy8FKkCcKCT3V6BbQ== 2021-02-12T17:15:39.302 INFO:teuthology.orchestra.run.gibba002.stdout:[mds.a] 2021-02-12T17:15:39.302 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQCftyZgP3PZNxAAykJmRiSKE30sInWA9sT2sA== 2021-02-12T17:15:39.303 INFO:teuthology.orchestra.run.gibba002.stdout:[mds.c] 2021-02-12T17:15:39.303 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQCgtyZggV2HBBAAaykgeyjUxFd8cK+9Cw+hNg== 2021-02-12T17:15:39.303 INFO:teuthology.orchestra.run.gibba002.stdout:[osd.0] 2021-02-12T17:15:39.303 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQChtyZg6UGdJBAA2VUbHWRJk+QnFZe3tUuiuQ== 2021-02-12T17:15:39.303 INFO:teuthology.orchestra.run.gibba002.stdout:[osd.1] 2021-02-12T17:15:39.303 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQCktyZgjdUWIxAAUTab7cMeXkhCPR8NqAVe+g== 2021-02-12T17:15:39.303 INFO:teuthology.orchestra.run.gibba002.stdout:[osd.2] 2021-02-12T17:15:39.303 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQCntyZgcTqtIRAAptDEJTMoqyg/nuSaot7qOA== 2021-02-12T17:15:39.303 INFO:teuthology.orchestra.run.gibba002.stdout:[osd.3] 2021-02-12T17:15:39.303 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQCqtyZgqKzKIBAAJKUGYyAaDglUirQou/4MEw== 2021-02-12T17:15:39.303 INFO:teuthology.orchestra.run.gibba002.stdout:[mgr.x] 2021-02-12T17:15:39.303 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQCftyZgBUBzNRAAhqoN9cd2Tk1fPHcwzqCdQg== 2021-02-12T17:15:39.303 INFO:teuthology.orchestra.run.gibba002.stdout:[mds.b] 2021-02-12T17:15:39.304 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQCgtyZgqMluChAAZ6bMLrPlvop7XOrz3q3WJQ== 2021-02-12T17:15:39.304 INFO:teuthology.orchestra.run.gibba002.stdout:[mds.d] 2021-02-12T17:15:39.304 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQCgtyZgOvrAEhAAApJPMwJR4dyvTrW0kMT5Pg== 2021-02-12T17:15:39.304 INFO:teuthology.orchestra.run.gibba002.stdout:[osd.4] 2021-02-12T17:15:39.304 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQCutyZg+U3GJRAArov7I/LRp6cKWvhaKi2zvQ== 2021-02-12T17:15:39.304 INFO:teuthology.orchestra.run.gibba002.stdout:[osd.5] 2021-02-12T17:15:39.304 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQCxtyZg+jl8IhAAssgWo6Hym+JEDjbYnYO1cQ== 2021-02-12T17:15:39.304 INFO:teuthology.orchestra.run.gibba002.stdout:[osd.6] 2021-02-12T17:15:39.304 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQC0tyZgHO8HIRAAmtOIUsipw4frJRmmYxOIpA== 2021-02-12T17:15:39.304 INFO:teuthology.orchestra.run.gibba002.stdout:[osd.7] 2021-02-12T17:15:39.304 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQC3tyZgkocnIBAAsIER2pfhKn05sWMb9dgWag== 2021-02-12T17:15:39.304 INFO:teuthology.orchestra.run.gibba002.stdout:[client.0] 2021-02-12T17:15:39.304 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQCgtyZge2A6GBAA6WX1pe7WvdxjDnZuWMPzww== 2021-02-12T17:15:39.305 INFO:teuthology.orchestra.run.gibba002.stdout:[client.1] 2021-02-12T17:15:39.305 INFO:teuthology.orchestra.run.gibba002.stdout: key = AQCgtyZgm8afGhAAOSEldo9yUp8KLwuQMSvLpA== 2021-02-12T17:15:39.317 INFO:teuthology.orchestra.run.gibba004.stdout:[mgr.y] 2021-02-12T17:15:39.317 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQCftyZgrlUGLxAAdvSG9iy8FKkCcKCT3V6BbQ== 2021-02-12T17:15:39.317 INFO:teuthology.orchestra.run.gibba004.stdout:[mds.a] 2021-02-12T17:15:39.317 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQCftyZgP3PZNxAAykJmRiSKE30sInWA9sT2sA== 2021-02-12T17:15:39.317 INFO:teuthology.orchestra.run.gibba004.stdout:[mds.c] 2021-02-12T17:15:39.317 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQCgtyZggV2HBBAAaykgeyjUxFd8cK+9Cw+hNg== 2021-02-12T17:15:39.317 INFO:teuthology.orchestra.run.gibba004.stdout:[osd.0] 2021-02-12T17:15:39.317 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQChtyZg6UGdJBAA2VUbHWRJk+QnFZe3tUuiuQ== 2021-02-12T17:15:39.317 INFO:teuthology.orchestra.run.gibba004.stdout:[osd.1] 2021-02-12T17:15:39.318 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQCktyZgjdUWIxAAUTab7cMeXkhCPR8NqAVe+g== 2021-02-12T17:15:39.318 INFO:teuthology.orchestra.run.gibba004.stdout:[osd.2] 2021-02-12T17:15:39.318 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQCntyZgcTqtIRAAptDEJTMoqyg/nuSaot7qOA== 2021-02-12T17:15:39.318 INFO:teuthology.orchestra.run.gibba004.stdout:[osd.3] 2021-02-12T17:15:39.318 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQCqtyZgqKzKIBAAJKUGYyAaDglUirQou/4MEw== 2021-02-12T17:15:39.318 INFO:teuthology.orchestra.run.gibba004.stdout:[mgr.x] 2021-02-12T17:15:39.318 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQCftyZgBUBzNRAAhqoN9cd2Tk1fPHcwzqCdQg== 2021-02-12T17:15:39.318 INFO:teuthology.orchestra.run.gibba004.stdout:[mds.b] 2021-02-12T17:15:39.318 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQCgtyZgqMluChAAZ6bMLrPlvop7XOrz3q3WJQ== 2021-02-12T17:15:39.318 INFO:teuthology.orchestra.run.gibba004.stdout:[mds.d] 2021-02-12T17:15:39.318 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQCgtyZgOvrAEhAAApJPMwJR4dyvTrW0kMT5Pg== 2021-02-12T17:15:39.318 INFO:teuthology.orchestra.run.gibba004.stdout:[osd.4] 2021-02-12T17:15:39.318 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQCutyZg+U3GJRAArov7I/LRp6cKWvhaKi2zvQ== 2021-02-12T17:15:39.319 INFO:teuthology.orchestra.run.gibba004.stdout:[osd.5] 2021-02-12T17:15:39.319 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQCxtyZg+jl8IhAAssgWo6Hym+JEDjbYnYO1cQ== 2021-02-12T17:15:39.319 INFO:teuthology.orchestra.run.gibba004.stdout:[osd.6] 2021-02-12T17:15:39.319 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQC0tyZgHO8HIRAAmtOIUsipw4frJRmmYxOIpA== 2021-02-12T17:15:39.319 INFO:teuthology.orchestra.run.gibba004.stdout:[osd.7] 2021-02-12T17:15:39.319 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQC3tyZgkocnIBAAsIER2pfhKn05sWMb9dgWag== 2021-02-12T17:15:39.319 INFO:teuthology.orchestra.run.gibba004.stdout:[client.0] 2021-02-12T17:15:39.319 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQCgtyZge2A6GBAA6WX1pe7WvdxjDnZuWMPzww== 2021-02-12T17:15:39.319 INFO:teuthology.orchestra.run.gibba004.stdout:[client.1] 2021-02-12T17:15:39.319 INFO:teuthology.orchestra.run.gibba004.stdout: key = AQCgtyZgm8afGhAAOSEldo9yUp8KLwuQMSvLpA== 2021-02-12T17:15:39.320 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-12T17:15:39.349 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-12T17:15:39.396 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-02-12T17:15:39.425 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-02-12T17:15:39.473 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-02-12T17:15:39.503 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-02-12T17:15:39.551 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:39.581 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:39.626 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:39.657 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:39.700 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:39.733 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:39.775 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:39.810 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:39.850 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-12T17:15:39.886 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-12T17:15:39.925 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-02-12T17:15:39.962 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-02-12T17:15:40.001 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-02-12T17:15:40.040 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-02-12T17:15:40.079 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:40.117 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:40.153 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:40.194 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:40.229 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:40.271 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:40.306 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:40.320 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:15:40.347 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-12T17:15:40.348 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:15:40.384 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-12T17:15:40.446 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-12T17:15:40.483 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-12T17:15:40.525 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-12T17:15:40.563 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-02-12T17:15:40.563 DEBUG:teuthology.orchestra.run.gibba002:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-02-12T17:15:40.621 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-02-12T17:15:40.703 DEBUG:teuthology.orchestra.run.gibba002:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-02-12T17:15:40.763 DEBUG:teuthology.orchestra.run.gibba004:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-02-12T17:15:40.783 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-02-12T17:15:40.866 DEBUG:teuthology.orchestra.run.gibba004:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-02-12T17:15:40.926 DEBUG:teuthology.orchestra.run.gibba004:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-02-12T17:15:40.986 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-02-12T17:15:41.068 DEBUG:teuthology.orchestra.run.gibba004:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-02-12T17:15:41.128 DEBUG:teuthology.orchestra.run.gibba002:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-02-12T17:15:41.131 DEBUG:teuthology.orchestra.run.gibba004:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-02-12T17:15:41.179 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-02-12T17:15:41.179 INFO:tasks.ceph.mon.a:Restarting daemon 2021-02-12T17:15:41.179 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-02-12T17:15:41.183 INFO:tasks.ceph.mon.a:Started 2021-02-12T17:15:41.183 INFO:tasks.ceph.mon.b:Restarting daemon 2021-02-12T17:15:41.183 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-02-12T17:15:41.222 INFO:tasks.ceph.mon.b:Started 2021-02-12T17:15:41.223 INFO:tasks.ceph.mon.c:Restarting daemon 2021-02-12T17:15:41.223 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-02-12T17:15:41.225 INFO:tasks.ceph.mon.c:Started 2021-02-12T17:15:41.225 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-02-12T17:15:41.225 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-02-12T17:15:41.226 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-02-12T17:15:41.227 INFO:tasks.ceph.mgr.y:Started 2021-02-12T17:15:41.228 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-02-12T17:15:41.228 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-02-12T17:15:41.230 INFO:tasks.ceph.mgr.x:Started 2021-02-12T17:15:41.230 INFO:tasks.ceph:Setting crush tunables to default 2021-02-12T17:15:41.230 DEBUG:teuthology.orchestra.run.gibba002:> sudo ceph --cluster ceph osd crush tunables default 2021-02-12T17:15:41.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.319+0000 7f3d20336700 1 Processor -- start 2021-02-12T17:15:41.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.320+0000 7f3d20336700 1 -- start start 2021-02-12T17:15:41.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.320+0000 7f3d20336700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 0x7f3d18151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:41.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.320+0000 7f3d20336700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 0x7f3d18151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:41.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.320+0000 7f3d20336700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:41.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.320+0000 7f3d20336700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d18151ff0 con 0x7f3d1809ada0 2021-02-12T17:15:41.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.320+0000 7f3d20336700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d180b27d0 con 0x7f3d180bc2b0 2021-02-12T17:15:41.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.320+0000 7f3d20336700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d18066b70 con 0x7f3d180b0940 2021-02-12T17:15:41.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.320+0000 7f3d1e8d3700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:41.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.320+0000 7f3d1e8d3700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:43718/0 (socket says 172.21.2.102:43718) 2021-02-12T17:15:41.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.320+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/2804968410 learned_addr learned my addr 172.21.2.102:0/2804968410 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:15:41.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.320+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 msgr2=0x7f3d18151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-12T17:15:41.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.320+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 msgr2=0x7f3d18151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:41.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.320+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:41.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.320+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:41.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.321+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 0x7f3d18151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:41.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.321+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 0x7f3d18151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:41.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.321+0000 7f3d1e0d2700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 msgr2=0x7f3d18151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-02-12T17:15:41.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.321+0000 7f3d1e0d2700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 msgr2=0x7f3d18151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:41.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.321+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 0x7f3d18151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:41.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.321+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 0x7f3d18151120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:41.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.321+0000 7f3d1d8d1700 1 -- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 msgr2=0x7f3d18151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-02-12T17:15:41.328 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.321+0000 7f3d1d8d1700 1 -- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 msgr2=0x7f3d18151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:41.328 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.321+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 0x7f3d18151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:41.328 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.321+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 0x7f3d18151610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:41.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.521+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:41.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.521+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 msgr2=0x7f3d18151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-12T17:15:41.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.521+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 msgr2=0x7f3d18151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:41.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.521+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:41.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.521+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-02-12T17:15:41.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.522+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 0x7f3d18151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:41.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.522+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 0x7f3d18151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:41.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.522+0000 7f3d1d8d1700 1 -- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 msgr2=0x7f3d18151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-02-12T17:15:41.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.522+0000 7f3d1d8d1700 1 -- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 msgr2=0x7f3d18151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:41.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.522+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 0x7f3d18151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:41.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.522+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 0x7f3d18151610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-02-12T17:15:41.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.522+0000 7f3d1e0d2700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 msgr2=0x7f3d18151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-12T17:15:41.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.522+0000 7f3d1e0d2700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 msgr2=0x7f3d18151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:41.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.522+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 0x7f3d18151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:41.525 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.522+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 0x7f3d18151120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-02-12T17:15:41.924 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.922+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:41.924 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.922+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 msgr2=0x7f3d18151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-12T17:15:41.924 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.922+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 msgr2=0x7f3d18151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:41.924 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.922+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:41.924 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.922+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-02-12T17:15:41.925 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.923+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 0x7f3d18151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:41.925 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.923+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 0x7f3d18151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:41.926 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.923+0000 7f3d1d8d1700 1 -- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 msgr2=0x7f3d18151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-12T17:15:41.926 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.924+0000 7f3d1d8d1700 1 -- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 msgr2=0x7f3d18151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:41.926 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.924+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 0x7f3d18151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:41.926 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.924+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 0x7f3d18151610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-02-12T17:15:41.926 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.924+0000 7f3d1e0d2700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 msgr2=0x7f3d18151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-02-12T17:15:41.926 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.924+0000 7f3d1e0d2700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 msgr2=0x7f3d18151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:41.926 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.924+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 0x7f3d18151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:41.926 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:41.924+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 0x7f3d18151120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-02-12T17:15:42.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.724+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:42.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.724+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 msgr2=0x7f3d18151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-12T17:15:42.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.724+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 msgr2=0x7f3d18151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:42.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.724+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:42.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.724+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-02-12T17:15:42.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.726+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 0x7f3d18151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:42.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.726+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 0x7f3d18151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:42.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.726+0000 7f3d1d8d1700 1 -- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 msgr2=0x7f3d18151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-12T17:15:42.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.726+0000 7f3d1d8d1700 1 -- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 msgr2=0x7f3d18151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:42.728 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.726+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 0x7f3d18151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:42.728 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.726+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 0x7f3d18151610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-02-12T17:15:42.728 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.726+0000 7f3d1e0d2700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 msgr2=0x7f3d18151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-02-12T17:15:42.728 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.726+0000 7f3d1e0d2700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 msgr2=0x7f3d18151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:42.728 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.726+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 0x7f3d18151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:42.728 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:42.726+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 0x7f3d18151120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-02-12T17:15:44.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:44.320+0000 7f3d0bfff700 1 -- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 msgr2=0x7f3d18151610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-12T17:15:44.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:44.320+0000 7f3d0bfff700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d180b0940 0x7f3d18151610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:44.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:44.320+0000 7f3d0bfff700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 msgr2=0x7f3d18151120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-12T17:15:44.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:44.320+0000 7f3d0bfff700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.104:3300/0 conn(0x7f3d180bc2b0 0x7f3d18151120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:44.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:44.320+0000 7f3d0bfff700 1 -- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 msgr2=0x7f3d18151b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-12T17:15:44.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:44.320+0000 7f3d0bfff700 1 --2- 172.21.2.102:0/2804968410 >> v2:172.21.2.102:3300/0 conn(0x7f3d1809ada0 0x7f3d18151b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:44.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:44.320+0000 7f3d0bfff700 1 -- 172.21.2.102:0/2804968410 --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d180685b0 con 0x7f3d000070b0 2021-02-12T17:15:44.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:44.320+0000 7f3d0bfff700 1 -- 172.21.2.102:0/2804968410 --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0000bde0 con 0x7f3d00003390 2021-02-12T17:15:46.482 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.480+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741995410 0 0) 0x7f3d180685b0 con 0x7f3d000070b0 2021-02-12T17:15:46.482 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.480+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf8003230 con 0x7f3d000070b0 2021-02-12T17:15:46.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.481+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972263856 0 0) 0x7f3d0000bde0 con 0x7f3d00003390 2021-02-12T17:15:46.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.481+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 --> v1:172.21.2.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d180685b0 con 0x7f3d00003390 2021-02-12T17:15:46.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.481+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 677168839 0 0) 0x7f3cf8003230 con 0x7f3d000070b0 2021-02-12T17:15:46.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.481+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 >> v1:172.21.2.104:6789/0 conn(0x7f3d00003390 legacy=0x7f3d00005810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:46.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.481+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0000cfe0 con 0x7f3d000070b0 2021-02-12T17:15:46.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.481+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f3d1400d1c0 con 0x7f3d000070b0 2021-02-12T17:15:46.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.481+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 >> v1:172.21.2.102:6789/0 conn(0x7f3d000070b0 legacy=0x7f3d00009530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:46.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.481+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/2804968410 reap_dead start 2021-02-12T17:15:46.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.481+0000 7f3d1d0d0700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3cf8003980 0x7f3cf8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:46.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.481+0000 7f3d1d0d0700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf80044d0 0x7f3cf8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:46.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.481+0000 7f3d1d0d0700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3cf8004ee0 0x7f3cf800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:46.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.481+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf800bc60 con 0x7f3cf8004ee0 2021-02-12T17:15:46.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.481+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf800bdd0 con 0x7f3cf8003980 2021-02-12T17:15:46.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.481+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf800bf90 con 0x7f3cf80044d0 2021-02-12T17:15:46.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3cf8004ee0 0x7f3cf800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:46.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf80044d0 0x7f3cf8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:46.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3cf8003980 0x7f3cf8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:46.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf80044d0 msgr2=0x7f3cf8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:46.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1d8d1700 1 -- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf80044d0 msgr2=0x7f3cf8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-02-12T17:15:46.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1d8d1700 1 -- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf80044d0 msgr2=0x7f3cf8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:46.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf80044d0 0x7f3cf8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:46.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf80044d0 0x7f3cf8004950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:46.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf80044d0 0x7f3cf8004950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:46.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3cf8003980 msgr2=0x7f3cf8003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:46.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3cf8003980 0x7f3cf8003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:46.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/2804968410 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf8003230 con 0x7f3cf8004ee0 2021-02-12T17:15:46.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3cf8003980 0x7f3cf8003d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:15:46.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3cf8004ee0 0x7f3cf800b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3d0000acd0 tx=0x7f3d10008040).ready entity=mon.0 client_cookie=b8ccaf1228c3dd99 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:46.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10014a90 con 0x7f3cf8004ee0 2021-02-12T17:15:46.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1000c040 con 0x7f3cf8004ee0 2021-02-12T17:15:46.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.482+0000 7f3d1d0d0700 1 -- 172.21.2.102:0/2804968410 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10014e00 con 0x7f3cf8004ee0 2021-02-12T17:15:46.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.483+0000 7f3d20336700 1 -- 172.21.2.102:0/2804968410 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3cf8004ee0 msgr2=0x7f3cf800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:46.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.483+0000 7f3d20336700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3cf8004ee0 0x7f3cf800b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3d0000acd0 tx=0x7f3d10008040).stop 2021-02-12T17:15:46.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.483+0000 7f3d20336700 1 -- 172.21.2.102:0/2804968410 shutdown_connections 2021-02-12T17:15:46.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.483+0000 7f3d20336700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3cf8004ee0 0x7f3cf800b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:46.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.483+0000 7f3d20336700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf80044d0 0x7f3cf8004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:46.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.483+0000 7f3d20336700 1 --2- 172.21.2.102:0/2804968410 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3cf8003980 0x7f3cf8003d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:46.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.483+0000 7f3d20336700 1 -- 172.21.2.102:0/2804968410 >> 172.21.2.102:0/2804968410 conn(0x7f3d18061830 msgr2=0x7f3d180bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:46.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.483+0000 7f3d20336700 1 -- 172.21.2.102:0/2804968410 shutdown_connections 2021-02-12T17:15:46.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.483+0000 7f3d20336700 1 -- 172.21.2.102:0/2804968410 wait complete. 2021-02-12T17:15:46.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.484+0000 7f3d20336700 1 Processor -- start 2021-02-12T17:15:46.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.484+0000 7f3d20336700 1 -- start start 2021-02-12T17:15:46.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.484+0000 7f3d20336700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf8003980 0x7f3d180bb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:46.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.484+0000 7f3d20336700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3cf80044d0 0x7f3d1809fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:46.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.484+0000 7f3d20336700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3cf8004ee0 0x7f3d1809ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:46.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.484+0000 7f3d20336700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d18150e30 con 0x7f3cf8004ee0 2021-02-12T17:15:46.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.484+0000 7f3d20336700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1809c100 con 0x7f3cf80044d0 2021-02-12T17:15:46.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.484+0000 7f3d20336700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1809f090 con 0x7f3cf8003980 2021-02-12T17:15:46.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1e8d3700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3cf8004ee0 0x7f3d1809ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:46.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1e8d3700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3cf8004ee0 0x7f3d1809ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:43792/0 (socket says 172.21.2.102:43792) 2021-02-12T17:15:46.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/3935470494 learned_addr learned my addr 172.21.2.102:0/3935470494 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:15:46.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/3935470494 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf8003980 0x7f3d180bb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:46.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1d8d1700 1 --2- 172.21.2.102:0/3935470494 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3cf80044d0 0x7f3d1809fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:46.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1e0d2700 1 -- 172.21.2.102:0/3935470494 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf8003980 msgr2=0x7f3d180bb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-02-12T17:15:46.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1e0d2700 1 -- 172.21.2.102:0/3935470494 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf8003980 msgr2=0x7f3d180bb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-12T17:15:46.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/3935470494 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf8003980 0x7f3d180bb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:46.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1e0d2700 1 --2- 172.21.2.102:0/3935470494 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf8003980 0x7f3d180bb660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:46.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/3935470494 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf8003980 msgr2=0x7f3d180bb660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-12T17:15:46.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/3935470494 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf8003980 0x7f3d180bb660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:46.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/3935470494 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3cf80044d0 msgr2=0x7f3d1809fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:46.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/3935470494 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3cf80044d0 0x7f3d1809fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:46.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1e8d3700 1 -- 172.21.2.102:0/3935470494 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d18150b90 con 0x7f3cf8004ee0 2021-02-12T17:15:46.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d1e8d3700 1 --2- 172.21.2.102:0/3935470494 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3cf8004ee0 0x7f3d1809ff20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f3d10011010 tx=0x7f3d10008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:46.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d0a7fc700 1 -- 172.21.2.102:0/3935470494 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10020420 con 0x7f3cf8004ee0 2021-02-12T17:15:46.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d0a7fc700 1 -- 172.21.2.102:0/3935470494 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d10020580 con 0x7f3cf8004ee0 2021-02-12T17:15:46.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d20336700 1 -- 172.21.2.102:0/3935470494 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1809f2f0 con 0x7f3cf8004ee0 2021-02-12T17:15:46.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d0a7fc700 1 -- 172.21.2.102:0/3935470494 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10020980 con 0x7f3cf8004ee0 2021-02-12T17:15:46.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d20336700 1 -- 172.21.2.102:0/3935470494 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d180bbb50 con 0x7f3cf8004ee0 2021-02-12T17:15:46.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d0a7fc700 1 -- 172.21.2.102:0/3935470494 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f3d10012070 con 0x7f3cf8004ee0 2021-02-12T17:15:46.494 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.485+0000 7f3d0a7fc700 1 -- 172.21.2.102:0/3935470494 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f3d1002c750 con 0x7f3cf8004ee0 2021-02-12T17:15:46.494 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.486+0000 7f3d20336700 1 -- 172.21.2.102:0/3935470494 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1809f750 con 0x7f3cf8004ee0 2021-02-12T17:15:46.494 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.487+0000 7f3d0a7fc700 1 -- 172.21.2.102:0/3935470494 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (secure 0 0 0) 0x7f3d10031060 con 0x7f3cf8004ee0 2021-02-12T17:15:46.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.549+0000 7f3d20336700 1 -- 172.21.2.102:0/3935470494 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3d18045460 con 0x7f3cf8004ee0 2021-02-12T17:15:46.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.552+0000 7f3d0a7fc700 1 -- 172.21.2.102:0/3935470494 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3d1000f040 con 0x7f3cf8004ee0 2021-02-12T17:15:46.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.553+0000 7f3d20336700 1 -- 172.21.2.102:0/3935470494 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3cf8004ee0 msgr2=0x7f3d1809ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:46.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.553+0000 7f3d20336700 1 --2- 172.21.2.102:0/3935470494 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3cf8004ee0 0x7f3d1809ff20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f3d10011010 tx=0x7f3d10008040).stop 2021-02-12T17:15:46.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.553+0000 7f3d20336700 1 -- 172.21.2.102:0/3935470494 shutdown_connections 2021-02-12T17:15:46.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.553+0000 7f3d20336700 1 --2- 172.21.2.102:0/3935470494 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3cf8004ee0 0x7f3d1809ff20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:46.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.553+0000 7f3d20336700 1 --2- 172.21.2.102:0/3935470494 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3cf8003980 0x7f3d180bb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:46.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.553+0000 7f3d20336700 1 --2- 172.21.2.102:0/3935470494 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3cf80044d0 0x7f3d1809fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:46.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.553+0000 7f3d20336700 1 -- 172.21.2.102:0/3935470494 >> 172.21.2.102:0/3935470494 conn(0x7f3d18061830 msgr2=0x7f3d180b7870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:46.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.553+0000 7f3d20336700 1 -- 172.21.2.102:0/3935470494 shutdown_connections 2021-02-12T17:15:46.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:46.553+0000 7f3d20336700 1 -- 172.21.2.102:0/3935470494 wait complete. 2021-02-12T17:15:46.555 INFO:teuthology.orchestra.run.gibba002.stderr:adjusted tunables profile to default 2021-02-12T17:15:46.563 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-02-12T17:15:46.563 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:46.563 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2021-02-12T17:15:46.582 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:46.582 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2021-02-12T17:15:46.640 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:46.640 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2021-02-12T17:15:46.698 DEBUG:teuthology.orchestra.run.gibba002:> set -ex 2021-02-12T17:15:46.699 DEBUG:teuthology.orchestra.run.gibba002:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2021-02-12T17:15:46.756 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:46.757 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2021-02-12T17:15:46.776 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:46.776 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2021-02-12T17:15:46.837 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:46.837 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2021-02-12T17:15:46.895 DEBUG:teuthology.orchestra.run.gibba004:> set -ex 2021-02-12T17:15:46.895 DEBUG:teuthology.orchestra.run.gibba004:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2021-02-12T17:15:46.955 DEBUG:teuthology.orchestra.run.gibba004:> sudo ceph --cluster ceph osd new df884b24-e755-46a4-a472-82bc1a0d6c30 0 2021-02-12T17:15:47.081 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.078+0000 7f6dbb3cf700 1 Processor -- start 2021-02-12T17:15:47.081 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.079+0000 7f6dbb3cf700 1 -- start start 2021-02-12T17:15:47.083 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.079+0000 7f6dbb3cf700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f6db40bc2b0 0x7f6db4151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.083 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.079+0000 7f6dbb3cf700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 0x7f6db4151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.083 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.079+0000 7f6dbb3cf700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db4066b70 con 0x7f6db409ada0 2021-02-12T17:15:47.083 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.079+0000 7f6dbb3cf700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db40b27d0 con 0x7f6db40bc2b0 2021-02-12T17:15:47.083 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.079+0000 7f6dbb3cf700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db40b7110 con 0x7f6db40b0940 2021-02-12T17:15:47.083 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.079+0000 7f6db896a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 0x7f6db4151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.083 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.079+0000 7f6db896a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 0x7f6db4151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.104:47356/0 (socket says 172.21.2.104:47356) 2021-02-12T17:15:47.083 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.079+0000 7f6db916b700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f6db40bc2b0 0x7f6db4151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.084 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.079+0000 7f6db896a700 1 -- 172.21.2.104:0/2130037044 learned_addr learned my addr 172.21.2.104:0/2130037044 (peer_addr_for_me v2:172.21.2.104:0/0) 2021-02-12T17:15:47.084 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.079+0000 7f6db896a700 1 -- 172.21.2.104:0/2130037044 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 msgr2=0x7f6db4151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-12T17:15:47.084 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.079+0000 7f6db896a700 1 -- 172.21.2.104:0/2130037044 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 msgr2=0x7f6db4151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:47.084 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.079+0000 7f6db896a700 1 --2- 172.21.2.104:0/2130037044 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 0x7f6db4151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:47.084 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.079+0000 7f6db896a700 1 --2- 172.21.2.104:0/2130037044 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 0x7f6db4151610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:47.084 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.080+0000 7f6db916b700 1 -- 172.21.2.104:0/2130037044 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 msgr2=0x7f6db4151610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-12T17:15:47.084 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.080+0000 7f6db916b700 1 --2- 172.21.2.104:0/2130037044 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 0x7f6db4151610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.084 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.080+0000 7f6db916b700 1 -- 172.21.2.104:0/2130037044 >> v1:172.21.2.102:6789/0 conn(0x7f6db409ada0 legacy=0x7f6db414d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.084 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.080+0000 7f6db916b700 1 -- 172.21.2.104:0/2130037044 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db40685b0 con 0x7f6db40bc2b0 2021-02-12T17:15:47.084 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.080+0000 7f6db916b700 1 --2- 172.21.2.104:0/2130037044 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6db40bc2b0 0x7f6db4151120 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f6da400b980 tx=0x7f6da4006de0).ready entity=mon.1 client_cookie=2f87e6b8c85a1088 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:47.084 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.080+0000 7f6da3fff700 1 -- 172.21.2.104:0/2130037044 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4009870 con 0x7f6db40bc2b0 2021-02-12T17:15:47.084 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.080+0000 7f6da3fff700 1 -- 172.21.2.104:0/2130037044 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da40099d0 con 0x7f6db40bc2b0 2021-02-12T17:15:47.084 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.080+0000 7f6da3fff700 1 -- 172.21.2.104:0/2130037044 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4009d50 con 0x7f6db40bc2b0 2021-02-12T17:15:47.084 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.080+0000 7f6dbb3cf700 1 -- 172.21.2.104:0/2130037044 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6db40bc2b0 msgr2=0x7f6db4151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.085 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.080+0000 7f6dbb3cf700 1 --2- 172.21.2.104:0/2130037044 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6db40bc2b0 0x7f6db4151120 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f6da400b980 tx=0x7f6da4006de0).stop 2021-02-12T17:15:47.085 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.080+0000 7f6dbb3cf700 1 -- 172.21.2.104:0/2130037044 shutdown_connections 2021-02-12T17:15:47.085 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.081+0000 7f6dbb3cf700 1 --2- 172.21.2.104:0/2130037044 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6db40bc2b0 0x7f6db4151120 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.085 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.081+0000 7f6dbb3cf700 1 --2- 172.21.2.104:0/2130037044 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 0x7f6db4151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.085 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.081+0000 7f6dbb3cf700 1 -- 172.21.2.104:0/2130037044 >> 172.21.2.104:0/2130037044 conn(0x7f6db4061830 msgr2=0x7f6db40bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:47.085 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.081+0000 7f6dbb3cf700 1 -- 172.21.2.104:0/2130037044 shutdown_connections 2021-02-12T17:15:47.085 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.081+0000 7f6dbb3cf700 1 -- 172.21.2.104:0/2130037044 wait complete. 2021-02-12T17:15:47.087 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6dbb3cf700 1 Processor -- start 2021-02-12T17:15:47.087 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6dbb3cf700 1 -- start start 2021-02-12T17:15:47.087 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6dbb3cf700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6db409ada0 0x7f6db4148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.088 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6dbb3cf700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 0x7f6db4160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.088 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6dbb3cf700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6db40bc2b0 0x7f6db4161440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.088 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6dbb3cf700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4063be0 con 0x7f6db409ada0 2021-02-12T17:15:47.088 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6dbb3cf700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db415ead0 con 0x7f6db40bc2b0 2021-02-12T17:15:47.088 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6dbb3cf700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db414a270 con 0x7f6db40b0940 2021-02-12T17:15:47.088 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6db896a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 0x7f6db4160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.088 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6db996c700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6db40bc2b0 0x7f6db4161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.088 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6db896a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 0x7f6db4160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.104:47362/0 (socket says 172.21.2.104:47362) 2021-02-12T17:15:47.088 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6db996c700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6db40bc2b0 0x7f6db4161440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.104:46330/0 (socket says 172.21.2.104:46330) 2021-02-12T17:15:47.088 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6db896a700 1 -- 172.21.2.104:0/3839899363 learned_addr learned my addr 172.21.2.104:0/3839899363 (peer_addr_for_me v2:172.21.2.104:0/0) 2021-02-12T17:15:47.088 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6db896a700 1 -- 172.21.2.104:0/3839899363 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 msgr2=0x7f6db4160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-02-12T17:15:47.088 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6db896a700 1 -- 172.21.2.104:0/3839899363 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 msgr2=0x7f6db4160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-12T17:15:47.088 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6db896a700 1 --2- 172.21.2.104:0/3839899363 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 0x7f6db4160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:47.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.082+0000 7f6db896a700 1 --2- 172.21.2.104:0/3839899363 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 0x7f6db4160f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:47.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6db916b700 1 --2- 172.21.2.104:0/3839899363 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6db409ada0 0x7f6db4148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6db996c700 1 -- 172.21.2.104:0/3839899363 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 msgr2=0x7f6db4160f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-12T17:15:47.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6db996c700 1 --2- 172.21.2.104:0/3839899363 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 0x7f6db4160f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6db996c700 1 -- 172.21.2.104:0/3839899363 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6db409ada0 msgr2=0x7f6db4148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6db996c700 1 --2- 172.21.2.104:0/3839899363 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6db409ada0 0x7f6db4148940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6db996c700 1 -- 172.21.2.104:0/3839899363 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db40b8820 con 0x7f6db40bc2b0 2021-02-12T17:15:47.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6db916b700 1 --2- 172.21.2.104:0/3839899363 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6db409ada0 0x7f6db4148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:15:47.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6db996c700 1 --2- 172.21.2.104:0/3839899363 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6db40bc2b0 0x7f6db4161440 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f6db409b250 tx=0x7f6dac007ea0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:47.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6da17fa700 1 -- 172.21.2.104:0/3839899363 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0030f0 con 0x7f6db40bc2b0 2021-02-12T17:15:47.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6da17fa700 1 -- 172.21.2.104:0/3839899363 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac00a7f0 con 0x7f6db40bc2b0 2021-02-12T17:15:47.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6da17fa700 1 -- 172.21.2.104:0/3839899363 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac00ab70 con 0x7f6db40bc2b0 2021-02-12T17:15:47.090 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6dbb3cf700 1 -- 172.21.2.104:0/3839899363 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db40b8ac0 con 0x7f6db40bc2b0 2021-02-12T17:15:47.090 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6dbb3cf700 1 -- 172.21.2.104:0/3839899363 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db4148e30 con 0x7f6db40bc2b0 2021-02-12T17:15:47.090 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6da17fa700 1 -- 172.21.2.104:0/3839899363 <== mon.1 v2:172.21.2.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f6dac019030 con 0x7f6db40bc2b0 2021-02-12T17:15:47.090 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.083+0000 7f6da17fa700 1 -- 172.21.2.104:0/3839899363 <== mon.1 v2:172.21.2.104:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f6dac012770 con 0x7f6db40bc2b0 2021-02-12T17:15:47.090 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.084+0000 7f6dbb3cf700 1 -- 172.21.2.104:0/3839899363 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db4160c90 con 0x7f6db40bc2b0 2021-02-12T17:15:47.090 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.085+0000 7f6da17fa700 1 -- 172.21.2.104:0/3839899363 <== mon.1 v2:172.21.2.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (secure 0 0 0) 0x7f6db4160c90 con 0x7f6db40bc2b0 2021-02-12T17:15:47.154 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.152+0000 7f6dbb3cf700 1 -- 172.21.2.104:0/3839899363 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "df884b24-e755-46a4-a472-82bc1a0d6c30", "id": 0} v 0) v1 -- 0x7f6db40bc7b0 con 0x7f6db40bc2b0 2021-02-12T17:15:47.157 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.155+0000 7f6da17fa700 1 -- 172.21.2.104:0/3839899363 <== mon.1 v2:172.21.2.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df884b24-e755-46a4-a472-82bc1a0d6c30", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6dac021060 con 0x7f6db40bc2b0 2021-02-12T17:15:47.158 INFO:teuthology.orchestra.run.gibba004.stdout:0 2021-02-12T17:15:47.159 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.156+0000 7f6dbb3cf700 1 -- 172.21.2.104:0/3839899363 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6db40bc2b0 msgr2=0x7f6db4161440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.159 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.156+0000 7f6dbb3cf700 1 --2- 172.21.2.104:0/3839899363 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6db40bc2b0 0x7f6db4161440 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f6db409b250 tx=0x7f6dac007ea0).stop 2021-02-12T17:15:47.159 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.156+0000 7f6dbb3cf700 1 -- 172.21.2.104:0/3839899363 shutdown_connections 2021-02-12T17:15:47.159 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.156+0000 7f6dbb3cf700 1 --2- 172.21.2.104:0/3839899363 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6db40bc2b0 0x7f6db4161440 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.160 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.156+0000 7f6dbb3cf700 1 --2- 172.21.2.104:0/3839899363 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6db409ada0 0x7f6db4148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.160 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.156+0000 7f6dbb3cf700 1 --2- 172.21.2.104:0/3839899363 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6db40b0940 0x7f6db4160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.160 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.156+0000 7f6dbb3cf700 1 -- 172.21.2.104:0/3839899363 >> 172.21.2.104:0/3839899363 conn(0x7f6db4061830 msgr2=0x7f6db414cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:47.160 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.157+0000 7f6dbb3cf700 1 -- 172.21.2.104:0/3839899363 shutdown_connections 2021-02-12T17:15:47.160 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.157+0000 7f6dbb3cf700 1 -- 172.21.2.104:0/3839899363 wait complete. 2021-02-12T17:15:47.167 DEBUG:teuthology.orchestra.run.gibba004:> sudo ceph --cluster ceph osd new 5c783edf-71c2-41fb-8dae-c750fee7027b 1 2021-02-12T17:15:47.256 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.252+0000 7f9e925f4700 1 Processor -- start 2021-02-12T17:15:47.257 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.252+0000 7f9e925f4700 1 -- start start 2021-02-12T17:15:47.257 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e925f4700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 0x7f9e8c14e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.257 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e925f4700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f9e8c09ada0 0x7f9e8c151830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.257 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e925f4700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c066b70 con 0x7f9e8c0bc2b0 2021-02-12T17:15:47.257 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e925f4700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c0b27d0 con 0x7f9e8c09ada0 2021-02-12T17:15:47.258 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e925f4700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c14e550 con 0x7f9e8c0b0940 2021-02-12T17:15:47.258 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e8b7fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 0x7f9e8c14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.258 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e8b7fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 0x7f9e8c14e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.104:47368/0 (socket says 172.21.2.104:47368) 2021-02-12T17:15:47.258 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e8b7fe700 1 -- 172.21.2.104:0/3233530312 learned_addr learned my addr 172.21.2.104:0/3233530312 (peer_addr_for_me v2:172.21.2.104:0/0) 2021-02-12T17:15:47.258 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e8b7fe700 1 -- 172.21.2.104:0/3233530312 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 msgr2=0x7f9e8c14e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-12T17:15:47.259 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e8b7fe700 1 -- 172.21.2.104:0/3233530312 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 msgr2=0x7f9e8c14e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:47.259 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e90b91700 1 --2- 172.21.2.104:0/3233530312 >> v2:172.21.2.102:3300/0 conn(0x7f9e8c09ada0 0x7f9e8c151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.259 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e8b7fe700 1 --2- 172.21.2.104:0/3233530312 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 0x7f9e8c14e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:47.259 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e8b7fe700 1 --2- 172.21.2.104:0/3233530312 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 0x7f9e8c14e060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:47.259 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e90b91700 1 -- 172.21.2.104:0/3233530312 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 msgr2=0x7f9e8c14e060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-12T17:15:47.259 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e90b91700 1 --2- 172.21.2.104:0/3233530312 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 0x7f9e8c14e060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.259 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e90b91700 1 -- 172.21.2.104:0/3233530312 >> v1:172.21.2.102:6789/0 conn(0x7f9e8c0bc2b0 legacy=0x7f9e8c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.259 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.253+0000 7f9e90b91700 1 -- 172.21.2.104:0/3233530312 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c0685b0 con 0x7f9e8c09ada0 2021-02-12T17:15:47.259 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.254+0000 7f9e90b91700 1 --2- 172.21.2.104:0/3233530312 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9e8c09ada0 0x7f9e8c151830 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f9e84009c90 tx=0x7f9e840091d0).ready entity=mon.0 client_cookie=eb62c9ba17cc4159 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:47.259 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.254+0000 7f9e8affd700 1 -- 172.21.2.104:0/3233530312 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84009ea0 con 0x7f9e8c09ada0 2021-02-12T17:15:47.260 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.254+0000 7f9e8affd700 1 -- 172.21.2.104:0/3233530312 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8400bc80 con 0x7f9e8c09ada0 2021-02-12T17:15:47.260 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.254+0000 7f9e8affd700 1 -- 172.21.2.104:0/3233530312 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84011400 con 0x7f9e8c09ada0 2021-02-12T17:15:47.260 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.254+0000 7f9e925f4700 1 -- 172.21.2.104:0/3233530312 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9e8c09ada0 msgr2=0x7f9e8c151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.260 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.254+0000 7f9e925f4700 1 --2- 172.21.2.104:0/3233530312 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9e8c09ada0 0x7f9e8c151830 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f9e84009c90 tx=0x7f9e840091d0).stop 2021-02-12T17:15:47.260 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.254+0000 7f9e925f4700 1 -- 172.21.2.104:0/3233530312 shutdown_connections 2021-02-12T17:15:47.260 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.254+0000 7f9e925f4700 1 --2- 172.21.2.104:0/3233530312 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9e8c09ada0 0x7f9e8c151830 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.260 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.254+0000 7f9e925f4700 1 --2- 172.21.2.104:0/3233530312 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 0x7f9e8c14e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.260 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.254+0000 7f9e925f4700 1 -- 172.21.2.104:0/3233530312 >> 172.21.2.104:0/3233530312 conn(0x7f9e8c061830 msgr2=0x7f9e8c0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:47.261 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.254+0000 7f9e925f4700 1 -- 172.21.2.104:0/3233530312 shutdown_connections 2021-02-12T17:15:47.261 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.254+0000 7f9e925f4700 1 -- 172.21.2.104:0/3233530312 wait complete. 2021-02-12T17:15:47.265 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.255+0000 7f9e925f4700 1 Processor -- start 2021-02-12T17:15:47.265 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.255+0000 7f9e925f4700 1 -- start start 2021-02-12T17:15:47.265 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e925f4700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9e8c09ada0 0x7f9e8c0b8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.265 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e925f4700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 0x7f9e8c14f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.265 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e925f4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9e8c0bc2b0 0x7f9e8c14f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.265 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e925f4700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c09b6b0 con 0x7f9e8c0bc2b0 2021-02-12T17:15:47.265 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e925f4700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c09b950 con 0x7f9e8c09ada0 2021-02-12T17:15:47.265 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e925f4700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c09bbf0 con 0x7f9e8c0b0940 2021-02-12T17:15:47.265 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8b7fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 0x7f9e8c14f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8bfff700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9e8c09ada0 0x7f9e8c0b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8b7fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 0x7f9e8c14f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.104:47376/0 (socket says 172.21.2.104:47376) 2021-02-12T17:15:47.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8bfff700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9e8c09ada0 0x7f9e8c0b8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.104:46340/0 (socket says 172.21.2.104:46340) 2021-02-12T17:15:47.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8b7fe700 1 -- 172.21.2.104:0/3538391223 learned_addr learned my addr 172.21.2.104:0/3538391223 (peer_addr_for_me v2:172.21.2.104:0/0) 2021-02-12T17:15:47.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8b7fe700 1 -- 172.21.2.104:0/3538391223 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 msgr2=0x7f9e8c14f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-02-12T17:15:47.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8b7fe700 1 -- 172.21.2.104:0/3538391223 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 msgr2=0x7f9e8c14f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-12T17:15:47.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8b7fe700 1 --2- 172.21.2.104:0/3538391223 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 0x7f9e8c14f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:47.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e90b91700 1 --2- 172.21.2.104:0/3538391223 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9e8c0bc2b0 0x7f9e8c14f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8b7fe700 1 --2- 172.21.2.104:0/3538391223 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 0x7f9e8c14f340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:47.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8bfff700 1 -- 172.21.2.104:0/3538391223 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 msgr2=0x7f9e8c14f340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-12T17:15:47.267 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8bfff700 1 --2- 172.21.2.104:0/3538391223 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 0x7f9e8c14f340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.267 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8bfff700 1 -- 172.21.2.104:0/3538391223 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9e8c0bc2b0 msgr2=0x7f9e8c14f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.267 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8bfff700 1 --2- 172.21.2.104:0/3538391223 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9e8c0bc2b0 0x7f9e8c14f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.267 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8bfff700 1 -- 172.21.2.104:0/3538391223 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c14eea0 con 0x7f9e8c09ada0 2021-02-12T17:15:47.267 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e90b91700 1 --2- 172.21.2.104:0/3538391223 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9e8c0bc2b0 0x7f9e8c14f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:15:47.267 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e8bfff700 1 --2- 172.21.2.104:0/3538391223 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9e8c09ada0 0x7f9e8c0b8580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f9e7400c710 tx=0x7f9e74007b80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:47.267 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e83fff700 1 -- 172.21.2.104:0/3538391223 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e74007020 con 0x7f9e8c09ada0 2021-02-12T17:15:47.267 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e83fff700 1 -- 172.21.2.104:0/3538391223 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e74007180 con 0x7f9e8c09ada0 2021-02-12T17:15:47.268 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e925f4700 1 -- 172.21.2.104:0/3538391223 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8c09b3a0 con 0x7f9e8c09ada0 2021-02-12T17:15:47.268 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e83fff700 1 -- 172.21.2.104:0/3538391223 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e740064e0 con 0x7f9e8c09ada0 2021-02-12T17:15:47.268 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e925f4700 1 -- 172.21.2.104:0/3538391223 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c063250 con 0x7f9e8c09ada0 2021-02-12T17:15:47.268 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e83fff700 1 -- 172.21.2.104:0/3538391223 <== mon.1 v2:172.21.2.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f9e74010070 con 0x7f9e8c09ada0 2021-02-12T17:15:47.268 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.256+0000 7f9e83fff700 1 -- 172.21.2.104:0/3538391223 <== mon.1 v2:172.21.2.104:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f9e7400ed60 con 0x7f9e8c09ada0 2021-02-12T17:15:47.268 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.257+0000 7f9e925f4700 1 -- 172.21.2.104:0/3538391223 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8c14f030 con 0x7f9e8c09ada0 2021-02-12T17:15:47.268 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.259+0000 7f9e83fff700 1 -- 172.21.2.104:0/3538391223 <== mon.1 v2:172.21.2.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (secure 0 0 0) 0x7f9e74020060 con 0x7f9e8c09ada0 2021-02-12T17:15:47.329 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.327+0000 7f9e925f4700 1 -- 172.21.2.104:0/3538391223 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5c783edf-71c2-41fb-8dae-c750fee7027b", "id": 1} v 0) v1 -- 0x7f9e8c09bdb0 con 0x7f9e8c09ada0 2021-02-12T17:15:47.332 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.330+0000 7f9e83fff700 1 -- 172.21.2.104:0/3538391223 <== mon.1 v2:172.21.2.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5c783edf-71c2-41fb-8dae-c750fee7027b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9e740290b0 con 0x7f9e8c09ada0 2021-02-12T17:15:47.332 INFO:teuthology.orchestra.run.gibba004.stdout:1 2021-02-12T17:15:47.334 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.331+0000 7f9e925f4700 1 -- 172.21.2.104:0/3538391223 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9e8c09ada0 msgr2=0x7f9e8c0b8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.334 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.331+0000 7f9e925f4700 1 --2- 172.21.2.104:0/3538391223 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9e8c09ada0 0x7f9e8c0b8580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f9e7400c710 tx=0x7f9e74007b80).stop 2021-02-12T17:15:47.334 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.331+0000 7f9e925f4700 1 -- 172.21.2.104:0/3538391223 shutdown_connections 2021-02-12T17:15:47.334 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.331+0000 7f9e925f4700 1 --2- 172.21.2.104:0/3538391223 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9e8c0bc2b0 0x7f9e8c14f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.335 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.331+0000 7f9e925f4700 1 --2- 172.21.2.104:0/3538391223 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9e8c09ada0 0x7f9e8c0b8580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.335 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.331+0000 7f9e925f4700 1 --2- 172.21.2.104:0/3538391223 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9e8c0b0940 0x7f9e8c14f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.335 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.331+0000 7f9e925f4700 1 -- 172.21.2.104:0/3538391223 >> 172.21.2.104:0/3538391223 conn(0x7f9e8c061830 msgr2=0x7f9e8c14d130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:47.335 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.331+0000 7f9e925f4700 1 -- 172.21.2.104:0/3538391223 shutdown_connections 2021-02-12T17:15:47.335 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.331+0000 7f9e925f4700 1 -- 172.21.2.104:0/3538391223 wait complete. 2021-02-12T17:15:47.341 DEBUG:teuthology.orchestra.run.gibba004:> sudo ceph --cluster ceph osd new f3a099b7-eb7f-411a-bb86-f9e93165e0a6 2 2021-02-12T17:15:47.430 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.428+0000 7f7610eeb700 1 Processor -- start 2021-02-12T17:15:47.430 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.428+0000 7f7610eeb700 1 -- start start 2021-02-12T17:15:47.432 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.428+0000 7f7610eeb700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f760c0b7d70 0x7f760c0bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.432 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.428+0000 7f7610eeb700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c149ea0 con 0x7f760c0bc0f0 2021-02-12T17:15:47.432 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.428+0000 7f7610eeb700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c14a140 con 0x7f760c149a00 2021-02-12T17:15:47.432 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.428+0000 7f7610eeb700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c14a3e0 con 0x7f760c0b7d70 2021-02-12T17:15:47.432 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.429+0000 7f7609d9b700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f760c149a00 0x7f760c0b1360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.104:37554/0 (socket says 172.21.2.104:37554) 2021-02-12T17:15:47.433 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.429+0000 7f7609d9b700 1 -- 172.21.2.104:0/2163291099 learned_addr learned my addr 172.21.2.104:0/2163291099 (peer_addr_for_me v1:172.21.2.104:0/0) 2021-02-12T17:15:47.433 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.429+0000 7f760ad9d700 1 --2- 172.21.2.104:0/2163291099 >> v2:172.21.2.102:3300/0 conn(0x7f760c0b7d70 0x7f760c0bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.433 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.429+0000 7f760959a700 1 -- 172.21.2.104:0/2163291099 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54237897 0 0) 0x7f760c149ea0 con 0x7f760c0bc0f0 2021-02-12T17:15:47.433 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.429+0000 7f760959a700 1 -- 172.21.2.104:0/2163291099 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75ec003230 con 0x7f760c0bc0f0 2021-02-12T17:15:47.433 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.429+0000 7f760959a700 1 -- 172.21.2.104:0/2163291099 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176509878 0 0) 0x7f760c14a140 con 0x7f760c149a00 2021-02-12T17:15:47.433 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.429+0000 7f760959a700 1 -- 172.21.2.104:0/2163291099 --> v1:172.21.2.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f760c149ea0 con 0x7f760c149a00 2021-02-12T17:15:47.433 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.429+0000 7f760ad9d700 1 -- 172.21.2.104:0/2163291099 >> v1:172.21.2.104:6789/0 conn(0x7f760c149a00 legacy=0x7f760c0b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.433 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.429+0000 7f760ad9d700 1 -- 172.21.2.104:0/2163291099 >> v1:172.21.2.102:6789/0 conn(0x7f760c0bc0f0 legacy=0x7f760c0b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.433 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.429+0000 7f760ad9d700 1 -- 172.21.2.104:0/2163291099 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c14a680 con 0x7f760c0b7d70 2021-02-12T17:15:47.433 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.429+0000 7f760ad9d700 1 --2- 172.21.2.104:0/2163291099 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f760c0b7d70 0x7f760c0bc4d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f7604009c90 tx=0x7f76040091d0).ready entity=mon.0 client_cookie=97ce7e3b8c4b56f5 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:47.433 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.429+0000 7f760959a700 1 -- 172.21.2.104:0/2163291099 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400b980 con 0x7f760c0b7d70 2021-02-12T17:15:47.433 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.429+0000 7f760959a700 1 -- 172.21.2.104:0/2163291099 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760400bae0 con 0x7f760c0b7d70 2021-02-12T17:15:47.434 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.430+0000 7f760959a700 1 -- 172.21.2.104:0/2163291099 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400be60 con 0x7f760c0b7d70 2021-02-12T17:15:47.434 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.430+0000 7f7610eeb700 1 -- 172.21.2.104:0/2163291099 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f760c0b7d70 msgr2=0x7f760c0bc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.434 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.430+0000 7f7610eeb700 1 --2- 172.21.2.104:0/2163291099 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f760c0b7d70 0x7f760c0bc4d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f7604009c90 tx=0x7f76040091d0).stop 2021-02-12T17:15:47.434 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.430+0000 7f7610eeb700 1 -- 172.21.2.104:0/2163291099 shutdown_connections 2021-02-12T17:15:47.434 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.430+0000 7f7610eeb700 1 --2- 172.21.2.104:0/2163291099 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f760c0b7d70 0x7f760c0bc4d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.434 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.430+0000 7f7610eeb700 1 -- 172.21.2.104:0/2163291099 >> 172.21.2.104:0/2163291099 conn(0x7f760c061830 msgr2=0x7f760c0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:47.434 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.430+0000 7f7610eeb700 1 -- 172.21.2.104:0/2163291099 shutdown_connections 2021-02-12T17:15:47.434 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.430+0000 7f7610eeb700 1 -- 172.21.2.104:0/2163291099 wait complete. 2021-02-12T17:15:47.437 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.431+0000 7f7610eeb700 1 Processor -- start 2021-02-12T17:15:47.437 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.431+0000 7f7610eeb700 1 -- start start 2021-02-12T17:15:47.437 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.431+0000 7f7610eeb700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f760c0b7d70 0x7f760c0a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.437 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.431+0000 7f7610eeb700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f760c0bc0f0 0x7f760c13a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.438 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.431+0000 7f7610eeb700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f760c149a00 0x7f760c13aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.438 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.431+0000 7f7610eeb700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c09f500 con 0x7f760c0b7d70 2021-02-12T17:15:47.438 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.431+0000 7f7610eeb700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c09f7a0 con 0x7f760c0bc0f0 2021-02-12T17:15:47.438 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.431+0000 7f7610eeb700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c139360 con 0x7f760c149a00 2021-02-12T17:15:47.438 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.431+0000 7f760ad9d700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f760c149a00 0x7f760c13aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.438 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.431+0000 7f7609d9b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f760c0bc0f0 0x7f760c13a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.438 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.431+0000 7f760ad9d700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f760c149a00 0x7f760c13aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.104:47386/0 (socket says 172.21.2.104:47386) 2021-02-12T17:15:47.438 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.431+0000 7f7609d9b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f760c0bc0f0 0x7f760c13a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.104:46356/0 (socket says 172.21.2.104:46356) 2021-02-12T17:15:47.438 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.431+0000 7f760ad9d700 1 -- 172.21.2.104:0/2851666283 learned_addr learned my addr 172.21.2.104:0/2851666283 (peer_addr_for_me v2:172.21.2.104:0/0) 2021-02-12T17:15:47.439 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f760a59c700 1 --2- 172.21.2.104:0/2851666283 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f760c0b7d70 0x7f760c0a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.439 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f760ad9d700 1 -- 172.21.2.104:0/2851666283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f760c149a00 msgr2=0x7f760c13aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-02-12T17:15:47.439 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f760ad9d700 1 -- 172.21.2.104:0/2851666283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f760c149a00 msgr2=0x7f760c13aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-12T17:15:47.439 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f760ad9d700 1 --2- 172.21.2.104:0/2851666283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f760c149a00 0x7f760c13aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:47.439 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f760ad9d700 1 --2- 172.21.2.104:0/2851666283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f760c149a00 0x7f760c13aa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:47.439 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f7609d9b700 1 -- 172.21.2.104:0/2851666283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f760c149a00 msgr2=0x7f760c13aa60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-12T17:15:47.439 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f7609d9b700 1 --2- 172.21.2.104:0/2851666283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f760c149a00 0x7f760c13aa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.439 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f7609d9b700 1 -- 172.21.2.104:0/2851666283 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f760c0b7d70 msgr2=0x7f760c0a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.440 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f7609d9b700 1 --2- 172.21.2.104:0/2851666283 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f760c0b7d70 0x7f760c0a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.440 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f7609d9b700 1 -- 172.21.2.104:0/2851666283 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c139600 con 0x7f760c0bc0f0 2021-02-12T17:15:47.440 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f7609d9b700 1 --2- 172.21.2.104:0/2851666283 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f760c0bc0f0 0x7f760c13a570 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f75f4007fd0 tx=0x7f75f4007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:47.440 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f76027fc700 1 -- 172.21.2.104:0/2851666283 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40072e0 con 0x7f760c0bc0f0 2021-02-12T17:15:47.440 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f76027fc700 1 -- 172.21.2.104:0/2851666283 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f4007440 con 0x7f760c0bc0f0 2021-02-12T17:15:47.440 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f7610eeb700 1 -- 172.21.2.104:0/2851666283 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0a1680 con 0x7f760c0bc0f0 2021-02-12T17:15:47.440 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f76027fc700 1 -- 172.21.2.104:0/2851666283 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f4005810 con 0x7f760c0bc0f0 2021-02-12T17:15:47.440 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f7610eeb700 1 -- 172.21.2.104:0/2851666283 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c138ee0 con 0x7f760c0bc0f0 2021-02-12T17:15:47.440 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f76027fc700 1 -- 172.21.2.104:0/2851666283 <== mon.1 v2:172.21.2.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f75f401a060 con 0x7f760c0bc0f0 2021-02-12T17:15:47.440 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.432+0000 7f76027fc700 1 -- 172.21.2.104:0/2851666283 <== mon.1 v2:172.21.2.104:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f75f401c3f0 con 0x7f760c0bc0f0 2021-02-12T17:15:47.440 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.433+0000 7f7610eeb700 1 -- 172.21.2.104:0/2851666283 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c13a2d0 con 0x7f760c0bc0f0 2021-02-12T17:15:47.440 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.434+0000 7f76027fc700 1 -- 172.21.2.104:0/2851666283 <== mon.1 v2:172.21.2.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (secure 0 0 0) 0x7f760c13a2d0 con 0x7f760c0bc0f0 2021-02-12T17:15:47.511 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.509+0000 7f7610eeb700 1 -- 172.21.2.104:0/2851666283 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f3a099b7-eb7f-411a-bb86-f9e93165e0a6", "id": 2} v 0) v1 -- 0x7f760c045460 con 0x7f760c0bc0f0 2021-02-12T17:15:47.514 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.512+0000 7f76027fc700 1 -- 172.21.2.104:0/2851666283 <== mon.1 v2:172.21.2.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f3a099b7-eb7f-411a-bb86-f9e93165e0a6", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f75f4018070 con 0x7f760c0bc0f0 2021-02-12T17:15:47.514 INFO:teuthology.orchestra.run.gibba004.stdout:2 2021-02-12T17:15:47.517 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.514+0000 7f75ebfff700 1 -- 172.21.2.104:0/2851666283 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f760c0bc0f0 msgr2=0x7f760c13a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.517 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.514+0000 7f75ebfff700 1 --2- 172.21.2.104:0/2851666283 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f760c0bc0f0 0x7f760c13a570 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f75f4007fd0 tx=0x7f75f4007c10).stop 2021-02-12T17:15:47.517 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.514+0000 7f75ebfff700 1 -- 172.21.2.104:0/2851666283 shutdown_connections 2021-02-12T17:15:47.517 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.514+0000 7f75ebfff700 1 --2- 172.21.2.104:0/2851666283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f760c149a00 0x7f760c13aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.517 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.514+0000 7f75ebfff700 1 --2- 172.21.2.104:0/2851666283 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f760c0b7d70 0x7f760c0a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.517 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.514+0000 7f75ebfff700 1 --2- 172.21.2.104:0/2851666283 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f760c0bc0f0 0x7f760c13a570 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.518 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.514+0000 7f75ebfff700 1 -- 172.21.2.104:0/2851666283 >> 172.21.2.104:0/2851666283 conn(0x7f760c061830 msgr2=0x7f760c066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:47.518 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.514+0000 7f75ebfff700 1 -- 172.21.2.104:0/2851666283 shutdown_connections 2021-02-12T17:15:47.518 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.514+0000 7f75ebfff700 1 -- 172.21.2.104:0/2851666283 wait complete. 2021-02-12T17:15:47.527 DEBUG:teuthology.orchestra.run.gibba004:> sudo ceph --cluster ceph osd new b059f336-ca68-49d9-868b-669c9019fdb7 3 2021-02-12T17:15:47.657 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.655+0000 7f0c54718700 1 Processor -- start 2021-02-12T17:15:47.658 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.655+0000 7f0c54718700 1 -- start start 2021-02-12T17:15:47.659 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.656+0000 7f0c54718700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f0c4c066b70 0x7f0c4c1491c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.659 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.656+0000 7f0c54718700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4c0b7030 con 0x7f0c4c0b0940 2021-02-12T17:15:47.659 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.656+0000 7f0c54718700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4c068620 con 0x7f0c4c0bc2b0 2021-02-12T17:15:47.659 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.656+0000 7f0c54718700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4c0688c0 con 0x7f0c4c066b70 2021-02-12T17:15:47.659 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.656+0000 7f0c524b4700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f0c4c0bc2b0 0x7f0c4c148ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.104:37564/0 (socket says 172.21.2.104:37564) 2021-02-12T17:15:47.659 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.656+0000 7f0c524b4700 1 -- 172.21.2.104:0/4292085960 learned_addr learned my addr 172.21.2.104:0/4292085960 (peer_addr_for_me v1:172.21.2.104:0/0) 2021-02-12T17:15:47.659 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.656+0000 7f0c51cb3700 1 --2- 172.21.2.104:0/4292085960 >> v2:172.21.2.104:3300/0 conn(0x7f0c4c066b70 0x7f0c4c1491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.659 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.657+0000 7f0c51cb3700 1 -- 172.21.2.104:0/4292085960 >> v1:172.21.2.104:6789/0 conn(0x7f0c4c0bc2b0 legacy=0x7f0c4c148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.659 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.657+0000 7f0c51cb3700 1 -- 172.21.2.104:0/4292085960 >> v1:172.21.2.102:6789/0 conn(0x7f0c4c0b0940 legacy=0x7f0c4c149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.659 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.657+0000 7f0c51cb3700 1 -- 172.21.2.104:0/4292085960 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c0b6c80 con 0x7f0c4c066b70 2021-02-12T17:15:47.660 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.657+0000 7f0c51cb3700 1 --2- 172.21.2.104:0/4292085960 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0c4c066b70 0x7f0c4c1491c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0c4800b980 tx=0x7f0c48006de0).ready entity=mon.1 client_cookie=4f70f3024301de4f server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:47.663 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.657+0000 7f0c514b2700 1 -- 172.21.2.104:0/4292085960 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48009870 con 0x7f0c4c066b70 2021-02-12T17:15:47.663 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.657+0000 7f0c514b2700 1 -- 172.21.2.104:0/4292085960 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c480099d0 con 0x7f0c4c066b70 2021-02-12T17:15:47.663 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.657+0000 7f0c514b2700 1 -- 172.21.2.104:0/4292085960 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48009d50 con 0x7f0c4c066b70 2021-02-12T17:15:47.663 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.657+0000 7f0c54718700 1 -- 172.21.2.104:0/4292085960 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0c4c066b70 msgr2=0x7f0c4c1491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.663 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.657+0000 7f0c54718700 1 --2- 172.21.2.104:0/4292085960 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0c4c066b70 0x7f0c4c1491c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0c4800b980 tx=0x7f0c48006de0).stop 2021-02-12T17:15:47.663 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.657+0000 7f0c54718700 1 -- 172.21.2.104:0/4292085960 shutdown_connections 2021-02-12T17:15:47.664 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.657+0000 7f0c54718700 1 --2- 172.21.2.104:0/4292085960 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0c4c066b70 0x7f0c4c1491c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.664 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.657+0000 7f0c54718700 1 -- 172.21.2.104:0/4292085960 >> 172.21.2.104:0/4292085960 conn(0x7f0c4c061830 msgr2=0x7f0c4c0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:47.664 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.658+0000 7f0c54718700 1 -- 172.21.2.104:0/4292085960 shutdown_connections 2021-02-12T17:15:47.664 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.658+0000 7f0c54718700 1 -- 172.21.2.104:0/4292085960 wait complete. 2021-02-12T17:15:47.664 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.658+0000 7f0c54718700 1 Processor -- start 2021-02-12T17:15:47.664 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.658+0000 7f0c54718700 1 -- start start 2021-02-12T17:15:47.664 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c54718700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c4c066b70 0x7f0c4c14f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.664 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c54718700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c4c0b0940 0x7f0c4c063270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.665 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c54718700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0c4c0bc2b0 0x7f0c4c14ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.665 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c54718700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0b4250 con 0x7f0c4c066b70 2021-02-12T17:15:47.665 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c54718700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0b48c0 con 0x7f0c4c0bc2b0 2021-02-12T17:15:47.665 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c54718700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0b4b60 con 0x7f0c4c0b0940 2021-02-12T17:15:47.665 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c51cb3700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c4c0b0940 0x7f0c4c063270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.665 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c51cb3700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c4c0b0940 0x7f0c4c063270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.104:47398/0 (socket says 172.21.2.104:47398) 2021-02-12T17:15:47.665 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c51cb3700 1 -- 172.21.2.104:0/2687686171 learned_addr learned my addr 172.21.2.104:0/2687686171 (peer_addr_for_me v2:172.21.2.104:0/0) 2021-02-12T17:15:47.665 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c52cb5700 1 --2- 172.21.2.104:0/2687686171 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0c4c0bc2b0 0x7f0c4c14ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.665 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c51cb3700 1 -- 172.21.2.104:0/2687686171 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c4c0b0940 msgr2=0x7f0c4c063270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-02-12T17:15:47.665 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c51cb3700 1 -- 172.21.2.104:0/2687686171 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c4c0b0940 msgr2=0x7f0c4c063270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-12T17:15:47.665 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c51cb3700 1 --2- 172.21.2.104:0/2687686171 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c4c0b0940 0x7f0c4c063270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:47.666 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c524b4700 1 --2- 172.21.2.104:0/2687686171 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c4c066b70 0x7f0c4c14f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.666 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c51cb3700 1 --2- 172.21.2.104:0/2687686171 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c4c0b0940 0x7f0c4c063270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:47.666 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c52cb5700 1 -- 172.21.2.104:0/2687686171 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c4c0b0940 msgr2=0x7f0c4c063270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-12T17:15:47.666 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c52cb5700 1 --2- 172.21.2.104:0/2687686171 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c4c0b0940 0x7f0c4c063270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.666 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c52cb5700 1 -- 172.21.2.104:0/2687686171 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c4c066b70 msgr2=0x7f0c4c14f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.666 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c52cb5700 1 --2- 172.21.2.104:0/2687686171 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c4c066b70 0x7f0c4c14f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.667 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.659+0000 7f0c52cb5700 1 -- 172.21.2.104:0/2687686171 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c0b5120 con 0x7f0c4c0bc2b0 2021-02-12T17:15:47.667 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.660+0000 7f0c52cb5700 1 --2- 172.21.2.104:0/2687686171 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0c4c0bc2b0 0x7f0c4c14ce50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f0c4c0b0d80 tx=0x7f0c44007e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:47.667 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.660+0000 7f0c3e7fc700 1 -- 172.21.2.104:0/2687686171 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400a5e0 con 0x7f0c4c0bc2b0 2021-02-12T17:15:47.667 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.660+0000 7f0c3e7fc700 1 -- 172.21.2.104:0/2687686171 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4400a740 con 0x7f0c4c0bc2b0 2021-02-12T17:15:47.667 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.660+0000 7f0c54718700 1 -- 172.21.2.104:0/2687686171 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4c0b53c0 con 0x7f0c4c0bc2b0 2021-02-12T17:15:47.667 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.660+0000 7f0c54718700 1 -- 172.21.2.104:0/2687686171 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4c0b45b0 con 0x7f0c4c0bc2b0 2021-02-12T17:15:47.667 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.660+0000 7f0c3e7fc700 1 -- 172.21.2.104:0/2687686171 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400aac0 con 0x7f0c4c0bc2b0 2021-02-12T17:15:47.667 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.660+0000 7f0c3e7fc700 1 -- 172.21.2.104:0/2687686171 <== mon.1 v2:172.21.2.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f0c44019030 con 0x7f0c4c0bc2b0 2021-02-12T17:15:47.668 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.660+0000 7f0c3e7fc700 1 -- 172.21.2.104:0/2687686171 <== mon.1 v2:172.21.2.104:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f0c440128c0 con 0x7f0c4c0bc2b0 2021-02-12T17:15:47.668 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.661+0000 7f0c54718700 1 -- 172.21.2.104:0/2687686171 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c30004f60 con 0x7f0c4c0bc2b0 2021-02-12T17:15:47.668 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.662+0000 7f0c3e7fc700 1 -- 172.21.2.104:0/2687686171 <== mon.1 v2:172.21.2.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (secure 0 0 0) 0x7f0c44021060 con 0x7f0c4c0bc2b0 2021-02-12T17:15:47.732 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.729+0000 7f0c54718700 1 -- 172.21.2.104:0/2687686171 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b059f336-ca68-49d9-868b-669c9019fdb7", "id": 3} v 0) v1 -- 0x7f0c30005210 con 0x7f0c4c0bc2b0 2021-02-12T17:15:47.735 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.733+0000 7f0c3e7fc700 1 -- 172.21.2.104:0/2687686171 <== mon.1 v2:172.21.2.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b059f336-ca68-49d9-868b-669c9019fdb7", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c44017070 con 0x7f0c4c0bc2b0 2021-02-12T17:15:47.735 INFO:teuthology.orchestra.run.gibba004.stdout:3 2021-02-12T17:15:47.736 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.734+0000 7f0c54718700 1 -- 172.21.2.104:0/2687686171 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0c4c0bc2b0 msgr2=0x7f0c4c14ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.736 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.734+0000 7f0c54718700 1 --2- 172.21.2.104:0/2687686171 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0c4c0bc2b0 0x7f0c4c14ce50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f0c4c0b0d80 tx=0x7f0c44007e60).stop 2021-02-12T17:15:47.736 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.734+0000 7f0c54718700 1 -- 172.21.2.104:0/2687686171 shutdown_connections 2021-02-12T17:15:47.736 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.734+0000 7f0c54718700 1 --2- 172.21.2.104:0/2687686171 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0c4c0bc2b0 0x7f0c4c14ce50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.736 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.734+0000 7f0c54718700 1 --2- 172.21.2.104:0/2687686171 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c4c066b70 0x7f0c4c14f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.737 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.734+0000 7f0c54718700 1 --2- 172.21.2.104:0/2687686171 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c4c0b0940 0x7f0c4c063270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.737 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.734+0000 7f0c54718700 1 -- 172.21.2.104:0/2687686171 >> 172.21.2.104:0/2687686171 conn(0x7f0c4c061830 msgr2=0x7f0c4c0b8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:47.737 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.734+0000 7f0c54718700 1 -- 172.21.2.104:0/2687686171 shutdown_connections 2021-02-12T17:15:47.737 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.734+0000 7f0c54718700 1 -- 172.21.2.104:0/2687686171 wait complete. 2021-02-12T17:15:47.744 DEBUG:teuthology.orchestra.run.gibba004:> sudo ceph --cluster ceph osd new 112296c9-c2ef-40ee-98a9-c781c7e7b217 4 2021-02-12T17:15:47.831 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.829+0000 7f9924793700 1 Processor -- start 2021-02-12T17:15:47.831 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.829+0000 7f9924793700 1 -- start start 2021-02-12T17:15:47.834 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9924793700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c0b0940 0x7f991c14e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.834 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9924793700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f991c09ada0 0x7f991c151830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.834 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9924793700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c066b70 con 0x7f991c0bc2b0 2021-02-12T17:15:47.834 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9924793700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c0b27d0 con 0x7f991c09ada0 2021-02-12T17:15:47.834 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9924793700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c14e550 con 0x7f991c0b0940 2021-02-12T17:15:47.834 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9921d2e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c0b0940 0x7f991c14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.834 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9921d2e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c0b0940 0x7f991c14e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.104:47404/0 (socket says 172.21.2.104:47404) 2021-02-12T17:15:47.834 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9921d2e700 1 -- 172.21.2.104:0/3686679751 learned_addr learned my addr 172.21.2.104:0/3686679751 (peer_addr_for_me v2:172.21.2.104:0/0) 2021-02-12T17:15:47.835 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9921d2e700 1 -- 172.21.2.104:0/3686679751 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c0b0940 msgr2=0x7f991c14e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-12T17:15:47.835 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9921d2e700 1 -- 172.21.2.104:0/3686679751 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c0b0940 msgr2=0x7f991c14e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:47.835 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9921d2e700 1 --2- 172.21.2.104:0/3686679751 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c0b0940 0x7f991c14e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:47.835 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9921d2e700 1 --2- 172.21.2.104:0/3686679751 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c0b0940 0x7f991c14e060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:47.835 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9922d30700 1 --2- 172.21.2.104:0/3686679751 >> v2:172.21.2.102:3300/0 conn(0x7f991c09ada0 0x7f991c151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.835 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9922d30700 1 -- 172.21.2.104:0/3686679751 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c0b0940 msgr2=0x7f991c14e060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-12T17:15:47.835 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9922d30700 1 --2- 172.21.2.104:0/3686679751 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c0b0940 0x7f991c14e060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.835 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9922d30700 1 -- 172.21.2.104:0/3686679751 >> v1:172.21.2.102:6789/0 conn(0x7f991c0bc2b0 legacy=0x7f991c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.835 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.830+0000 7f9922d30700 1 -- 172.21.2.104:0/3686679751 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0685b0 con 0x7f991c09ada0 2021-02-12T17:15:47.835 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.831+0000 7f9922d30700 1 --2- 172.21.2.104:0/3686679751 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f991c09ada0 0x7f991c151830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f9914009c90 tx=0x7f99140091d0).ready entity=mon.0 client_cookie=a639702ff105b592 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:47.836 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.831+0000 7f992152d700 1 -- 172.21.2.104:0/3686679751 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914009ea0 con 0x7f991c09ada0 2021-02-12T17:15:47.836 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.831+0000 7f992152d700 1 -- 172.21.2.104:0/3686679751 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991400bc80 con 0x7f991c09ada0 2021-02-12T17:15:47.836 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.831+0000 7f992152d700 1 -- 172.21.2.104:0/3686679751 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914011400 con 0x7f991c09ada0 2021-02-12T17:15:47.836 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.831+0000 7f9924793700 1 -- 172.21.2.104:0/3686679751 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f991c09ada0 msgr2=0x7f991c151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.836 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.831+0000 7f9924793700 1 --2- 172.21.2.104:0/3686679751 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f991c09ada0 0x7f991c151830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f9914009c90 tx=0x7f99140091d0).stop 2021-02-12T17:15:47.836 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.831+0000 7f9924793700 1 -- 172.21.2.104:0/3686679751 shutdown_connections 2021-02-12T17:15:47.836 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.831+0000 7f9924793700 1 --2- 172.21.2.104:0/3686679751 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f991c09ada0 0x7f991c151830 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.836 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.831+0000 7f9924793700 1 --2- 172.21.2.104:0/3686679751 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c0b0940 0x7f991c14e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.836 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.831+0000 7f9924793700 1 -- 172.21.2.104:0/3686679751 >> 172.21.2.104:0/3686679751 conn(0x7f991c061830 msgr2=0x7f991c0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:47.836 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.831+0000 7f9924793700 1 -- 172.21.2.104:0/3686679751 shutdown_connections 2021-02-12T17:15:47.836 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.831+0000 7f9924793700 1 -- 172.21.2.104:0/3686679751 wait complete. 2021-02-12T17:15:47.839 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.832+0000 7f9924793700 1 Processor -- start 2021-02-12T17:15:47.839 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.832+0000 7f9924793700 1 -- start start 2021-02-12T17:15:47.839 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9924793700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c09ada0 0x7f991c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.840 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9924793700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f991c0b0940 0x7f991c150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.840 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9924793700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f991c0bc2b0 0x7f991c09b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:47.840 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9924793700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0a1a70 con 0x7f991c0bc2b0 2021-02-12T17:15:47.840 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9924793700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c063940 con 0x7f991c0b0940 2021-02-12T17:15:47.840 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9924793700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c09f870 con 0x7f991c09ada0 2021-02-12T17:15:47.840 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9921d2e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f991c0b0940 0x7f991c150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.840 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f992252f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c09ada0 0x7f991c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.840 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f992252f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c09ada0 0x7f991c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.104:47410/0 (socket says 172.21.2.104:47410) 2021-02-12T17:15:47.840 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9921d2e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f991c0b0940 0x7f991c150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.104:46378/0 (socket says 172.21.2.104:46378) 2021-02-12T17:15:47.840 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f992252f700 1 -- 172.21.2.104:0/2798631397 learned_addr learned my addr 172.21.2.104:0/2798631397 (peer_addr_for_me v2:172.21.2.104:0/0) 2021-02-12T17:15:47.840 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9922d30700 1 --2- 172.21.2.104:0/2798631397 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f991c0bc2b0 0x7f991c09b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:47.840 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f992252f700 1 -- 172.21.2.104:0/2798631397 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c09ada0 msgr2=0x7f991c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-02-12T17:15:47.840 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f992252f700 1 -- 172.21.2.104:0/2798631397 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c09ada0 msgr2=0x7f991c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-12T17:15:47.841 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f992252f700 1 --2- 172.21.2.104:0/2798631397 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c09ada0 0x7f991c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:47.841 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f992252f700 1 --2- 172.21.2.104:0/2798631397 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c09ada0 0x7f991c15d5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:47.841 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9921d2e700 1 -- 172.21.2.104:0/2798631397 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c09ada0 msgr2=0x7f991c15d5d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-12T17:15:47.841 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9921d2e700 1 --2- 172.21.2.104:0/2798631397 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c09ada0 0x7f991c15d5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.841 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9921d2e700 1 -- 172.21.2.104:0/2798631397 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f991c0bc2b0 msgr2=0x7f991c09b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.841 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9921d2e700 1 --2- 172.21.2.104:0/2798631397 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f991c0bc2b0 0x7f991c09b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.841 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9921d2e700 1 -- 172.21.2.104:0/2798631397 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c09f090 con 0x7f991c0b0940 2021-02-12T17:15:47.841 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.833+0000 7f9921d2e700 1 --2- 172.21.2.104:0/2798631397 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f991c0b0940 0x7f991c150290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f9910006cb0 tx=0x7f9910008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:47.841 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.834+0000 7f990e7fc700 1 -- 172.21.2.104:0/2798631397 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910017070 con 0x7f991c0b0940 2021-02-12T17:15:47.842 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.834+0000 7f990e7fc700 1 -- 172.21.2.104:0/2798631397 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99100125f0 con 0x7f991c0b0940 2021-02-12T17:15:47.842 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.834+0000 7f9924793700 1 -- 172.21.2.104:0/2798631397 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991c09f330 con 0x7f991c0b0940 2021-02-12T17:15:47.842 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.834+0000 7f990e7fc700 1 -- 172.21.2.104:0/2798631397 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910012990 con 0x7f991c0b0940 2021-02-12T17:15:47.842 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.834+0000 7f9924793700 1 -- 172.21.2.104:0/2798631397 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991c150780 con 0x7f991c0b0940 2021-02-12T17:15:47.842 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.834+0000 7f990e7fc700 1 -- 172.21.2.104:0/2798631397 <== mon.1 v2:172.21.2.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f9910006300 con 0x7f991c0b0940 2021-02-12T17:15:47.842 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.834+0000 7f990e7fc700 1 -- 172.21.2.104:0/2798631397 <== mon.1 v2:172.21.2.104:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f9910005bc0 con 0x7f991c0b0940 2021-02-12T17:15:47.842 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.834+0000 7f9924793700 1 -- 172.21.2.104:0/2798631397 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c0b8060 con 0x7f991c0b0940 2021-02-12T17:15:47.842 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.836+0000 7f990e7fc700 1 -- 172.21.2.104:0/2798631397 <== mon.1 v2:172.21.2.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (secure 0 0 0) 0x7f9910012d80 con 0x7f991c0b0940 2021-02-12T17:15:47.906 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.904+0000 7f9924793700 1 -- 172.21.2.104:0/2798631397 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "112296c9-c2ef-40ee-98a9-c781c7e7b217", "id": 4} v 0) v1 -- 0x7f991c045460 con 0x7f991c0b0940 2021-02-12T17:15:47.909 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.907+0000 7f990e7fc700 1 -- 172.21.2.104:0/2798631397 <== mon.1 v2:172.21.2.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "112296c9-c2ef-40ee-98a9-c781c7e7b217", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f991002a0b0 con 0x7f991c0b0940 2021-02-12T17:15:47.910 INFO:teuthology.orchestra.run.gibba004.stdout:4 2021-02-12T17:15:47.911 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.908+0000 7f9924793700 1 -- 172.21.2.104:0/2798631397 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f991c0b0940 msgr2=0x7f991c150290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:47.911 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.908+0000 7f9924793700 1 --2- 172.21.2.104:0/2798631397 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f991c0b0940 0x7f991c150290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f9910006cb0 tx=0x7f9910008040).stop 2021-02-12T17:15:47.911 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.908+0000 7f9924793700 1 -- 172.21.2.104:0/2798631397 shutdown_connections 2021-02-12T17:15:47.911 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.908+0000 7f9924793700 1 --2- 172.21.2.104:0/2798631397 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f991c0bc2b0 0x7f991c09b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.911 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.908+0000 7f9924793700 1 --2- 172.21.2.104:0/2798631397 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f991c09ada0 0x7f991c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.911 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.908+0000 7f9924793700 1 --2- 172.21.2.104:0/2798631397 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f991c0b0940 0x7f991c150290 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:47.911 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.908+0000 7f9924793700 1 -- 172.21.2.104:0/2798631397 >> 172.21.2.104:0/2798631397 conn(0x7f991c061830 msgr2=0x7f991c0b98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:47.912 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.908+0000 7f9924793700 1 -- 172.21.2.104:0/2798631397 shutdown_connections 2021-02-12T17:15:47.912 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:47.908+0000 7f9924793700 1 -- 172.21.2.104:0/2798631397 wait complete. 2021-02-12T17:15:47.919 DEBUG:teuthology.orchestra.run.gibba004:> sudo ceph --cluster ceph osd new b57fba19-36f5-4046-b76c-a2a899f44246 5 2021-02-12T17:15:48.009 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.007+0000 7f40d2105700 1 Processor -- start 2021-02-12T17:15:48.010 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.007+0000 7f40d2105700 1 -- start start 2021-02-12T17:15:48.011 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40d2105700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc0bc2b0 0x7f40cc151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.011 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40d2105700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f40cc0b0940 0x7f40cc151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.011 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40d2105700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc066b70 con 0x7f40cc09ada0 2021-02-12T17:15:48.012 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40d2105700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0b27d0 con 0x7f40cc0b0940 2021-02-12T17:15:48.012 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40d2105700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0b7110 con 0x7f40cc0bc2b0 2021-02-12T17:15:48.012 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40cb7fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc0bc2b0 0x7f40cc151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.012 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40cb7fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc0bc2b0 0x7f40cc151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.104:47414/0 (socket says 172.21.2.104:47414) 2021-02-12T17:15:48.012 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40cb7fe700 1 -- 172.21.2.104:0/3888951156 learned_addr learned my addr 172.21.2.104:0/3888951156 (peer_addr_for_me v2:172.21.2.104:0/0) 2021-02-12T17:15:48.012 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40caffd700 1 --2- 172.21.2.104:0/3888951156 >> v2:172.21.2.104:3300/0 conn(0x7f40cc0b0940 0x7f40cc151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.012 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40cb7fe700 1 -- 172.21.2.104:0/3888951156 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc0bc2b0 msgr2=0x7f40cc151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-12T17:15:48.012 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40cb7fe700 1 -- 172.21.2.104:0/3888951156 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc0bc2b0 msgr2=0x7f40cc151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:48.012 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40cb7fe700 1 --2- 172.21.2.104:0/3888951156 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc0bc2b0 0x7f40cc151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:48.012 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40cb7fe700 1 --2- 172.21.2.104:0/3888951156 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc0bc2b0 0x7f40cc151120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:48.012 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40caffd700 1 -- 172.21.2.104:0/3888951156 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc0bc2b0 msgr2=0x7f40cc151120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-12T17:15:48.012 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40caffd700 1 --2- 172.21.2.104:0/3888951156 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc0bc2b0 0x7f40cc151120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.012 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40caffd700 1 -- 172.21.2.104:0/3888951156 >> v1:172.21.2.102:6789/0 conn(0x7f40cc09ada0 legacy=0x7f40cc14d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:48.013 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40caffd700 1 -- 172.21.2.104:0/3888951156 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0685b0 con 0x7f40cc0b0940 2021-02-12T17:15:48.013 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.008+0000 7f40caffd700 1 --2- 172.21.2.104:0/3888951156 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40cc0b0940 0x7f40cc151610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f40b400b980 tx=0x7f40b4006de0).ready entity=mon.1 client_cookie=82eb2d7d30446ef7 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:48.013 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.009+0000 7f40ca7fc700 1 -- 172.21.2.104:0/3888951156 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4009870 con 0x7f40cc0b0940 2021-02-12T17:15:48.013 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.009+0000 7f40ca7fc700 1 -- 172.21.2.104:0/3888951156 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b40099d0 con 0x7f40cc0b0940 2021-02-12T17:15:48.013 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.009+0000 7f40ca7fc700 1 -- 172.21.2.104:0/3888951156 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4009d50 con 0x7f40cc0b0940 2021-02-12T17:15:48.013 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.009+0000 7f40d2105700 1 -- 172.21.2.104:0/3888951156 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40cc0b0940 msgr2=0x7f40cc151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:48.013 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.009+0000 7f40d2105700 1 --2- 172.21.2.104:0/3888951156 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40cc0b0940 0x7f40cc151610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f40b400b980 tx=0x7f40b4006de0).stop 2021-02-12T17:15:48.013 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.009+0000 7f40d2105700 1 -- 172.21.2.104:0/3888951156 shutdown_connections 2021-02-12T17:15:48.013 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.009+0000 7f40d2105700 1 --2- 172.21.2.104:0/3888951156 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc0bc2b0 0x7f40cc151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.013 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.009+0000 7f40d2105700 1 --2- 172.21.2.104:0/3888951156 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40cc0b0940 0x7f40cc151610 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.013 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.009+0000 7f40d2105700 1 -- 172.21.2.104:0/3888951156 >> 172.21.2.104:0/3888951156 conn(0x7f40cc061830 msgr2=0x7f40cc0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:48.013 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.009+0000 7f40d2105700 1 -- 172.21.2.104:0/3888951156 shutdown_connections 2021-02-12T17:15:48.014 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.009+0000 7f40d2105700 1 -- 172.21.2.104:0/3888951156 wait complete. 2021-02-12T17:15:48.016 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.010+0000 7f40d2105700 1 Processor -- start 2021-02-12T17:15:48.016 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.010+0000 7f40d2105700 1 -- start start 2021-02-12T17:15:48.016 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40d2105700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc09ada0 0x7f40cc0640a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.016 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40d2105700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40cc0b0940 0x7f40cc152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.016 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40d2105700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40cc0bc2b0 0x7f40cc09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.016 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40d2105700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc062630 con 0x7f40cc0b0940 2021-02-12T17:15:48.016 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40d2105700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc062100 con 0x7f40cc0bc2b0 2021-02-12T17:15:48.016 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40d2105700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc09b520 con 0x7f40cc09ada0 2021-02-12T17:15:48.016 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40cb7fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc09ada0 0x7f40cc0640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.016 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40cb7fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc09ada0 0x7f40cc0640a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.104:47420/0 (socket says 172.21.2.104:47420) 2021-02-12T17:15:48.016 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40cb7fe700 1 -- 172.21.2.104:0/2497229421 learned_addr learned my addr 172.21.2.104:0/2497229421 (peer_addr_for_me v2:172.21.2.104:0/0) 2021-02-12T17:15:48.017 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40cbfff700 1 --2- 172.21.2.104:0/2497229421 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40cc0bc2b0 0x7f40cc09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.017 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40cb7fe700 1 -- 172.21.2.104:0/2497229421 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc09ada0 msgr2=0x7f40cc0640a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-02-12T17:15:48.017 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40cb7fe700 1 -- 172.21.2.104:0/2497229421 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc09ada0 msgr2=0x7f40cc0640a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-12T17:15:48.017 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40cb7fe700 1 --2- 172.21.2.104:0/2497229421 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc09ada0 0x7f40cc0640a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:48.017 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40cb7fe700 1 --2- 172.21.2.104:0/2497229421 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc09ada0 0x7f40cc0640a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:48.017 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40caffd700 1 --2- 172.21.2.104:0/2497229421 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40cc0b0940 0x7f40cc152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.017 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40cbfff700 1 -- 172.21.2.104:0/2497229421 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc09ada0 msgr2=0x7f40cc0640a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-12T17:15:48.017 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40cbfff700 1 --2- 172.21.2.104:0/2497229421 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc09ada0 0x7f40cc0640a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.017 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40cbfff700 1 -- 172.21.2.104:0/2497229421 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40cc0b0940 msgr2=0x7f40cc152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:48.017 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40cbfff700 1 --2- 172.21.2.104:0/2497229421 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40cc0b0940 0x7f40cc152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.017 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40cbfff700 1 -- 172.21.2.104:0/2497229421 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc061df0 con 0x7f40cc0bc2b0 2021-02-12T17:15:48.017 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40caffd700 1 --2- 172.21.2.104:0/2497229421 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40cc0b0940 0x7f40cc152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:15:48.017 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40cbfff700 1 --2- 172.21.2.104:0/2497229421 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40cc0bc2b0 0x7f40cc09cc20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f40c400ca60 tx=0x7f40c4007ea0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:48.018 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40c37fe700 1 -- 172.21.2.104:0/2497229421 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c40030f0 con 0x7f40cc0bc2b0 2021-02-12T17:15:48.018 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40c37fe700 1 -- 172.21.2.104:0/2497229421 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c400a760 con 0x7f40cc0bc2b0 2021-02-12T17:15:48.018 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40d2105700 1 -- 172.21.2.104:0/2497229421 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc152a80 con 0x7f40cc0bc2b0 2021-02-12T17:15:48.018 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40c37fe700 1 -- 172.21.2.104:0/2497229421 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c400aae0 con 0x7f40cc0bc2b0 2021-02-12T17:15:48.018 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.011+0000 7f40d2105700 1 -- 172.21.2.104:0/2497229421 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc062a60 con 0x7f40cc0bc2b0 2021-02-12T17:15:48.018 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.012+0000 7f40c37fe700 1 -- 172.21.2.104:0/2497229421 <== mon.1 v2:172.21.2.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f40c4019030 con 0x7f40cc0bc2b0 2021-02-12T17:15:48.018 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.012+0000 7f40c37fe700 1 -- 172.21.2.104:0/2497229421 <== mon.1 v2:172.21.2.104:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f40c401b960 con 0x7f40cc0bc2b0 2021-02-12T17:15:48.018 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.012+0000 7f40d2105700 1 -- 172.21.2.104:0/2497229421 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc152c10 con 0x7f40cc0bc2b0 2021-02-12T17:15:48.018 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.014+0000 7f40c37fe700 1 -- 172.21.2.104:0/2497229421 <== mon.1 v2:172.21.2.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (secure 0 0 0) 0x7f40c4021060 con 0x7f40cc0bc2b0 2021-02-12T17:15:48.085 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.083+0000 7f40d2105700 1 -- 172.21.2.104:0/2497229421 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b57fba19-36f5-4046-b76c-a2a899f44246", "id": 5} v 0) v1 -- 0x7f40cc062770 con 0x7f40cc0bc2b0 2021-02-12T17:15:48.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.087+0000 7f40c37fe700 1 -- 172.21.2.104:0/2497229421 <== mon.1 v2:172.21.2.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b57fba19-36f5-4046-b76c-a2a899f44246", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f40c4017070 con 0x7f40cc0bc2b0 2021-02-12T17:15:48.089 INFO:teuthology.orchestra.run.gibba004.stdout:5 2021-02-12T17:15:48.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.087+0000 7f40d2105700 1 -- 172.21.2.104:0/2497229421 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40cc0bc2b0 msgr2=0x7f40cc09cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:48.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.087+0000 7f40d2105700 1 --2- 172.21.2.104:0/2497229421 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40cc0bc2b0 0x7f40cc09cc20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f40c400ca60 tx=0x7f40c4007ea0).stop 2021-02-12T17:15:48.089 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.087+0000 7f40d2105700 1 -- 172.21.2.104:0/2497229421 shutdown_connections 2021-02-12T17:15:48.090 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.087+0000 7f40d2105700 1 --2- 172.21.2.104:0/2497229421 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40cc0bc2b0 0x7f40cc09cc20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.090 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.087+0000 7f40d2105700 1 --2- 172.21.2.104:0/2497229421 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40cc09ada0 0x7f40cc0640a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.090 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.087+0000 7f40d2105700 1 --2- 172.21.2.104:0/2497229421 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40cc0b0940 0x7f40cc152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.090 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.087+0000 7f40d2105700 1 -- 172.21.2.104:0/2497229421 >> 172.21.2.104:0/2497229421 conn(0x7f40cc061830 msgr2=0x7f40cc0ba680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:48.090 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.087+0000 7f40d2105700 1 -- 172.21.2.104:0/2497229421 shutdown_connections 2021-02-12T17:15:48.090 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.087+0000 7f40d2105700 1 -- 172.21.2.104:0/2497229421 wait complete. 2021-02-12T17:15:48.098 DEBUG:teuthology.orchestra.run.gibba004:> sudo ceph --cluster ceph osd new 011ced51-ce2a-4fdb-825f-cc739d5727d5 6 2021-02-12T17:15:48.186 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.184+0000 7f16481a5700 1 Processor -- start 2021-02-12T17:15:48.187 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.184+0000 7f16481a5700 1 -- start start 2021-02-12T17:15:48.189 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f16481a5700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f16400bc2b0 0x7f1640151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.189 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f16481a5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 0x7f1640151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.189 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f16481a5700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f164009ada0 0x7f1640151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.189 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f16481a5700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1640151ff0 con 0x7f16400bc2b0 2021-02-12T17:15:48.189 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f16481a5700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16400b27d0 con 0x7f164009ada0 2021-02-12T17:15:48.189 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f16481a5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1640066b70 con 0x7f16400b0940 2021-02-12T17:15:48.189 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f1645740700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 0x7f1640151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.189 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f1645740700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 0x7f1640151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.104:47428/0 (socket says 172.21.2.104:47428) 2021-02-12T17:15:48.189 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f1645740700 1 -- 172.21.2.104:0/4257085091 learned_addr learned my addr 172.21.2.104:0/4257085091 (peer_addr_for_me v2:172.21.2.104:0/0) 2021-02-12T17:15:48.189 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f1646742700 1 --2- 172.21.2.104:0/4257085091 >> v2:172.21.2.104:3300/0 conn(0x7f164009ada0 0x7f1640151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.189 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f1645f41700 1 --2- 172.21.2.104:0/4257085091 >> v2:172.21.2.102:3300/0 conn(0x7f16400bc2b0 0x7f1640151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.190 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f1645740700 1 -- 172.21.2.104:0/4257085091 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 msgr2=0x7f1640151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-02-12T17:15:48.190 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f1645740700 1 -- 172.21.2.104:0/4257085091 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 msgr2=0x7f1640151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:48.190 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f1645740700 1 --2- 172.21.2.104:0/4257085091 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 0x7f1640151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:48.190 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f1645740700 1 --2- 172.21.2.104:0/4257085091 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 0x7f1640151610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:48.190 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f1646742700 1 -- 172.21.2.104:0/4257085091 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 msgr2=0x7f1640151610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-12T17:15:48.190 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f1646742700 1 --2- 172.21.2.104:0/4257085091 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 0x7f1640151610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.190 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f1646742700 1 -- 172.21.2.104:0/4257085091 >> v2:172.21.2.102:3300/0 conn(0x7f16400bc2b0 msgr2=0x7f1640151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:48.190 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.185+0000 7f1646742700 1 --2- 172.21.2.104:0/4257085091 >> v2:172.21.2.102:3300/0 conn(0x7f16400bc2b0 0x7f1640151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.190 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f1646742700 1 -- 172.21.2.104:0/4257085091 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16400685b0 con 0x7f164009ada0 2021-02-12T17:15:48.190 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f1645f41700 1 --2- 172.21.2.104:0/4257085091 >> v2:172.21.2.102:3300/0 conn(0x7f16400bc2b0 0x7f1640151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:15:48.190 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f1646742700 1 --2- 172.21.2.104:0/4257085091 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f164009ada0 0x7f1640151b00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f1640068240 tx=0x7f16380091d0).ready entity=mon.1 client_cookie=e951c787cac1c521 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:48.191 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f1644f3f700 1 -- 172.21.2.104:0/4257085091 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638009e70 con 0x7f164009ada0 2021-02-12T17:15:48.191 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f1644f3f700 1 -- 172.21.2.104:0/4257085091 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163800bc80 con 0x7f164009ada0 2021-02-12T17:15:48.191 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f1644f3f700 1 -- 172.21.2.104:0/4257085091 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638011400 con 0x7f164009ada0 2021-02-12T17:15:48.191 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f16481a5700 1 -- 172.21.2.104:0/4257085091 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f164009ada0 msgr2=0x7f1640151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:48.191 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f16481a5700 1 --2- 172.21.2.104:0/4257085091 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f164009ada0 0x7f1640151b00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f1640068240 tx=0x7f16380091d0).stop 2021-02-12T17:15:48.191 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f16481a5700 1 -- 172.21.2.104:0/4257085091 shutdown_connections 2021-02-12T17:15:48.191 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f16481a5700 1 --2- 172.21.2.104:0/4257085091 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f164009ada0 0x7f1640151b00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.191 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f16481a5700 1 --2- 172.21.2.104:0/4257085091 >> v2:172.21.2.102:3300/0 conn(0x7f16400bc2b0 0x7f1640151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.191 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f16481a5700 1 --2- 172.21.2.104:0/4257085091 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 0x7f1640151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.191 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f16481a5700 1 -- 172.21.2.104:0/4257085091 >> 172.21.2.104:0/4257085091 conn(0x7f1640061830 msgr2=0x7f16400bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:48.191 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f16481a5700 1 -- 172.21.2.104:0/4257085091 shutdown_connections 2021-02-12T17:15:48.191 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.186+0000 7f16481a5700 1 -- 172.21.2.104:0/4257085091 wait complete. 2021-02-12T17:15:48.193 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.187+0000 7f16481a5700 1 Processor -- start 2021-02-12T17:15:48.193 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.187+0000 7f16481a5700 1 -- start start 2021-02-12T17:15:48.193 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f16481a5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f164009ada0 0x7f16400b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.193 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f16481a5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 0x7f164014cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.194 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f16481a5700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f16400bc2b0 0x7f164014d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.194 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f16481a5700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16400b30e0 con 0x7f164009ada0 2021-02-12T17:15:48.194 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f16481a5700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164009cd70 con 0x7f16400bc2b0 2021-02-12T17:15:48.194 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f16481a5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164009c870 con 0x7f16400b0940 2021-02-12T17:15:48.194 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1645740700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 0x7f164014cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.194 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1645740700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 0x7f164014cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.104:47434/0 (socket says 172.21.2.104:47434) 2021-02-12T17:15:48.194 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1645740700 1 -- 172.21.2.104:0/993527979 learned_addr learned my addr 172.21.2.104:0/993527979 (peer_addr_for_me v2:172.21.2.104:0/0) 2021-02-12T17:15:48.194 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1646742700 1 --2- 172.21.2.104:0/993527979 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f16400bc2b0 0x7f164014d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.195 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1645740700 1 -- 172.21.2.104:0/993527979 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 msgr2=0x7f164014cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-02-12T17:15:48.195 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1645740700 1 -- 172.21.2.104:0/993527979 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 msgr2=0x7f164014cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-12T17:15:48.195 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1645740700 1 --2- 172.21.2.104:0/993527979 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 0x7f164014cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:48.195 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1645740700 1 --2- 172.21.2.104:0/993527979 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 0x7f164014cfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:48.195 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1645f41700 1 --2- 172.21.2.104:0/993527979 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f164009ada0 0x7f16400b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.195 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1646742700 1 -- 172.21.2.104:0/993527979 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 msgr2=0x7f164014cfd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-12T17:15:48.195 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1646742700 1 --2- 172.21.2.104:0/993527979 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 0x7f164014cfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.195 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1646742700 1 -- 172.21.2.104:0/993527979 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f164009ada0 msgr2=0x7f16400b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:48.195 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1646742700 1 --2- 172.21.2.104:0/993527979 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f164009ada0 0x7f16400b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.195 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1646742700 1 -- 172.21.2.104:0/993527979 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16400b2e40 con 0x7f16400bc2b0 2021-02-12T17:15:48.195 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1645f41700 1 --2- 172.21.2.104:0/993527979 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f164009ada0 0x7f16400b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:15:48.195 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1646742700 1 --2- 172.21.2.104:0/993527979 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f16400bc2b0 0x7f164014d4c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f1638014000 tx=0x7f1638017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:48.196 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1635ffb700 1 -- 172.21.2.104:0/993527979 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638010800 con 0x7f16400bc2b0 2021-02-12T17:15:48.196 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1635ffb700 1 -- 172.21.2.104:0/993527979 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1638010980 con 0x7f16400bc2b0 2021-02-12T17:15:48.196 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f1635ffb700 1 -- 172.21.2.104:0/993527979 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638010d40 con 0x7f16400bc2b0 2021-02-12T17:15:48.196 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.188+0000 7f16481a5700 1 -- 172.21.2.104:0/993527979 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164009cad0 con 0x7f16400bc2b0 2021-02-12T17:15:48.196 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.189+0000 7f16481a5700 1 -- 172.21.2.104:0/993527979 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16400b58f0 con 0x7f16400bc2b0 2021-02-12T17:15:48.196 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.189+0000 7f1635ffb700 1 -- 172.21.2.104:0/993527979 <== mon.1 v2:172.21.2.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f163800f070 con 0x7f16400bc2b0 2021-02-12T17:15:48.196 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.189+0000 7f1635ffb700 1 -- 172.21.2.104:0/993527979 <== mon.1 v2:172.21.2.104:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f163801cae0 con 0x7f16400bc2b0 2021-02-12T17:15:48.196 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.189+0000 7f16481a5700 1 -- 172.21.2.104:0/993527979 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164009fe50 con 0x7f16400bc2b0 2021-02-12T17:15:48.196 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.191+0000 7f1635ffb700 1 -- 172.21.2.104:0/993527979 <== mon.1 v2:172.21.2.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (secure 0 0 0) 0x7f163801cdc0 con 0x7f16400bc2b0 2021-02-12T17:15:48.261 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.258+0000 7f16481a5700 1 -- 172.21.2.104:0/993527979 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "011ced51-ce2a-4fdb-825f-cc739d5727d5", "id": 6} v 0) v1 -- 0x7f1640045460 con 0x7f16400bc2b0 2021-02-12T17:15:48.264 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.262+0000 7f1635ffb700 1 -- 172.21.2.104:0/993527979 <== mon.1 v2:172.21.2.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "011ced51-ce2a-4fdb-825f-cc739d5727d5", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f16380360b0 con 0x7f16400bc2b0 2021-02-12T17:15:48.264 INFO:teuthology.orchestra.run.gibba004.stdout:6 2021-02-12T17:15:48.265 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.263+0000 7f16481a5700 1 -- 172.21.2.104:0/993527979 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f16400bc2b0 msgr2=0x7f164014d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:48.265 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.263+0000 7f16481a5700 1 --2- 172.21.2.104:0/993527979 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f16400bc2b0 0x7f164014d4c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f1638014000 tx=0x7f1638017000).stop 2021-02-12T17:15:48.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.263+0000 7f16481a5700 1 -- 172.21.2.104:0/993527979 shutdown_connections 2021-02-12T17:15:48.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.263+0000 7f16481a5700 1 --2- 172.21.2.104:0/993527979 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f16400bc2b0 0x7f164014d4c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.263+0000 7f16481a5700 1 --2- 172.21.2.104:0/993527979 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f164009ada0 0x7f16400b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.263+0000 7f16481a5700 1 --2- 172.21.2.104:0/993527979 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f16400b0940 0x7f164014cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.263+0000 7f16481a5700 1 -- 172.21.2.104:0/993527979 >> 172.21.2.104:0/993527979 conn(0x7f1640061830 msgr2=0x7f164014e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:48.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.263+0000 7f16481a5700 1 -- 172.21.2.104:0/993527979 shutdown_connections 2021-02-12T17:15:48.266 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.263+0000 7f16481a5700 1 -- 172.21.2.104:0/993527979 wait complete. 2021-02-12T17:15:48.274 DEBUG:teuthology.orchestra.run.gibba004:> sudo ceph --cluster ceph osd new 95b9bfd6-a301-474d-be2f-32eecb7ec826 7 2021-02-12T17:15:48.363 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.361+0000 7ff8333cf700 1 Processor -- start 2021-02-12T17:15:48.363 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.361+0000 7ff8333cf700 1 -- start start 2021-02-12T17:15:48.368 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff8333cf700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c09ada0 0x7ff82c14e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.368 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff8333cf700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c066b70 con 0x7ff82c0bc2b0 2021-02-12T17:15:48.368 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff8333cf700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c0685b0 con 0x7ff82c0b0940 2021-02-12T17:15:48.368 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff8333cf700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0b27d0 con 0x7ff82c09ada0 2021-02-12T17:15:48.368 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff83196c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c09ada0 0x7ff82c14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.368 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff83196c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c09ada0 0x7ff82c14e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.104:47438/0 (socket says 172.21.2.104:47438) 2021-02-12T17:15:48.368 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff83196c700 1 -- 172.21.2.104:0/3081317021 learned_addr learned my addr 172.21.2.104:0/3081317021 (peer_addr_for_me v2:172.21.2.104:0/0) 2021-02-12T17:15:48.369 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff83096a700 1 --1- 172.21.2.104:0/3081317021 >> v1:172.21.2.104:6789/0 conn(0x7ff82c0b0940 0x7ff82c151830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.104:37608/0 (socket says 172.21.2.104:37608) 2021-02-12T17:15:48.369 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff83196c700 1 -- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c09ada0 msgr2=0x7ff82c14e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-02-12T17:15:48.369 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff83196c700 1 -- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c09ada0 msgr2=0x7ff82c14e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:48.369 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff83196c700 1 --2- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c09ada0 0x7ff82c14e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:48.369 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff83196c700 1 --2- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c09ada0 0x7ff82c14e060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:48.369 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362034262 0 0) 0x7ff82c0685b0 con 0x7ff82c0b0940 2021-02-12T17:15:48.369 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 --> v1:172.21.2.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff814003230 con 0x7ff82c0b0940 2021-02-12T17:15:48.369 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215631287 0 0) 0x7ff82c066b70 con 0x7ff82c0bc2b0 2021-02-12T17:15:48.369 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff82c0685b0 con 0x7ff82c0bc2b0 2021-02-12T17:15:48.369 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 <== mon.1 v1:172.21.2.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2586449577 0 0) 0x7ff814003230 con 0x7ff82c0b0940 2021-02-12T17:15:48.369 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c09ada0 msgr2=0x7ff82c14e060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-12T17:15:48.369 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff81bfff700 1 --2- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c09ada0 0x7ff82c14e060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.369 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 >> v1:172.21.2.102:6789/0 conn(0x7ff82c0bc2b0 legacy=0x7ff82c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:48.370 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 --> v1:172.21.2.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c14e550 con 0x7ff82c0b0940 2021-02-12T17:15:48.370 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.362+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 <== mon.1 v1:172.21.2.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7ff81c001520 con 0x7ff82c0b0940 2021-02-12T17:15:48.370 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 >> v1:172.21.2.104:6789/0 conn(0x7ff82c0b0940 legacy=0x7ff82c151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:48.370 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff81bfff700 1 --2- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c09ada0 0x7ff8140038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.370 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff81bfff700 1 --2- 172.21.2.104:0/3081317021 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff814003da0 0x7ff8140044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.370 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff81bfff700 1 --2- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff8140049c0 0x7ff814004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.370 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0b27d0 con 0x7ff814003da0 2021-02-12T17:15:48.370 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff814005330 con 0x7ff8140049c0 2021-02-12T17:15:48.370 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81400b750 con 0x7ff82c09ada0 2021-02-12T17:15:48.370 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff83116b700 1 --2- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c09ada0 0x7ff8140038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.370 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff83196c700 1 --2- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff8140049c0 0x7ff814004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.370 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff83096a700 1 --2- 172.21.2.104:0/3081317021 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff814003da0 0x7ff8140044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.371 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff83196c700 1 -- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c09ada0 msgr2=0x7ff8140038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:48.371 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff83196c700 1 --2- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c09ada0 0x7ff8140038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.371 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff83196c700 1 -- 172.21.2.104:0/3081317021 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff814003da0 msgr2=0x7ff8140044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:48.371 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff83196c700 1 --2- 172.21.2.104:0/3081317021 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff814003da0 0x7ff8140044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.371 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff83196c700 1 -- 172.21.2.104:0/3081317021 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff814003230 con 0x7ff8140049c0 2021-02-12T17:15:48.371 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff83116b700 1 --2- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c09ada0 0x7ff8140038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:15:48.371 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff83196c700 1 --2- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff8140049c0 0x7ff814004e40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff8240090a0 tx=0x7ff824008040).ready entity=mon.1 client_cookie=36cd4471e15cda77 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:48.371 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82400c070 con 0x7ff8140049c0 2021-02-12T17:15:48.371 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82400e9f0 con 0x7ff8140049c0 2021-02-12T17:15:48.371 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff81bfff700 1 -- 172.21.2.104:0/3081317021 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82400edb0 con 0x7ff8140049c0 2021-02-12T17:15:48.371 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff8333cf700 1 -- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff8140049c0 msgr2=0x7ff814004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:48.371 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff8333cf700 1 --2- 172.21.2.104:0/3081317021 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff8140049c0 0x7ff814004e40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff8240090a0 tx=0x7ff824008040).stop 2021-02-12T17:15:48.371 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff83196c700 1 -- 172.21.2.104:0/3081317021 reap_dead start 2021-02-12T17:15:48.372 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff8333cf700 1 -- 172.21.2.104:0/3081317021 shutdown_connections 2021-02-12T17:15:48.372 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.363+0000 7ff8333cf700 1 -- 172.21.2.104:0/3081317021 >> 172.21.2.104:0/3081317021 conn(0x7ff82c061830 msgr2=0x7ff82c0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:48.372 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.364+0000 7ff8333cf700 1 -- 172.21.2.104:0/3081317021 shutdown_connections 2021-02-12T17:15:48.372 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.364+0000 7ff8333cf700 1 -- 172.21.2.104:0/3081317021 wait complete. 2021-02-12T17:15:48.372 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.364+0000 7ff8333cf700 1 Processor -- start 2021-02-12T17:15:48.372 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.364+0000 7ff8333cf700 1 -- start start 2021-02-12T17:15:48.372 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff8333cf700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff8140049c0 0x7ff82c15cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.372 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff8333cf700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff82c0b33a0 0x7ff82c0baf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.372 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff8333cf700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c0b48f0 0x7ff82c09bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:48.372 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff8333cf700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c09bb80 con 0x7ff8140049c0 2021-02-12T17:15:48.372 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff8333cf700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c15dbc0 con 0x7ff82c0b33a0 2021-02-12T17:15:48.372 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff8333cf700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c15d120 con 0x7ff82c0b48f0 2021-02-12T17:15:48.372 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83096a700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff82c0b33a0 0x7ff82c0baf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.373 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83096a700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff82c0b33a0 0x7ff82c0baf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.104:46416/0 (socket says 172.21.2.104:46416) 2021-02-12T17:15:48.373 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83096a700 1 -- 172.21.2.104:0/222619185 learned_addr learned my addr 172.21.2.104:0/222619185 (peer_addr_for_me v2:172.21.2.104:0/0) 2021-02-12T17:15:48.373 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83196c700 1 --2- 172.21.2.104:0/222619185 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c0b48f0 0x7ff82c09bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.373 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83116b700 1 --2- 172.21.2.104:0/222619185 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff8140049c0 0x7ff82c15cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:48.373 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83196c700 1 -- 172.21.2.104:0/222619185 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c0b48f0 msgr2=0x7ff82c09bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-02-12T17:15:48.373 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83196c700 1 -- 172.21.2.104:0/222619185 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c0b48f0 msgr2=0x7ff82c09bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-12T17:15:48.373 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83196c700 1 --2- 172.21.2.104:0/222619185 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c0b48f0 0x7ff82c09bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:48.373 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83196c700 1 --2- 172.21.2.104:0/222619185 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c0b48f0 0x7ff82c09bfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:48.373 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83096a700 1 -- 172.21.2.104:0/222619185 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c0b48f0 msgr2=0x7ff82c09bfb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-02-12T17:15:48.373 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83096a700 1 --2- 172.21.2.104:0/222619185 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c0b48f0 0x7ff82c09bfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.373 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83096a700 1 -- 172.21.2.104:0/222619185 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff8140049c0 msgr2=0x7ff82c15cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:48.373 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83096a700 1 --2- 172.21.2.104:0/222619185 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff8140049c0 0x7ff82c15cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.373 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83096a700 1 -- 172.21.2.104:0/222619185 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0b3e80 con 0x7ff82c0b33a0 2021-02-12T17:15:48.374 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff83096a700 1 --2- 172.21.2.104:0/222619185 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff82c0b33a0 0x7ff82c0baf80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff81c00eb00 tx=0x7ff81c000fd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:48.374 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.365+0000 7ff8197fa700 1 -- 172.21.2.104:0/222619185 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c00a7d0 con 0x7ff82c0b33a0 2021-02-12T17:15:48.374 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.366+0000 7ff8197fa700 1 -- 172.21.2.104:0/222619185 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c010040 con 0x7ff82c0b33a0 2021-02-12T17:15:48.374 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.366+0000 7ff8333cf700 1 -- 172.21.2.104:0/222619185 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c0b4120 con 0x7ff82c0b33a0 2021-02-12T17:15:48.374 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.366+0000 7ff8197fa700 1 -- 172.21.2.104:0/222619185 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c00ab40 con 0x7ff82c0b33a0 2021-02-12T17:15:48.374 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.366+0000 7ff8333cf700 1 -- 172.21.2.104:0/222619185 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c0b46e0 con 0x7ff82c0b33a0 2021-02-12T17:15:48.374 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.366+0000 7ff8197fa700 1 -- 172.21.2.104:0/222619185 <== mon.1 v2:172.21.2.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7ff81c01b020 con 0x7ff82c0b33a0 2021-02-12T17:15:48.374 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.366+0000 7ff8197fa700 1 -- 172.21.2.104:0/222619185 <== mon.1 v2:172.21.2.104:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7ff81c01eb10 con 0x7ff82c0b33a0 2021-02-12T17:15:48.374 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.366+0000 7ff8333cf700 1 -- 172.21.2.104:0/222619185 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82c0bb590 con 0x7ff82c0b33a0 2021-02-12T17:15:48.375 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.368+0000 7ff8197fa700 1 -- 172.21.2.104:0/222619185 <== mon.1 v2:172.21.2.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (secure 0 0 0) 0x7ff82c0bb590 con 0x7ff82c0b33a0 2021-02-12T17:15:48.438 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.437+0000 7ff8333cf700 1 -- 172.21.2.104:0/222619185 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "95b9bfd6-a301-474d-be2f-32eecb7ec826", "id": 7} v 0) v1 -- 0x7ff82c09bcc0 con 0x7ff82c0b33a0 2021-02-12T17:15:48.442 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.440+0000 7ff8197fa700 1 -- 172.21.2.104:0/222619185 <== mon.1 v2:172.21.2.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "95b9bfd6-a301-474d-be2f-32eecb7ec826", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff81c01eda0 con 0x7ff82c0b33a0 2021-02-12T17:15:48.442 INFO:teuthology.orchestra.run.gibba004.stdout:7 2021-02-12T17:15:48.443 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.440+0000 7ff8333cf700 1 -- 172.21.2.104:0/222619185 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff82c0b33a0 msgr2=0x7ff82c0baf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:48.443 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.440+0000 7ff8333cf700 1 --2- 172.21.2.104:0/222619185 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff82c0b33a0 0x7ff82c0baf80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff81c00eb00 tx=0x7ff81c000fd0).stop 2021-02-12T17:15:48.443 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.440+0000 7ff8333cf700 1 -- 172.21.2.104:0/222619185 shutdown_connections 2021-02-12T17:15:48.443 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.440+0000 7ff8333cf700 1 --2- 172.21.2.104:0/222619185 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff82c0b48f0 0x7ff82c09bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.443 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.440+0000 7ff8333cf700 1 --2- 172.21.2.104:0/222619185 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff8140049c0 0x7ff82c15cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.443 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.441+0000 7ff8333cf700 1 --2- 172.21.2.104:0/222619185 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff82c0b33a0 0x7ff82c0baf80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:48.443 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.441+0000 7ff8333cf700 1 -- 172.21.2.104:0/222619185 >> 172.21.2.104:0/222619185 conn(0x7ff82c061830 msgr2=0x7ff82c14d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:48.443 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.441+0000 7ff8333cf700 1 -- 172.21.2.104:0/222619185 shutdown_connections 2021-02-12T17:15:48.443 INFO:teuthology.orchestra.run.gibba004.stderr:2021-02-12T17:15:48.441+0000 7ff8333cf700 1 -- 172.21.2.104:0/222619185 wait complete. 2021-02-12T17:15:48.451 INFO:tasks.ceph.osd.0:Restarting daemon 2021-02-12T17:15:48.451 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-02-12T17:15:48.453 INFO:tasks.ceph.osd.0:Started 2021-02-12T17:15:48.453 INFO:tasks.ceph.osd.1:Restarting daemon 2021-02-12T17:15:48.454 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-02-12T17:15:48.456 INFO:tasks.ceph.osd.1:Started 2021-02-12T17:15:48.456 INFO:tasks.ceph.osd.2:Restarting daemon 2021-02-12T17:15:48.456 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-02-12T17:15:48.458 INFO:tasks.ceph.osd.2:Started 2021-02-12T17:15:48.458 INFO:tasks.ceph.osd.3:Restarting daemon 2021-02-12T17:15:48.458 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-02-12T17:15:48.460 INFO:tasks.ceph.osd.3:Started 2021-02-12T17:15:48.461 INFO:tasks.ceph.osd.4:Restarting daemon 2021-02-12T17:15:48.461 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-02-12T17:15:48.463 INFO:tasks.ceph.osd.4:Started 2021-02-12T17:15:48.464 INFO:tasks.ceph.osd.5:Restarting daemon 2021-02-12T17:15:48.464 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-02-12T17:15:48.466 INFO:tasks.ceph.osd.5:Started 2021-02-12T17:15:48.466 INFO:tasks.ceph.osd.6:Restarting daemon 2021-02-12T17:15:48.466 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-02-12T17:15:48.470 INFO:tasks.ceph.osd.6:Started 2021-02-12T17:15:48.470 INFO:tasks.ceph.osd.7:Restarting daemon 2021-02-12T17:15:48.471 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-02-12T17:15:48.473 INFO:tasks.ceph.osd.7:Started 2021-02-12T17:15:48.473 INFO:tasks.ceph:Waiting for OSDs to come up 2021-02-12T17:15:49.030 INFO:tasks.ceph.osd.0.gibba002.stderr:2021-02-12T17:15:49.028+0000 7ff18dccd200 -1 Falling back to public interface 2021-02-12T17:15:49.030 INFO:tasks.ceph.osd.1.gibba002.stderr:2021-02-12T17:15:49.028+0000 7f3943891200 -1 Falling back to public interface 2021-02-12T17:15:49.030 INFO:tasks.ceph.osd.1.gibba002.stderr:2021-02-12T17:15:49.028+0000 7f393d822700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2021-02-12T17:15:49.032 INFO:tasks.ceph.osd.1.gibba002.stderr:2021-02-12T17:15:49.031+0000 7f393d822700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6814/0: (98) Address already in use 2021-02-12T17:15:49.036 INFO:tasks.ceph.osd.2.gibba002.stderr:2021-02-12T17:15:49.035+0000 7f6982158200 -1 Falling back to public interface 2021-02-12T17:15:49.037 INFO:tasks.ceph.osd.3.gibba002.stderr:2021-02-12T17:15:49.036+0000 7fc6c204f200 -1 Falling back to public interface 2021-02-12T17:15:49.038 INFO:tasks.ceph.osd.2.gibba002.stderr:2021-02-12T17:15:49.037+0000 7f697c0e9700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6817/0: (98) Address already in use 2021-02-12T17:15:49.038 INFO:tasks.ceph.osd.4.gibba004.stderr:2021-02-12T17:15:49.036+0000 7f1e7e156200 -1 Falling back to public interface 2021-02-12T17:15:49.039 INFO:tasks.ceph.osd.4.gibba004.stderr:2021-02-12T17:15:49.036+0000 7f1e780e7700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2021-02-12T17:15:49.039 INFO:tasks.ceph.osd.5.gibba004.stderr:2021-02-12T17:15:49.036+0000 7ff9d956c200 -1 Falling back to public interface 2021-02-12T17:15:49.041 INFO:tasks.ceph.osd.6.gibba004.stderr:2021-02-12T17:15:49.039+0000 7f1864cf4200 -1 Falling back to public interface 2021-02-12T17:15:49.055 INFO:tasks.ceph.osd.7.gibba004.stderr:2021-02-12T17:15:49.053+0000 7f3d3b9f2200 -1 Falling back to public interface 2021-02-12T17:15:49.279 DEBUG:teuthology.orchestra.run.gibba002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-02-12T17:15:49.362 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.360+0000 7f9c7a627700 1 Processor -- start 2021-02-12T17:15:49.362 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.360+0000 7f9c7a627700 1 -- start start 2021-02-12T17:15:49.364 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c7a627700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9c740bbfa0 0x7f9c740ba810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:49.364 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c7a627700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f9c7414ce20 0x7f9c7414d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:49.364 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c7a627700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c740bc440 con 0x7f9c74061e60 2021-02-12T17:15:49.364 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c7a627700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c740bb2d0 con 0x7f9c7414ce20 2021-02-12T17:15:49.364 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c7a627700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c740bb570 con 0x7f9c740bbfa0 2021-02-12T17:15:49.364 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c737fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9c740bbfa0 0x7f9c740ba810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:49.364 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c78bc4700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f9c7414ce20 0x7f9c7414d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:49.365 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c73fff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f9c74061e60 0x7f9c74148cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:52464/0 (socket says 172.21.2.102:52464) 2021-02-12T17:15:49.365 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c73fff700 1 -- 172.21.2.102:0/1734067248 learned_addr learned my addr 172.21.2.102:0/1734067248 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:15:49.365 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c737fe700 1 -- 172.21.2.102:0/1734067248 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9c740bbfa0 msgr2=0x7f9c740ba810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-12T17:15:49.365 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c737fe700 1 -- 172.21.2.102:0/1734067248 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9c740bbfa0 msgr2=0x7f9c740ba810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-12T17:15:49.365 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c737fe700 1 --2- 172.21.2.102:0/1734067248 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9c740bbfa0 0x7f9c740ba810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-12T17:15:49.365 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c737fe700 1 --2- 172.21.2.102:0/1734067248 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9c740bbfa0 0x7f9c740ba810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-12T17:15:49.365 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c78bc4700 1 -- 172.21.2.102:0/1734067248 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9c740bbfa0 msgr2=0x7f9c740ba810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-12T17:15:49.365 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c78bc4700 1 --2- 172.21.2.102:0/1734067248 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9c740bbfa0 0x7f9c740ba810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:49.365 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c78bc4700 1 -- 172.21.2.102:0/1734067248 >> v1:172.21.2.102:6789/0 conn(0x7f9c74061e60 legacy=0x7f9c74148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:49.365 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c78bc4700 1 -- 172.21.2.102:0/1734067248 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c740bb810 con 0x7f9c7414ce20 2021-02-12T17:15:49.365 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.361+0000 7f9c78bc4700 1 --2- 172.21.2.102:0/1734067248 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9c7414ce20 0x7f9c7414d2d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9c6c009c90 tx=0x7f9c6c0091d0).ready entity=mon.1 client_cookie=3a984141d968627b server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:49.365 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.362+0000 7f9c72ffd700 1 -- 172.21.2.102:0/1734067248 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c009ea0 con 0x7f9c7414ce20 2021-02-12T17:15:49.365 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.362+0000 7f9c72ffd700 1 -- 172.21.2.102:0/1734067248 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c00bc80 con 0x7f9c7414ce20 2021-02-12T17:15:49.366 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.362+0000 7f9c72ffd700 1 -- 172.21.2.102:0/1734067248 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c011400 con 0x7f9c7414ce20 2021-02-12T17:15:49.366 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.362+0000 7f9c7a627700 1 -- 172.21.2.102:0/1734067248 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9c7414ce20 msgr2=0x7f9c7414d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:49.366 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.362+0000 7f9c7a627700 1 --2- 172.21.2.102:0/1734067248 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9c7414ce20 0x7f9c7414d2d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9c6c009c90 tx=0x7f9c6c0091d0).stop 2021-02-12T17:15:49.366 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.362+0000 7f9c7a627700 1 -- 172.21.2.102:0/1734067248 shutdown_connections 2021-02-12T17:15:49.366 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.362+0000 7f9c7a627700 1 --2- 172.21.2.102:0/1734067248 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9c7414ce20 0x7f9c7414d2d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:49.366 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.362+0000 7f9c7a627700 1 --2- 172.21.2.102:0/1734067248 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9c740bbfa0 0x7f9c740ba810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:49.366 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.362+0000 7f9c7a627700 1 -- 172.21.2.102:0/1734067248 >> 172.21.2.102:0/1734067248 conn(0x7f9c740646b0 msgr2=0x7f9c74064ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:49.366 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.362+0000 7f9c7a627700 1 -- 172.21.2.102:0/1734067248 shutdown_connections 2021-02-12T17:15:49.366 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.362+0000 7f9c7a627700 1 -- 172.21.2.102:0/1734067248 wait complete. 2021-02-12T17:15:49.368 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.363+0000 7f9c7a627700 1 Processor -- start 2021-02-12T17:15:49.368 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.363+0000 7f9c7a627700 1 -- start start 2021-02-12T17:15:49.368 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c7a627700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9c74061e60 0x7f9c74146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:49.368 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c7a627700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9c740bbfa0 0x7f9c740be4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:49.368 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c7a627700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9c7414ce20 0x7f9c7415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:49.369 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c7a627700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c741605e0 con 0x7f9c74061e60 2021-02-12T17:15:49.369 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c7a627700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c74160880 con 0x7f9c7414ce20 2021-02-12T17:15:49.369 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c7a627700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c74160b20 con 0x7f9c740bbfa0 2021-02-12T17:15:49.369 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c73fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9c74061e60 0x7f9c74146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:49.369 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c737fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9c740bbfa0 0x7f9c740be4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:49.369 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c73fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9c74061e60 0x7f9c74146a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:43824/0 (socket says 172.21.2.102:43824) 2021-02-12T17:15:49.369 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c73fff700 1 -- 172.21.2.102:0/1883964358 learned_addr learned my addr 172.21.2.102:0/1883964358 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:15:49.369 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c78bc4700 1 --2- 172.21.2.102:0/1883964358 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9c7414ce20 0x7f9c7415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:49.369 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c73fff700 1 -- 172.21.2.102:0/1883964358 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9c740bbfa0 msgr2=0x7f9c740be4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:49.369 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c73fff700 1 --2- 172.21.2.102:0/1883964358 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9c740bbfa0 0x7f9c740be4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:49.369 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c73fff700 1 -- 172.21.2.102:0/1883964358 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9c7414ce20 msgr2=0x7f9c7415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:49.369 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c73fff700 1 --2- 172.21.2.102:0/1883964358 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9c7414ce20 0x7f9c7415cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:49.369 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c73fff700 1 -- 172.21.2.102:0/1883964358 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74160dc0 con 0x7f9c74061e60 2021-02-12T17:15:49.370 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c78bc4700 1 --2- 172.21.2.102:0/1883964358 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9c7414ce20 0x7f9c7415cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:15:49.370 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.364+0000 7f9c73fff700 1 --2- 172.21.2.102:0/1883964358 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9c74061e60 0x7f9c74146a40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f9c6400c710 tx=0x7f9c64007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:49.370 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.365+0000 7f9c6bfff700 1 -- 172.21.2.102:0/1883964358 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c64007320 con 0x7f9c74061e60 2021-02-12T17:15:49.370 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.365+0000 7f9c6bfff700 1 -- 172.21.2.102:0/1883964358 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c64007480 con 0x7f9c74061e60 2021-02-12T17:15:49.370 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.365+0000 7f9c7a627700 1 -- 172.21.2.102:0/1883964358 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c74161060 con 0x7f9c74061e60 2021-02-12T17:15:49.370 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.365+0000 7f9c7a627700 1 -- 172.21.2.102:0/1883964358 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c74146f30 con 0x7f9c74061e60 2021-02-12T17:15:49.370 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.365+0000 7f9c6bfff700 1 -- 172.21.2.102:0/1883964358 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c640057f0 con 0x7f9c74061e60 2021-02-12T17:15:49.370 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.365+0000 7f9c6bfff700 1 -- 172.21.2.102:0/1883964358 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f9c64010030 con 0x7f9c74061e60 2021-02-12T17:15:49.370 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.365+0000 7f9c6bfff700 1 -- 172.21.2.102:0/1883964358 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f9c64013b10 con 0x7f9c74061e60 2021-02-12T17:15:49.370 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.365+0000 7f9c7a627700 1 -- 172.21.2.102:0/1883964358 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c004f60 con 0x7f9c74061e60 2021-02-12T17:15:49.370 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.367+0000 7f9c6bfff700 1 -- 172.21.2.102:0/1883964358 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71998 (secure 0 0 0) 0x7f9c6401d440 con 0x7f9c74061e60 2021-02-12T17:15:49.424 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.423+0000 7f9c7a627700 1 -- 172.21.2.102:0/1883964358 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c4c0054e0 con 0x7f9c74061e60 2021-02-12T17:15:49.425 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.424+0000 7f9c6bfff700 1 -- 172.21.2.102:0/1883964358 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7000 (secure 0 0 0) 0x7f9c64013de0 con 0x7f9c74061e60 2021-02-12T17:15:49.425 INFO:teuthology.misc.health.gibba002.stdout: 2021-02-12T17:15:49.425 INFO:teuthology.misc.health.gibba002.stdout:{"epoch":10,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:15:48.438966+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:15:49.426 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.424+0000 7f9c7a627700 1 -- 172.21.2.102:0/1883964358 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9c74061e60 msgr2=0x7f9c74146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:49.426 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.424+0000 7f9c7a627700 1 --2- 172.21.2.102:0/1883964358 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9c74061e60 0x7f9c74146a40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f9c6400c710 tx=0x7f9c64007c30).stop 2021-02-12T17:15:49.426 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.425+0000 7f9c7a627700 1 -- 172.21.2.102:0/1883964358 shutdown_connections 2021-02-12T17:15:49.426 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.425+0000 7f9c7a627700 1 --2- 172.21.2.102:0/1883964358 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9c7414ce20 0x7f9c7415cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:49.426 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.425+0000 7f9c7a627700 1 --2- 172.21.2.102:0/1883964358 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9c74061e60 0x7f9c74146a40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:49.426 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.425+0000 7f9c7a627700 1 --2- 172.21.2.102:0/1883964358 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9c740bbfa0 0x7f9c740be4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:49.426 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.425+0000 7f9c7a627700 1 -- 172.21.2.102:0/1883964358 >> 172.21.2.102:0/1883964358 conn(0x7f9c740646b0 msgr2=0x7f9c7414b830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:49.427 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.425+0000 7f9c7a627700 1 -- 172.21.2.102:0/1883964358 shutdown_connections 2021-02-12T17:15:49.427 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:49.425+0000 7f9c7a627700 1 -- 172.21.2.102:0/1883964358 wait complete. 2021-02-12T17:15:49.434 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-02-12T17:15:52.490 INFO:tasks.ceph.osd.4.gibba004.stderr:2021-02-12T17:15:52.488+0000 7f1e7e156200 -1 osd.4 0 log_to_monitors {default=true} 2021-02-12T17:15:52.493 INFO:tasks.ceph.osd.0.gibba002.stderr:2021-02-12T17:15:52.492+0000 7ff18dccd200 -1 osd.0 0 log_to_monitors {default=true} 2021-02-12T17:15:52.505 INFO:tasks.ceph.osd.6.gibba004.stderr:2021-02-12T17:15:52.503+0000 7f1864cf4200 -1 osd.6 0 log_to_monitors {default=true} 2021-02-12T17:15:52.507 INFO:tasks.ceph.osd.1.gibba002.stderr:2021-02-12T17:15:52.506+0000 7f3943891200 -1 osd.1 0 log_to_monitors {default=true} 2021-02-12T17:15:52.511 INFO:tasks.ceph.osd.2.gibba002.stderr:2021-02-12T17:15:52.510+0000 7f6982158200 -1 osd.2 0 log_to_monitors {default=true} 2021-02-12T17:15:52.513 INFO:tasks.ceph.osd.3.gibba002.stderr:2021-02-12T17:15:52.512+0000 7fc6c204f200 -1 osd.3 0 log_to_monitors {default=true} 2021-02-12T17:15:52.520 INFO:tasks.ceph.osd.5.gibba004.stderr:2021-02-12T17:15:52.518+0000 7ff9d956c200 -1 osd.5 0 log_to_monitors {default=true} 2021-02-12T17:15:52.534 INFO:tasks.ceph.osd.7.gibba004.stderr:2021-02-12T17:15:52.532+0000 7f3d3b9f2200 -1 osd.7 0 log_to_monitors {default=true} 2021-02-12T17:15:53.597 INFO:tasks.ceph.osd.2.gibba002.stderr:2021-02-12T17:15:53.595+0000 7f697a0e5700 -1 osd.2 0 waiting for initial osdmap 2021-02-12T17:15:53.597 INFO:tasks.ceph.osd.0.gibba002.stderr:2021-02-12T17:15:53.596+0000 7ff184457700 -1 osd.0 0 waiting for initial osdmap 2021-02-12T17:15:53.597 INFO:tasks.ceph.osd.1.gibba002.stderr:2021-02-12T17:15:53.596+0000 7f393a01b700 -1 osd.1 0 waiting for initial osdmap 2021-02-12T17:15:53.598 INFO:tasks.ceph.osd.6.gibba004.stderr:2021-02-12T17:15:53.595+0000 7f185b47e700 -1 osd.6 0 waiting for initial osdmap 2021-02-12T17:15:53.598 INFO:tasks.ceph.osd.7.gibba004.stderr:2021-02-12T17:15:53.595+0000 7f3d3217c700 -1 osd.7 0 waiting for initial osdmap 2021-02-12T17:15:53.599 INFO:tasks.ceph.osd.5.gibba004.stderr:2021-02-12T17:15:53.596+0000 7ff9cfcf6700 -1 osd.5 0 waiting for initial osdmap 2021-02-12T17:15:53.599 INFO:tasks.ceph.osd.3.gibba002.stderr:2021-02-12T17:15:53.596+0000 7fc6b87d9700 -1 osd.3 0 waiting for initial osdmap 2021-02-12T17:15:53.599 INFO:tasks.ceph.osd.4.gibba004.stderr:2021-02-12T17:15:53.597+0000 7f1e748e0700 -1 osd.4 0 waiting for initial osdmap 2021-02-12T17:15:53.600 INFO:tasks.ceph.osd.2.gibba002.stderr:2021-02-12T17:15:53.599+0000 7f697505e700 -1 osd.2 12 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-12T17:15:53.600 INFO:tasks.ceph.osd.0.gibba002.stderr:2021-02-12T17:15:53.599+0000 7ff180bd3700 -1 osd.0 12 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-12T17:15:53.601 INFO:tasks.ceph.osd.1.gibba002.stderr:2021-02-12T17:15:53.599+0000 7f3936797700 -1 osd.1 12 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-12T17:15:53.601 INFO:tasks.ceph.osd.3.gibba002.stderr:2021-02-12T17:15:53.599+0000 7fc6b4f55700 -1 osd.3 12 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-12T17:15:53.601 INFO:tasks.ceph.osd.5.gibba004.stderr:2021-02-12T17:15:53.599+0000 7ff9cc472700 -1 osd.5 12 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-12T17:15:53.601 INFO:tasks.ceph.osd.7.gibba004.stderr:2021-02-12T17:15:53.599+0000 7f3d2e8f8700 -1 osd.7 12 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-12T17:15:53.602 INFO:tasks.ceph.osd.6.gibba004.stderr:2021-02-12T17:15:53.600+0000 7f1857bfa700 -1 osd.6 12 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-12T17:15:53.602 INFO:tasks.ceph.osd.4.gibba004.stderr:2021-02-12T17:15:53.600+0000 7f1e7105c700 -1 osd.4 12 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-12T17:15:56.241 DEBUG:teuthology.orchestra.run.gibba002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-02-12T17:15:56.321 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.320+0000 7f3c531dc700 1 Processor -- start 2021-02-12T17:15:56.322 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.320+0000 7f3c531dc700 1 -- start start 2021-02-12T17:15:56.322 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.321+0000 7f3c531dc700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c4c147e00 0x7f3c4c061170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:56.322 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.321+0000 7f3c531dc700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c061cf0 con 0x7f3c4c06a220 2021-02-12T17:15:56.322 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.321+0000 7f3c531dc700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c061f90 con 0x7f3c4c060d90 2021-02-12T17:15:56.323 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.321+0000 7f3c531dc700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0634a0 con 0x7f3c4c147e00 2021-02-12T17:15:56.323 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.321+0000 7f3c51779700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f3c4c06a220 0x7f3c4c0b1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:52688/0 (socket says 172.21.2.102:52688) 2021-02-12T17:15:56.323 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.321+0000 7f3c51779700 1 -- 172.21.2.102:0/3599373581 learned_addr learned my addr 172.21.2.102:0/3599373581 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:15:56.323 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.321+0000 7f3c4b7fe700 1 -- 172.21.2.102:0/3599373581 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434578330 0 0) 0x7f3c4c061cf0 con 0x7f3c4c06a220 2021-02-12T17:15:56.323 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.321+0000 7f3c4bfff700 1 --2- 172.21.2.102:0/3599373581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c4c147e00 0x7f3c4c061170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:56.323 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.321+0000 7f3c4b7fe700 1 -- 172.21.2.102:0/3599373581 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c38003230 con 0x7f3c4c06a220 2021-02-12T17:15:56.326 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.321+0000 7f3c4b7fe700 1 -- 172.21.2.102:0/3599373581 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3086093549 0 0) 0x7f3c38003230 con 0x7f3c4c06a220 2021-02-12T17:15:56.326 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 -- 172.21.2.102:0/3599373581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c4c147e00 msgr2=0x7f3c4c061170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:56.327 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 --2- 172.21.2.102:0/3599373581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c4c147e00 0x7f3c4c061170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:56.327 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 -- 172.21.2.102:0/3599373581 >> v1:172.21.2.104:6789/0 conn(0x7f3c4c060d90 legacy=0x7f3c4c1476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:56.327 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 -- 172.21.2.102:0/3599373581 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c063740 con 0x7f3c4c06a220 2021-02-12T17:15:56.327 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 -- 172.21.2.102:0/3599373581 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f3c44001860 con 0x7f3c4c06a220 2021-02-12T17:15:56.327 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 -- 172.21.2.102:0/3599373581 >> v1:172.21.2.102:6789/0 conn(0x7f3c4c06a220 legacy=0x7f3c4c0b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:56.327 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 --2- 172.21.2.102:0/3599373581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c4c147e00 0x7f3c38003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:56.327 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 --2- 172.21.2.102:0/3599373581 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3c38003c40 0x7f3c380044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:56.327 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 --2- 172.21.2.102:0/3599373581 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3c380049c0 0x7f3c38004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:56.327 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 -- 172.21.2.102:0/3599373581 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0634a0 con 0x7f3c380049c0 2021-02-12T17:15:56.327 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 -- 172.21.2.102:0/3599373581 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38004160 con 0x7f3c38003c40 2021-02-12T17:15:56.327 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 -- 172.21.2.102:0/3599373581 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38004320 con 0x7f3c4c147e00 2021-02-12T17:15:56.327 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c51779700 1 --2- 172.21.2.102:0/3599373581 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3c380049c0 0x7f3c38004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:56.328 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4bfff700 1 --2- 172.21.2.102:0/3599373581 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3c38003c40 0x7f3c380044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:56.328 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c50f78700 1 --2- 172.21.2.102:0/3599373581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c4c147e00 0x7f3c38003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:56.328 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c51779700 1 -- 172.21.2.102:0/3599373581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c4c147e00 msgr2=0x7f3c38003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:56.328 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c51779700 1 --2- 172.21.2.102:0/3599373581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c4c147e00 0x7f3c38003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:56.328 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c51779700 1 -- 172.21.2.102:0/3599373581 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3c38003c40 msgr2=0x7f3c380044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:56.328 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c51779700 1 --2- 172.21.2.102:0/3599373581 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3c38003c40 0x7f3c380044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:56.328 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c51779700 1 -- 172.21.2.102:0/3599373581 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c38003230 con 0x7f3c380049c0 2021-02-12T17:15:56.328 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c50f78700 1 --2- 172.21.2.102:0/3599373581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c4c147e00 0x7f3c38003750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:15:56.328 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c51779700 1 --2- 172.21.2.102:0/3599373581 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3c380049c0 0x7f3c38004e40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3c4400c600 tx=0x7f3c4c061e80).ready entity=mon.0 client_cookie=a0658c6d54391039 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:56.328 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 -- 172.21.2.102:0/3599373581 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44005b70 con 0x7f3c380049c0 2021-02-12T17:15:56.328 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 -- 172.21.2.102:0/3599373581 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c44005cd0 con 0x7f3c380049c0 2021-02-12T17:15:56.328 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.322+0000 7f3c4b7fe700 1 -- 172.21.2.102:0/3599373581 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44007320 con 0x7f3c380049c0 2021-02-12T17:15:56.328 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.323+0000 7f3c531dc700 1 -- 172.21.2.102:0/3599373581 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3c380049c0 msgr2=0x7f3c38004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:56.329 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.323+0000 7f3c531dc700 1 --2- 172.21.2.102:0/3599373581 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3c380049c0 0x7f3c38004e40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3c4400c600 tx=0x7f3c4c061e80).stop 2021-02-12T17:15:56.329 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.323+0000 7f3c51779700 1 -- 172.21.2.102:0/3599373581 reap_dead start 2021-02-12T17:15:56.329 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.323+0000 7f3c531dc700 1 -- 172.21.2.102:0/3599373581 shutdown_connections 2021-02-12T17:15:56.329 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.323+0000 7f3c531dc700 1 -- 172.21.2.102:0/3599373581 >> 172.21.2.102:0/3599373581 conn(0x7f3c4c065270 msgr2=0x7f3c4c065650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:56.329 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.323+0000 7f3c531dc700 1 -- 172.21.2.102:0/3599373581 shutdown_connections 2021-02-12T17:15:56.329 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.323+0000 7f3c531dc700 1 -- 172.21.2.102:0/3599373581 wait complete. 2021-02-12T17:15:56.329 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.324+0000 7f3c531dc700 1 Processor -- start 2021-02-12T17:15:56.329 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.324+0000 7f3c531dc700 1 -- start start 2021-02-12T17:15:56.329 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.324+0000 7f3c531dc700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c380049c0 0x7f3c4c14a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:56.329 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.324+0000 7f3c531dc700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3c4c148280 0x7f3c4c14fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:56.329 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.324+0000 7f3c531dc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3c4c150130 0x7f3c4c149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:56.329 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.324+0000 7f3c531dc700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c161580 con 0x7f3c4c150130 2021-02-12T17:15:56.330 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.324+0000 7f3c531dc700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c160b00 con 0x7f3c4c148280 2021-02-12T17:15:56.330 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.324+0000 7f3c531dc700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c160da0 con 0x7f3c380049c0 2021-02-12T17:15:56.330 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.324+0000 7f3c51779700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3c4c150130 0x7f3c4c149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:56.330 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.324+0000 7f3c51779700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3c4c150130 0x7f3c4c149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44052/0 (socket says 172.21.2.102:44052) 2021-02-12T17:15:56.330 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.324+0000 7f3c51779700 1 -- 172.21.2.102:0/2372925547 learned_addr learned my addr 172.21.2.102:0/2372925547 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:15:56.330 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.324+0000 7f3c4bfff700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3c4c148280 0x7f3c4c14fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:56.330 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.325+0000 7f3c51779700 1 -- 172.21.2.102:0/2372925547 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c380049c0 msgr2=0x7f3c4c14a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:56.330 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.325+0000 7f3c50f78700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c380049c0 0x7f3c4c14a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:56.330 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.325+0000 7f3c51779700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c380049c0 0x7f3c4c14a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:56.330 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.325+0000 7f3c51779700 1 -- 172.21.2.102:0/2372925547 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3c4c148280 msgr2=0x7f3c4c14fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:56.330 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.325+0000 7f3c51779700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3c4c148280 0x7f3c4c14fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:56.330 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.325+0000 7f3c51779700 1 -- 172.21.2.102:0/2372925547 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c161040 con 0x7f3c4c150130 2021-02-12T17:15:56.330 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.325+0000 7f3c4bfff700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3c4c148280 0x7f3c4c14fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:15:56.331 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.325+0000 7f3c51779700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3c4c150130 0x7f3c4c149170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3c4400a000 tx=0x7f3c44013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:56.331 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.325+0000 7f3c50f78700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c380049c0 0x7f3c4c14a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:15:56.331 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.325+0000 7f3c48ff9700 1 -- 172.21.2.102:0/2372925547 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44017070 con 0x7f3c4c150130 2021-02-12T17:15:56.331 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.325+0000 7f3c48ff9700 1 -- 172.21.2.102:0/2372925547 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c440072e0 con 0x7f3c4c150130 2021-02-12T17:15:56.331 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.325+0000 7f3c48ff9700 1 -- 172.21.2.102:0/2372925547 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44001130 con 0x7f3c4c150130 2021-02-12T17:15:56.331 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.325+0000 7f3c531dc700 1 -- 172.21.2.102:0/2372925547 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c1612e0 con 0x7f3c4c150130 2021-02-12T17:15:56.331 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.325+0000 7f3c531dc700 1 -- 172.21.2.102:0/2372925547 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c14d1b0 con 0x7f3c4c150130 2021-02-12T17:15:56.332 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.326+0000 7f3c531dc700 1 -- 172.21.2.102:0/2372925547 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c045460 con 0x7f3c4c150130 2021-02-12T17:15:56.332 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.326+0000 7f3c48ff9700 1 -- 172.21.2.102:0/2372925547 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f3c44026030 con 0x7f3c4c150130 2021-02-12T17:15:56.332 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.326+0000 7f3c48ff9700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3c2c059d80 0x7f3c2c05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:56.332 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.326+0000 7f3c48ff9700 1 -- 172.21.2.102:0/2372925547 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4872+0+0 (secure 0 0 0) 0x7f3c44074b90 con 0x7f3c4c150130 2021-02-12T17:15:56.332 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.326+0000 7f3c50f78700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3c2c059d80 0x7f3c2c05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:56.332 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.326+0000 7f3c50f78700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3c2c059d80 0x7f3c2c05c240 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3c3c001060 tx=0x7f3c3c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:56.333 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.329+0000 7f3c48ff9700 1 -- 172.21.2.102:0/2372925547 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f3c44048af0 con 0x7f3c4c150130 2021-02-12T17:15:56.459 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.458+0000 7f3c531dc700 1 -- 172.21.2.102:0/2372925547 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c4c0bad80 con 0x7f3c4c150130 2021-02-12T17:15:56.460 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.458+0000 7f3c48ff9700 1 -- 172.21.2.102:0/2372925547 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12071 (secure 0 0 0) 0x7f3c44024030 con 0x7f3c4c150130 2021-02-12T17:15:56.460 INFO:teuthology.misc.health.gibba002.stdout: 2021-02-12T17:15:56.460 INFO:teuthology.misc.health.gibba002.stdout:{"epoch":14,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:15:55.600099+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:15:56.461 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.459+0000 7f3c531dc700 1 -- 172.21.2.102:0/2372925547 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3c2c059d80 msgr2=0x7f3c2c05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:56.461 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.459+0000 7f3c531dc700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3c2c059d80 0x7f3c2c05c240 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3c3c001060 tx=0x7f3c3c009040).stop 2021-02-12T17:15:56.461 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.459+0000 7f3c531dc700 1 -- 172.21.2.102:0/2372925547 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3c4c150130 msgr2=0x7f3c4c149170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:56.461 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.459+0000 7f3c531dc700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3c4c150130 0x7f3c4c149170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3c4400a000 tx=0x7f3c44013000).stop 2021-02-12T17:15:56.461 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.460+0000 7f3c531dc700 1 -- 172.21.2.102:0/2372925547 shutdown_connections 2021-02-12T17:15:56.461 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.460+0000 7f3c531dc700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3c2c059d80 0x7f3c2c05c240 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:56.461 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.460+0000 7f3c531dc700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3c4c150130 0x7f3c4c149170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:56.461 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.460+0000 7f3c531dc700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3c380049c0 0x7f3c4c14a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:56.462 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.460+0000 7f3c531dc700 1 --2- 172.21.2.102:0/2372925547 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3c4c148280 0x7f3c4c14fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:56.462 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.460+0000 7f3c531dc700 1 -- 172.21.2.102:0/2372925547 >> 172.21.2.102:0/2372925547 conn(0x7f3c4c065270 msgr2=0x7f3c4c068020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:56.462 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.460+0000 7f3c531dc700 1 -- 172.21.2.102:0/2372925547 shutdown_connections 2021-02-12T17:15:56.462 INFO:teuthology.misc.health.gibba002.stderr:2021-02-12T17:15:56.460+0000 7f3c531dc700 1 -- 172.21.2.102:0/2372925547 wait complete. 2021-02-12T17:15:56.469 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-02-12T17:15:56.469 INFO:tasks.ceph:Creating RBD pool 2021-02-12T17:15:56.469 DEBUG:teuthology.orchestra.run.gibba002:> sudo ceph --cluster ceph osd pool create rbd 8 2021-02-12T17:15:56.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.553+0000 7f45e25cf700 1 Processor -- start 2021-02-12T17:15:56.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.553+0000 7f45e25cf700 1 -- start start 2021-02-12T17:15:56.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.554+0000 7f45e25cf700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f45dc0b0940 0x7f45dc14e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:56.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.554+0000 7f45e25cf700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45dc066b70 con 0x7f45dc0bc2b0 2021-02-12T17:15:56.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.554+0000 7f45e25cf700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45dc0685b0 con 0x7f45dc09ada0 2021-02-12T17:15:56.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.554+0000 7f45e25cf700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45dc0b27d0 con 0x7f45dc0b0940 2021-02-12T17:15:56.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.554+0000 7f45dbfff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f45dc0bc2b0 0x7f45dc151120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:52704/0 (socket says 172.21.2.102:52704) 2021-02-12T17:15:56.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.554+0000 7f45dbfff700 1 -- 172.21.2.102:0/92247107 learned_addr learned my addr 172.21.2.102:0/92247107 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:15:56.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.554+0000 7f45db7fe700 1 --2- 172.21.2.102:0/92247107 >> v2:172.21.2.102:3300/0 conn(0x7f45dc0b0940 0x7f45dc14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:56.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.554+0000 7f45db7fe700 1 -- 172.21.2.102:0/92247107 >> v1:172.21.2.104:6789/0 conn(0x7f45dc09ada0 legacy=0x7f45dc151830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:15:56.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.554+0000 7f45db7fe700 1 -- 172.21.2.102:0/92247107 >> v1:172.21.2.102:6789/0 conn(0x7f45dc0bc2b0 legacy=0x7f45dc151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:56.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.554+0000 7f45db7fe700 1 -- 172.21.2.102:0/92247107 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc14e550 con 0x7f45dc0b0940 2021-02-12T17:15:56.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.554+0000 7f45db7fe700 1 --2- 172.21.2.102:0/92247107 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f45dc0b0940 0x7f45dc14e060 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f45d000b980 tx=0x7f45d0006de0).ready entity=mon.0 client_cookie=61f5a35e839c418b server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:56.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.554+0000 7f45daffd700 1 -- 172.21.2.102:0/92247107 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d00097a0 con 0x7f45dc0b0940 2021-02-12T17:15:56.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.554+0000 7f45daffd700 1 -- 172.21.2.102:0/92247107 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d0009900 con 0x7f45dc0b0940 2021-02-12T17:15:56.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.554+0000 7f45daffd700 1 -- 172.21.2.102:0/92247107 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0009c80 con 0x7f45dc0b0940 2021-02-12T17:15:56.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.555+0000 7f45e25cf700 1 -- 172.21.2.102:0/92247107 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f45dc0b0940 msgr2=0x7f45dc14e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:56.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.555+0000 7f45e25cf700 1 --2- 172.21.2.102:0/92247107 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f45dc0b0940 0x7f45dc14e060 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f45d000b980 tx=0x7f45d0006de0).stop 2021-02-12T17:15:56.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.555+0000 7f45e25cf700 1 -- 172.21.2.102:0/92247107 shutdown_connections 2021-02-12T17:15:56.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.555+0000 7f45e25cf700 1 --2- 172.21.2.102:0/92247107 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f45dc0b0940 0x7f45dc14e060 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:56.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.555+0000 7f45e25cf700 1 -- 172.21.2.102:0/92247107 >> 172.21.2.102:0/92247107 conn(0x7f45dc061830 msgr2=0x7f45dc0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:56.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.555+0000 7f45e25cf700 1 -- 172.21.2.102:0/92247107 shutdown_connections 2021-02-12T17:15:56.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.555+0000 7f45e25cf700 1 -- 172.21.2.102:0/92247107 wait complete. 2021-02-12T17:15:56.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.556+0000 7f45e25cf700 1 Processor -- start 2021-02-12T17:15:56.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.556+0000 7f45e25cf700 1 -- start start 2021-02-12T17:15:56.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.556+0000 7f45e25cf700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f45dc09ada0 0x7f45dc0b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:56.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.556+0000 7f45e25cf700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f45dc0b0940 0x7f45dc14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:56.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.556+0000 7f45e25cf700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f45dc0bc2b0 0x7f45dc14b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:56.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.556+0000 7f45e25cf700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0b39c0 con 0x7f45dc09ada0 2021-02-12T17:15:56.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.556+0000 7f45e25cf700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0a17b0 con 0x7f45dc0b0940 2021-02-12T17:15:56.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.556+0000 7f45e25cf700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc09baa0 con 0x7f45dc0bc2b0 2021-02-12T17:15:56.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.556+0000 7f45dbfff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f45dc09ada0 0x7f45dc0b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:56.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.556+0000 7f45dbfff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f45dc09ada0 0x7f45dc0b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44068/0 (socket says 172.21.2.102:44068) 2021-02-12T17:15:56.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.556+0000 7f45dbfff700 1 -- 172.21.2.102:0/3914621188 learned_addr learned my addr 172.21.2.102:0/3914621188 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:15:56.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.557+0000 7f45dbfff700 1 -- 172.21.2.102:0/3914621188 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f45dc0bc2b0 msgr2=0x7f45dc14b880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:15:56.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.557+0000 7f45dbfff700 1 --2- 172.21.2.102:0/3914621188 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f45dc0bc2b0 0x7f45dc14b880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:56.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.557+0000 7f45dbfff700 1 -- 172.21.2.102:0/3914621188 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f45dc0b0940 msgr2=0x7f45dc14b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:56.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.557+0000 7f45dbfff700 1 --2- 172.21.2.102:0/3914621188 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f45dc0b0940 0x7f45dc14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:56.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.557+0000 7f45dbfff700 1 -- 172.21.2.102:0/3914621188 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc15df30 con 0x7f45dc09ada0 2021-02-12T17:15:56.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.557+0000 7f45dbfff700 1 --2- 172.21.2.102:0/3914621188 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f45dc09ada0 0x7f45dc0b3080 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f45cc00c740 tx=0x7f45cc007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:56.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.557+0000 7f45c3fff700 1 -- 172.21.2.102:0/3914621188 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0072e0 con 0x7f45dc09ada0 2021-02-12T17:15:56.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.557+0000 7f45c3fff700 1 -- 172.21.2.102:0/3914621188 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc007440 con 0x7f45dc09ada0 2021-02-12T17:15:56.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.557+0000 7f45e25cf700 1 -- 172.21.2.102:0/3914621188 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45dc15e1d0 con 0x7f45dc09ada0 2021-02-12T17:15:56.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.557+0000 7f45c3fff700 1 -- 172.21.2.102:0/3914621188 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc005810 con 0x7f45dc09ada0 2021-02-12T17:15:56.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.557+0000 7f45e25cf700 1 -- 172.21.2.102:0/3914621188 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc14bd70 con 0x7f45dc09ada0 2021-02-12T17:15:56.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.558+0000 7f45e25cf700 1 -- 172.21.2.102:0/3914621188 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45dc09be90 con 0x7f45dc09ada0 2021-02-12T17:15:56.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.558+0000 7f45c3fff700 1 -- 172.21.2.102:0/3914621188 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f45cc010070 con 0x7f45dc09ada0 2021-02-12T17:15:56.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.558+0000 7f45c3fff700 1 --2- 172.21.2.102:0/3914621188 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f45bc059d30 0x7f45bc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:56.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.558+0000 7f45c3fff700 1 -- 172.21.2.102:0/3914621188 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4872+0+0 (secure 0 0 0) 0x7f45cc072ac0 con 0x7f45dc09ada0 2021-02-12T17:15:56.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.558+0000 7f45db7fe700 1 --2- 172.21.2.102:0/3914621188 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f45bc059d30 0x7f45bc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:56.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.559+0000 7f45db7fe700 1 --2- 172.21.2.102:0/3914621188 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f45bc059d30 0x7f45bc05c1f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f45dc0b0d40 tx=0x7f45d0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:56.563 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.561+0000 7f45c3fff700 1 -- 172.21.2.102:0/3914621188 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f45cc046b60 con 0x7f45dc09ada0 2021-02-12T17:15:56.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:56.690+0000 7f45e25cf700 1 -- 172.21.2.102:0/3914621188 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f45dc045460 con 0x7f45dc09ada0 2021-02-12T17:15:57.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.614+0000 7f45c3fff700 1 -- 172.21.2.102:0/3914621188 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f45cc04a180 con 0x7f45dc09ada0 2021-02-12T17:15:57.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.615+0000 7f45e25cf700 1 -- 172.21.2.102:0/3914621188 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f45bc059d30 msgr2=0x7f45bc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:57.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.615+0000 7f45e25cf700 1 --2- 172.21.2.102:0/3914621188 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f45bc059d30 0x7f45bc05c1f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f45dc0b0d40 tx=0x7f45d0016000).stop 2021-02-12T17:15:57.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.615+0000 7f45e25cf700 1 -- 172.21.2.102:0/3914621188 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f45dc09ada0 msgr2=0x7f45dc0b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:57.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.615+0000 7f45e25cf700 1 --2- 172.21.2.102:0/3914621188 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f45dc09ada0 0x7f45dc0b3080 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f45cc00c740 tx=0x7f45cc007c90).stop 2021-02-12T17:15:57.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.615+0000 7f45e25cf700 1 -- 172.21.2.102:0/3914621188 shutdown_connections 2021-02-12T17:15:57.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.615+0000 7f45e25cf700 1 --2- 172.21.2.102:0/3914621188 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f45dc0bc2b0 0x7f45dc14b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:57.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.615+0000 7f45e25cf700 1 --2- 172.21.2.102:0/3914621188 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f45bc059d30 0x7f45bc05c1f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:57.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.615+0000 7f45e25cf700 1 --2- 172.21.2.102:0/3914621188 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f45dc09ada0 0x7f45dc0b3080 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:57.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.615+0000 7f45e25cf700 1 --2- 172.21.2.102:0/3914621188 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f45dc0b0940 0x7f45dc14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:57.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.615+0000 7f45e25cf700 1 -- 172.21.2.102:0/3914621188 >> 172.21.2.102:0/3914621188 conn(0x7f45dc061830 msgr2=0x7f45dc1503f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:57.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.615+0000 7f45e25cf700 1 -- 172.21.2.102:0/3914621188 shutdown_connections 2021-02-12T17:15:57.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.615+0000 7f45e25cf700 1 -- 172.21.2.102:0/3914621188 wait complete. 2021-02-12T17:15:57.618 INFO:teuthology.orchestra.run.gibba002.stderr:pool 'rbd' created 2021-02-12T17:15:57.625 DEBUG:teuthology.orchestra.run.gibba002:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-02-12T17:15:57.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.711+0000 7fa9a607b700 1 Processor -- start 2021-02-12T17:15:57.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.711+0000 7fa9a607b700 1 -- start start 2021-02-12T17:15:57.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.711+0000 7fa9a607b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa9a00bc440 0x7fa9a00b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:57.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.711+0000 7fa9a607b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa9a0151050 0x7fa9a014aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:57.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.711+0000 7fa9a607b700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a0061f80 con 0x7fa9a014af20 2021-02-12T17:15:57.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.711+0000 7fa9a607b700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a014da30 con 0x7fa9a00bc440 2021-02-12T17:15:57.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.711+0000 7fa9a607b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a0151520 con 0x7fa9a0151050 2021-02-12T17:15:57.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.711+0000 7fa99ffff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fa9a014af20 0x7fa9a014de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:52724/0 (socket says 172.21.2.102:52724) 2021-02-12T17:15:57.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.712+0000 7fa99ffff700 1 -- 172.21.2.102:0/4171192868 learned_addr learned my addr 172.21.2.102:0/4171192868 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:15:57.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.712+0000 7fa99f7fe700 1 --2- 172.21.2.102:0/4171192868 >> v2:172.21.2.102:3300/0 conn(0x7fa9a00bc440 0x7fa9a00b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:57.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.712+0000 7fa99effd700 1 --2- 172.21.2.102:0/4171192868 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa9a0151050 0x7fa9a014aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:57.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.712+0000 7fa99f7fe700 1 -- 172.21.2.102:0/4171192868 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa9a0151050 msgr2=0x7fa9a014aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:57.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.712+0000 7fa99f7fe700 1 --2- 172.21.2.102:0/4171192868 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa9a0151050 0x7fa9a014aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:57.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.712+0000 7fa99f7fe700 1 -- 172.21.2.102:0/4171192868 >> v1:172.21.2.102:6789/0 conn(0x7fa9a014af20 legacy=0x7fa9a014de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:57.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.712+0000 7fa99f7fe700 1 -- 172.21.2.102:0/4171192868 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a01517c0 con 0x7fa9a00bc440 2021-02-12T17:15:57.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.712+0000 7fa99effd700 1 --2- 172.21.2.102:0/4171192868 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa9a0151050 0x7fa9a014aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:15:57.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.712+0000 7fa99f7fe700 1 --2- 172.21.2.102:0/4171192868 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa9a00bc440 0x7fa9a00b5eb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa99000b980 tx=0x7fa990006de0).ready entity=mon.0 client_cookie=9c8713cf5e315495 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:57.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.712+0000 7fa99e7fc700 1 -- 172.21.2.102:0/4171192868 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990009870 con 0x7fa9a00bc440 2021-02-12T17:15:57.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.712+0000 7fa99e7fc700 1 -- 172.21.2.102:0/4171192868 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9900099d0 con 0x7fa9a00bc440 2021-02-12T17:15:57.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.712+0000 7fa99e7fc700 1 -- 172.21.2.102:0/4171192868 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990009d50 con 0x7fa9a00bc440 2021-02-12T17:15:57.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.712+0000 7fa9a607b700 1 -- 172.21.2.102:0/4171192868 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa9a00bc440 msgr2=0x7fa9a00b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:57.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.712+0000 7fa9a607b700 1 --2- 172.21.2.102:0/4171192868 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa9a00bc440 0x7fa9a00b5eb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa99000b980 tx=0x7fa990006de0).stop 2021-02-12T17:15:57.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.713+0000 7fa9a607b700 1 -- 172.21.2.102:0/4171192868 shutdown_connections 2021-02-12T17:15:57.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.713+0000 7fa9a607b700 1 --2- 172.21.2.102:0/4171192868 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa9a00bc440 0x7fa9a00b5eb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:57.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.713+0000 7fa9a607b700 1 --2- 172.21.2.102:0/4171192868 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa9a0151050 0x7fa9a014aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:57.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.713+0000 7fa9a607b700 1 -- 172.21.2.102:0/4171192868 >> 172.21.2.102:0/4171192868 conn(0x7fa9a0061870 msgr2=0x7fa9a00bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:57.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.713+0000 7fa9a607b700 1 -- 172.21.2.102:0/4171192868 shutdown_connections 2021-02-12T17:15:57.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.713+0000 7fa9a607b700 1 -- 172.21.2.102:0/4171192868 wait complete. 2021-02-12T17:15:57.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa9a607b700 1 Processor -- start 2021-02-12T17:15:57.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa9a607b700 1 -- start start 2021-02-12T17:15:57.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa9a607b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa9a00bc440 0x7fa9a00984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:57.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa9a607b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa9a014af20 0x7fa9a014eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:57.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa9a607b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa9a0151050 0x7fa9a014eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:57.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa9a607b700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a0098e30 con 0x7fa9a014af20 2021-02-12T17:15:57.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa9a607b700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00a1140 con 0x7fa9a00bc440 2021-02-12T17:15:57.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa9a607b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a015e350 con 0x7fa9a0151050 2021-02-12T17:15:57.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa99effd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa9a014af20 0x7fa9a014eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:57.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa99effd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa9a014af20 0x7fa9a014eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44082/0 (socket says 172.21.2.102:44082) 2021-02-12T17:15:57.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa99effd700 1 -- 172.21.2.102:0/2019372110 learned_addr learned my addr 172.21.2.102:0/2019372110 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:15:57.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa99effd700 1 -- 172.21.2.102:0/2019372110 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa9a0151050 msgr2=0x7fa9a014eff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:15:57.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa99effd700 1 --2- 172.21.2.102:0/2019372110 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa9a0151050 0x7fa9a014eff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:57.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa99effd700 1 -- 172.21.2.102:0/2019372110 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa9a00bc440 msgr2=0x7fa9a00984f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:15:57.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa99effd700 1 --2- 172.21.2.102:0/2019372110 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa9a00bc440 0x7fa9a00984f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:57.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.714+0000 7fa99effd700 1 -- 172.21.2.102:0/2019372110 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a015e5f0 con 0x7fa9a014af20 2021-02-12T17:15:57.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.715+0000 7fa99effd700 1 --2- 172.21.2.102:0/2019372110 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa9a014af20 0x7fa9a014eb00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa99400c920 tx=0x7fa994008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:57.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.715+0000 7fa9877fe700 1 -- 172.21.2.102:0/2019372110 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99400cec0 con 0x7fa9a014af20 2021-02-12T17:15:57.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.715+0000 7fa9877fe700 1 -- 172.21.2.102:0/2019372110 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa994007770 con 0x7fa9a014af20 2021-02-12T17:15:57.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.715+0000 7fa9a607b700 1 -- 172.21.2.102:0/2019372110 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a00989e0 con 0x7fa9a014af20 2021-02-12T17:15:57.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.715+0000 7fa9a607b700 1 -- 172.21.2.102:0/2019372110 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a009e520 con 0x7fa9a014af20 2021-02-12T17:15:57.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.715+0000 7fa9877fe700 1 -- 172.21.2.102:0/2019372110 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994007af0 con 0x7fa9a014af20 2021-02-12T17:15:57.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.715+0000 7fa9a607b700 1 -- 172.21.2.102:0/2019372110 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa978004f60 con 0x7fa9a014af20 2021-02-12T17:15:57.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.716+0000 7fa9877fe700 1 -- 172.21.2.102:0/2019372110 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fa99401b460 con 0x7fa9a014af20 2021-02-12T17:15:57.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.716+0000 7fa9877fe700 1 --2- 172.21.2.102:0/2019372110 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa980059d80 0x7fa98005c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:57.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.716+0000 7fa9877fe700 1 -- 172.21.2.102:0/2019372110 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5238+0+0 (secure 0 0 0) 0x7fa994073810 con 0x7fa9a014af20 2021-02-12T17:15:57.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.716+0000 7fa99f7fe700 1 --2- 172.21.2.102:0/2019372110 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa980059d80 0x7fa98005c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:57.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.716+0000 7fa99f7fe700 1 --2- 172.21.2.102:0/2019372110 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa980059d80 0x7fa98005c240 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa990006e20 tx=0x7fa990016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:57.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.719+0000 7fa9877fe700 1 -- 172.21.2.102:0/2019372110 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fa9940475a0 con 0x7fa9a014af20 2021-02-12T17:15:57.858 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:57.857+0000 7fa9a607b700 1 -- 172.21.2.102:0/2019372110 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa978005790 con 0x7fa9a014af20 2021-02-12T17:15:58.621 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.620+0000 7fa9877fe700 1 -- 172.21.2.102:0/2019372110 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa99404abc0 con 0x7fa9a014af20 2021-02-12T17:15:58.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.621+0000 7fa9a607b700 1 -- 172.21.2.102:0/2019372110 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa980059d80 msgr2=0x7fa98005c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:58.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.621+0000 7fa9a607b700 1 --2- 172.21.2.102:0/2019372110 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa980059d80 0x7fa98005c240 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa990006e20 tx=0x7fa990016000).stop 2021-02-12T17:15:58.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.621+0000 7fa9a607b700 1 -- 172.21.2.102:0/2019372110 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa9a014af20 msgr2=0x7fa9a014eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:58.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.621+0000 7fa9a607b700 1 --2- 172.21.2.102:0/2019372110 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa9a014af20 0x7fa9a014eb00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa99400c920 tx=0x7fa994008040).stop 2021-02-12T17:15:58.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.622+0000 7fa9a607b700 1 -- 172.21.2.102:0/2019372110 shutdown_connections 2021-02-12T17:15:58.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.622+0000 7fa9a607b700 1 --2- 172.21.2.102:0/2019372110 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa9a0151050 0x7fa9a014eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:58.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.622+0000 7fa9a607b700 1 --2- 172.21.2.102:0/2019372110 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa9a00bc440 0x7fa9a00984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:58.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.622+0000 7fa9a607b700 1 --2- 172.21.2.102:0/2019372110 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa980059d80 0x7fa98005c240 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:58.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.622+0000 7fa9a607b700 1 --2- 172.21.2.102:0/2019372110 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa9a014af20 0x7fa9a014eb00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:58.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.622+0000 7fa9a607b700 1 -- 172.21.2.102:0/2019372110 >> 172.21.2.102:0/2019372110 conn(0x7fa9a0061870 msgr2=0x7fa9a00621a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:58.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.622+0000 7fa9a607b700 1 -- 172.21.2.102:0/2019372110 shutdown_connections 2021-02-12T17:15:58.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.622+0000 7fa9a607b700 1 -- 172.21.2.102:0/2019372110 wait complete. 2021-02-12T17:15:58.624 INFO:teuthology.orchestra.run.gibba002.stderr:enabled application 'rbd' on pool 'rbd' 2021-02-12T17:15:58.631 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-02-12T17:15:58.632 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-12T17:15:58.632 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-12T17:15:58.634 INFO:tasks.ceph.mds.a:Started 2021-02-12T17:15:58.634 INFO:tasks.ceph.mds.c:Restarting daemon 2021-02-12T17:15:58.634 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-02-12T17:15:58.636 INFO:tasks.ceph.mds.c:Started 2021-02-12T17:15:58.636 INFO:tasks.ceph.mds.b:Restarting daemon 2021-02-12T17:15:58.637 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-02-12T17:15:58.639 INFO:tasks.ceph.mds.b:Started 2021-02-12T17:15:58.639 INFO:tasks.ceph.mds.d:Restarting daemon 2021-02-12T17:15:58.639 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2021-02-12T17:15:58.641 INFO:tasks.ceph.mds.d:Started 2021-02-12T17:15:58.641 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2021-02-12T17:15:58.642 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:15:58.691 INFO:tasks.ceph.mds.a.gibba002.stdout:starting mds.a at 2021-02-12T17:15:58.692 INFO:tasks.ceph.mds.c.gibba002.stdout:starting mds.c at 2021-02-12T17:15:58.694 INFO:tasks.ceph.mds.b.gibba004.stdout:starting mds.b at 2021-02-12T17:15:58.694 INFO:tasks.ceph.mds.d.gibba004.stdout:starting mds.d at 2021-02-12T17:15:58.694 INFO:tasks.ceph.mds.d.gibba004.stderr:2021-02-12T17:15:58.693+0000 7f39ba386700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2021-02-12T17:15:58.734 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.733+0000 7f973ddab700 1 Processor -- start 2021-02-12T17:15:58.734 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.733+0000 7f973ddab700 1 -- start start 2021-02-12T17:15:58.736 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.733+0000 7f973ddab700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f973814e530 0x7f9738068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:58.736 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.733+0000 7f973ddab700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97380b7960 con 0x7f97380b8d20 2021-02-12T17:15:58.736 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.733+0000 7f973ddab700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97380622a0 con 0x7f9738062740 2021-02-12T17:15:58.736 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.733+0000 7f973ddab700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9738068d20 con 0x7f973814e530 2021-02-12T17:15:58.736 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.734+0000 7f97377fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f97380b8d20 0x7f97380b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:52810/0 (socket says 172.21.2.102:52810) 2021-02-12T17:15:58.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.734+0000 7f97377fe700 1 -- 172.21.2.102:0/3169381439 learned_addr learned my addr 172.21.2.102:0/3169381439 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:15:58.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.734+0000 7f9736ffd700 1 --2- 172.21.2.102:0/3169381439 >> v2:172.21.2.104:3300/0 conn(0x7f973814e530 0x7f9738068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:58.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.734+0000 7f97367fc700 1 -- 172.21.2.102:0/3169381439 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047010600 0 0) 0x7f97380b7960 con 0x7f97380b8d20 2021-02-12T17:15:58.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.734+0000 7f97367fc700 1 -- 172.21.2.102:0/3169381439 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9724003230 con 0x7f97380b8d20 2021-02-12T17:15:58.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.734+0000 7f9736ffd700 1 -- 172.21.2.102:0/3169381439 >> v1:172.21.2.104:6789/0 conn(0x7f9738062740 legacy=0x7f9738062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:58.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.734+0000 7f9736ffd700 1 -- 172.21.2.102:0/3169381439 >> v1:172.21.2.102:6789/0 conn(0x7f97380b8d20 legacy=0x7f97380b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:58.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.734+0000 7f97367fc700 1 -- 172.21.2.102:0/3169381439 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082584517 0 0) 0x7f97380622a0 con 0x7f9738062740 2021-02-12T17:15:58.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.734+0000 7f9736ffd700 1 -- 172.21.2.102:0/3169381439 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973814ea10 con 0x7f973814e530 2021-02-12T17:15:58.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.734+0000 7f9736ffd700 1 --2- 172.21.2.102:0/3169381439 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f973814e530 0x7f9738068830 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f972c00b980 tx=0x7f972c006de0).ready entity=mon.1 client_cookie=7df00ef23f0c3306 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:58.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.734+0000 7f97367fc700 1 -- 172.21.2.102:0/3169381439 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00be70 con 0x7f973814e530 2021-02-12T17:15:58.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.734+0000 7f97367fc700 1 -- 172.21.2.102:0/3169381439 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c0097e0 con 0x7f973814e530 2021-02-12T17:15:58.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.734+0000 7f97367fc700 1 -- 172.21.2.102:0/3169381439 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c009b60 con 0x7f973814e530 2021-02-12T17:15:58.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.735+0000 7f973ddab700 1 -- 172.21.2.102:0/3169381439 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f973814e530 msgr2=0x7f9738068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:58.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.735+0000 7f973ddab700 1 --2- 172.21.2.102:0/3169381439 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f973814e530 0x7f9738068830 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f972c00b980 tx=0x7f972c006de0).stop 2021-02-12T17:15:58.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.735+0000 7f973ddab700 1 -- 172.21.2.102:0/3169381439 shutdown_connections 2021-02-12T17:15:58.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.735+0000 7f973ddab700 1 --2- 172.21.2.102:0/3169381439 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f973814e530 0x7f9738068830 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:58.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.735+0000 7f973ddab700 1 -- 172.21.2.102:0/3169381439 >> 172.21.2.102:0/3169381439 conn(0x7f97380bc480 msgr2=0x7f97380b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:58.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.735+0000 7f973ddab700 1 -- 172.21.2.102:0/3169381439 shutdown_connections 2021-02-12T17:15:58.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.735+0000 7f973ddab700 1 -- 172.21.2.102:0/3169381439 wait complete. 2021-02-12T17:15:58.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.736+0000 7f973ddab700 1 Processor -- start 2021-02-12T17:15:58.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.736+0000 7f973ddab700 1 -- start start 2021-02-12T17:15:58.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.736+0000 7f973ddab700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9738062740 0x7f97380b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:58.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.736+0000 7f973ddab700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97380b8d20 0x7f97380ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:58.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.736+0000 7f973ddab700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f973814e530 0x7f97380acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:58.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.736+0000 7f973ddab700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97380b5020 con 0x7f97380b8d20 2021-02-12T17:15:58.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.736+0000 7f973ddab700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97380b5250 con 0x7f9738062740 2021-02-12T17:15:58.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.736+0000 7f973ddab700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97380b0cc0 con 0x7f973814e530 2021-02-12T17:15:58.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.736+0000 7f9736ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97380b8d20 0x7f97380ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:58.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.736+0000 7f9736ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97380b8d20 0x7f97380ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44172/0 (socket says 172.21.2.102:44172) 2021-02-12T17:15:58.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.736+0000 7f9736ffd700 1 -- 172.21.2.102:0/86915570 learned_addr learned my addr 172.21.2.102:0/86915570 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:15:58.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.736+0000 7f9737fff700 1 --2- 172.21.2.102:0/86915570 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f973814e530 0x7f97380acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:58.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.737+0000 7f97377fe700 1 --2- 172.21.2.102:0/86915570 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9738062740 0x7f97380b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:58.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.737+0000 7f9736ffd700 1 -- 172.21.2.102:0/86915570 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f973814e530 msgr2=0x7f97380acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:58.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.737+0000 7f9736ffd700 1 --2- 172.21.2.102:0/86915570 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f973814e530 0x7f97380acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:58.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.737+0000 7f9736ffd700 1 -- 172.21.2.102:0/86915570 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9738062740 msgr2=0x7f97380b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:58.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.737+0000 7f9736ffd700 1 --2- 172.21.2.102:0/86915570 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9738062740 0x7f97380b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:58.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.737+0000 7f9736ffd700 1 -- 172.21.2.102:0/86915570 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97380b0f60 con 0x7f97380b8d20 2021-02-12T17:15:58.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.737+0000 7f9736ffd700 1 --2- 172.21.2.102:0/86915570 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97380b8d20 0x7f97380ae5d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f97380653c0 tx=0x7f972c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:58.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.737+0000 7f971f7fe700 1 -- 172.21.2.102:0/86915570 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c011cc0 con 0x7f97380b8d20 2021-02-12T17:15:58.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.737+0000 7f971f7fe700 1 -- 172.21.2.102:0/86915570 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c011e20 con 0x7f97380b8d20 2021-02-12T17:15:58.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.737+0000 7f973ddab700 1 -- 172.21.2.102:0/86915570 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97380b1200 con 0x7f97380b8d20 2021-02-12T17:15:58.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.737+0000 7f971f7fe700 1 -- 172.21.2.102:0/86915570 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c01d680 con 0x7f97380b8d20 2021-02-12T17:15:58.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.737+0000 7f973ddab700 1 -- 172.21.2.102:0/86915570 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97380b5a00 con 0x7f97380b8d20 2021-02-12T17:15:58.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.738+0000 7f973ddab700 1 -- 172.21.2.102:0/86915570 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973814efb0 con 0x7f97380b8d20 2021-02-12T17:15:58.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.738+0000 7f971f7fe700 1 -- 172.21.2.102:0/86915570 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f972c00f070 con 0x7f97380b8d20 2021-02-12T17:15:58.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.738+0000 7f971f7fe700 1 --2- 172.21.2.102:0/86915570 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9718059d30 0x7f971805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:58.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.738+0000 7f971f7fe700 1 -- 172.21.2.102:0/86915570 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f972c074da0 con 0x7f97380b8d20 2021-02-12T17:15:58.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.738+0000 7f97377fe700 1 --2- 172.21.2.102:0/86915570 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9718059d30 0x7f971805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:58.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.738+0000 7f97377fe700 1 --2- 172.21.2.102:0/86915570 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9718059d30 0x7f971805c1f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9728005590 tx=0x7f9728009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:58.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.741+0000 7f971f7fe700 1 -- 172.21.2.102:0/86915570 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f972c048c50 con 0x7f97380b8d20 2021-02-12T17:15:58.875 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.873+0000 7f973ddab700 1 -- 172.21.2.102:0/86915570 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9738061c30 con 0x7f97380b8d20 2021-02-12T17:15:58.875 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.874+0000 7f971f7fe700 1 -- 172.21.2.102:0/86915570 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13636 (secure 0 0 0) 0x7f972c04c230 con 0x7f97380b8d20 2021-02-12T17:15:58.876 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:58.876 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":17,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:15:58.614584+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:15:58.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.875+0000 7f973ddab700 1 -- 172.21.2.102:0/86915570 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9718059d30 msgr2=0x7f971805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:58.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.875+0000 7f973ddab700 1 --2- 172.21.2.102:0/86915570 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9718059d30 0x7f971805c1f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9728005590 tx=0x7f9728009040).stop 2021-02-12T17:15:58.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.875+0000 7f973ddab700 1 -- 172.21.2.102:0/86915570 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97380b8d20 msgr2=0x7f97380ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:58.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.875+0000 7f973ddab700 1 --2- 172.21.2.102:0/86915570 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97380b8d20 0x7f97380ae5d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f97380653c0 tx=0x7f972c016000).stop 2021-02-12T17:15:58.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.875+0000 7f973ddab700 1 -- 172.21.2.102:0/86915570 shutdown_connections 2021-02-12T17:15:58.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.875+0000 7f973ddab700 1 --2- 172.21.2.102:0/86915570 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f973814e530 0x7f97380acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:58.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.875+0000 7f973ddab700 1 --2- 172.21.2.102:0/86915570 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9738062740 0x7f97380b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:58.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.875+0000 7f973ddab700 1 --2- 172.21.2.102:0/86915570 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9718059d30 0x7f971805c1f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:58.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.875+0000 7f973ddab700 1 --2- 172.21.2.102:0/86915570 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97380b8d20 0x7f97380ae5d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:58.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.875+0000 7f973ddab700 1 -- 172.21.2.102:0/86915570 >> 172.21.2.102:0/86915570 conn(0x7f97380bc480 msgr2=0x7f9738151850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:58.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.875+0000 7f973ddab700 1 -- 172.21.2.102:0/86915570 shutdown_connections 2021-02-12T17:15:58.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.875+0000 7f973ddab700 1 -- 172.21.2.102:0/86915570 wait complete. 2021-02-12T17:15:58.885 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-12T17:15:54.614238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-12T17:15:56.701902+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-12T17:15:58.886 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-02-12T17:15:58.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.973+0000 7febf60f6700 1 Processor -- start 2021-02-12T17:15:58.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.973+0000 7febf60f6700 1 -- start start 2021-02-12T17:15:58.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.973+0000 7febf60f6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febf014d790 0x7febf00b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:58.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.973+0000 7febf60f6700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf0068d60 con 0x7febf00b89c0 2021-02-12T17:15:58.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.973+0000 7febf60f6700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf0068820 con 0x7febf00669e0 2021-02-12T17:15:58.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.973+0000 7febf60f6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf0068ac0 con 0x7febf014d790 2021-02-12T17:15:58.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febf50f4700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7febf00b89c0 0x7febf014e380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:52824/0 (socket says 172.21.2.102:52824) 2021-02-12T17:15:58.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febf50f4700 1 -- 172.21.2.102:0/2035722335 learned_addr learned my addr 172.21.2.102:0/2035722335 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:15:58.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 -- 172.21.2.102:0/2035722335 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450319799 0 0) 0x7febf0068d60 con 0x7febf00b89c0 2021-02-12T17:15:58.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 -- 172.21.2.102:0/2035722335 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd8003230 con 0x7febf00b89c0 2021-02-12T17:15:58.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 -- 172.21.2.102:0/2035722335 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 728666126 0 0) 0x7febd8003230 con 0x7febf00b89c0 2021-02-12T17:15:58.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febf58f5700 1 --2- 172.21.2.102:0/2035722335 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febf014d790 0x7febf00b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:58.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 -- 172.21.2.102:0/2035722335 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febf014d790 msgr2=0x7febf00b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:58.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 --2- 172.21.2.102:0/2035722335 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febf014d790 0x7febf00b8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:58.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 -- 172.21.2.102:0/2035722335 >> v1:172.21.2.104:6789/0 conn(0x7febf00669e0 legacy=0x7febf014d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:58.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 -- 172.21.2.102:0/2035722335 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf014dc40 con 0x7febf00b89c0 2021-02-12T17:15:58.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 -- 172.21.2.102:0/2035722335 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7febec001660 con 0x7febf00b89c0 2021-02-12T17:15:58.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 -- 172.21.2.102:0/2035722335 >> v1:172.21.2.102:6789/0 conn(0x7febf00b89c0 legacy=0x7febf014e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:58.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 --2- 172.21.2.102:0/2035722335 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febd8003750 0x7febd8003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:58.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 --2- 172.21.2.102:0/2035722335 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febd80044d0 0x7febd8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:58.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 --2- 172.21.2.102:0/2035722335 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febf014d790 0x7febd8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:58.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 -- 172.21.2.102:0/2035722335 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf0068ac0 con 0x7febd80044d0 2021-02-12T17:15:58.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 -- 172.21.2.102:0/2035722335 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd8005380 con 0x7febd8003750 2021-02-12T17:15:58.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.974+0000 7febdffff700 1 -- 172.21.2.102:0/2035722335 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd80042f0 con 0x7febf014d790 2021-02-12T17:15:58.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.975+0000 7febf48f3700 1 --2- 172.21.2.102:0/2035722335 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febd80044d0 0x7febd8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:58.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.975+0000 7febf50f4700 1 --2- 172.21.2.102:0/2035722335 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febd8003750 0x7febd8003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:58.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.975+0000 7febf58f5700 1 --2- 172.21.2.102:0/2035722335 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febf014d790 0x7febd8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:58.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.975+0000 7febf48f3700 1 -- 172.21.2.102:0/2035722335 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febf014d790 msgr2=0x7febd8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:58.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.975+0000 7febf48f3700 1 --2- 172.21.2.102:0/2035722335 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febf014d790 0x7febd8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:58.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.975+0000 7febf48f3700 1 -- 172.21.2.102:0/2035722335 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febd8003750 msgr2=0x7febd8003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:58.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.975+0000 7febf48f3700 1 --2- 172.21.2.102:0/2035722335 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febd8003750 0x7febd8003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:58.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.975+0000 7febf48f3700 1 -- 172.21.2.102:0/2035722335 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8003230 con 0x7febd80044d0 2021-02-12T17:15:58.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.975+0000 7febf48f3700 1 --2- 172.21.2.102:0/2035722335 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febd80044d0 0x7febd8004950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7febe0002860 tx=0x7febe0007b80).ready entity=mon.0 client_cookie=59a681289e3ab369 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:58.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.975+0000 7febdffff700 1 -- 172.21.2.102:0/2035722335 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0007020 con 0x7febd80044d0 2021-02-12T17:15:58.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.975+0000 7febdffff700 1 -- 172.21.2.102:0/2035722335 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe00071c0 con 0x7febd80044d0 2021-02-12T17:15:58.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.975+0000 7febdffff700 1 -- 172.21.2.102:0/2035722335 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000cab0 con 0x7febd80044d0 2021-02-12T17:15:58.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.975+0000 7febf60f6700 1 -- 172.21.2.102:0/2035722335 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febd80044d0 msgr2=0x7febd8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:58.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.975+0000 7febf60f6700 1 --2- 172.21.2.102:0/2035722335 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febd80044d0 0x7febd8004950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7febe0002860 tx=0x7febe0007b80).stop 2021-02-12T17:15:58.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.976+0000 7febf58f5700 1 -- 172.21.2.102:0/2035722335 reap_dead start 2021-02-12T17:15:58.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.976+0000 7febf60f6700 1 -- 172.21.2.102:0/2035722335 shutdown_connections 2021-02-12T17:15:58.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.976+0000 7febf60f6700 1 -- 172.21.2.102:0/2035722335 >> 172.21.2.102:0/2035722335 conn(0x7febf00bc2e0 msgr2=0x7febf00b82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:58.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.976+0000 7febf60f6700 1 -- 172.21.2.102:0/2035722335 shutdown_connections 2021-02-12T17:15:58.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.976+0000 7febf60f6700 1 -- 172.21.2.102:0/2035722335 wait complete. 2021-02-12T17:15:58.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.977+0000 7febf60f6700 1 Processor -- start 2021-02-12T17:15:58.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.977+0000 7febf60f6700 1 -- start start 2021-02-12T17:15:58.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.977+0000 7febf60f6700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febd80044d0 0x7febf0153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:58.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.977+0000 7febf60f6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febf0160380 0x7febf009f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:58.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.977+0000 7febf60f6700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febf00b3110 0x7febf0150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:58.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.977+0000 7febf60f6700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf00a0c50 con 0x7febd80044d0 2021-02-12T17:15:58.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.977+0000 7febf60f6700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf00b3620 con 0x7febf00b3110 2021-02-12T17:15:58.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.977+0000 7febf60f6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf00b55c0 con 0x7febf0160380 2021-02-12T17:15:58.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.977+0000 7febf50f4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febd80044d0 0x7febf0153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:58.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.977+0000 7febf50f4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febd80044d0 0x7febf0153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44192/0 (socket says 172.21.2.102:44192) 2021-02-12T17:15:58.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.977+0000 7febf50f4700 1 -- 172.21.2.102:0/2799606658 learned_addr learned my addr 172.21.2.102:0/2799606658 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:15:58.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.978+0000 7febf50f4700 1 -- 172.21.2.102:0/2799606658 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febf0160380 msgr2=0x7febf009f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:58.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.978+0000 7febf50f4700 1 --2- 172.21.2.102:0/2799606658 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febf0160380 0x7febf009f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:58.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.978+0000 7febf50f4700 1 -- 172.21.2.102:0/2799606658 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febf00b3110 msgr2=0x7febf0150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:58.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.978+0000 7febf50f4700 1 --2- 172.21.2.102:0/2799606658 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febf00b3110 0x7febf0150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:58.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.978+0000 7febf50f4700 1 -- 172.21.2.102:0/2799606658 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf00b5860 con 0x7febd80044d0 2021-02-12T17:15:58.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.978+0000 7febf50f4700 1 --2- 172.21.2.102:0/2799606658 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febd80044d0 0x7febf0153680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7febec00eb70 tx=0x7febec009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:58.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.978+0000 7febdd7fa700 1 -- 172.21.2.102:0/2799606658 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec007320 con 0x7febd80044d0 2021-02-12T17:15:58.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.978+0000 7febdd7fa700 1 -- 172.21.2.102:0/2799606658 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec00c6a0 con 0x7febd80044d0 2021-02-12T17:15:58.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.978+0000 7febdd7fa700 1 -- 172.21.2.102:0/2799606658 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec00ca20 con 0x7febd80044d0 2021-02-12T17:15:58.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.978+0000 7febf60f6700 1 -- 172.21.2.102:0/2799606658 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf00a07b0 con 0x7febd80044d0 2021-02-12T17:15:58.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.978+0000 7febf60f6700 1 -- 172.21.2.102:0/2799606658 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf00b2db0 con 0x7febd80044d0 2021-02-12T17:15:58.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.979+0000 7febf60f6700 1 -- 172.21.2.102:0/2799606658 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf00a0940 con 0x7febd80044d0 2021-02-12T17:15:58.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.979+0000 7febdd7fa700 1 -- 172.21.2.102:0/2799606658 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7febec0054b0 con 0x7febd80044d0 2021-02-12T17:15:58.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.979+0000 7febdd7fa700 1 --2- 172.21.2.102:0/2799606658 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7febd0059d80 0x7febd005c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:58.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.980+0000 7febdd7fa700 1 -- 172.21.2.102:0/2799606658 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5249+0+0 (secure 0 0 0) 0x7febec073430 con 0x7febd80044d0 2021-02-12T17:15:58.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.980+0000 7febf48f3700 1 --2- 172.21.2.102:0/2799606658 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7febd0059d80 0x7febd005c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:58.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.980+0000 7febf48f3700 1 --2- 172.21.2.102:0/2799606658 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7febd0059d80 0x7febd005c240 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7febf009ed80 tx=0x7febe0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:58.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:58.982+0000 7febdd7fa700 1 -- 172.21.2.102:0/2799606658 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7febec046580 con 0x7febd80044d0 2021-02-12T17:15:59.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.110+0000 7febf60f6700 1 -- 172.21.2.102:0/2799606658 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7febf00667b0 con 0x7febd80044d0 2021-02-12T17:15:59.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.110+0000 7febdd7fa700 1 -- 172.21.2.102:0/2799606658 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7febec04abe0 con 0x7febd80044d0 2021-02-12T17:15:59.112 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 1 2021-02-12T17:15:59.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.111+0000 7febf60f6700 1 -- 172.21.2.102:0/2799606658 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7febd0059d80 msgr2=0x7febd005c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.111+0000 7febf60f6700 1 --2- 172.21.2.102:0/2799606658 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7febd0059d80 0x7febd005c240 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7febf009ed80 tx=0x7febe0015000).stop 2021-02-12T17:15:59.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.111+0000 7febf60f6700 1 -- 172.21.2.102:0/2799606658 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febd80044d0 msgr2=0x7febf0153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.111+0000 7febf60f6700 1 --2- 172.21.2.102:0/2799606658 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febd80044d0 0x7febf0153680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7febec00eb70 tx=0x7febec009040).stop 2021-02-12T17:15:59.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.112+0000 7febf60f6700 1 -- 172.21.2.102:0/2799606658 shutdown_connections 2021-02-12T17:15:59.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.112+0000 7febf60f6700 1 --2- 172.21.2.102:0/2799606658 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febf00b3110 0x7febf0150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:59.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.112+0000 7febf60f6700 1 --2- 172.21.2.102:0/2799606658 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7febd0059d80 0x7febd005c240 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.112+0000 7febf60f6700 1 --2- 172.21.2.102:0/2799606658 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febd80044d0 0x7febf0153680 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.112+0000 7febf60f6700 1 --2- 172.21.2.102:0/2799606658 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febf0160380 0x7febf009f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:59.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.112+0000 7febf60f6700 1 -- 172.21.2.102:0/2799606658 >> 172.21.2.102:0/2799606658 conn(0x7febf00bc2e0 msgr2=0x7febf00a0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:59.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.112+0000 7febf60f6700 1 -- 172.21.2.102:0/2799606658 shutdown_connections 2021-02-12T17:15:59.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.112+0000 7febf60f6700 1 -- 172.21.2.102:0/2799606658 wait complete. 2021-02-12T17:15:59.121 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-02-12T17:15:59.210 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.208+0000 7f820c554700 1 Processor -- start 2021-02-12T17:15:59.210 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.208+0000 7f820c554700 1 -- start start 2021-02-12T17:15:59.210 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.209+0000 7f820c554700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f82040bc2b0 0x7f8204151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.209+0000 7f820c554700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f82040b0940 0x7f8204151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.209+0000 7f820c554700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f820409ada0 0x7f8204151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.209+0000 7f820c554700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8204151ff0 con 0x7f82040b0940 2021-02-12T17:15:59.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.209+0000 7f820c554700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82040b27d0 con 0x7f82040bc2b0 2021-02-12T17:15:59.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.209+0000 7f820c554700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8204066b70 con 0x7f820409ada0 2021-02-12T17:15:59.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.209+0000 7f8209aef700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f82040b0940 0x7f8204151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:59.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.209+0000 7f8209aef700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f82040b0940 0x7f8204151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44204/0 (socket says 172.21.2.102:44204) 2021-02-12T17:15:59.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.209+0000 7f8209aef700 1 -- 172.21.2.102:0/3886965263 learned_addr learned my addr 172.21.2.102:0/3886965263 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:15:59.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.209+0000 7f8209aef700 1 -- 172.21.2.102:0/3886965263 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f820409ada0 msgr2=0x7f8204151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:59.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.209+0000 7f8209aef700 1 --2- 172.21.2.102:0/3886965263 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f820409ada0 0x7f8204151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:59.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.209+0000 7f8209aef700 1 -- 172.21.2.102:0/3886965263 >> v2:172.21.2.104:3300/0 conn(0x7f82040bc2b0 msgr2=0x7f8204151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:59.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.209+0000 7f8209aef700 1 --2- 172.21.2.102:0/3886965263 >> v2:172.21.2.104:3300/0 conn(0x7f82040bc2b0 0x7f8204151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:59.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.209+0000 7f8209aef700 1 -- 172.21.2.102:0/3886965263 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82040685b0 con 0x7f82040b0940 2021-02-12T17:15:59.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.210+0000 7f8209aef700 1 --2- 172.21.2.102:0/3886965263 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f82040b0940 0x7f8204151610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f82040b94d0 tx=0x7f8200006ea0).ready entity=mon.0 client_cookie=29c3ffc6de8b72aa server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:59.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.210+0000 7f82092ee700 1 -- 172.21.2.102:0/3886965263 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82000098d0 con 0x7f82040b0940 2021-02-12T17:15:59.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.210+0000 7f82092ee700 1 -- 172.21.2.102:0/3886965263 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8200009a30 con 0x7f82040b0940 2021-02-12T17:15:59.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.210+0000 7f82092ee700 1 -- 172.21.2.102:0/3886965263 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8200009db0 con 0x7f82040b0940 2021-02-12T17:15:59.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.210+0000 7f820c554700 1 -- 172.21.2.102:0/3886965263 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f82040b0940 msgr2=0x7f8204151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.210+0000 7f820c554700 1 --2- 172.21.2.102:0/3886965263 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f82040b0940 0x7f8204151610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f82040b94d0 tx=0x7f8200006ea0).stop 2021-02-12T17:15:59.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.210+0000 7f820c554700 1 -- 172.21.2.102:0/3886965263 shutdown_connections 2021-02-12T17:15:59.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.210+0000 7f820c554700 1 --2- 172.21.2.102:0/3886965263 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f820409ada0 0x7f8204151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:59.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.210+0000 7f820c554700 1 --2- 172.21.2.102:0/3886965263 >> v2:172.21.2.104:3300/0 conn(0x7f82040bc2b0 0x7f8204151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:59.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.210+0000 7f820c554700 1 --2- 172.21.2.102:0/3886965263 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f82040b0940 0x7f8204151610 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.210+0000 7f820c554700 1 -- 172.21.2.102:0/3886965263 >> 172.21.2.102:0/3886965263 conn(0x7f8204061830 msgr2=0x7f82040bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:59.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.210+0000 7f820c554700 1 -- 172.21.2.102:0/3886965263 shutdown_connections 2021-02-12T17:15:59.214 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.210+0000 7f820c554700 1 -- 172.21.2.102:0/3886965263 wait complete. 2021-02-12T17:15:59.214 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.211+0000 7f820c554700 1 Processor -- start 2021-02-12T17:15:59.214 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.211+0000 7f820c554700 1 -- start start 2021-02-12T17:15:59.214 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f820c554700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f820409ada0 0x7f82040b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.214 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f820c554700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f82040b0940 0x7f820415dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.214 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f820c554700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f82040bc2b0 0x7f820415e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.214 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f820c554700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8204161b70 con 0x7f82040b0940 2021-02-12T17:15:59.214 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f820c554700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820415e5f0 con 0x7f82040bc2b0 2021-02-12T17:15:59.214 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f820c554700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820409cba0 con 0x7f820409ada0 2021-02-12T17:15:59.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f8209aef700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f82040b0940 0x7f820415dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:59.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f8209aef700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f82040b0940 0x7f820415dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44206/0 (socket says 172.21.2.102:44206) 2021-02-12T17:15:59.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f8209aef700 1 -- 172.21.2.102:0/4053581064 learned_addr learned my addr 172.21.2.102:0/4053581064 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:15:59.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f820aaf1700 1 --2- 172.21.2.102:0/4053581064 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f82040bc2b0 0x7f820415e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:59.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f820a2f0700 1 --2- 172.21.2.102:0/4053581064 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f820409ada0 0x7f82040b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:59.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f8209aef700 1 -- 172.21.2.102:0/4053581064 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f820409ada0 msgr2=0x7f82040b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f8209aef700 1 --2- 172.21.2.102:0/4053581064 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f820409ada0 0x7f82040b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f8209aef700 1 -- 172.21.2.102:0/4053581064 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f82040bc2b0 msgr2=0x7f820415e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f8209aef700 1 --2- 172.21.2.102:0/4053581064 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f82040bc2b0 0x7f820415e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f8209aef700 1 -- 172.21.2.102:0/4053581064 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820409ce00 con 0x7f82040b0940 2021-02-12T17:15:59.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f8209aef700 1 --2- 172.21.2.102:0/4053581064 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f82040b0940 0x7f820415dc10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8200007fd0 tx=0x7f8200016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:59.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f81f67fc700 1 -- 172.21.2.102:0/4053581064 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820001c420 con 0x7f82040b0940 2021-02-12T17:15:59.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f81f67fc700 1 -- 172.21.2.102:0/4053581064 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820001c580 con 0x7f82040b0940 2021-02-12T17:15:59.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.212+0000 7f820c554700 1 -- 172.21.2.102:0/4053581064 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820409d0a0 con 0x7f82040b0940 2021-02-12T17:15:59.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.213+0000 7f81f67fc700 1 -- 172.21.2.102:0/4053581064 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820001c900 con 0x7f82040b0940 2021-02-12T17:15:59.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.213+0000 7f820c554700 1 -- 172.21.2.102:0/4053581064 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820409d390 con 0x7f82040b0940 2021-02-12T17:15:59.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.213+0000 7f820c554700 1 -- 172.21.2.102:0/4053581064 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82040b15a0 con 0x7f82040b0940 2021-02-12T17:15:59.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.213+0000 7f81f67fc700 1 -- 172.21.2.102:0/4053581064 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f820000f070 con 0x7f82040b0940 2021-02-12T17:15:59.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.214+0000 7f81f67fc700 1 --2- 172.21.2.102:0/4053581064 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f81e4059d30 0x7f81e405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.214+0000 7f81f67fc700 1 -- 172.21.2.102:0/4053581064 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f8200074d20 con 0x7f82040b0940 2021-02-12T17:15:59.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.214+0000 7f820a2f0700 1 --2- 172.21.2.102:0/4053581064 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f81e4059d30 0x7f81e405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:59.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.214+0000 7f820a2f0700 1 --2- 172.21.2.102:0/4053581064 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f81e4059d30 0x7f81e405c1f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f81f800b630 tx=0x7f81f8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:59.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.217+0000 7f81f67fc700 1 -- 172.21.2.102:0/4053581064 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f8200048b90 con 0x7f82040b0940 2021-02-12T17:15:59.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.343+0000 7f820c554700 1 -- 172.21.2.102:0/4053581064 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8204045460 con 0x7f82040b0940 2021-02-12T17:15:59.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.344+0000 7f81f67fc700 1 -- 172.21.2.102:0/4053581064 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f820004c1b0 con 0x7f82040b0940 2021-02-12T17:15:59.345 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:15:59.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.345+0000 7f820c554700 1 -- 172.21.2.102:0/4053581064 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f81e4059d30 msgr2=0x7f81e405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.345+0000 7f820c554700 1 --2- 172.21.2.102:0/4053581064 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f81e4059d30 0x7f81e405c1f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f81f800b630 tx=0x7f81f8008040).stop 2021-02-12T17:15:59.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.345+0000 7f820c554700 1 -- 172.21.2.102:0/4053581064 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f82040b0940 msgr2=0x7f820415dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.345+0000 7f820c554700 1 --2- 172.21.2.102:0/4053581064 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f82040b0940 0x7f820415dc10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8200007fd0 tx=0x7f8200016000).stop 2021-02-12T17:15:59.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.345+0000 7f820c554700 1 -- 172.21.2.102:0/4053581064 shutdown_connections 2021-02-12T17:15:59.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.345+0000 7f820c554700 1 --2- 172.21.2.102:0/4053581064 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f82040bc2b0 0x7f820415e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.345+0000 7f820c554700 1 --2- 172.21.2.102:0/4053581064 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f820409ada0 0x7f82040b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.345+0000 7f820c554700 1 --2- 172.21.2.102:0/4053581064 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f81e4059d30 0x7f81e405c1f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.345+0000 7f820c554700 1 --2- 172.21.2.102:0/4053581064 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f82040b0940 0x7f820415dc10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.345+0000 7f820c554700 1 -- 172.21.2.102:0/4053581064 >> 172.21.2.102:0/4053581064 conn(0x7f8204061830 msgr2=0x7f820414e270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:59.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.345+0000 7f820c554700 1 -- 172.21.2.102:0/4053581064 shutdown_connections 2021-02-12T17:15:59.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.345+0000 7f820c554700 1 -- 172.21.2.102:0/4053581064 wait complete. 2021-02-12T17:15:59.355 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-02-12T17:15:59.443 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.442+0000 7f3a8ec44700 1 Processor -- start 2021-02-12T17:15:59.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.442+0000 7f3a8ec44700 1 -- start start 2021-02-12T17:15:59.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a8ec44700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a880b8d20 0x7f3a88068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a8ec44700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3a8814e530 0x7f3a880b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a8ec44700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a880622a0 con 0x7f3a88062740 2021-02-12T17:15:59.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a8ec44700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a88068d20 con 0x7f3a8814e530 2021-02-12T17:15:59.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a8ec44700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8814ea10 con 0x7f3a880b8d20 2021-02-12T17:15:59.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a87fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3a8814e530 0x7f3a880b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:59.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a87fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3a8814e530 0x7f3a880b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44214/0 (socket says 172.21.2.102:44214) 2021-02-12T17:15:59.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a87fff700 1 -- 172.21.2.102:0/4117695603 learned_addr learned my addr 172.21.2.102:0/4117695603 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:15:59.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a87fff700 1 -- 172.21.2.102:0/4117695603 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a880b8d20 msgr2=0x7f3a88068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:15:59.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a87fff700 1 --2- 172.21.2.102:0/4117695603 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a880b8d20 0x7f3a88068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:59.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a87fff700 1 -- 172.21.2.102:0/4117695603 >> v1:172.21.2.104:6789/0 conn(0x7f3a88062740 legacy=0x7f3a88062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:15:59.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a87fff700 1 -- 172.21.2.102:0/4117695603 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a880b63f0 con 0x7f3a8814e530 2021-02-12T17:15:59.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a87fff700 1 --2- 172.21.2.102:0/4117695603 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a8814e530 0x7f3a880b7250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3a7800b9e0 tx=0x7f3a78006ea0).ready entity=mon.0 client_cookie=b5ef34fdff46133b server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:59.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a877fe700 1 -- 172.21.2.102:0/4117695603 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78009800 con 0x7f3a8814e530 2021-02-12T17:15:59.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a877fe700 1 -- 172.21.2.102:0/4117695603 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a78009960 con 0x7f3a8814e530 2021-02-12T17:15:59.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.443+0000 7f3a877fe700 1 -- 172.21.2.102:0/4117695603 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78009ce0 con 0x7f3a8814e530 2021-02-12T17:15:59.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.444+0000 7f3a8ec44700 1 -- 172.21.2.102:0/4117695603 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a8814e530 msgr2=0x7f3a880b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.444+0000 7f3a8ec44700 1 --2- 172.21.2.102:0/4117695603 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a8814e530 0x7f3a880b7250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3a7800b9e0 tx=0x7f3a78006ea0).stop 2021-02-12T17:15:59.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.444+0000 7f3a8ec44700 1 -- 172.21.2.102:0/4117695603 shutdown_connections 2021-02-12T17:15:59.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.444+0000 7f3a8ec44700 1 --2- 172.21.2.102:0/4117695603 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a880b8d20 0x7f3a88068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:59.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.444+0000 7f3a8ec44700 1 --2- 172.21.2.102:0/4117695603 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a8814e530 0x7f3a880b7250 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.444+0000 7f3a8ec44700 1 -- 172.21.2.102:0/4117695603 >> 172.21.2.102:0/4117695603 conn(0x7f3a880bc480 msgr2=0x7f3a880b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:59.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.444+0000 7f3a8ec44700 1 -- 172.21.2.102:0/4117695603 shutdown_connections 2021-02-12T17:15:59.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.444+0000 7f3a8ec44700 1 -- 172.21.2.102:0/4117695603 wait complete. 2021-02-12T17:15:59.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.445+0000 7f3a8ec44700 1 Processor -- start 2021-02-12T17:15:59.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.445+0000 7f3a8ec44700 1 -- start start 2021-02-12T17:15:59.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.445+0000 7f3a8ec44700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3a88062740 0x7f3a8814cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.445+0000 7f3a8ec44700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a880b8d20 0x7f3a8815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.445+0000 7f3a8ec44700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a8814e530 0x7f3a8815df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.445+0000 7f3a8ec44700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8815e480 con 0x7f3a880b8d20 2021-02-12T17:15:59.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.445+0000 7f3a8ec44700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a881617e0 con 0x7f3a88062740 2021-02-12T17:15:59.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.445+0000 7f3a8ec44700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880b54c0 con 0x7f3a8814e530 2021-02-12T17:15:59.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.445+0000 7f3a87fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a880b8d20 0x7f3a8815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:59.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.445+0000 7f3a87fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a880b8d20 0x7f3a8815daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44222/0 (socket says 172.21.2.102:44222) 2021-02-12T17:15:59.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.445+0000 7f3a87fff700 1 -- 172.21.2.102:0/1061346730 learned_addr learned my addr 172.21.2.102:0/1061346730 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:15:59.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.446+0000 7f3a87fff700 1 -- 172.21.2.102:0/1061346730 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a8814e530 msgr2=0x7f3a8815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.446+0000 7f3a87fff700 1 --2- 172.21.2.102:0/1061346730 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a8814e530 0x7f3a8815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:59.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.446+0000 7f3a87fff700 1 -- 172.21.2.102:0/1061346730 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3a88062740 msgr2=0x7f3a8814cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.446+0000 7f3a87fff700 1 --2- 172.21.2.102:0/1061346730 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3a88062740 0x7f3a8814cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:59.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.446+0000 7f3a87fff700 1 -- 172.21.2.102:0/1061346730 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8815d600 con 0x7f3a880b8d20 2021-02-12T17:15:59.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.446+0000 7f3a87fff700 1 --2- 172.21.2.102:0/1061346730 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a880b8d20 0x7f3a8815daa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3a78006ee0 tx=0x7f3a78016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:59.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.446+0000 7f3a84ff9700 1 -- 172.21.2.102:0/1061346730 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78011e50 con 0x7f3a880b8d20 2021-02-12T17:15:59.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.446+0000 7f3a84ff9700 1 -- 172.21.2.102:0/1061346730 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7801c420 con 0x7f3a880b8d20 2021-02-12T17:15:59.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.446+0000 7f3a8ec44700 1 -- 172.21.2.102:0/1061346730 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a881614d0 con 0x7f3a880b8d20 2021-02-12T17:15:59.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.446+0000 7f3a84ff9700 1 -- 172.21.2.102:0/1061346730 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7801c7c0 con 0x7f3a880b8d20 2021-02-12T17:15:59.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.446+0000 7f3a8ec44700 1 -- 172.21.2.102:0/1061346730 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a880ad1c0 con 0x7f3a880b8d20 2021-02-12T17:15:59.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.447+0000 7f3a8ec44700 1 -- 172.21.2.102:0/1061346730 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a88045460 con 0x7f3a880b8d20 2021-02-12T17:15:59.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.447+0000 7f3a84ff9700 1 -- 172.21.2.102:0/1061346730 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f3a78023030 con 0x7f3a880b8d20 2021-02-12T17:15:59.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.447+0000 7f3a84ff9700 1 --2- 172.21.2.102:0/1061346730 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3a6c059d30 0x7f3a6c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.447+0000 7f3a84ff9700 1 -- 172.21.2.102:0/1061346730 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f3a78074530 con 0x7f3a880b8d20 2021-02-12T17:15:59.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.447+0000 7f3a8c9e0700 1 --2- 172.21.2.102:0/1061346730 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3a6c059d30 0x7f3a6c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:59.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.448+0000 7f3a8c9e0700 1 --2- 172.21.2.102:0/1061346730 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3a6c059d30 0x7f3a6c05c1f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3a70009480 tx=0x7f3a700069a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:59.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.450+0000 7f3a84ff9700 1 -- 172.21.2.102:0/1061346730 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f3a780483a0 con 0x7f3a880b8d20 2021-02-12T17:15:59.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.579+0000 7f3a8ec44700 1 -- 172.21.2.102:0/1061346730 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3a8815d790 con 0x7f3a880b8d20 2021-02-12T17:15:59.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.580+0000 7f3a84ff9700 1 -- 172.21.2.102:0/1061346730 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+143 (secure 0 0 0) 0x7f3a78021020 con 0x7f3a880b8d20 2021-02-12T17:15:59.581 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:15:59.581 INFO:teuthology.orchestra.run.gibba002.stdout:[ 2021-02-12T17:15:59.581 INFO:teuthology.orchestra.run.gibba002.stdout: { 2021-02-12T17:15:59.581 INFO:teuthology.orchestra.run.gibba002.stdout: "poolnum": 1, 2021-02-12T17:15:59.581 INFO:teuthology.orchestra.run.gibba002.stdout: "poolname": "device_health_metrics" 2021-02-12T17:15:59.581 INFO:teuthology.orchestra.run.gibba002.stdout: }, 2021-02-12T17:15:59.582 INFO:teuthology.orchestra.run.gibba002.stdout: { 2021-02-12T17:15:59.582 INFO:teuthology.orchestra.run.gibba002.stdout: "poolnum": 2, 2021-02-12T17:15:59.582 INFO:teuthology.orchestra.run.gibba002.stdout: "poolname": "rbd" 2021-02-12T17:15:59.582 INFO:teuthology.orchestra.run.gibba002.stdout: } 2021-02-12T17:15:59.582 INFO:teuthology.orchestra.run.gibba002.stdout:] 2021-02-12T17:15:59.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.581+0000 7f3a8ec44700 1 -- 172.21.2.102:0/1061346730 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3a6c059d30 msgr2=0x7f3a6c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.581+0000 7f3a8ec44700 1 --2- 172.21.2.102:0/1061346730 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3a6c059d30 0x7f3a6c05c1f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3a70009480 tx=0x7f3a700069a0).stop 2021-02-12T17:15:59.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.581+0000 7f3a8ec44700 1 -- 172.21.2.102:0/1061346730 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a880b8d20 msgr2=0x7f3a8815daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.581+0000 7f3a8ec44700 1 --2- 172.21.2.102:0/1061346730 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a880b8d20 0x7f3a8815daa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3a78006ee0 tx=0x7f3a78016000).stop 2021-02-12T17:15:59.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.581+0000 7f3a8ec44700 1 -- 172.21.2.102:0/1061346730 shutdown_connections 2021-02-12T17:15:59.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.581+0000 7f3a8ec44700 1 --2- 172.21.2.102:0/1061346730 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a8814e530 0x7f3a8815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:59.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.581+0000 7f3a8ec44700 1 --2- 172.21.2.102:0/1061346730 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3a88062740 0x7f3a8814cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:59.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.581+0000 7f3a8ec44700 1 --2- 172.21.2.102:0/1061346730 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3a6c059d30 0x7f3a6c05c1f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.581+0000 7f3a8ec44700 1 --2- 172.21.2.102:0/1061346730 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a880b8d20 0x7f3a8815daa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.581+0000 7f3a8ec44700 1 -- 172.21.2.102:0/1061346730 >> 172.21.2.102:0/1061346730 conn(0x7f3a880bc480 msgr2=0x7f3a880b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:59.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.581+0000 7f3a8ec44700 1 -- 172.21.2.102:0/1061346730 shutdown_connections 2021-02-12T17:15:59.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.581+0000 7f3a8ec44700 1 -- 172.21.2.102:0/1061346730 wait complete. 2021-02-12T17:15:59.591 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'a' 2021-02-12T17:15:59.591 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_metadata 8 2021-02-12T17:15:59.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.682+0000 7f11de79d700 1 Processor -- start 2021-02-12T17:15:59.684 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.682+0000 7f11de79d700 1 -- start start 2021-02-12T17:15:59.684 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.683+0000 7f11de79d700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f11d80bc2b0 0x7f11d8151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.684 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.683+0000 7f11de79d700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f11d80b0940 0x7f11d8151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.684 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.683+0000 7f11de79d700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d8066b70 con 0x7f11d809ada0 2021-02-12T17:15:59.684 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.683+0000 7f11de79d700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d80b27d0 con 0x7f11d80bc2b0 2021-02-12T17:15:59.684 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.683+0000 7f11de79d700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d80b7110 con 0x7f11d80b0940 2021-02-12T17:15:59.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.683+0000 7f11d7fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f11d80bc2b0 0x7f11d8151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:59.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.683+0000 7f11d7fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f11d80bc2b0 0x7f11d8151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44228/0 (socket says 172.21.2.102:44228) 2021-02-12T17:15:59.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.683+0000 7f11d7fff700 1 -- 172.21.2.102:0/818099466 learned_addr learned my addr 172.21.2.102:0/818099466 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:15:59.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.683+0000 7f11d7fff700 1 -- 172.21.2.102:0/818099466 >> v2:172.21.2.104:3300/0 conn(0x7f11d80b0940 msgr2=0x7f11d8151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:59.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.683+0000 7f11d7fff700 1 --2- 172.21.2.102:0/818099466 >> v2:172.21.2.104:3300/0 conn(0x7f11d80b0940 0x7f11d8151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:59.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.683+0000 7f11d7fff700 1 -- 172.21.2.102:0/818099466 >> v1:172.21.2.104:6789/0 conn(0x7f11d809ada0 legacy=0x7f11d814d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:15:59.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.683+0000 7f11d7fff700 1 -- 172.21.2.102:0/818099466 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d80685b0 con 0x7f11d80bc2b0 2021-02-12T17:15:59.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.683+0000 7f11d7fff700 1 --2- 172.21.2.102:0/818099466 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f11d80bc2b0 0x7f11d8151120 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f11d80b6280 tx=0x7f11c0006ea0).ready entity=mon.0 client_cookie=398190786c622a9e server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:59.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.684+0000 7f11d6ffd700 1 -- 172.21.2.102:0/818099466 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0009800 con 0x7f11d80bc2b0 2021-02-12T17:15:59.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.684+0000 7f11d6ffd700 1 -- 172.21.2.102:0/818099466 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c0009960 con 0x7f11d80bc2b0 2021-02-12T17:15:59.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.684+0000 7f11d6ffd700 1 -- 172.21.2.102:0/818099466 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0009ce0 con 0x7f11d80bc2b0 2021-02-12T17:15:59.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.684+0000 7f11de79d700 1 -- 172.21.2.102:0/818099466 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f11d80bc2b0 msgr2=0x7f11d8151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.684+0000 7f11de79d700 1 --2- 172.21.2.102:0/818099466 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f11d80bc2b0 0x7f11d8151120 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f11d80b6280 tx=0x7f11c0006ea0).stop 2021-02-12T17:15:59.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.684+0000 7f11de79d700 1 -- 172.21.2.102:0/818099466 shutdown_connections 2021-02-12T17:15:59.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.684+0000 7f11de79d700 1 --2- 172.21.2.102:0/818099466 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f11d80bc2b0 0x7f11d8151120 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.684+0000 7f11de79d700 1 --2- 172.21.2.102:0/818099466 >> v2:172.21.2.104:3300/0 conn(0x7f11d80b0940 0x7f11d8151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:15:59.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.684+0000 7f11de79d700 1 -- 172.21.2.102:0/818099466 >> 172.21.2.102:0/818099466 conn(0x7f11d8061830 msgr2=0x7f11d80bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:15:59.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.684+0000 7f11de79d700 1 -- 172.21.2.102:0/818099466 shutdown_connections 2021-02-12T17:15:59.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.684+0000 7f11de79d700 1 -- 172.21.2.102:0/818099466 wait complete. 2021-02-12T17:15:59.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.685+0000 7f11de79d700 1 Processor -- start 2021-02-12T17:15:59.689 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.685+0000 7f11de79d700 1 -- start start 2021-02-12T17:15:59.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11de79d700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f11d809ada0 0x7f11d80b8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11de79d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f11d80b0940 0x7f11d8160080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11de79d700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f11d80bc2b0 0x7f11d8160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11de79d700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d81481c0 con 0x7f11d80b0940 2021-02-12T17:15:59.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11de79d700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8061df0 con 0x7f11d809ada0 2021-02-12T17:15:59.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11de79d700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d814aee0 con 0x7f11d80bc2b0 2021-02-12T17:15:59.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11d77fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f11d80b0940 0x7f11d8160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:59.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11d77fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f11d80b0940 0x7f11d8160080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44234/0 (socket says 172.21.2.102:44234) 2021-02-12T17:15:59.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11d77fe700 1 -- 172.21.2.102:0/1753394685 learned_addr learned my addr 172.21.2.102:0/1753394685 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:15:59.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11dcd3a700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f11d80bc2b0 0x7f11d8160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:59.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11d7fff700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f11d809ada0 0x7f11d80b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:59.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11d77fe700 1 -- 172.21.2.102:0/1753394685 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f11d80bc2b0 msgr2=0x7f11d8160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11d77fe700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f11d80bc2b0 0x7f11d8160570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11d77fe700 1 -- 172.21.2.102:0/1753394685 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f11d809ada0 msgr2=0x7f11d80b8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:15:59.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11d77fe700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f11d809ada0 0x7f11d80b8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:15:59.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11d77fe700 1 -- 172.21.2.102:0/1753394685 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d814b180 con 0x7f11d80b0940 2021-02-12T17:15:59.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11d7fff700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f11d809ada0 0x7f11d80b8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:15:59.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11d77fe700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f11d80b0940 0x7f11d8160080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f11c8009760 tx=0x7f11c8006e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:59.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11cffff700 1 -- 172.21.2.102:0/1753394685 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c800d580 con 0x7f11d80b0940 2021-02-12T17:15:59.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11cffff700 1 -- 172.21.2.102:0/1753394685 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c8000e90 con 0x7f11d80b0940 2021-02-12T17:15:59.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11cffff700 1 -- 172.21.2.102:0/1753394685 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c800d930 con 0x7f11d80b0940 2021-02-12T17:15:59.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.686+0000 7f11de79d700 1 -- 172.21.2.102:0/1753394685 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d814b420 con 0x7f11d80b0940 2021-02-12T17:15:59.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.687+0000 7f11de79d700 1 -- 172.21.2.102:0/1753394685 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d80b8a70 con 0x7f11d80b0940 2021-02-12T17:15:59.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.687+0000 7f11de79d700 1 -- 172.21.2.102:0/1753394685 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d815e990 con 0x7f11d80b0940 2021-02-12T17:15:59.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.687+0000 7f11cffff700 1 -- 172.21.2.102:0/1753394685 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f11c8017030 con 0x7f11d80b0940 2021-02-12T17:15:59.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.687+0000 7f11cffff700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f11bc059d30 0x7f11bc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:15:59.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.687+0000 7f11cffff700 1 -- 172.21.2.102:0/1753394685 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f11c8072880 con 0x7f11d80b0940 2021-02-12T17:15:59.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.688+0000 7f11d7fff700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f11bc059d30 0x7f11bc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:15:59.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.688+0000 7f11d7fff700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f11bc059d30 0x7f11bc05c1f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f11c000b190 tx=0x7f11c0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:15:59.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.690+0000 7f11cffff700 1 -- 172.21.2.102:0/1753394685 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f11c8046690 con 0x7f11d80b0940 2021-02-12T17:15:59.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:15:59.821+0000 7f11de79d700 1 -- 172.21.2.102:0/1753394685 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_metadata", "pg_num": 8} v 0) v1 -- 0x7f11d8045460 con 0x7f11d80b0940 2021-02-12T17:16:00.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.713+0000 7f11cffff700 1 -- 172.21.2.102:0/1753394685 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_metadata", "pg_num": 8}]=0 pool 'a_metadata' created v19) v1 ==== 123+0+0 (secure 0 0 0) 0x7f11c8049cb0 con 0x7f11d80b0940 2021-02-12T17:16:00.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.715+0000 7f11de79d700 1 -- 172.21.2.102:0/1753394685 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f11bc059d30 msgr2=0x7f11bc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:00.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.715+0000 7f11de79d700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f11bc059d30 0x7f11bc05c1f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f11c000b190 tx=0x7f11c0016000).stop 2021-02-12T17:16:00.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.715+0000 7f11de79d700 1 -- 172.21.2.102:0/1753394685 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f11d80b0940 msgr2=0x7f11d8160080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:00.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.715+0000 7f11de79d700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f11d80b0940 0x7f11d8160080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f11c8009760 tx=0x7f11c8006e80).stop 2021-02-12T17:16:00.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.715+0000 7f11de79d700 1 -- 172.21.2.102:0/1753394685 shutdown_connections 2021-02-12T17:16:00.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.715+0000 7f11de79d700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f11d80bc2b0 0x7f11d8160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:00.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.715+0000 7f11de79d700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f11d809ada0 0x7f11d80b8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:00.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.715+0000 7f11de79d700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f11bc059d30 0x7f11bc05c1f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:00.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.715+0000 7f11de79d700 1 --2- 172.21.2.102:0/1753394685 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f11d80b0940 0x7f11d8160080 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:00.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.715+0000 7f11de79d700 1 -- 172.21.2.102:0/1753394685 >> 172.21.2.102:0/1753394685 conn(0x7f11d8061830 msgr2=0x7f11d814d030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:00.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.715+0000 7f11de79d700 1 -- 172.21.2.102:0/1753394685 shutdown_connections 2021-02-12T17:16:00.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.715+0000 7f11de79d700 1 -- 172.21.2.102:0/1753394685 wait complete. 2021-02-12T17:16:00.718 INFO:teuthology.orchestra.run.gibba002.stderr:pool 'a_metadata' created 2021-02-12T17:16:00.725 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_data 8 2021-02-12T17:16:00.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.814+0000 7f6e9f496700 1 Processor -- start 2021-02-12T17:16:00.816 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.814+0000 7f6e9f496700 1 -- start start 2021-02-12T17:16:00.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.815+0000 7f6e9f496700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6e9809ada0 0x7f6e9814e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:00.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.815+0000 7f6e9f496700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e98066b70 con 0x7f6e980bc2b0 2021-02-12T17:16:00.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.815+0000 7f6e9f496700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e980685b0 con 0x7f6e980b0940 2021-02-12T17:16:00.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.815+0000 7f6e9f496700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980b27d0 con 0x7f6e9809ada0 2021-02-12T17:16:00.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.815+0000 7f6e9d232700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f6e980bc2b0 0x7f6e98151120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:52896/0 (socket says 172.21.2.102:52896) 2021-02-12T17:16:00.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.815+0000 7f6e9d232700 1 -- 172.21.2.102:0/3470936587 learned_addr learned my addr 172.21.2.102:0/3470936587 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:00.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.815+0000 7f6e9da33700 1 --2- 172.21.2.102:0/3470936587 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6e9809ada0 0x7f6e9814e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:00.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.815+0000 7f6e87fff700 1 -- 172.21.2.102:0/3470936587 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177744071 0 0) 0x7f6e98066b70 con 0x7f6e980bc2b0 2021-02-12T17:16:00.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.815+0000 7f6e87fff700 1 -- 172.21.2.102:0/3470936587 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e80003230 con 0x7f6e980bc2b0 2021-02-12T17:16:00.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 -- 172.21.2.102:0/3470936587 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 126919705 0 0) 0x7f6e80003230 con 0x7f6e980bc2b0 2021-02-12T17:16:00.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 -- 172.21.2.102:0/3470936587 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6e9809ada0 msgr2=0x7f6e9814e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:00.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 --2- 172.21.2.102:0/3470936587 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6e9809ada0 0x7f6e9814e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:00.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 -- 172.21.2.102:0/3470936587 >> v1:172.21.2.104:6789/0 conn(0x7f6e980b0940 legacy=0x7f6e98151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:00.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 -- 172.21.2.102:0/3470936587 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9814e550 con 0x7f6e980bc2b0 2021-02-12T17:16:00.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 -- 172.21.2.102:0/3470936587 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f6e940014e0 con 0x7f6e980bc2b0 2021-02-12T17:16:00.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 -- 172.21.2.102:0/3470936587 >> v1:172.21.2.102:6789/0 conn(0x7f6e980bc2b0 legacy=0x7f6e98151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:00.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 --2- 172.21.2.102:0/3470936587 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6e80003750 0x7f6e80003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:00.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 --2- 172.21.2.102:0/3470936587 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6e9809ada0 0x7f6e800044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:00.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 --2- 172.21.2.102:0/3470936587 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6e800049c0 0x7f6e80004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:00.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 -- 172.21.2.102:0/3470936587 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980b27d0 con 0x7f6e80003750 2021-02-12T17:16:00.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 -- 172.21.2.102:0/3470936587 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e80004240 con 0x7f6e800049c0 2021-02-12T17:16:00.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 -- 172.21.2.102:0/3470936587 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8000b720 con 0x7f6e9809ada0 2021-02-12T17:16:00.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e9d232700 1 --2- 172.21.2.102:0/3470936587 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6e80003750 0x7f6e80003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:00.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e9ca31700 1 --2- 172.21.2.102:0/3470936587 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6e9809ada0 0x7f6e800044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:00.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e9da33700 1 --2- 172.21.2.102:0/3470936587 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6e800049c0 0x7f6e80004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:00.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e9d232700 1 -- 172.21.2.102:0/3470936587 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6e9809ada0 msgr2=0x7f6e800044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:00.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e9d232700 1 --2- 172.21.2.102:0/3470936587 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6e9809ada0 0x7f6e800044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:00.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e9d232700 1 -- 172.21.2.102:0/3470936587 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6e800049c0 msgr2=0x7f6e80004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:00.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e9d232700 1 --2- 172.21.2.102:0/3470936587 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6e800049c0 0x7f6e80004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:00.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e9d232700 1 -- 172.21.2.102:0/3470936587 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e80003230 con 0x7f6e80003750 2021-02-12T17:16:00.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e9d232700 1 --2- 172.21.2.102:0/3470936587 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6e80003750 0x7f6e80003b70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6e9400c210 tx=0x7f6e940076c0).ready entity=mon.0 client_cookie=de7fb5472ab171e3 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:00.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 -- 172.21.2.102:0/3470936587 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9400ce80 con 0x7f6e80003750 2021-02-12T17:16:00.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 -- 172.21.2.102:0/3470936587 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e940070d0 con 0x7f6e80003750 2021-02-12T17:16:00.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.816+0000 7f6e87fff700 1 -- 172.21.2.102:0/3470936587 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94007450 con 0x7f6e80003750 2021-02-12T17:16:00.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.817+0000 7f6e9f496700 1 -- 172.21.2.102:0/3470936587 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6e80003750 msgr2=0x7f6e80003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:00.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.817+0000 7f6e9f496700 1 --2- 172.21.2.102:0/3470936587 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6e80003750 0x7f6e80003b70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6e9400c210 tx=0x7f6e940076c0).stop 2021-02-12T17:16:00.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.817+0000 7f6e9da33700 1 -- 172.21.2.102:0/3470936587 reap_dead start 2021-02-12T17:16:00.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.817+0000 7f6e9f496700 1 -- 172.21.2.102:0/3470936587 shutdown_connections 2021-02-12T17:16:00.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.817+0000 7f6e9f496700 1 -- 172.21.2.102:0/3470936587 >> 172.21.2.102:0/3470936587 conn(0x7f6e98061830 msgr2=0x7f6e980bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:00.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.817+0000 7f6e9f496700 1 -- 172.21.2.102:0/3470936587 shutdown_connections 2021-02-12T17:16:00.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.817+0000 7f6e9f496700 1 -- 172.21.2.102:0/3470936587 wait complete. 2021-02-12T17:16:00.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.817+0000 7f6e9f496700 1 Processor -- start 2021-02-12T17:16:00.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9f496700 1 -- start start 2021-02-12T17:16:00.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9f496700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6e980b0f90 0x7f6e98160f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:00.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9f496700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6e980a1350 0x7f6e98161400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:00.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9f496700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6e9815d3a0 0x7f6e98149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:00.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9f496700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980a1140 con 0x7f6e980a1350 2021-02-12T17:16:00.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9f496700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9809f2d0 con 0x7f6e9815d3a0 2021-02-12T17:16:00.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9f496700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9809eaf0 con 0x7f6e980b0f90 2021-02-12T17:16:00.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9ca31700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6e980a1350 0x7f6e98161400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:00.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9ca31700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6e980a1350 0x7f6e98161400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44260/0 (socket says 172.21.2.102:44260) 2021-02-12T17:16:00.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9ca31700 1 -- 172.21.2.102:0/916278559 learned_addr learned my addr 172.21.2.102:0/916278559 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:00.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9d232700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6e980b0f90 0x7f6e98160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:00.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9da33700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6e9815d3a0 0x7f6e98149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:00.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9ca31700 1 -- 172.21.2.102:0/916278559 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6e980b0f90 msgr2=0x7f6e98160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:00.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9ca31700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6e980b0f90 0x7f6e98160f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:00.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9ca31700 1 -- 172.21.2.102:0/916278559 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6e9815d3a0 msgr2=0x7f6e98149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:00.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9ca31700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6e9815d3a0 0x7f6e98149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:00.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9ca31700 1 -- 172.21.2.102:0/916278559 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9809ed90 con 0x7f6e980a1350 2021-02-12T17:16:00.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9d232700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6e980b0f90 0x7f6e98160f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:00.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.818+0000 7f6e9ca31700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6e980a1350 0x7f6e98161400 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f6e88002980 tx=0x7f6e88007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:00.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.819+0000 7f6e857fa700 1 -- 172.21.2.102:0/916278559 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8800f8d0 con 0x7f6e980a1350 2021-02-12T17:16:00.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.819+0000 7f6e857fa700 1 -- 172.21.2.102:0/916278559 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8800fa30 con 0x7f6e980a1350 2021-02-12T17:16:00.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.819+0000 7f6e9f496700 1 -- 172.21.2.102:0/916278559 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9809f030 con 0x7f6e980a1350 2021-02-12T17:16:00.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.819+0000 7f6e857fa700 1 -- 172.21.2.102:0/916278559 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8800fdb0 con 0x7f6e980a1350 2021-02-12T17:16:00.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.819+0000 7f6e9f496700 1 -- 172.21.2.102:0/916278559 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e980baaf0 con 0x7f6e980a1350 2021-02-12T17:16:00.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.819+0000 7f6e9f496700 1 -- 172.21.2.102:0/916278559 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e98160c30 con 0x7f6e980a1350 2021-02-12T17:16:00.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.819+0000 7f6e857fa700 1 -- 172.21.2.102:0/916278559 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f6e8801b030 con 0x7f6e980a1350 2021-02-12T17:16:00.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.820+0000 7f6e857fa700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6e78059d30 0x7f6e7805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:00.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.820+0000 7f6e857fa700 1 -- 172.21.2.102:0/916278559 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5598+0+0 (secure 0 0 0) 0x7f6e880733e0 con 0x7f6e980a1350 2021-02-12T17:16:00.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.820+0000 7f6e9d232700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6e78059d30 0x7f6e7805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:00.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.820+0000 7f6e9d232700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6e78059d30 0x7f6e7805c1f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6e94000bc0 tx=0x7f6e94015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:00.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.823+0000 7f6e857fa700 1 -- 172.21.2.102:0/916278559 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f6e88047150 con 0x7f6e980a1350 2021-02-12T17:16:00.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:00.953+0000 7f6e9f496700 1 -- 172.21.2.102:0/916278559 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_data", "pg_num": 8} v 0) v1 -- 0x7f6e98045460 con 0x7f6e980a1350 2021-02-12T17:16:01.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.717+0000 7f6e857fa700 1 -- 172.21.2.102:0/916278559 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_data", "pg_num": 8}]=0 pool 'a_data' created v20) v1 ==== 115+0+0 (secure 0 0 0) 0x7f6e8804a770 con 0x7f6e980a1350 2021-02-12T17:16:01.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.719+0000 7f6e9f496700 1 -- 172.21.2.102:0/916278559 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6e78059d30 msgr2=0x7f6e7805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:01.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.719+0000 7f6e9f496700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6e78059d30 0x7f6e7805c1f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6e94000bc0 tx=0x7f6e94015000).stop 2021-02-12T17:16:01.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.719+0000 7f6e9f496700 1 -- 172.21.2.102:0/916278559 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6e980a1350 msgr2=0x7f6e98161400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:01.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.719+0000 7f6e9f496700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6e980a1350 0x7f6e98161400 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f6e88002980 tx=0x7f6e88007b80).stop 2021-02-12T17:16:01.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.719+0000 7f6e9f496700 1 -- 172.21.2.102:0/916278559 shutdown_connections 2021-02-12T17:16:01.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.719+0000 7f6e9f496700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6e9815d3a0 0x7f6e98149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:01.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.719+0000 7f6e9f496700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6e980b0f90 0x7f6e98160f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:01.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.719+0000 7f6e9f496700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6e78059d30 0x7f6e7805c1f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:01.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.719+0000 7f6e9f496700 1 --2- 172.21.2.102:0/916278559 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6e980a1350 0x7f6e98161400 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:01.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.719+0000 7f6e9f496700 1 -- 172.21.2.102:0/916278559 >> 172.21.2.102:0/916278559 conn(0x7f6e98061830 msgr2=0x7f6e9814c940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:01.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.719+0000 7f6e9f496700 1 -- 172.21.2.102:0/916278559 shutdown_connections 2021-02-12T17:16:01.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.719+0000 7f6e9f496700 1 -- 172.21.2.102:0/916278559 wait complete. 2021-02-12T17:16:01.722 INFO:teuthology.orchestra.run.gibba002.stderr:pool 'a_data' created 2021-02-12T17:16:01.730 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new a a_metadata a_data 2021-02-12T17:16:01.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.819+0000 7fd6dfe1b700 1 Processor -- start 2021-02-12T17:16:01.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.819+0000 7fd6dfe1b700 1 -- start start 2021-02-12T17:16:01.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.819+0000 7fd6dfe1b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fd6d80bc2b0 0x7fd6d8151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:01.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.819+0000 7fd6dfe1b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd6d80b0940 0x7fd6d8151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:01.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.819+0000 7fd6dfe1b700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d8066b70 con 0x7fd6d809ada0 2021-02-12T17:16:01.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.819+0000 7fd6dfe1b700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d80b27d0 con 0x7fd6d80bc2b0 2021-02-12T17:16:01.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.819+0000 7fd6dfe1b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80b7110 con 0x7fd6d80b0940 2021-02-12T17:16:01.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.820+0000 7fd6ddbb7700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fd6d80bc2b0 0x7fd6d8151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:01.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.820+0000 7fd6ddbb7700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fd6d80bc2b0 0x7fd6d8151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44274/0 (socket says 172.21.2.102:44274) 2021-02-12T17:16:01.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.820+0000 7fd6ddbb7700 1 -- 172.21.2.102:0/3643972440 learned_addr learned my addr 172.21.2.102:0/3643972440 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:01.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.820+0000 7fd6ddbb7700 1 -- 172.21.2.102:0/3643972440 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd6d80b0940 msgr2=0x7fd6d8151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:01.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.820+0000 7fd6ddbb7700 1 --2- 172.21.2.102:0/3643972440 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd6d80b0940 0x7fd6d8151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:01.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.820+0000 7fd6ddbb7700 1 -- 172.21.2.102:0/3643972440 >> v1:172.21.2.104:6789/0 conn(0x7fd6d809ada0 legacy=0x7fd6d814d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:01.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.820+0000 7fd6ddbb7700 1 -- 172.21.2.102:0/3643972440 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d80685b0 con 0x7fd6d80bc2b0 2021-02-12T17:16:01.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.820+0000 7fd6ddbb7700 1 --2- 172.21.2.102:0/3643972440 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd6d80bc2b0 0x7fd6d8151120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fd6c800b9e0 tx=0x7fd6c8006ea0).ready entity=mon.0 client_cookie=663c457964fab116 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:01.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.820+0000 7fd6dcbb5700 1 -- 172.21.2.102:0/3643972440 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8009890 con 0x7fd6d80bc2b0 2021-02-12T17:16:01.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.820+0000 7fd6dcbb5700 1 -- 172.21.2.102:0/3643972440 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c80099f0 con 0x7fd6d80bc2b0 2021-02-12T17:16:01.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.821+0000 7fd6dcbb5700 1 -- 172.21.2.102:0/3643972440 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8009d70 con 0x7fd6d80bc2b0 2021-02-12T17:16:01.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.821+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/3643972440 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd6d80bc2b0 msgr2=0x7fd6d8151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:01.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.821+0000 7fd6dfe1b700 1 --2- 172.21.2.102:0/3643972440 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd6d80bc2b0 0x7fd6d8151120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fd6c800b9e0 tx=0x7fd6c8006ea0).stop 2021-02-12T17:16:01.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.821+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/3643972440 shutdown_connections 2021-02-12T17:16:01.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.821+0000 7fd6dfe1b700 1 --2- 172.21.2.102:0/3643972440 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd6d80bc2b0 0x7fd6d8151120 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:01.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.821+0000 7fd6dfe1b700 1 --2- 172.21.2.102:0/3643972440 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd6d80b0940 0x7fd6d8151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:01.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.821+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/3643972440 >> 172.21.2.102:0/3643972440 conn(0x7fd6d8061830 msgr2=0x7fd6d80bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:01.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.821+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/3643972440 shutdown_connections 2021-02-12T17:16:01.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.821+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/3643972440 wait complete. 2021-02-12T17:16:01.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.822+0000 7fd6dfe1b700 1 Processor -- start 2021-02-12T17:16:01.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.822+0000 7fd6dfe1b700 1 -- start start 2021-02-12T17:16:01.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.822+0000 7fd6dfe1b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd6d809ada0 0x7fd6d814adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:01.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.822+0000 7fd6dfe1b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd6d80b0940 0x7fd6d814f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:01.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.822+0000 7fd6dfe1b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd6d80bc2b0 0x7fd6d814f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:01.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.822+0000 7fd6dfe1b700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d81481c0 con 0x7fd6d809ada0 2021-02-12T17:16:01.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.822+0000 7fd6dfe1b700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8148e80 con 0x7fd6d80b0940 2021-02-12T17:16:01.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.822+0000 7fd6dfe1b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d814a5f0 con 0x7fd6d80bc2b0 2021-02-12T17:16:01.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6ddbb7700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd6d809ada0 0x7fd6d814adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:01.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6ddbb7700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd6d809ada0 0x7fd6d814adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44282/0 (socket says 172.21.2.102:44282) 2021-02-12T17:16:01.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6ddbb7700 1 -- 172.21.2.102:0/1135498134 learned_addr learned my addr 172.21.2.102:0/1135498134 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:01.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6de3b8700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd6d80bc2b0 0x7fd6d814f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:01.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6dd3b6700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd6d80b0940 0x7fd6d814f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:01.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6ddbb7700 1 -- 172.21.2.102:0/1135498134 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd6d80bc2b0 msgr2=0x7fd6d814f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:01.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6ddbb7700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd6d80bc2b0 0x7fd6d814f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:01.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6ddbb7700 1 -- 172.21.2.102:0/1135498134 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd6d80b0940 msgr2=0x7fd6d814f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:01.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6ddbb7700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd6d80b0940 0x7fd6d814f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:01.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6ddbb7700 1 -- 172.21.2.102:0/1135498134 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d8148c20 con 0x7fd6d809ada0 2021-02-12T17:16:01.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6dd3b6700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd6d80b0940 0x7fd6d814f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:01.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6ddbb7700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd6d809ada0 0x7fd6d814adc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd6c8006ee0 tx=0x7fd6c8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:01.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6c5ffb700 1 -- 172.21.2.102:0/1135498134 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8011e30 con 0x7fd6d809ada0 2021-02-12T17:16:01.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6c5ffb700 1 -- 172.21.2.102:0/1135498134 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c801c420 con 0x7fd6d809ada0 2021-02-12T17:16:01.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/1135498134 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d814a390 con 0x7fd6d809ada0 2021-02-12T17:16:01.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6c5ffb700 1 -- 172.21.2.102:0/1135498134 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c801c7c0 con 0x7fd6d809ada0 2021-02-12T17:16:01.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.823+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/1135498134 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d814b2b0 con 0x7fd6d809ada0 2021-02-12T17:16:01.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.824+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/1135498134 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d80643d0 con 0x7fd6d809ada0 2021-02-12T17:16:01.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.824+0000 7fd6c5ffb700 1 -- 172.21.2.102:0/1135498134 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fd6c800f070 con 0x7fd6d809ada0 2021-02-12T17:16:01.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.825+0000 7fd6c5ffb700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd6b8059d30 0x7fd6b805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:01.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.825+0000 7fd6c5ffb700 1 -- 172.21.2.102:0/1135498134 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5943+0+0 (secure 0 0 0) 0x7fd6c80750a0 con 0x7fd6d809ada0 2021-02-12T17:16:01.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.825+0000 7fd6dd3b6700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd6b8059d30 0x7fd6b805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:01.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.825+0000 7fd6dd3b6700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd6b8059d30 0x7fd6b805c1f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd6d80b0d40 tx=0x7fd6d4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:01.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.828+0000 7fd6c5ffb700 1 -- 172.21.2.102:0/1135498134 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fd6c8048c60 con 0x7fd6d809ada0 2021-02-12T17:16:01.991 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.990+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/1135498134 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"} v 0) v1 -- 0x7fd6d8045460 con 0x7fd6d809ada0 2021-02-12T17:16:01.996 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.995+0000 7fd6c5ffb700 1 -- 172.21.2.102:0/1135498134 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 157+0+0 (secure 0 0 0) 0x7fd6c804c280 con 0x7fd6d809ada0 2021-02-12T17:16:01.998 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.997+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/1135498134 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd6b8059d30 msgr2=0x7fd6b805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:01.999 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.997+0000 7fd6dfe1b700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd6b8059d30 0x7fd6b805c1f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd6d80b0d40 tx=0x7fd6d4008040).stop 2021-02-12T17:16:01.999 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.997+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/1135498134 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd6d809ada0 msgr2=0x7fd6d814adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:01.999 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.997+0000 7fd6dfe1b700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd6d809ada0 0x7fd6d814adc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd6c8006ee0 tx=0x7fd6c8016000).stop 2021-02-12T17:16:01.999 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.997+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/1135498134 shutdown_connections 2021-02-12T17:16:01.999 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.997+0000 7fd6dfe1b700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd6d80bc2b0 0x7fd6d814f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:01.999 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.997+0000 7fd6dfe1b700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd6b8059d30 0x7fd6b805c1f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:01.999 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.997+0000 7fd6dfe1b700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd6d809ada0 0x7fd6d814adc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:01.999 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.997+0000 7fd6dfe1b700 1 --2- 172.21.2.102:0/1135498134 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd6d80b0940 0x7fd6d814f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:01.999 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.997+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/1135498134 >> 172.21.2.102:0/1135498134 conn(0x7fd6d8061830 msgr2=0x7fd6d814d030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:01.999 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.997+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/1135498134 shutdown_connections 2021-02-12T17:16:01.999 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:01.997+0000 7fd6dfe1b700 1 -- 172.21.2.102:0/1135498134 wait complete. 2021-02-12T17:16:02.000 INFO:teuthology.orchestra.run.gibba002.stderr:new fs with metadata pool 3 and data pool 4 2021-02-12T17:16:02.009 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:02.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.095+0000 7fa30bd58700 1 Processor -- start 2021-02-12T17:16:02.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.095+0000 7fa30bd58700 1 -- start start 2021-02-12T17:16:02.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.096+0000 7fa30bd58700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa30414e530 0x7fa304068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.096+0000 7fa30bd58700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3040b7960 con 0x7fa304062740 2021-02-12T17:16:02.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.096+0000 7fa30bd58700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3040622a0 con 0x7fa3040b8d20 2021-02-12T17:16:02.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.096+0000 7fa30bd58700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa304068d20 con 0x7fa30414e530 2021-02-12T17:16:02.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.096+0000 7fa3092f3700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa30414e530 0x7fa304068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:02.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.096+0000 7fa30a2f5700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fa304062740 0x7fa304062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:52952/0 (socket says 172.21.2.102:52952) 2021-02-12T17:16:02.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.096+0000 7fa30a2f5700 1 -- 172.21.2.102:0/3009439910 learned_addr learned my addr 172.21.2.102:0/3009439910 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:02.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.096+0000 7fa3092f3700 1 -- 172.21.2.102:0/3009439910 >> v1:172.21.2.104:6789/0 conn(0x7fa3040b8d20 legacy=0x7fa3040b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:02.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.096+0000 7fa3092f3700 1 -- 172.21.2.102:0/3009439910 >> v1:172.21.2.102:6789/0 conn(0x7fa304062740 legacy=0x7fa304062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.096+0000 7fa3092f3700 1 -- 172.21.2.102:0/3009439910 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30414ea10 con 0x7fa30414e530 2021-02-12T17:16:02.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.097+0000 7fa3092f3700 1 --2- 172.21.2.102:0/3009439910 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa30414e530 0x7fa304068830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa30000b980 tx=0x7fa300006de0).ready entity=mon.0 client_cookie=4ecabc3084e88ef0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:02.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.097+0000 7fa308af2700 1 -- 172.21.2.102:0/3009439910 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3000097a0 con 0x7fa30414e530 2021-02-12T17:16:02.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.097+0000 7fa308af2700 1 -- 172.21.2.102:0/3009439910 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa300009900 con 0x7fa30414e530 2021-02-12T17:16:02.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.097+0000 7fa308af2700 1 -- 172.21.2.102:0/3009439910 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300009c80 con 0x7fa30414e530 2021-02-12T17:16:02.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.097+0000 7fa30bd58700 1 -- 172.21.2.102:0/3009439910 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa30414e530 msgr2=0x7fa304068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.097+0000 7fa30bd58700 1 --2- 172.21.2.102:0/3009439910 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa30414e530 0x7fa304068830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa30000b980 tx=0x7fa300006de0).stop 2021-02-12T17:16:02.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.097+0000 7fa30bd58700 1 -- 172.21.2.102:0/3009439910 shutdown_connections 2021-02-12T17:16:02.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.097+0000 7fa30bd58700 1 --2- 172.21.2.102:0/3009439910 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa30414e530 0x7fa304068830 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:02.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.097+0000 7fa30bd58700 1 -- 172.21.2.102:0/3009439910 >> 172.21.2.102:0/3009439910 conn(0x7fa3040bc480 msgr2=0x7fa3040b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:02.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.097+0000 7fa30bd58700 1 -- 172.21.2.102:0/3009439910 shutdown_connections 2021-02-12T17:16:02.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.097+0000 7fa30bd58700 1 -- 172.21.2.102:0/3009439910 wait complete. 2021-02-12T17:16:02.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.098+0000 7fa30bd58700 1 Processor -- start 2021-02-12T17:16:02.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.098+0000 7fa30bd58700 1 -- start start 2021-02-12T17:16:02.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa30bd58700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa304062740 0x7fa304151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa30bd58700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa3040b8d20 0x7fa3040aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa30bd58700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa30414e530 0x7fa3040aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa30bd58700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30411d840 con 0x7fa304062740 2021-02-12T17:16:02.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa30bd58700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30411dae0 con 0x7fa30414e530 2021-02-12T17:16:02.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa30bd58700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30411dd80 con 0x7fa3040b8d20 2021-02-12T17:16:02.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa309af4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa304062740 0x7fa304151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:02.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa309af4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa304062740 0x7fa304151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44310/0 (socket says 172.21.2.102:44310) 2021-02-12T17:16:02.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa309af4700 1 -- 172.21.2.102:0/2670755177 learned_addr learned my addr 172.21.2.102:0/2670755177 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:02.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa309af4700 1 -- 172.21.2.102:0/2670755177 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa3040b8d20 msgr2=0x7fa3040aea30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:02.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa309af4700 1 --2- 172.21.2.102:0/2670755177 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa3040b8d20 0x7fa3040aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:02.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa309af4700 1 -- 172.21.2.102:0/2670755177 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa30414e530 msgr2=0x7fa3040aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa309af4700 1 --2- 172.21.2.102:0/2670755177 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa30414e530 0x7fa3040aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:02.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa309af4700 1 -- 172.21.2.102:0/2670755177 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30411e020 con 0x7fa304062740 2021-02-12T17:16:02.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa309af4700 1 --2- 172.21.2.102:0/2670755177 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa304062740 0x7fa304151640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa2f40096b0 tx=0x7fa2f4006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:02.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa2f1ffb700 1 -- 172.21.2.102:0/2670755177 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f400d590 con 0x7fa304062740 2021-02-12T17:16:02.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa2f1ffb700 1 -- 172.21.2.102:0/2670755177 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f400d710 con 0x7fa304062740 2021-02-12T17:16:02.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa2f1ffb700 1 -- 172.21.2.102:0/2670755177 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f400dad0 con 0x7fa304062740 2021-02-12T17:16:02.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa30bd58700 1 -- 172.21.2.102:0/2670755177 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30411e2c0 con 0x7fa304062740 2021-02-12T17:16:02.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.099+0000 7fa30bd58700 1 -- 172.21.2.102:0/2670755177 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3040acf10 con 0x7fa304062740 2021-02-12T17:16:02.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.100+0000 7fa30bd58700 1 -- 172.21.2.102:0/2670755177 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa304161330 con 0x7fa304062740 2021-02-12T17:16:02.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.100+0000 7fa2f1ffb700 1 -- 172.21.2.102:0/2670755177 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fa2f4017030 con 0x7fa304062740 2021-02-12T17:16:02.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.100+0000 7fa2f1ffb700 1 --2- 172.21.2.102:0/2670755177 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa2e4059d30 0x7fa2e405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.100+0000 7fa2f1ffb700 1 -- 172.21.2.102:0/2670755177 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fa2f4072cb0 con 0x7fa304062740 2021-02-12T17:16:02.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.100+0000 7fa3092f3700 1 --2- 172.21.2.102:0/2670755177 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa2e4059d30 0x7fa2e405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:02.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.101+0000 7fa3092f3700 1 --2- 172.21.2.102:0/2670755177 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa2e4059d30 0x7fa2e405c1f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa304151fd0 tx=0x7fa300016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:02.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.103+0000 7fa2f1ffb700 1 -- 172.21.2.102:0/2670755177 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fa2f40467a0 con 0x7fa304062740 2021-02-12T17:16:02.235 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.234+0000 7fa30bd58700 1 -- 172.21.2.102:0/2670755177 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa304045460 con 0x7fa304062740 2021-02-12T17:16:02.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.234+0000 7fa2f1ffb700 1 -- 172.21.2.102:0/2670755177 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16770 (secure 0 0 0) 0x7fa2f4049dc0 con 0x7fa304062740 2021-02-12T17:16:02.237 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:02.237 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":21,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:01.991426+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:02.238 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.236+0000 7fa30bd58700 1 -- 172.21.2.102:0/2670755177 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa2e4059d30 msgr2=0x7fa2e405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.238 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.236+0000 7fa30bd58700 1 --2- 172.21.2.102:0/2670755177 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa2e4059d30 0x7fa2e405c1f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa304151fd0 tx=0x7fa300016000).stop 2021-02-12T17:16:02.238 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.236+0000 7fa30bd58700 1 -- 172.21.2.102:0/2670755177 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa304062740 msgr2=0x7fa304151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.238 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.236+0000 7fa30bd58700 1 --2- 172.21.2.102:0/2670755177 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa304062740 0x7fa304151640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa2f40096b0 tx=0x7fa2f4006de0).stop 2021-02-12T17:16:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.236+0000 7fa30bd58700 1 -- 172.21.2.102:0/2670755177 shutdown_connections 2021-02-12T17:16:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.236+0000 7fa30bd58700 1 --2- 172.21.2.102:0/2670755177 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa30414e530 0x7fa3040aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.236+0000 7fa30bd58700 1 --2- 172.21.2.102:0/2670755177 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa2e4059d30 0x7fa2e405c1f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.236+0000 7fa30bd58700 1 --2- 172.21.2.102:0/2670755177 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa304062740 0x7fa304151640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.236+0000 7fa30bd58700 1 --2- 172.21.2.102:0/2670755177 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa3040b8d20 0x7fa3040aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:02.240 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.236+0000 7fa30bd58700 1 -- 172.21.2.102:0/2670755177 >> 172.21.2.102:0/2670755177 conn(0x7fa3040bc480 msgr2=0x7fa3040b7250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:02.240 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.236+0000 7fa30bd58700 1 -- 172.21.2.102:0/2670755177 shutdown_connections 2021-02-12T17:16:02.240 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.236+0000 7fa30bd58700 1 -- 172.21.2.102:0/2670755177 wait complete. 2021-02-12T17:16:02.246 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:02.335 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.334+0000 7fa5328e1700 1 Processor -- start 2021-02-12T17:16:02.335 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.334+0000 7fa5328e1700 1 -- start start 2021-02-12T17:16:02.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.334+0000 7fa5328e1700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa52c0b8d20 0x7fa52c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.334+0000 7fa5328e1700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52c0b7960 con 0x7fa52c062740 2021-02-12T17:16:02.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.334+0000 7fa5328e1700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52c0622a0 con 0x7fa52c14e530 2021-02-12T17:16:02.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.334+0000 7fa5328e1700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa52c068d20 con 0x7fa52c0b8d20 2021-02-12T17:16:02.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.334+0000 7fa52bfff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa52c0b8d20 0x7fa52c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:02.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.334+0000 7fa530e7e700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fa52c062740 0x7fa52c062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:52966/0 (socket says 172.21.2.102:52966) 2021-02-12T17:16:02.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.334+0000 7fa530e7e700 1 -- 172.21.2.102:0/2196581984 learned_addr learned my addr 172.21.2.102:0/2196581984 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:02.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.335+0000 7fa52bfff700 1 -- 172.21.2.102:0/2196581984 >> v1:172.21.2.104:6789/0 conn(0x7fa52c14e530 legacy=0x7fa52c0b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:02.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.335+0000 7fa52bfff700 1 -- 172.21.2.102:0/2196581984 >> v1:172.21.2.102:6789/0 conn(0x7fa52c062740 legacy=0x7fa52c062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.335+0000 7fa52bfff700 1 -- 172.21.2.102:0/2196581984 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c14ea10 con 0x7fa52c0b8d20 2021-02-12T17:16:02.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.335+0000 7fa52bfff700 1 --2- 172.21.2.102:0/2196581984 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa52c0b8d20 0x7fa52c068830 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa51400b980 tx=0x7fa514006de0).ready entity=mon.0 client_cookie=28f61789c531a9c server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:02.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.335+0000 7fa52affd700 1 -- 172.21.2.102:0/2196581984 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5140097a0 con 0x7fa52c0b8d20 2021-02-12T17:16:02.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.335+0000 7fa52affd700 1 -- 172.21.2.102:0/2196581984 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa514009900 con 0x7fa52c0b8d20 2021-02-12T17:16:02.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.335+0000 7fa52affd700 1 -- 172.21.2.102:0/2196581984 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514009c80 con 0x7fa52c0b8d20 2021-02-12T17:16:02.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.335+0000 7fa5328e1700 1 -- 172.21.2.102:0/2196581984 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa52c0b8d20 msgr2=0x7fa52c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.335+0000 7fa5328e1700 1 --2- 172.21.2.102:0/2196581984 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa52c0b8d20 0x7fa52c068830 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa51400b980 tx=0x7fa514006de0).stop 2021-02-12T17:16:02.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.335+0000 7fa5328e1700 1 -- 172.21.2.102:0/2196581984 shutdown_connections 2021-02-12T17:16:02.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.335+0000 7fa5328e1700 1 --2- 172.21.2.102:0/2196581984 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa52c0b8d20 0x7fa52c068830 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:02.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.335+0000 7fa5328e1700 1 -- 172.21.2.102:0/2196581984 >> 172.21.2.102:0/2196581984 conn(0x7fa52c0bc480 msgr2=0x7fa52c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:02.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.335+0000 7fa5328e1700 1 -- 172.21.2.102:0/2196581984 shutdown_connections 2021-02-12T17:16:02.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.335+0000 7fa5328e1700 1 -- 172.21.2.102:0/2196581984 wait complete. 2021-02-12T17:16:02.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.336+0000 7fa5328e1700 1 Processor -- start 2021-02-12T17:16:02.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.336+0000 7fa5328e1700 1 -- start start 2021-02-12T17:16:02.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa5328e1700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa52c062740 0x7fa52c0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa5328e1700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa52c0b8d20 0x7fa52c0ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa5328e1700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa52c14e530 0x7fa52c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa5328e1700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c0aea40 con 0x7fa52c062740 2021-02-12T17:16:02.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa5328e1700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c160dd0 con 0x7fa52c14e530 2021-02-12T17:16:02.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa5328e1700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c161070 con 0x7fa52c0b8d20 2021-02-12T17:16:02.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa52bfff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa52c062740 0x7fa52c0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:02.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa52bfff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa52c062740 0x7fa52c0af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44326/0 (socket says 172.21.2.102:44326) 2021-02-12T17:16:02.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa52bfff700 1 -- 172.21.2.102:0/2608104704 learned_addr learned my addr 172.21.2.102:0/2608104704 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:02.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa52bfff700 1 -- 172.21.2.102:0/2608104704 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa52c0b8d20 msgr2=0x7fa52c0ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa52bfff700 1 --2- 172.21.2.102:0/2608104704 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa52c0b8d20 0x7fa52c0ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:02.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa52bfff700 1 -- 172.21.2.102:0/2608104704 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa52c14e530 msgr2=0x7fa52c0b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa52bfff700 1 --2- 172.21.2.102:0/2608104704 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa52c14e530 0x7fa52c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:02.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa52bfff700 1 -- 172.21.2.102:0/2608104704 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c161310 con 0x7fa52c062740 2021-02-12T17:16:02.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa52bfff700 1 --2- 172.21.2.102:0/2608104704 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa52c062740 0x7fa52c0af7f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fa52c0653c0 tx=0x7fa514016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:02.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa523fff700 1 -- 172.21.2.102:0/2608104704 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51401d430 con 0x7fa52c062740 2021-02-12T17:16:02.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa523fff700 1 -- 172.21.2.102:0/2608104704 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51401d590 con 0x7fa52c062740 2021-02-12T17:16:02.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa5328e1700 1 -- 172.21.2.102:0/2608104704 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52c1615b0 con 0x7fa52c062740 2021-02-12T17:16:02.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa523fff700 1 -- 172.21.2.102:0/2608104704 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51401d910 con 0x7fa52c062740 2021-02-12T17:16:02.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.337+0000 7fa5328e1700 1 -- 172.21.2.102:0/2608104704 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52c0b52d0 con 0x7fa52c062740 2021-02-12T17:16:02.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.338+0000 7fa5328e1700 1 -- 172.21.2.102:0/2608104704 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52c045460 con 0x7fa52c062740 2021-02-12T17:16:02.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.338+0000 7fa523fff700 1 -- 172.21.2.102:0/2608104704 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fa514024030 con 0x7fa52c062740 2021-02-12T17:16:02.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.338+0000 7fa523fff700 1 --2- 172.21.2.102:0/2608104704 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa510059d30 0x7fa51005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.338+0000 7fa523fff700 1 -- 172.21.2.102:0/2608104704 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fa514074ba0 con 0x7fa52c062740 2021-02-12T17:16:02.343 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.339+0000 7fa52b7fe700 1 --2- 172.21.2.102:0/2608104704 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa510059d30 0x7fa51005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:02.343 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.339+0000 7fa52b7fe700 1 --2- 172.21.2.102:0/2608104704 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa510059d30 0x7fa51005c1f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa52c0afce0 tx=0x7fa51c006900).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:02.343 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.341+0000 7fa523fff700 1 -- 172.21.2.102:0/2608104704 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fa5140487a0 con 0x7fa52c062740 2021-02-12T17:16:02.469 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.468+0000 7fa5328e1700 1 -- 172.21.2.102:0/2608104704 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa52c067e40 con 0x7fa52c062740 2021-02-12T17:16:02.470 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.469+0000 7fa523fff700 1 -- 172.21.2.102:0/2608104704 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16770 (secure 0 0 0) 0x7fa5140301a0 con 0x7fa52c062740 2021-02-12T17:16:02.470 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:02.471 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":21,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:01.991426+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:02.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.470+0000 7fa5328e1700 1 -- 172.21.2.102:0/2608104704 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa510059d30 msgr2=0x7fa51005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.470+0000 7fa5328e1700 1 --2- 172.21.2.102:0/2608104704 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa510059d30 0x7fa51005c1f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa52c0afce0 tx=0x7fa51c006900).stop 2021-02-12T17:16:02.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.470+0000 7fa5328e1700 1 -- 172.21.2.102:0/2608104704 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa52c062740 msgr2=0x7fa52c0af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.470+0000 7fa5328e1700 1 --2- 172.21.2.102:0/2608104704 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa52c062740 0x7fa52c0af7f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fa52c0653c0 tx=0x7fa514016000).stop 2021-02-12T17:16:02.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.470+0000 7fa5328e1700 1 -- 172.21.2.102:0/2608104704 shutdown_connections 2021-02-12T17:16:02.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.470+0000 7fa5328e1700 1 --2- 172.21.2.102:0/2608104704 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa52c14e530 0x7fa52c0b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:02.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.470+0000 7fa5328e1700 1 --2- 172.21.2.102:0/2608104704 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa510059d30 0x7fa51005c1f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:02.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.470+0000 7fa5328e1700 1 --2- 172.21.2.102:0/2608104704 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa52c062740 0x7fa52c0af7f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:02.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.470+0000 7fa5328e1700 1 --2- 172.21.2.102:0/2608104704 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa52c0b8d20 0x7fa52c0ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:02.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.470+0000 7fa5328e1700 1 -- 172.21.2.102:0/2608104704 >> 172.21.2.102:0/2608104704 conn(0x7fa52c0bc480 msgr2=0x7fa52c14ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:02.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.470+0000 7fa5328e1700 1 -- 172.21.2.102:0/2608104704 shutdown_connections 2021-02-12T17:16:02.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.470+0000 7fa5328e1700 1 -- 172.21.2.102:0/2608104704 wait complete. 2021-02-12T17:16:02.480 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a standby_count_wanted 0 2021-02-12T17:16:02.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.570+0000 7f2bf19bf700 1 Processor -- start 2021-02-12T17:16:02.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.570+0000 7f2bf19bf700 1 -- start start 2021-02-12T17:16:02.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.571+0000 7f2bf19bf700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bec0bc2b0 0x7f2bec151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.571+0000 7f2bf19bf700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f2bec0b0940 0x7f2bec151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.571+0000 7f2bf19bf700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bec066b70 con 0x7f2bec09ada0 2021-02-12T17:16:02.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.571+0000 7f2bf19bf700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bec0b27d0 con 0x7f2bec0b0940 2021-02-12T17:16:02.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.571+0000 7f2bf19bf700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec0b7110 con 0x7f2bec0bc2b0 2021-02-12T17:16:02.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.571+0000 7f2beaffd700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bec0bc2b0 0x7f2bec151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:02.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.571+0000 7f2beaffd700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bec0bc2b0 0x7f2bec151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.102:46482/0 (socket says 172.21.2.102:46482) 2021-02-12T17:16:02.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.571+0000 7f2bea7fc700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f2bec0b0940 0x7f2bec151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:02.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.571+0000 7f2beaffd700 1 -- 172.21.2.102:0/914423238 learned_addr learned my addr 172.21.2.102:0/914423238 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:02.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.572+0000 7f2beaffd700 1 -- 172.21.2.102:0/914423238 >> v2:172.21.2.104:3300/0 conn(0x7f2bec0b0940 msgr2=0x7f2bec151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:02.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.572+0000 7f2beaffd700 1 --2- 172.21.2.102:0/914423238 >> v2:172.21.2.104:3300/0 conn(0x7f2bec0b0940 0x7f2bec151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:02.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.572+0000 7f2beaffd700 1 -- 172.21.2.102:0/914423238 >> v1:172.21.2.104:6789/0 conn(0x7f2bec09ada0 legacy=0x7f2bec14d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.572+0000 7f2beaffd700 1 -- 172.21.2.102:0/914423238 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec0685b0 con 0x7f2bec0bc2b0 2021-02-12T17:16:02.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.572+0000 7f2bea7fc700 1 --2- 172.21.2.102:0/914423238 >> v2:172.21.2.104:3300/0 conn(0x7f2bec0b0940 0x7f2bec151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:16:02.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.572+0000 7f2beaffd700 1 --2- 172.21.2.102:0/914423238 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bec0bc2b0 0x7f2bec151120 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f2bd400b9e0 tx=0x7f2bd4006ea0).ready entity=mon.2 client_cookie=5ab0aeec2096f97d server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:02.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.572+0000 7f2be9ffb700 1 -- 172.21.2.102:0/914423238 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40098d0 con 0x7f2bec0bc2b0 2021-02-12T17:16:02.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.573+0000 7f2be9ffb700 1 -- 172.21.2.102:0/914423238 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd4009a30 con 0x7f2bec0bc2b0 2021-02-12T17:16:02.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.573+0000 7f2be9ffb700 1 -- 172.21.2.102:0/914423238 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4009db0 con 0x7f2bec0bc2b0 2021-02-12T17:16:02.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.573+0000 7f2bf19bf700 1 -- 172.21.2.102:0/914423238 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bec0bc2b0 msgr2=0x7f2bec151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.573+0000 7f2bf19bf700 1 --2- 172.21.2.102:0/914423238 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bec0bc2b0 0x7f2bec151120 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f2bd400b9e0 tx=0x7f2bd4006ea0).stop 2021-02-12T17:16:02.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.573+0000 7f2bf19bf700 1 -- 172.21.2.102:0/914423238 shutdown_connections 2021-02-12T17:16:02.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.573+0000 7f2bf19bf700 1 --2- 172.21.2.102:0/914423238 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bec0bc2b0 0x7f2bec151120 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:02.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.573+0000 7f2bf19bf700 1 --2- 172.21.2.102:0/914423238 >> v2:172.21.2.104:3300/0 conn(0x7f2bec0b0940 0x7f2bec151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:02.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.573+0000 7f2bf19bf700 1 -- 172.21.2.102:0/914423238 >> 172.21.2.102:0/914423238 conn(0x7f2bec061830 msgr2=0x7f2bec0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:02.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.573+0000 7f2bf19bf700 1 -- 172.21.2.102:0/914423238 shutdown_connections 2021-02-12T17:16:02.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.573+0000 7f2bf19bf700 1 -- 172.21.2.102:0/914423238 wait complete. 2021-02-12T17:16:02.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.574+0000 7f2bf19bf700 1 Processor -- start 2021-02-12T17:16:02.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.574+0000 7f2bf19bf700 1 -- start start 2021-02-12T17:16:02.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.574+0000 7f2bf19bf700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2bec09ada0 0x7f2bec14f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.574+0000 7f2bf19bf700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bec0b0940 0x7f2bec14a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.574+0000 7f2bf19bf700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2bec0bc2b0 0x7f2bec09f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.574+0000 7f2bf19bf700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec14f8a0 con 0x7f2bec09ada0 2021-02-12T17:16:02.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.574+0000 7f2bf19bf700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec150130 con 0x7f2bec0bc2b0 2021-02-12T17:16:02.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.574+0000 7f2bf19bf700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec1503d0 con 0x7f2bec0b0940 2021-02-12T17:16:02.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2beaffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2bec09ada0 0x7f2bec14f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:02.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2beaffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2bec09ada0 0x7f2bec14f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44340/0 (socket says 172.21.2.102:44340) 2021-02-12T17:16:02.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2beaffd700 1 -- 172.21.2.102:0/1881215437 learned_addr learned my addr 172.21.2.102:0/1881215437 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:02.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2bea7fc700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bec0b0940 0x7f2bec14a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:02.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2beb7fe700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2bec0bc2b0 0x7f2bec09f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:02.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2beaffd700 1 -- 172.21.2.102:0/1881215437 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bec0b0940 msgr2=0x7f2bec14a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2beaffd700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bec0b0940 0x7f2bec14a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:02.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2beaffd700 1 -- 172.21.2.102:0/1881215437 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2bec0bc2b0 msgr2=0x7f2bec09f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:02.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2beaffd700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2bec0bc2b0 0x7f2bec09f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:02.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2beaffd700 1 -- 172.21.2.102:0/1881215437 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec150670 con 0x7f2bec09ada0 2021-02-12T17:16:02.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2bea7fc700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bec0b0940 0x7f2bec14a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:02.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2beb7fe700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2bec0bc2b0 0x7f2bec09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:02.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2beaffd700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2bec09ada0 0x7f2bec14f200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2bec0b7250 tx=0x7f2bd4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:02.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2be2ffd700 1 -- 172.21.2.102:0/1881215437 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4012d20 con 0x7f2bec09ada0 2021-02-12T17:16:02.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2be2ffd700 1 -- 172.21.2.102:0/1881215437 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd4012e80 con 0x7f2bec09ada0 2021-02-12T17:16:02.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2bf19bf700 1 -- 172.21.2.102:0/1881215437 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bec09ec60 con 0x7f2bec09ada0 2021-02-12T17:16:02.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2be2ffd700 1 -- 172.21.2.102:0/1881215437 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd401c650 con 0x7f2bec09ada0 2021-02-12T17:16:02.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.575+0000 7f2bf19bf700 1 -- 172.21.2.102:0/1881215437 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bec152720 con 0x7f2bec09ada0 2021-02-12T17:16:02.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.576+0000 7f2bf19bf700 1 -- 172.21.2.102:0/1881215437 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bec045460 con 0x7f2bec09ada0 2021-02-12T17:16:02.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.576+0000 7f2be2ffd700 1 -- 172.21.2.102:0/1881215437 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f2bd400f070 con 0x7f2bec09ada0 2021-02-12T17:16:02.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.577+0000 7f2be2ffd700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2bd0059d60 0x7f2bd005c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:02.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.577+0000 7f2be2ffd700 1 -- 172.21.2.102:0/1881215437 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f2bd4074ec0 con 0x7f2bec09ada0 2021-02-12T17:16:02.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.577+0000 7f2bea7fc700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2bd0059d60 0x7f2bd005c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:02.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.577+0000 7f2bea7fc700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2bd0059d60 0x7f2bd005c220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2bec0a0a50 tx=0x7f2bdc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:02.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.580+0000 7f2be2ffd700 1 -- 172.21.2.102:0/1881215437 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f2bd4048a10 con 0x7f2bec09ada0 2021-02-12T17:16:02.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.743+0000 7f2bf19bf700 1 -- 172.21.2.102:0/1881215437 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2bec0b7650 con 0x7f2bec09ada0 2021-02-12T17:16:02.998 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.996+0000 7f2be2ffd700 1 -- 172.21.2.102:0/1881215437 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 113+0+0 (secure 0 0 0) 0x7f2bd4006a30 con 0x7f2bec09ada0 2021-02-12T17:16:03.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.998+0000 7f2bf19bf700 1 -- 172.21.2.102:0/1881215437 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2bd0059d60 msgr2=0x7f2bd005c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:03.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.998+0000 7f2bf19bf700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2bd0059d60 0x7f2bd005c220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2bec0a0a50 tx=0x7f2bdc008040).stop 2021-02-12T17:16:03.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.998+0000 7f2bf19bf700 1 -- 172.21.2.102:0/1881215437 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2bec09ada0 msgr2=0x7f2bec14f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:03.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.998+0000 7f2bf19bf700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2bec09ada0 0x7f2bec14f200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2bec0b7250 tx=0x7f2bd4016000).stop 2021-02-12T17:16:03.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.998+0000 7f2bf19bf700 1 -- 172.21.2.102:0/1881215437 shutdown_connections 2021-02-12T17:16:03.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.998+0000 7f2bf19bf700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2bec0bc2b0 0x7f2bec09f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:03.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.998+0000 7f2bf19bf700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2bd0059d60 0x7f2bd005c220 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:03.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.998+0000 7f2bf19bf700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2bec09ada0 0x7f2bec14f200 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:03.001 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.998+0000 7f2bf19bf700 1 --2- 172.21.2.102:0/1881215437 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bec0b0940 0x7f2bec14a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:03.001 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.998+0000 7f2bf19bf700 1 -- 172.21.2.102:0/1881215437 >> 172.21.2.102:0/1881215437 conn(0x7f2bec061830 msgr2=0x7f2bec153350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:03.001 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.998+0000 7f2bf19bf700 1 -- 172.21.2.102:0/1881215437 shutdown_connections 2021-02-12T17:16:03.001 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:02.998+0000 7f2bf19bf700 1 -- 172.21.2.102:0/1881215437 wait complete. 2021-02-12T17:16:03.009 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a session_timeout 300 2021-02-12T17:16:03.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.098+0000 7ff687d0e700 1 Processor -- start 2021-02-12T17:16:03.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.098+0000 7ff687d0e700 1 -- start start 2021-02-12T17:16:03.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff687d0e700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7ff6800bc2b0 0x7ff680151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:03.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff687d0e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff6800b0940 0x7ff680151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:03.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff687d0e700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff680066b70 con 0x7ff68009ada0 2021-02-12T17:16:03.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff687d0e700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6800b27d0 con 0x7ff6800bc2b0 2021-02-12T17:16:03.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff687d0e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800b7110 con 0x7ff6800b0940 2021-02-12T17:16:03.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff685aaa700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7ff6800bc2b0 0x7ff680151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:03.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff685aaa700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7ff6800bc2b0 0x7ff680151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44348/0 (socket says 172.21.2.102:44348) 2021-02-12T17:16:03.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff685aaa700 1 -- 172.21.2.102:0/1399772663 learned_addr learned my addr 172.21.2.102:0/1399772663 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:03.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff6862ab700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7ff68009ada0 0x7ff68014d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:52994/0 (socket says 172.21.2.102:52994) 2021-02-12T17:16:03.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff6852a9700 1 --2- 172.21.2.102:0/1399772663 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff6800b0940 0x7ff680151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:03.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff684aa8700 1 -- 172.21.2.102:0/1399772663 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697389551 0 0) 0x7ff680066b70 con 0x7ff68009ada0 2021-02-12T17:16:03.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff685aaa700 1 -- 172.21.2.102:0/1399772663 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff6800b0940 msgr2=0x7ff680151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:03.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff685aaa700 1 --2- 172.21.2.102:0/1399772663 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff6800b0940 0x7ff680151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:03.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff685aaa700 1 -- 172.21.2.102:0/1399772663 >> v1:172.21.2.102:6789/0 conn(0x7ff68009ada0 legacy=0x7ff68014d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:03.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff685aaa700 1 -- 172.21.2.102:0/1399772663 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6800685b0 con 0x7ff6800bc2b0 2021-02-12T17:16:03.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.099+0000 7ff6852a9700 1 --2- 172.21.2.102:0/1399772663 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff6800b0940 0x7ff680151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:03.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.100+0000 7ff685aaa700 1 --2- 172.21.2.102:0/1399772663 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff6800bc2b0 0x7ff680151120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff67c00b9e0 tx=0x7ff67c006ea0).ready entity=mon.0 client_cookie=c7cfa9d905f4812c server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:03.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.100+0000 7ff684aa8700 1 -- 172.21.2.102:0/1399772663 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c0098d0 con 0x7ff6800bc2b0 2021-02-12T17:16:03.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.100+0000 7ff684aa8700 1 -- 172.21.2.102:0/1399772663 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67c009a30 con 0x7ff6800bc2b0 2021-02-12T17:16:03.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.100+0000 7ff684aa8700 1 -- 172.21.2.102:0/1399772663 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c009db0 con 0x7ff6800bc2b0 2021-02-12T17:16:03.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.100+0000 7ff687d0e700 1 -- 172.21.2.102:0/1399772663 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff6800bc2b0 msgr2=0x7ff680151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:03.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.100+0000 7ff687d0e700 1 --2- 172.21.2.102:0/1399772663 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff6800bc2b0 0x7ff680151120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff67c00b9e0 tx=0x7ff67c006ea0).stop 2021-02-12T17:16:03.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.100+0000 7ff687d0e700 1 -- 172.21.2.102:0/1399772663 shutdown_connections 2021-02-12T17:16:03.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.100+0000 7ff687d0e700 1 --2- 172.21.2.102:0/1399772663 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff6800bc2b0 0x7ff680151120 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:03.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.100+0000 7ff687d0e700 1 --2- 172.21.2.102:0/1399772663 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff6800b0940 0x7ff680151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:03.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.100+0000 7ff687d0e700 1 -- 172.21.2.102:0/1399772663 >> 172.21.2.102:0/1399772663 conn(0x7ff680061830 msgr2=0x7ff6800bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:03.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.100+0000 7ff687d0e700 1 -- 172.21.2.102:0/1399772663 shutdown_connections 2021-02-12T17:16:03.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.100+0000 7ff687d0e700 1 -- 172.21.2.102:0/1399772663 wait complete. 2021-02-12T17:16:03.106 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.101+0000 7ff687d0e700 1 Processor -- start 2021-02-12T17:16:03.106 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.101+0000 7ff687d0e700 1 -- start start 2021-02-12T17:16:03.106 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff687d0e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff68009ada0 0x7ff680149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:03.106 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff687d0e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff6800b0940 0x7ff6801486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:03.106 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff687d0e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff6800bc2b0 0x7ff680148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:03.106 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff687d0e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff680150850 con 0x7ff6800b0940 2021-02-12T17:16:03.106 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff687d0e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6801505b0 con 0x7ff6800bc2b0 2021-02-12T17:16:03.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff687d0e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff680061fc0 con 0x7ff68009ada0 2021-02-12T17:16:03.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff6852a9700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff6800b0940 0x7ff6801486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:03.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff6852a9700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff6800b0940 0x7ff6801486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44352/0 (socket says 172.21.2.102:44352) 2021-02-12T17:16:03.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff6852a9700 1 -- 172.21.2.102:0/457079047 learned_addr learned my addr 172.21.2.102:0/457079047 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:03.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff6852a9700 1 -- 172.21.2.102:0/457079047 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff68009ada0 msgr2=0x7ff680149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:03.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff685aaa700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff68009ada0 0x7ff680149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:03.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff6862ab700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff6800bc2b0 0x7ff680148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:03.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff6852a9700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff68009ada0 0x7ff680149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:03.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff6852a9700 1 -- 172.21.2.102:0/457079047 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff6800bc2b0 msgr2=0x7ff680148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:03.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff6852a9700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff6800bc2b0 0x7ff680148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:03.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff6852a9700 1 -- 172.21.2.102:0/457079047 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff680062260 con 0x7ff6800b0940 2021-02-12T17:16:03.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff685aaa700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff68009ada0 0x7ff680149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:03.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff6852a9700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff6800b0940 0x7ff6801486f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff67000cb50 tx=0x7ff670008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:03.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff6862ab700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff6800bc2b0 0x7ff680148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:03.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff66dffb700 1 -- 172.21.2.102:0/457079047 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670007740 con 0x7ff6800b0940 2021-02-12T17:16:03.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff66dffb700 1 -- 172.21.2.102:0/457079047 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6700078a0 con 0x7ff6800b0940 2021-02-12T17:16:03.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff66dffb700 1 -- 172.21.2.102:0/457079047 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670007c20 con 0x7ff6800b0940 2021-02-12T17:16:03.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff687d0e700 1 -- 172.21.2.102:0/457079047 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff680062500 con 0x7ff6800b0940 2021-02-12T17:16:03.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.102+0000 7ff687d0e700 1 -- 172.21.2.102:0/457079047 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6801490d0 con 0x7ff6800b0940 2021-02-12T17:16:03.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.103+0000 7ff687d0e700 1 -- 172.21.2.102:0/457079047 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6800628c0 con 0x7ff6800b0940 2021-02-12T17:16:03.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.103+0000 7ff66dffb700 1 -- 172.21.2.102:0/457079047 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7ff67001b460 con 0x7ff6800b0940 2021-02-12T17:16:03.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.103+0000 7ff66dffb700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff660059d30 0x7ff66005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:03.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.103+0000 7ff66dffb700 1 -- 172.21.2.102:0/457079047 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6049+0+0 (secure 0 0 0) 0x7ff670073b90 con 0x7ff6800b0940 2021-02-12T17:16:03.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.103+0000 7ff685aaa700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff660059d30 0x7ff66005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:03.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.104+0000 7ff685aaa700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff660059d30 0x7ff66005c1f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff67c007fd0 tx=0x7ff67c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:03.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.106+0000 7ff66dffb700 1 -- 172.21.2.102:0/457079047 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7ff670047680 con 0x7ff6800b0940 2021-02-12T17:16:03.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:03.266+0000 7ff687d0e700 1 -- 172.21.2.102:0/457079047 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7ff680062690 con 0x7ff6800b0940 2021-02-12T17:16:03.700 INFO:tasks.ceph.mds.c.gibba002.stderr:2021-02-12T17:16:03.699+0000 7f69e2f9b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-02-12T17:16:04.005 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.004+0000 7ff66dffb700 1 -- 172.21.2.102:0/457079047 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"}]=0 v6) v1 ==== 110+0+0 (secure 0 0 0) 0x7ff67004aca0 con 0x7ff6800b0940 2021-02-12T17:16:04.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.006+0000 7ff687d0e700 1 -- 172.21.2.102:0/457079047 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff660059d30 msgr2=0x7ff66005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.006+0000 7ff687d0e700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff660059d30 0x7ff66005c1f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff67c007fd0 tx=0x7ff67c016000).stop 2021-02-12T17:16:04.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.006+0000 7ff687d0e700 1 -- 172.21.2.102:0/457079047 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff6800b0940 msgr2=0x7ff6801486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.006+0000 7ff687d0e700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff6800b0940 0x7ff6801486f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff67000cb50 tx=0x7ff670008040).stop 2021-02-12T17:16:04.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.006+0000 7ff687d0e700 1 -- 172.21.2.102:0/457079047 shutdown_connections 2021-02-12T17:16:04.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.006+0000 7ff687d0e700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff6800bc2b0 0x7ff680148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.006+0000 7ff687d0e700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff68009ada0 0x7ff680149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.006+0000 7ff687d0e700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff660059d30 0x7ff66005c1f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.006+0000 7ff687d0e700 1 --2- 172.21.2.102:0/457079047 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff6800b0940 0x7ff6801486f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.006+0000 7ff687d0e700 1 -- 172.21.2.102:0/457079047 >> 172.21.2.102:0/457079047 conn(0x7ff680061830 msgr2=0x7ff68014ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:04.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.006+0000 7ff687d0e700 1 -- 172.21.2.102:0/457079047 shutdown_connections 2021-02-12T17:16:04.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.006+0000 7ff687d0e700 1 -- 172.21.2.102:0/457079047 wait complete. 2021-02-12T17:16:04.016 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:16:04.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.102+0000 7f47f0c48700 1 Processor -- start 2021-02-12T17:16:04.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.102+0000 7f47f0c48700 1 -- start start 2021-02-12T17:16:04.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.103+0000 7f47f0c48700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f47ec0b8d20 0x7f47ec068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.105 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.103+0000 7f47f0c48700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec0b7960 con 0x7f47ec062740 2021-02-12T17:16:04.105 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.103+0000 7f47f0c48700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec0622a0 con 0x7f47ec14e530 2021-02-12T17:16:04.105 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.103+0000 7f47f0c48700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec068d20 con 0x7f47ec0b8d20 2021-02-12T17:16:04.105 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.103+0000 7f47ead9d700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f47ec062740 0x7f47ec062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53006/0 (socket says 172.21.2.102:53006) 2021-02-12T17:16:04.105 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.103+0000 7f47ead9d700 1 -- 172.21.2.102:0/729674113 learned_addr learned my addr 172.21.2.102:0/729674113 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:04.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 -- 172.21.2.102:0/729674113 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309903062 0 0) 0x7f47ec0b7960 con 0x7f47ec062740 2021-02-12T17:16:04.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 -- 172.21.2.102:0/729674113 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47d0003230 con 0x7f47ec062740 2021-02-12T17:16:04.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47ea59c700 1 --2- 172.21.2.102:0/729674113 >> v2:172.21.2.104:3300/0 conn(0x7f47ec0b8d20 0x7f47ec068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 -- 172.21.2.102:0/729674113 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1803004248 0 0) 0x7f47d0003230 con 0x7f47ec062740 2021-02-12T17:16:04.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 -- 172.21.2.102:0/729674113 >> v2:172.21.2.104:3300/0 conn(0x7f47ec0b8d20 msgr2=0x7f47ec068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:04.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 --2- 172.21.2.102:0/729674113 >> v2:172.21.2.104:3300/0 conn(0x7f47ec0b8d20 0x7f47ec068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 -- 172.21.2.102:0/729674113 >> v1:172.21.2.104:6789/0 conn(0x7f47ec14e530 legacy=0x7f47ec0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 -- 172.21.2.102:0/729674113 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec14ea10 con 0x7f47ec062740 2021-02-12T17:16:04.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 -- 172.21.2.102:0/729674113 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f47dc0014e0 con 0x7f47ec062740 2021-02-12T17:16:04.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 -- 172.21.2.102:0/729674113 >> v1:172.21.2.102:6789/0 conn(0x7f47ec062740 legacy=0x7f47ec062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 --2- 172.21.2.102:0/729674113 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f47d0003720 0x7f47d0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 --2- 172.21.2.102:0/729674113 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f47d00044d0 0x7f47d0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 --2- 172.21.2.102:0/729674113 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f47d0004e40 0x7f47d000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 -- 172.21.2.102:0/729674113 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec068d20 con 0x7f47d00044d0 2021-02-12T17:16:04.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 -- 172.21.2.102:0/729674113 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d0004250 con 0x7f47d0004e40 2021-02-12T17:16:04.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e959a700 1 -- 172.21.2.102:0/729674113 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d000bc10 con 0x7f47d0003720 2021-02-12T17:16:04.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e9d9b700 1 --2- 172.21.2.102:0/729674113 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f47d00044d0 0x7f47d0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47ead9d700 1 --2- 172.21.2.102:0/729674113 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f47d0004e40 0x7f47d000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47ea59c700 1 --2- 172.21.2.102:0/729674113 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f47d0003720 0x7f47d0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e9d9b700 1 -- 172.21.2.102:0/729674113 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f47d0003720 msgr2=0x7f47d0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:04.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e9d9b700 1 --2- 172.21.2.102:0/729674113 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f47d0003720 0x7f47d0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e9d9b700 1 -- 172.21.2.102:0/729674113 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f47d0004e40 msgr2=0x7f47d000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:04.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e9d9b700 1 --2- 172.21.2.102:0/729674113 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f47d0004e40 0x7f47d000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47ead9d700 1 -- 172.21.2.102:0/729674113 reap_dead start 2021-02-12T17:16:04.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.104+0000 7f47e9d9b700 1 -- 172.21.2.102:0/729674113 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec14ea10 con 0x7f47d00044d0 2021-02-12T17:16:04.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.105+0000 7f47e9d9b700 1 --2- 172.21.2.102:0/729674113 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f47d00044d0 0x7f47d0004950 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f47e0001920 tx=0x7f47e0007b80).ready entity=mon.0 client_cookie=b4739a78d1795844 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:04.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.105+0000 7f47e959a700 1 -- 172.21.2.102:0/729674113 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0007020 con 0x7f47d00044d0 2021-02-12T17:16:04.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.105+0000 7f47e959a700 1 -- 172.21.2.102:0/729674113 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e0007180 con 0x7f47d00044d0 2021-02-12T17:16:04.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.105+0000 7f47e959a700 1 -- 172.21.2.102:0/729674113 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000c650 con 0x7f47d00044d0 2021-02-12T17:16:04.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.105+0000 7f47f0c48700 1 -- 172.21.2.102:0/729674113 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f47d00044d0 msgr2=0x7f47d0004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.105+0000 7f47f0c48700 1 --2- 172.21.2.102:0/729674113 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f47d00044d0 0x7f47d0004950 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f47e0001920 tx=0x7f47e0007b80).stop 2021-02-12T17:16:04.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.105+0000 7f47f0c48700 1 -- 172.21.2.102:0/729674113 shutdown_connections 2021-02-12T17:16:04.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.105+0000 7f47f0c48700 1 --2- 172.21.2.102:0/729674113 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f47d00044d0 0x7f47d0004950 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.105+0000 7f47f0c48700 1 -- 172.21.2.102:0/729674113 >> 172.21.2.102:0/729674113 conn(0x7f47ec0bc480 msgr2=0x7f47ec0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:04.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.105+0000 7f47f0c48700 1 -- 172.21.2.102:0/729674113 shutdown_connections 2021-02-12T17:16:04.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.105+0000 7f47f0c48700 1 -- 172.21.2.102:0/729674113 wait complete. 2021-02-12T17:16:04.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.106+0000 7f47f0c48700 1 Processor -- start 2021-02-12T17:16:04.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.106+0000 7f47f0c48700 1 -- start start 2021-02-12T17:16:04.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.106+0000 7f47f0c48700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f47d00044d0 0x7f47ec0b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47f0c48700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f47ec160790 0x7f47ec0b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47f0c48700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f47ec1498a0 0x7f47ec149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47f0c48700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0b14e0 con 0x7f47d00044d0 2021-02-12T17:16:04.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47f0c48700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0afd90 con 0x7f47ec160790 2021-02-12T17:16:04.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47f0c48700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0b0030 con 0x7f47ec1498a0 2021-02-12T17:16:04.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47ea59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f47d00044d0 0x7f47ec0b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47ea59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f47d00044d0 0x7f47ec0b1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44372/0 (socket says 172.21.2.102:44372) 2021-02-12T17:16:04.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47ea59c700 1 -- 172.21.2.102:0/142834771 learned_addr learned my addr 172.21.2.102:0/142834771 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:04.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47e9d9b700 1 --2- 172.21.2.102:0/142834771 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f47ec160790 0x7f47ec0b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47ead9d700 1 --2- 172.21.2.102:0/142834771 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f47ec1498a0 0x7f47ec149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47ea59c700 1 -- 172.21.2.102:0/142834771 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f47ec1498a0 msgr2=0x7f47ec149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47ea59c700 1 --2- 172.21.2.102:0/142834771 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f47ec1498a0 0x7f47ec149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47ea59c700 1 -- 172.21.2.102:0/142834771 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f47ec160790 msgr2=0x7f47ec0b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47ea59c700 1 --2- 172.21.2.102:0/142834771 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f47ec160790 0x7f47ec0b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47ea59c700 1 -- 172.21.2.102:0/142834771 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec14ef10 con 0x7f47d00044d0 2021-02-12T17:16:04.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47ea59c700 1 --2- 172.21.2.102:0/142834771 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f47d00044d0 0x7f47ec0b1930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f47e4010fa0 tx=0x7f47e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:04.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47da7fc700 1 -- 172.21.2.102:0/142834771 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e400eb80 con 0x7f47d00044d0 2021-02-12T17:16:04.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47da7fc700 1 -- 172.21.2.102:0/142834771 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e400ece0 con 0x7f47d00044d0 2021-02-12T17:16:04.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47da7fc700 1 -- 172.21.2.102:0/142834771 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4014640 con 0x7f47d00044d0 2021-02-12T17:16:04.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47f0c48700 1 -- 172.21.2.102:0/142834771 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec14f1b0 con 0x7f47d00044d0 2021-02-12T17:16:04.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.107+0000 7f47f0c48700 1 -- 172.21.2.102:0/142834771 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ec0b1e20 con 0x7f47d00044d0 2021-02-12T17:16:04.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.108+0000 7f47f0c48700 1 -- 172.21.2.102:0/142834771 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ec045460 con 0x7f47d00044d0 2021-02-12T17:16:04.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.108+0000 7f47da7fc700 1 -- 172.21.2.102:0/142834771 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f47e4024070 con 0x7f47d00044d0 2021-02-12T17:16:04.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.108+0000 7f47da7fc700 1 --2- 172.21.2.102:0/142834771 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f47c8059d30 0x7f47c805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.108+0000 7f47da7fc700 1 -- 172.21.2.102:0/142834771 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f47e40741a0 con 0x7f47d00044d0 2021-02-12T17:16:04.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.109+0000 7f47e9d9b700 1 --2- 172.21.2.102:0/142834771 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f47c8059d30 0x7f47c805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.109+0000 7f47e9d9b700 1 --2- 172.21.2.102:0/142834771 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f47c8059d30 0x7f47c805c1f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f47e0001920 tx=0x7f47e0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:04.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.111+0000 7f47da7fc700 1 -- 172.21.2.102:0/142834771 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f47e4047cf0 con 0x7f47d00044d0 2021-02-12T17:16:04.273 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.272+0000 7f47f0c48700 1 -- 172.21.2.102:0/142834771 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47ec063670 con 0x7f47d00044d0 2021-02-12T17:16:04.274 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.272+0000 7f47da7fc700 1 -- 172.21.2.102:0/142834771 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2825 (secure 0 0 0) 0x7f47e4022070 con 0x7f47d00044d0 2021-02-12T17:16:04.274 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:04.274 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1}]} 2021-02-12T17:16:04.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.274+0000 7f47f0c48700 1 -- 172.21.2.102:0/142834771 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f47c8059d30 msgr2=0x7f47c805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.274+0000 7f47f0c48700 1 --2- 172.21.2.102:0/142834771 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f47c8059d30 0x7f47c805c1f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f47e0001920 tx=0x7f47e0015000).stop 2021-02-12T17:16:04.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.274+0000 7f47f0c48700 1 -- 172.21.2.102:0/142834771 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f47d00044d0 msgr2=0x7f47ec0b1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.274+0000 7f47f0c48700 1 --2- 172.21.2.102:0/142834771 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f47d00044d0 0x7f47ec0b1930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f47e4010fa0 tx=0x7f47e4008040).stop 2021-02-12T17:16:04.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.274+0000 7f47f0c48700 1 -- 172.21.2.102:0/142834771 shutdown_connections 2021-02-12T17:16:04.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.274+0000 7f47f0c48700 1 --2- 172.21.2.102:0/142834771 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f47ec1498a0 0x7f47ec149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.274+0000 7f47f0c48700 1 --2- 172.21.2.102:0/142834771 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f47c8059d30 0x7f47c805c1f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.274+0000 7f47f0c48700 1 --2- 172.21.2.102:0/142834771 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f47d00044d0 0x7f47ec0b1930 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.276 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.274+0000 7f47f0c48700 1 --2- 172.21.2.102:0/142834771 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f47ec160790 0x7f47ec0b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.276 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.274+0000 7f47f0c48700 1 -- 172.21.2.102:0/142834771 >> 172.21.2.102:0/142834771 conn(0x7f47ec0bc480 msgr2=0x7f47ec14d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:04.276 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.274+0000 7f47f0c48700 1 -- 172.21.2.102:0/142834771 shutdown_connections 2021-02-12T17:16:04.276 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.274+0000 7f47f0c48700 1 -- 172.21.2.102:0/142834771 wait complete. 2021-02-12T17:16:04.276 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 6 2021-02-12T17:16:04.284 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:04.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.368+0000 7fb42b0cc700 1 Processor -- start 2021-02-12T17:16:04.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.368+0000 7fb42b0cc700 1 -- start start 2021-02-12T17:16:04.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.369+0000 7fb42b0cc700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fb4240b7750 0x7fb4240b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.369+0000 7fb42b0cc700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4240b8b60 0x7fb424145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.369+0000 7fb42b0cc700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4240b7fd0 con 0x7fb4240b4e10 2021-02-12T17:16:04.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.369+0000 7fb42b0cc700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4240b6ef0 con 0x7fb4240b7750 2021-02-12T17:16:04.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.369+0000 7fb42b0cc700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240b7d30 con 0x7fb4240b8b60 2021-02-12T17:16:04.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.369+0000 7fb428e68700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fb4240b4e10 0x7fb4240b58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53024/0 (socket says 172.21.2.102:53024) 2021-02-12T17:16:04.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.369+0000 7fb428e68700 1 -- 172.21.2.102:0/3759287081 learned_addr learned my addr 172.21.2.102:0/3759287081 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:04.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.369+0000 7fb423fff700 1 --2- 172.21.2.102:0/3759287081 >> v2:172.21.2.104:3300/0 conn(0x7fb4240b7750 0x7fb4240b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb429669700 1 --2- 172.21.2.102:0/3759287081 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4240b8b60 0x7fb424145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 -- 172.21.2.102:0/3759287081 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427121508 0 0) 0x7fb4240b7fd0 con 0x7fb4240b4e10 2021-02-12T17:16:04.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 -- 172.21.2.102:0/3759287081 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb410003230 con 0x7fb4240b4e10 2021-02-12T17:16:04.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 -- 172.21.2.102:0/3759287081 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1765486068 0 0) 0x7fb410003230 con 0x7fb4240b4e10 2021-02-12T17:16:04.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 -- 172.21.2.102:0/3759287081 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4240b8b60 msgr2=0x7fb424145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:04.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 --2- 172.21.2.102:0/3759287081 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4240b8b60 0x7fb424145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 -- 172.21.2.102:0/3759287081 >> v2:172.21.2.104:3300/0 conn(0x7fb4240b7750 msgr2=0x7fb4240b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:04.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 --2- 172.21.2.102:0/3759287081 >> v2:172.21.2.104:3300/0 conn(0x7fb4240b7750 0x7fb4240b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 -- 172.21.2.102:0/3759287081 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4240b6510 con 0x7fb4240b4e10 2021-02-12T17:16:04.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 -- 172.21.2.102:0/3759287081 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fb4140014e0 con 0x7fb4240b4e10 2021-02-12T17:16:04.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 -- 172.21.2.102:0/3759287081 >> v1:172.21.2.102:6789/0 conn(0x7fb4240b4e10 legacy=0x7fb4240b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 --2- 172.21.2.102:0/3759287081 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4100037a0 0x7fb410003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 --2- 172.21.2.102:0/3759287081 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb4100044d0 0x7fb410004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 --2- 172.21.2.102:0/3759287081 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4240b8b60 0x7fb410004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 -- 172.21.2.102:0/3759287081 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240b6ef0 con 0x7fb4100037a0 2021-02-12T17:16:04.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 -- 172.21.2.102:0/3759287081 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240b7d30 con 0x7fb4100044d0 2021-02-12T17:16:04.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb4237fe700 1 -- 172.21.2.102:0/3759287081 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb410005330 con 0x7fb4240b8b60 2021-02-12T17:16:04.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb423fff700 1 --2- 172.21.2.102:0/3759287081 >> v2:172.21.2.104:3300/0 conn(0x7fb4240b7750 0x7fb4240b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:04.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb428e68700 1 --2- 172.21.2.102:0/3759287081 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4100037a0 0x7fb410003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb423fff700 1 --2- 172.21.2.102:0/3759287081 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb4100044d0 0x7fb410004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb428e68700 1 -- 172.21.2.102:0/3759287081 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4240b8b60 msgr2=0x7fb410004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:04.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb428e68700 1 --2- 172.21.2.102:0/3759287081 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4240b8b60 0x7fb410004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:04.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb428e68700 1 -- 172.21.2.102:0/3759287081 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb4100044d0 msgr2=0x7fb410004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:04.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb428e68700 1 --2- 172.21.2.102:0/3759287081 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb4100044d0 0x7fb410004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb428e68700 1 -- 172.21.2.102:0/3759287081 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb410003230 con 0x7fb4100037a0 2021-02-12T17:16:04.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.370+0000 7fb428e68700 1 --2- 172.21.2.102:0/3759287081 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4100037a0 0x7fb410003bc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fb41400c210 tx=0x7fb414007740).ready entity=mon.0 client_cookie=e0cba1aaae9ab381 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:04.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.371+0000 7fb4237fe700 1 -- 172.21.2.102:0/3759287081 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4140070d0 con 0x7fb4100037a0 2021-02-12T17:16:04.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.371+0000 7fb4237fe700 1 -- 172.21.2.102:0/3759287081 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb414007230 con 0x7fb4100037a0 2021-02-12T17:16:04.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.371+0000 7fb4237fe700 1 -- 172.21.2.102:0/3759287081 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4140055e0 con 0x7fb4100037a0 2021-02-12T17:16:04.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.371+0000 7fb42b0cc700 1 -- 172.21.2.102:0/3759287081 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4100037a0 msgr2=0x7fb410003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.371+0000 7fb42b0cc700 1 --2- 172.21.2.102:0/3759287081 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4100037a0 0x7fb410003bc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fb41400c210 tx=0x7fb414007740).stop 2021-02-12T17:16:04.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.371+0000 7fb429669700 1 -- 172.21.2.102:0/3759287081 reap_dead start 2021-02-12T17:16:04.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.371+0000 7fb42b0cc700 1 -- 172.21.2.102:0/3759287081 shutdown_connections 2021-02-12T17:16:04.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.371+0000 7fb42b0cc700 1 -- 172.21.2.102:0/3759287081 >> 172.21.2.102:0/3759287081 conn(0x7fb4240bc480 msgr2=0x7fb4240b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:04.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.371+0000 7fb42b0cc700 1 -- 172.21.2.102:0/3759287081 shutdown_connections 2021-02-12T17:16:04.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.371+0000 7fb42b0cc700 1 -- 172.21.2.102:0/3759287081 wait complete. 2021-02-12T17:16:04.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.372+0000 7fb42b0cc700 1 Processor -- start 2021-02-12T17:16:04.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.372+0000 7fb42b0cc700 1 -- start start 2021-02-12T17:16:04.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.372+0000 7fb42b0cc700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb424159680 0x7fb424149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.372+0000 7fb42b0cc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb424147600 0x7fb42415c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.372+0000 7fb42b0cc700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb424147a50 0x7fb42415c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.372+0000 7fb42b0cc700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240b13c0 con 0x7fb424147600 2021-02-12T17:16:04.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.372+0000 7fb42b0cc700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240b1b30 con 0x7fb424147a50 2021-02-12T17:16:04.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.372+0000 7fb42b0cc700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb424141020 con 0x7fb424159680 2021-02-12T17:16:04.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.372+0000 7fb423fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb424147600 0x7fb42415c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.372+0000 7fb423fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb424147600 0x7fb42415c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44396/0 (socket says 172.21.2.102:44396) 2021-02-12T17:16:04.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.372+0000 7fb423fff700 1 -- 172.21.2.102:0/1982531172 learned_addr learned my addr 172.21.2.102:0/1982531172 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:04.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.373+0000 7fb429669700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb424147a50 0x7fb42415c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.373+0000 7fb428e68700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb424159680 0x7fb424149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.373+0000 7fb423fff700 1 -- 172.21.2.102:0/1982531172 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb424159680 msgr2=0x7fb424149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.373+0000 7fb423fff700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb424159680 0x7fb424149ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.373+0000 7fb423fff700 1 -- 172.21.2.102:0/1982531172 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb424147a50 msgr2=0x7fb42415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.373+0000 7fb423fff700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb424147a50 0x7fb42415c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.380 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.373+0000 7fb423fff700 1 -- 172.21.2.102:0/1982531172 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb424158ae0 con 0x7fb424147600 2021-02-12T17:16:04.380 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.373+0000 7fb429669700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb424147a50 0x7fb42415c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:04.380 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.373+0000 7fb423fff700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb424147600 0x7fb42415c420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb418002f00 tx=0x7fb418008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:04.380 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.373+0000 7fb420ff9700 1 -- 172.21.2.102:0/1982531172 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41800b630 con 0x7fb424147600 2021-02-12T17:16:04.380 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.373+0000 7fb420ff9700 1 -- 172.21.2.102:0/1982531172 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41800b790 con 0x7fb424147600 2021-02-12T17:16:04.380 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.373+0000 7fb42b0cc700 1 -- 172.21.2.102:0/1982531172 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb424148120 con 0x7fb424147600 2021-02-12T17:16:04.380 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.373+0000 7fb420ff9700 1 -- 172.21.2.102:0/1982531172 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41800bb10 con 0x7fb424147600 2021-02-12T17:16:04.380 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.373+0000 7fb42b0cc700 1 -- 172.21.2.102:0/1982531172 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4240b1890 con 0x7fb424147600 2021-02-12T17:16:04.380 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.374+0000 7fb42b0cc700 1 -- 172.21.2.102:0/1982531172 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb424159ac0 con 0x7fb424147600 2021-02-12T17:16:04.380 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.374+0000 7fb420ff9700 1 -- 172.21.2.102:0/1982531172 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fb418023070 con 0x7fb424147600 2021-02-12T17:16:04.380 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.374+0000 7fb420ff9700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb404059d30 0x7fb40405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.380 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.374+0000 7fb420ff9700 1 -- 172.21.2.102:0/1982531172 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fb418073d40 con 0x7fb424147600 2021-02-12T17:16:04.380 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.374+0000 7fb428e68700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb404059d30 0x7fb40405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.381 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.375+0000 7fb428e68700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb404059d30 0x7fb40405c1f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb41400c210 tx=0x7fb414015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:04.381 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.377+0000 7fb420ff9700 1 -- 172.21.2.102:0/1982531172 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fb418047780 con 0x7fb424147600 2021-02-12T17:16:04.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.505+0000 7fb42b0cc700 1 -- 172.21.2.102:0/1982531172 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb424045460 con 0x7fb424147600 2021-02-12T17:16:04.507 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.506+0000 7fb420ff9700 1 -- 172.21.2.102:0/1982531172 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16757 (secure 0 0 0) 0x7fb418017030 con 0x7fb424147600 2021-02-12T17:16:04.507 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:04.508 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":23,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:03.999204+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:04.508 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.507+0000 7fb42b0cc700 1 -- 172.21.2.102:0/1982531172 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb404059d30 msgr2=0x7fb40405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.507+0000 7fb42b0cc700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb404059d30 0x7fb40405c1f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb41400c210 tx=0x7fb414015000).stop 2021-02-12T17:16:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.507+0000 7fb42b0cc700 1 -- 172.21.2.102:0/1982531172 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb424147600 msgr2=0x7fb42415c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.507+0000 7fb42b0cc700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb424147600 0x7fb42415c420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb418002f00 tx=0x7fb418008040).stop 2021-02-12T17:16:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.507+0000 7fb42b0cc700 1 -- 172.21.2.102:0/1982531172 shutdown_connections 2021-02-12T17:16:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.507+0000 7fb42b0cc700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb424147a50 0x7fb42415c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.507+0000 7fb42b0cc700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb424159680 0x7fb424149ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.507+0000 7fb42b0cc700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb404059d30 0x7fb40405c1f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.507+0000 7fb42b0cc700 1 --2- 172.21.2.102:0/1982531172 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb424147600 0x7fb42415c420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.507+0000 7fb42b0cc700 1 -- 172.21.2.102:0/1982531172 >> 172.21.2.102:0/1982531172 conn(0x7fb4240bc480 msgr2=0x7fb424145760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.507+0000 7fb42b0cc700 1 -- 172.21.2.102:0/1982531172 shutdown_connections 2021-02-12T17:16:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.507+0000 7fb42b0cc700 1 -- 172.21.2.102:0/1982531172 wait complete. 2021-02-12T17:16:04.517 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true 2021-02-12T17:16:04.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.605+0000 7f4617b92700 1 Processor -- start 2021-02-12T17:16:04.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.605+0000 7f4617b92700 1 -- start start 2021-02-12T17:16:04.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.606+0000 7f4617b92700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f46100bc2b0 0x7f4610151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.606+0000 7f4617b92700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f4610151d20 0x7f461014e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.606+0000 7f4617b92700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4610066b70 con 0x7f46100b0940 2021-02-12T17:16:04.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.606+0000 7f4617b92700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46100b27d0 con 0x7f4610151d20 2021-02-12T17:16:04.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.606+0000 7f4617b92700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461014e550 con 0x7f46100bc2b0 2021-02-12T17:16:04.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.606+0000 7f461612f700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f4610151d20 0x7f461014e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.606+0000 7f461612f700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f4610151d20 0x7f461014e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44404/0 (socket says 172.21.2.102:44404) 2021-02-12T17:16:04.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.606+0000 7f461612f700 1 -- 172.21.2.102:0/327331848 learned_addr learned my addr 172.21.2.102:0/327331848 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:04.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.606+0000 7f461612f700 1 -- 172.21.2.102:0/327331848 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f46100bc2b0 msgr2=0x7f4610151120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:04.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.606+0000 7f461612f700 1 --2- 172.21.2.102:0/327331848 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f46100bc2b0 0x7f4610151120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:04.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.606+0000 7f461612f700 1 -- 172.21.2.102:0/327331848 >> v1:172.21.2.102:6789/0 conn(0x7f46100b0940 legacy=0x7f4610151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.606+0000 7f461612f700 1 -- 172.21.2.102:0/327331848 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46100685b0 con 0x7f4610151d20 2021-02-12T17:16:04.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.606+0000 7f461612f700 1 --2- 172.21.2.102:0/327331848 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4610151d20 0x7f461014e060 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f4608009d50 tx=0x7f4608009290).ready entity=mon.0 client_cookie=7af05ede0a08cc85 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:04.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.606+0000 7f461492c700 1 -- 172.21.2.102:0/327331848 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460800bc80 con 0x7f4610151d20 2021-02-12T17:16:04.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.607+0000 7f461492c700 1 -- 172.21.2.102:0/327331848 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460800bde0 con 0x7f4610151d20 2021-02-12T17:16:04.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.607+0000 7f461492c700 1 -- 172.21.2.102:0/327331848 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4608011610 con 0x7f4610151d20 2021-02-12T17:16:04.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.607+0000 7f4617b92700 1 -- 172.21.2.102:0/327331848 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4610151d20 msgr2=0x7f461014e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.607+0000 7f4617b92700 1 --2- 172.21.2.102:0/327331848 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4610151d20 0x7f461014e060 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f4608009d50 tx=0x7f4608009290).stop 2021-02-12T17:16:04.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.607+0000 7f4617b92700 1 -- 172.21.2.102:0/327331848 shutdown_connections 2021-02-12T17:16:04.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.607+0000 7f4617b92700 1 --2- 172.21.2.102:0/327331848 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4610151d20 0x7f461014e060 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.607+0000 7f4617b92700 1 --2- 172.21.2.102:0/327331848 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f46100bc2b0 0x7f4610151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:04.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.607+0000 7f4617b92700 1 -- 172.21.2.102:0/327331848 >> 172.21.2.102:0/327331848 conn(0x7f4610061830 msgr2=0x7f46100bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:04.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.607+0000 7f4617b92700 1 -- 172.21.2.102:0/327331848 shutdown_connections 2021-02-12T17:16:04.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.607+0000 7f4617b92700 1 -- 172.21.2.102:0/327331848 wait complete. 2021-02-12T17:16:04.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.608+0000 7f4617b92700 1 Processor -- start 2021-02-12T17:16:04.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.608+0000 7f4617b92700 1 -- start start 2021-02-12T17:16:04.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.608+0000 7f4617b92700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f46100b0940 0x7f461009f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.608+0000 7f4617b92700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f46100bc2b0 0x7f46100a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.608+0000 7f4617b92700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4610151d20 0x7f46100a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.608+0000 7f4617b92700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46100b2d30 con 0x7f46100b0940 2021-02-12T17:16:04.613 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.608+0000 7f4617b92700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46100b2f60 con 0x7f4610151d20 2021-02-12T17:16:04.613 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.608+0000 7f4617b92700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46100b3200 con 0x7f46100bc2b0 2021-02-12T17:16:04.613 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f461592e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f46100b0940 0x7f461009f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.613 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f461592e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f46100b0940 0x7f461009f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44408/0 (socket says 172.21.2.102:44408) 2021-02-12T17:16:04.613 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f461592e700 1 -- 172.21.2.102:0/3543061241 learned_addr learned my addr 172.21.2.102:0/3543061241 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:04.613 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f461612f700 1 --2- 172.21.2.102:0/3543061241 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4610151d20 0x7f46100a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.613 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f461512d700 1 --2- 172.21.2.102:0/3543061241 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f46100bc2b0 0x7f46100a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.613 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f461592e700 1 -- 172.21.2.102:0/3543061241 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f46100bc2b0 msgr2=0x7f46100a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.613 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f461592e700 1 --2- 172.21.2.102:0/3543061241 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f46100bc2b0 0x7f46100a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f461592e700 1 -- 172.21.2.102:0/3543061241 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4610151d20 msgr2=0x7f46100a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:04.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f461592e700 1 --2- 172.21.2.102:0/3543061241 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4610151d20 0x7f46100a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:04.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f461592e700 1 -- 172.21.2.102:0/3543061241 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46100b5110 con 0x7f46100b0940 2021-02-12T17:16:04.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f461592e700 1 --2- 172.21.2.102:0/3543061241 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f46100b0940 0x7f461009f300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f460c0096b0 tx=0x7f460c006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:04.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f45fdffb700 1 -- 172.21.2.102:0/3543061241 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c00d500 con 0x7f46100b0940 2021-02-12T17:16:04.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f45fdffb700 1 -- 172.21.2.102:0/3543061241 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c00d680 con 0x7f46100b0940 2021-02-12T17:16:04.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f4617b92700 1 -- 172.21.2.102:0/3543061241 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46100b53b0 con 0x7f46100b0940 2021-02-12T17:16:04.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.609+0000 7f45fdffb700 1 -- 172.21.2.102:0/3543061241 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c00da40 con 0x7f46100b0940 2021-02-12T17:16:04.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.610+0000 7f4617b92700 1 -- 172.21.2.102:0/3543061241 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461009f7f0 con 0x7f46100b0940 2021-02-12T17:16:04.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.610+0000 7f4617b92700 1 -- 172.21.2.102:0/3543061241 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4610045460 con 0x7f46100b0940 2021-02-12T17:16:04.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.610+0000 7f45fdffb700 1 -- 172.21.2.102:0/3543061241 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f460c012420 con 0x7f46100b0940 2021-02-12T17:16:04.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.610+0000 7f45fdffb700 1 --2- 172.21.2.102:0/3543061241 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f45f0059d30 0x7f45f005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:04.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.611+0000 7f45fdffb700 1 -- 172.21.2.102:0/3543061241 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f460c0738b0 con 0x7f46100b0940 2021-02-12T17:16:04.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.611+0000 7f461512d700 1 --2- 172.21.2.102:0/3543061241 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f45f0059d30 0x7f45f005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:04.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.611+0000 7f461512d700 1 --2- 172.21.2.102:0/3543061241 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f45f0059d30 0x7f45f005c1f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f46101618d0 tx=0x7f4600009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:04.616 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.613+0000 7f45fdffb700 1 -- 172.21.2.102:0/3543061241 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f460c0473a0 con 0x7f46100b0940 2021-02-12T17:16:04.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:04.772+0000 7f4617b92700 1 -- 172.21.2.102:0/3543061241 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true"} v 0) v1 -- 0x7f461009f170 con 0x7f46100b0940 2021-02-12T17:16:05.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.006+0000 7f45fdffb700 1 -- 172.21.2.102:0/3543061241 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true"}]=0 v7) v1 ==== 106+0+0 (secure 0 0 0) 0x7f460c00ddb0 con 0x7f46100b0940 2021-02-12T17:16:05.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.008+0000 7f4617b92700 1 -- 172.21.2.102:0/3543061241 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f45f0059d30 msgr2=0x7f45f005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.008+0000 7f4617b92700 1 --2- 172.21.2.102:0/3543061241 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f45f0059d30 0x7f45f005c1f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f46101618d0 tx=0x7f4600009040).stop 2021-02-12T17:16:05.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.008+0000 7f4617b92700 1 -- 172.21.2.102:0/3543061241 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f46100b0940 msgr2=0x7f461009f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.008+0000 7f4617b92700 1 --2- 172.21.2.102:0/3543061241 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f46100b0940 0x7f461009f300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f460c0096b0 tx=0x7f460c006de0).stop 2021-02-12T17:16:05.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.008+0000 7f4617b92700 1 -- 172.21.2.102:0/3543061241 shutdown_connections 2021-02-12T17:16:05.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.008+0000 7f4617b92700 1 --2- 172.21.2.102:0/3543061241 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4610151d20 0x7f46100a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.008+0000 7f4617b92700 1 --2- 172.21.2.102:0/3543061241 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f45f0059d30 0x7f45f005c1f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.008+0000 7f4617b92700 1 --2- 172.21.2.102:0/3543061241 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f46100b0940 0x7f461009f300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.008+0000 7f4617b92700 1 --2- 172.21.2.102:0/3543061241 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f46100bc2b0 0x7f46100a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.008+0000 7f4617b92700 1 -- 172.21.2.102:0/3543061241 >> 172.21.2.102:0/3543061241 conn(0x7f4610061830 msgr2=0x7f461009dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:05.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.008+0000 7f4617b92700 1 -- 172.21.2.102:0/3543061241 shutdown_connections 2021-02-12T17:16:05.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.008+0000 7f4617b92700 1 -- 172.21.2.102:0/3543061241 wait complete. 2021-02-12T17:16:05.018 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:05.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.105+0000 7f27d8d29700 1 Processor -- start 2021-02-12T17:16:05.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.105+0000 7f27d8d29700 1 -- start start 2021-02-12T17:16:05.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.106+0000 7f27d8d29700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f27d414e530 0x7f27d4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.106+0000 7f27d8d29700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d40b7960 con 0x7f27d40b8d20 2021-02-12T17:16:05.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.106+0000 7f27d8d29700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d40622a0 con 0x7f27d4062740 2021-02-12T17:16:05.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.106+0000 7f27d8d29700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d4068d20 con 0x7f27d414e530 2021-02-12T17:16:05.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.106+0000 7f27d259c700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f27d40b8d20 0x7f27d40b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53058/0 (socket says 172.21.2.102:53058) 2021-02-12T17:16:05.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.106+0000 7f27d259c700 1 -- 172.21.2.102:0/2421569395 learned_addr learned my addr 172.21.2.102:0/2421569395 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:05.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.106+0000 7f27d1d9b700 1 --2- 172.21.2.102:0/2421569395 >> v2:172.21.2.102:3300/0 conn(0x7f27d414e530 0x7f27d4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.106+0000 7f27d159a700 1 -- 172.21.2.102:0/2421569395 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787620173 0 0) 0x7f27d40b7960 con 0x7f27d40b8d20 2021-02-12T17:16:05.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.106+0000 7f27d159a700 1 -- 172.21.2.102:0/2421569395 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b4003230 con 0x7f27d40b8d20 2021-02-12T17:16:05.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.106+0000 7f27d1d9b700 1 -- 172.21.2.102:0/2421569395 >> v1:172.21.2.104:6789/0 conn(0x7f27d4062740 legacy=0x7f27d4062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:05.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.107+0000 7f27d1d9b700 1 -- 172.21.2.102:0/2421569395 >> v1:172.21.2.102:6789/0 conn(0x7f27d40b8d20 legacy=0x7f27d40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.107+0000 7f27d1d9b700 1 -- 172.21.2.102:0/2421569395 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d414ea10 con 0x7f27d414e530 2021-02-12T17:16:05.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.107+0000 7f27d1d9b700 1 --2- 172.21.2.102:0/2421569395 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f27d414e530 0x7f27d4068830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f27bc00b980 tx=0x7f27bc006de0).ready entity=mon.0 client_cookie=fda89ec39c0006fc server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:05.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.107+0000 7f27d159a700 1 -- 172.21.2.102:0/2421569395 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc00be70 con 0x7f27d414e530 2021-02-12T17:16:05.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.107+0000 7f27d159a700 1 -- 172.21.2.102:0/2421569395 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc0097a0 con 0x7f27d414e530 2021-02-12T17:16:05.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.107+0000 7f27d159a700 1 -- 172.21.2.102:0/2421569395 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc009b20 con 0x7f27d414e530 2021-02-12T17:16:05.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.107+0000 7f27d8d29700 1 -- 172.21.2.102:0/2421569395 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f27d414e530 msgr2=0x7f27d4068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.107+0000 7f27d8d29700 1 --2- 172.21.2.102:0/2421569395 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f27d414e530 0x7f27d4068830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f27bc00b980 tx=0x7f27bc006de0).stop 2021-02-12T17:16:05.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.107+0000 7f27d8d29700 1 -- 172.21.2.102:0/2421569395 shutdown_connections 2021-02-12T17:16:05.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.107+0000 7f27d8d29700 1 --2- 172.21.2.102:0/2421569395 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f27d414e530 0x7f27d4068830 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.107+0000 7f27d8d29700 1 -- 172.21.2.102:0/2421569395 >> 172.21.2.102:0/2421569395 conn(0x7f27d40bc480 msgr2=0x7f27d40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:05.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.107+0000 7f27d8d29700 1 -- 172.21.2.102:0/2421569395 shutdown_connections 2021-02-12T17:16:05.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.107+0000 7f27d8d29700 1 -- 172.21.2.102:0/2421569395 wait complete. 2021-02-12T17:16:05.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.108+0000 7f27d8d29700 1 Processor -- start 2021-02-12T17:16:05.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.108+0000 7f27d8d29700 1 -- start start 2021-02-12T17:16:05.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.108+0000 7f27d8d29700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f27d4062740 0x7f27d40b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.108+0000 7f27d8d29700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f27d40b8d20 0x7f27d40b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.108+0000 7f27d8d29700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f27d414e530 0x7f27d40b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27d8d29700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4140700 con 0x7f27d4062740 2021-02-12T17:16:05.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27d8d29700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40b0e90 con 0x7f27d414e530 2021-02-12T17:16:05.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27d8d29700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40b4440 con 0x7f27d40b8d20 2021-02-12T17:16:05.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27d259c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f27d4062740 0x7f27d40b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27d259c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f27d4062740 0x7f27d40b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44420/0 (socket says 172.21.2.102:44420) 2021-02-12T17:16:05.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27d259c700 1 -- 172.21.2.102:0/4089207005 learned_addr learned my addr 172.21.2.102:0/4089207005 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:05.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27d259c700 1 -- 172.21.2.102:0/4089207005 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f27d40b8d20 msgr2=0x7f27d40b0840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:05.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27d259c700 1 --2- 172.21.2.102:0/4089207005 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f27d40b8d20 0x7f27d40b0840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:05.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27d259c700 1 -- 172.21.2.102:0/4089207005 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f27d414e530 msgr2=0x7f27d40b1590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:05.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27d259c700 1 --2- 172.21.2.102:0/4089207005 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f27d414e530 0x7f27d40b1590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:05.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27d259c700 1 -- 172.21.2.102:0/4089207005 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40b24f0 con 0x7f27d4062740 2021-02-12T17:16:05.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27d259c700 1 --2- 172.21.2.102:0/4089207005 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f27d4062740 0x7f27d40b0350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f27c400c6d0 tx=0x7f27c4007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:05.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27ca7fc700 1 -- 172.21.2.102:0/4089207005 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4007320 con 0x7f27d4062740 2021-02-12T17:16:05.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27ca7fc700 1 -- 172.21.2.102:0/4089207005 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c4007480 con 0x7f27d4062740 2021-02-12T17:16:05.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27d8d29700 1 -- 172.21.2.102:0/4089207005 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d4140930 con 0x7f27d4062740 2021-02-12T17:16:05.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27ca7fc700 1 -- 172.21.2.102:0/4089207005 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c40057f0 con 0x7f27d4062740 2021-02-12T17:16:05.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.109+0000 7f27d8d29700 1 -- 172.21.2.102:0/4089207005 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d40b29c0 con 0x7f27d4062740 2021-02-12T17:16:05.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.110+0000 7f27d8d29700 1 -- 172.21.2.102:0/4089207005 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d40b12b0 con 0x7f27d4062740 2021-02-12T17:16:05.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.110+0000 7f27ca7fc700 1 -- 172.21.2.102:0/4089207005 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f27c4010030 con 0x7f27d4062740 2021-02-12T17:16:05.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.110+0000 7f27ca7fc700 1 --2- 172.21.2.102:0/4089207005 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f27b8059d80 0x7f27b805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.110+0000 7f27ca7fc700 1 -- 172.21.2.102:0/4089207005 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f27c40737a0 con 0x7f27d4062740 2021-02-12T17:16:05.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.110+0000 7f27d1d9b700 1 --2- 172.21.2.102:0/4089207005 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f27b8059d80 0x7f27b805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.111+0000 7f27d1d9b700 1 --2- 172.21.2.102:0/4089207005 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f27b8059d80 0x7f27b805c240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f27bc007fd0 tx=0x7f27bc016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:05.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.113+0000 7f27ca7fc700 1 -- 172.21.2.102:0/4089207005 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f27c4047260 con 0x7f27d4062740 2021-02-12T17:16:05.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.242+0000 7f27d8d29700 1 -- 172.21.2.102:0/4089207005 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27d4045460 con 0x7f27d4062740 2021-02-12T17:16:05.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.243+0000 7f27ca7fc700 1 -- 172.21.2.102:0/4089207005 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16757 (secure 0 0 0) 0x7f27c404a880 con 0x7f27d4062740 2021-02-12T17:16:05.244 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:05.244 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":23,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:03.999204+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:05.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.244+0000 7f27d8d29700 1 -- 172.21.2.102:0/4089207005 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f27b8059d80 msgr2=0x7f27b805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.244+0000 7f27d8d29700 1 --2- 172.21.2.102:0/4089207005 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f27b8059d80 0x7f27b805c240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f27bc007fd0 tx=0x7f27bc016000).stop 2021-02-12T17:16:05.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.244+0000 7f27d8d29700 1 -- 172.21.2.102:0/4089207005 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f27d4062740 msgr2=0x7f27d40b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.244+0000 7f27d8d29700 1 --2- 172.21.2.102:0/4089207005 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f27d4062740 0x7f27d40b0350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f27c400c6d0 tx=0x7f27c4007ac0).stop 2021-02-12T17:16:05.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.244+0000 7f27d8d29700 1 -- 172.21.2.102:0/4089207005 shutdown_connections 2021-02-12T17:16:05.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.244+0000 7f27d8d29700 1 --2- 172.21.2.102:0/4089207005 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f27d414e530 0x7f27d40b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:05.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.244+0000 7f27d8d29700 1 --2- 172.21.2.102:0/4089207005 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f27b8059d80 0x7f27b805c240 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.244+0000 7f27d8d29700 1 --2- 172.21.2.102:0/4089207005 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f27d4062740 0x7f27d40b0350 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.244+0000 7f27d8d29700 1 --2- 172.21.2.102:0/4089207005 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f27d40b8d20 0x7f27d40b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:05.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.244+0000 7f27d8d29700 1 -- 172.21.2.102:0/4089207005 >> 172.21.2.102:0/4089207005 conn(0x7f27d40bc480 msgr2=0x7f27d414cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:05.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.244+0000 7f27d8d29700 1 -- 172.21.2.102:0/4089207005 shutdown_connections 2021-02-12T17:16:05.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.244+0000 7f27d8d29700 1 -- 172.21.2.102:0/4089207005 wait complete. 2021-02-12T17:16:05.254 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-12T17:15:54.614238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-12T17:15:56.701902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'a_metadata', 'create_time': '2021-02-12T17:15:59.832660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}}, {'pool': 4, 'pool_name': 'a_data', 'create_time': '2021-02-12T17:16:00.965024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'a'}}}] 2021-02-12T17:16:05.255 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-02-12T17:16:05.343 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.342+0000 7fa848a11700 1 Processor -- start 2021-02-12T17:16:05.343 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.342+0000 7fa848a11700 1 -- start start 2021-02-12T17:16:05.344 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.342+0000 7fa848a11700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa844145430 0x7fa8440bc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.344 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.342+0000 7fa848a11700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa8440643b0 0x7fa844144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.344 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.342+0000 7fa848a11700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa844068b60 con 0x7fa8440b0940 2021-02-12T17:16:05.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.342+0000 7fa848a11700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8440620f0 con 0x7fa844145430 2021-02-12T17:16:05.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.342+0000 7fa848a11700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa844149cb0 con 0x7fa8440643b0 2021-02-12T17:16:05.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.343+0000 7fa84259c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa844145430 0x7fa8440bc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.343+0000 7fa84259c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa844145430 0x7fa8440bc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44426/0 (socket says 172.21.2.102:44426) 2021-02-12T17:16:05.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.343+0000 7fa84259c700 1 -- 172.21.2.102:0/2356627343 learned_addr learned my addr 172.21.2.102:0/2356627343 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:05.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.343+0000 7fa84259c700 1 -- 172.21.2.102:0/2356627343 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa8440643b0 msgr2=0x7fa844144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:05.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.343+0000 7fa84259c700 1 --2- 172.21.2.102:0/2356627343 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa8440643b0 0x7fa844144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:05.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.343+0000 7fa84259c700 1 -- 172.21.2.102:0/2356627343 >> v1:172.21.2.104:6789/0 conn(0x7fa8440b0940 legacy=0x7fa844145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:05.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.343+0000 7fa84259c700 1 -- 172.21.2.102:0/2356627343 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa844149a10 con 0x7fa844145430 2021-02-12T17:16:05.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.343+0000 7fa84259c700 1 --2- 172.21.2.102:0/2356627343 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa844145430 0x7fa8440bc2b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fa82c00b9e0 tx=0x7fa82c006ea0).ready entity=mon.0 client_cookie=86b88215dbe8f072 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:05.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.343+0000 7fa84159a700 1 -- 172.21.2.102:0/2356627343 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c009800 con 0x7fa844145430 2021-02-12T17:16:05.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.343+0000 7fa84159a700 1 -- 172.21.2.102:0/2356627343 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c009960 con 0x7fa844145430 2021-02-12T17:16:05.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.343+0000 7fa84159a700 1 -- 172.21.2.102:0/2356627343 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c009ce0 con 0x7fa844145430 2021-02-12T17:16:05.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.344+0000 7fa848a11700 1 -- 172.21.2.102:0/2356627343 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa844145430 msgr2=0x7fa8440bc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.344+0000 7fa848a11700 1 --2- 172.21.2.102:0/2356627343 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa844145430 0x7fa8440bc2b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fa82c00b9e0 tx=0x7fa82c006ea0).stop 2021-02-12T17:16:05.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.344+0000 7fa848a11700 1 -- 172.21.2.102:0/2356627343 shutdown_connections 2021-02-12T17:16:05.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.344+0000 7fa848a11700 1 --2- 172.21.2.102:0/2356627343 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa844145430 0x7fa8440bc2b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.344+0000 7fa848a11700 1 --2- 172.21.2.102:0/2356627343 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa8440643b0 0x7fa844144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:05.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.344+0000 7fa848a11700 1 -- 172.21.2.102:0/2356627343 >> 172.21.2.102:0/2356627343 conn(0x7fa844061830 msgr2=0x7fa8440bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:05.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.344+0000 7fa848a11700 1 -- 172.21.2.102:0/2356627343 shutdown_connections 2021-02-12T17:16:05.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.344+0000 7fa848a11700 1 -- 172.21.2.102:0/2356627343 wait complete. 2021-02-12T17:16:05.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.345+0000 7fa848a11700 1 Processor -- start 2021-02-12T17:16:05.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.345+0000 7fa848a11700 1 -- start start 2021-02-12T17:16:05.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.345+0000 7fa848a11700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa8440643b0 0x7fa8441526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.345+0000 7fa848a11700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa8440b0940 0x7fa84415c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.345+0000 7fa848a11700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa844145430 0x7fa84415c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.345+0000 7fa848a11700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84415e180 con 0x7fa844145430 2021-02-12T17:16:05.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.345+0000 7fa848a11700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84415dc40 con 0x7fa8440b0940 2021-02-12T17:16:05.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.345+0000 7fa848a11700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84415dee0 con 0x7fa8440643b0 2021-02-12T17:16:05.349 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.345+0000 7fa842d9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa844145430 0x7fa84415c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.349 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.345+0000 7fa842d9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa844145430 0x7fa84415c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44436/0 (socket says 172.21.2.102:44436) 2021-02-12T17:16:05.349 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.345+0000 7fa842d9d700 1 -- 172.21.2.102:0/478170687 learned_addr learned my addr 172.21.2.102:0/478170687 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:05.349 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.346+0000 7fa841d9b700 1 --2- 172.21.2.102:0/478170687 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa8440b0940 0x7fa84415c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.349 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.346+0000 7fa842d9d700 1 -- 172.21.2.102:0/478170687 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa8440643b0 msgr2=0x7fa8441526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.349 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.346+0000 7fa842d9d700 1 --2- 172.21.2.102:0/478170687 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa8440643b0 0x7fa8441526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:05.349 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.346+0000 7fa842d9d700 1 -- 172.21.2.102:0/478170687 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa8440b0940 msgr2=0x7fa84415c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.349 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.346+0000 7fa842d9d700 1 --2- 172.21.2.102:0/478170687 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa8440b0940 0x7fa84415c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.349 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.346+0000 7fa842d9d700 1 -- 172.21.2.102:0/478170687 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84409aff0 con 0x7fa844145430 2021-02-12T17:16:05.349 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.346+0000 7fa842d9d700 1 --2- 172.21.2.102:0/478170687 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa844145430 0x7fa84415c9a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa83c00bae0 tx=0x7fa83c009120).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:05.349 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.346+0000 7fa83a7fc700 1 -- 172.21.2.102:0/478170687 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c00c820 con 0x7fa844145430 2021-02-12T17:16:05.349 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.346+0000 7fa83a7fc700 1 -- 172.21.2.102:0/478170687 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c00c9a0 con 0x7fa844145430 2021-02-12T17:16:05.349 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.346+0000 7fa848a11700 1 -- 172.21.2.102:0/478170687 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84409b290 con 0x7fa844145430 2021-02-12T17:16:05.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.346+0000 7fa83a7fc700 1 -- 172.21.2.102:0/478170687 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c00cb50 con 0x7fa844145430 2021-02-12T17:16:05.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.346+0000 7fa848a11700 1 -- 172.21.2.102:0/478170687 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8440b5c50 con 0x7fa844145430 2021-02-12T17:16:05.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.347+0000 7fa848a11700 1 -- 172.21.2.102:0/478170687 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84409b6f0 con 0x7fa844145430 2021-02-12T17:16:05.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.347+0000 7fa83a7fc700 1 -- 172.21.2.102:0/478170687 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fa83c01c070 con 0x7fa844145430 2021-02-12T17:16:05.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.347+0000 7fa83a7fc700 1 --2- 172.21.2.102:0/478170687 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa828059d80 0x7fa82805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.347+0000 7fa83a7fc700 1 -- 172.21.2.102:0/478170687 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fa83c073160 con 0x7fa844145430 2021-02-12T17:16:05.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.347+0000 7fa84259c700 1 --2- 172.21.2.102:0/478170687 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa828059d80 0x7fa82805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.348+0000 7fa84259c700 1 --2- 172.21.2.102:0/478170687 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa828059d80 0x7fa82805c240 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa84409dc80 tx=0x7fa82c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:05.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.350+0000 7fa83a7fc700 1 -- 172.21.2.102:0/478170687 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fa83c046c20 con 0x7fa844145430 2021-02-12T17:16:05.478 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.477+0000 7fa848a11700 1 -- 172.21.2.102:0/478170687 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa844045460 con 0x7fa844145430 2021-02-12T17:16:05.478 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.477+0000 7fa83a7fc700 1 -- 172.21.2.102:0/478170687 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa83c01a070 con 0x7fa844145430 2021-02-12T17:16:05.479 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 1 2021-02-12T17:16:05.479 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.478+0000 7fa848a11700 1 -- 172.21.2.102:0/478170687 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa828059d80 msgr2=0x7fa82805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.480 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.478+0000 7fa848a11700 1 --2- 172.21.2.102:0/478170687 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa828059d80 0x7fa82805c240 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa84409dc80 tx=0x7fa82c016000).stop 2021-02-12T17:16:05.480 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.478+0000 7fa848a11700 1 -- 172.21.2.102:0/478170687 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa844145430 msgr2=0x7fa84415c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.480 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.478+0000 7fa848a11700 1 --2- 172.21.2.102:0/478170687 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa844145430 0x7fa84415c9a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa83c00bae0 tx=0x7fa83c009120).stop 2021-02-12T17:16:05.480 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.478+0000 7fa848a11700 1 -- 172.21.2.102:0/478170687 shutdown_connections 2021-02-12T17:16:05.480 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.478+0000 7fa848a11700 1 --2- 172.21.2.102:0/478170687 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa828059d80 0x7fa82805c240 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.480 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.478+0000 7fa848a11700 1 --2- 172.21.2.102:0/478170687 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa844145430 0x7fa84415c9a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.480 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.478+0000 7fa848a11700 1 --2- 172.21.2.102:0/478170687 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa8440643b0 0x7fa8441526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:05.480 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.478+0000 7fa848a11700 1 --2- 172.21.2.102:0/478170687 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa8440b0940 0x7fa84415c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.480 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.478+0000 7fa848a11700 1 -- 172.21.2.102:0/478170687 >> 172.21.2.102:0/478170687 conn(0x7fa844061830 msgr2=0x7fa844148b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:05.480 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.478+0000 7fa848a11700 1 -- 172.21.2.102:0/478170687 shutdown_connections 2021-02-12T17:16:05.480 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.478+0000 7fa848a11700 1 -- 172.21.2.102:0/478170687 wait complete. 2021-02-12T17:16:05.491 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-02-12T17:16:05.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.579+0000 7f59e9806700 1 Processor -- start 2021-02-12T17:16:05.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.580+0000 7f59e9806700 1 -- start start 2021-02-12T17:16:05.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.580+0000 7f59e9806700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f59e40bc2b0 0x7f59e4151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.580+0000 7f59e9806700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f59e4151d20 0x7f59e414e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.580+0000 7f59e9806700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e4066b70 con 0x7f59e40b0940 2021-02-12T17:16:05.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.580+0000 7f59e9806700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e40b27d0 con 0x7f59e40bc2b0 2021-02-12T17:16:05.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.580+0000 7f59e9806700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e414e550 con 0x7f59e4151d20 2021-02-12T17:16:05.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.580+0000 7f59e2ffd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f59e40bc2b0 0x7f59e4151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.580+0000 7f59e27fc700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f59e40b0940 0x7f59e4151610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53084/0 (socket says 172.21.2.102:53084) 2021-02-12T17:16:05.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.580+0000 7f59e27fc700 1 -- 172.21.2.102:0/2501276355 learned_addr learned my addr 172.21.2.102:0/2501276355 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:05.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.580+0000 7f59e2ffd700 1 --2- 172.21.2.102:0/2501276355 >> v2:172.21.2.102:3300/0 conn(0x7f59e40bc2b0 0x7f59e4151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44440/0 (socket says 172.21.2.102:44440) 2021-02-12T17:16:05.587 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.581+0000 7f59e37fe700 1 --2- 172.21.2.102:0/2501276355 >> v2:172.21.2.104:3300/0 conn(0x7f59e4151d20 0x7f59e414e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.587 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.581+0000 7f59e1ffb700 1 -- 172.21.2.102:0/2501276355 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202182573 0 0) 0x7f59e4066b70 con 0x7f59e40b0940 2021-02-12T17:16:05.587 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.581+0000 7f59e1ffb700 1 -- 172.21.2.102:0/2501276355 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c4003230 con 0x7f59e40b0940 2021-02-12T17:16:05.587 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.581+0000 7f59e2ffd700 1 -- 172.21.2.102:0/2501276355 >> v2:172.21.2.104:3300/0 conn(0x7f59e4151d20 msgr2=0x7f59e414e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:05.587 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.581+0000 7f59e2ffd700 1 --2- 172.21.2.102:0/2501276355 >> v2:172.21.2.104:3300/0 conn(0x7f59e4151d20 0x7f59e414e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.587 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.581+0000 7f59e2ffd700 1 -- 172.21.2.102:0/2501276355 >> v1:172.21.2.102:6789/0 conn(0x7f59e40b0940 legacy=0x7f59e4151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.588 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.581+0000 7f59e2ffd700 1 -- 172.21.2.102:0/2501276355 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e40685b0 con 0x7f59e40bc2b0 2021-02-12T17:16:05.588 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.581+0000 7f59e2ffd700 1 --2- 172.21.2.102:0/2501276355 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59e40bc2b0 0x7f59e4151120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f59e4065e20 tx=0x7f59cc006de0).ready entity=mon.0 client_cookie=97bdd3f4005787b9 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:05.588 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.581+0000 7f59e1ffb700 1 -- 172.21.2.102:0/2501276355 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc009610 con 0x7f59e40bc2b0 2021-02-12T17:16:05.588 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.581+0000 7f59e1ffb700 1 -- 172.21.2.102:0/2501276355 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc009770 con 0x7f59e40bc2b0 2021-02-12T17:16:05.588 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.581+0000 7f59e1ffb700 1 -- 172.21.2.102:0/2501276355 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc009af0 con 0x7f59e40bc2b0 2021-02-12T17:16:05.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.582+0000 7f59e9806700 1 -- 172.21.2.102:0/2501276355 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59e40bc2b0 msgr2=0x7f59e4151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.582+0000 7f59e9806700 1 --2- 172.21.2.102:0/2501276355 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59e40bc2b0 0x7f59e4151120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f59e4065e20 tx=0x7f59cc006de0).stop 2021-02-12T17:16:05.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.582+0000 7f59e9806700 1 -- 172.21.2.102:0/2501276355 shutdown_connections 2021-02-12T17:16:05.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.582+0000 7f59e9806700 1 --2- 172.21.2.102:0/2501276355 >> v2:172.21.2.104:3300/0 conn(0x7f59e4151d20 0x7f59e414e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.582+0000 7f59e9806700 1 --2- 172.21.2.102:0/2501276355 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59e40bc2b0 0x7f59e4151120 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.582+0000 7f59e9806700 1 -- 172.21.2.102:0/2501276355 >> 172.21.2.102:0/2501276355 conn(0x7f59e4061830 msgr2=0x7f59e40bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:05.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.582+0000 7f59e9806700 1 -- 172.21.2.102:0/2501276355 shutdown_connections 2021-02-12T17:16:05.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.582+0000 7f59e9806700 1 -- 172.21.2.102:0/2501276355 wait complete. 2021-02-12T17:16:05.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.583+0000 7f59e9806700 1 Processor -- start 2021-02-12T17:16:05.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.583+0000 7f59e9806700 1 -- start start 2021-02-12T17:16:05.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e9806700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59e40b0940 0x7f59e415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e9806700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59e40bc2b0 0x7f59e40ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e9806700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59e4151d20 0x7f59e409c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e9806700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e40b4120 con 0x7f59e40bc2b0 2021-02-12T17:16:05.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e9806700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e409c8d0 con 0x7f59e4151d20 2021-02-12T17:16:05.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e9806700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e409cb70 con 0x7f59e40b0940 2021-02-12T17:16:05.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e27fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59e40bc2b0 0x7f59e40ba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e27fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59e40bc2b0 0x7f59e40ba2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44446/0 (socket says 172.21.2.102:44446) 2021-02-12T17:16:05.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e27fc700 1 -- 172.21.2.102:0/1159896303 learned_addr learned my addr 172.21.2.102:0/1159896303 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:05.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e2ffd700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59e40b0940 0x7f59e415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e37fe700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59e4151d20 0x7f59e409c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e27fc700 1 -- 172.21.2.102:0/1159896303 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59e40b0940 msgr2=0x7f59e415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e27fc700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59e40b0940 0x7f59e415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e27fc700 1 -- 172.21.2.102:0/1159896303 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59e4151d20 msgr2=0x7f59e409c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e27fc700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59e4151d20 0x7f59e409c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e27fc700 1 -- 172.21.2.102:0/1159896303 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e415d0d0 con 0x7f59e40bc2b0 2021-02-12T17:16:05.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e2ffd700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59e40b0940 0x7f59e415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:05.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e37fe700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59e4151d20 0x7f59e409c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:05.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59e27fc700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59e40bc2b0 0x7f59e40ba2c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f59d400c710 tx=0x7f59d4007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:05.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.584+0000 7f59daffd700 1 -- 172.21.2.102:0/1159896303 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4007320 con 0x7f59e40bc2b0 2021-02-12T17:16:05.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.585+0000 7f59daffd700 1 -- 172.21.2.102:0/1159896303 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d4007480 con 0x7f59e40bc2b0 2021-02-12T17:16:05.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.585+0000 7f59e9806700 1 -- 172.21.2.102:0/1159896303 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e415d370 con 0x7f59e40bc2b0 2021-02-12T17:16:05.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.585+0000 7f59daffd700 1 -- 172.21.2.102:0/1159896303 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d40057f0 con 0x7f59e40bc2b0 2021-02-12T17:16:05.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.585+0000 7f59e9806700 1 -- 172.21.2.102:0/1159896303 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e40ba7b0 con 0x7f59e40bc2b0 2021-02-12T17:16:05.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.585+0000 7f59e9806700 1 -- 172.21.2.102:0/1159896303 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e415d7d0 con 0x7f59e40bc2b0 2021-02-12T17:16:05.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.585+0000 7f59daffd700 1 -- 172.21.2.102:0/1159896303 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f59d4010030 con 0x7f59e40bc2b0 2021-02-12T17:16:05.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.586+0000 7f59daffd700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f59c8059d30 0x7f59c805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.586+0000 7f59daffd700 1 -- 172.21.2.102:0/1159896303 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f59d40736e0 con 0x7f59e40bc2b0 2021-02-12T17:16:05.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.586+0000 7f59e2ffd700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f59c8059d30 0x7f59c805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.586+0000 7f59e2ffd700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f59c8059d30 0x7f59c805c1f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f59cc006e20 tx=0x7f59cc016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:05.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.589+0000 7f59daffd700 1 -- 172.21.2.102:0/1159896303 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f59d4047120 con 0x7f59e40bc2b0 2021-02-12T17:16:05.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.719+0000 7f59e9806700 1 -- 172.21.2.102:0/1159896303 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59e4045460 con 0x7f59e40bc2b0 2021-02-12T17:16:05.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.720+0000 7f59daffd700 1 -- 172.21.2.102:0/1159896303 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59d404a740 con 0x7f59e40bc2b0 2021-02-12T17:16:05.721 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:05.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.721+0000 7f59e9806700 1 -- 172.21.2.102:0/1159896303 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f59c8059d30 msgr2=0x7f59c805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.721+0000 7f59e9806700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f59c8059d30 0x7f59c805c1f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f59cc006e20 tx=0x7f59cc016000).stop 2021-02-12T17:16:05.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.721+0000 7f59e9806700 1 -- 172.21.2.102:0/1159896303 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59e40bc2b0 msgr2=0x7f59e40ba2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.723 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.721+0000 7f59e9806700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59e40bc2b0 0x7f59e40ba2c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f59d400c710 tx=0x7f59d4007a90).stop 2021-02-12T17:16:05.723 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.721+0000 7f59e9806700 1 -- 172.21.2.102:0/1159896303 shutdown_connections 2021-02-12T17:16:05.723 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.721+0000 7f59e9806700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59e4151d20 0x7f59e409c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.723 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.721+0000 7f59e9806700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59e40b0940 0x7f59e415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.723 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.721+0000 7f59e9806700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f59c8059d30 0x7f59c805c1f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.723 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.721+0000 7f59e9806700 1 --2- 172.21.2.102:0/1159896303 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59e40bc2b0 0x7f59e40ba2c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.723 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.721+0000 7f59e9806700 1 -- 172.21.2.102:0/1159896303 >> 172.21.2.102:0/1159896303 conn(0x7f59e4061830 msgr2=0x7f59e414d950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:05.723 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.721+0000 7f59e9806700 1 -- 172.21.2.102:0/1159896303 shutdown_connections 2021-02-12T17:16:05.723 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.721+0000 7f59e9806700 1 -- 172.21.2.102:0/1159896303 wait complete. 2021-02-12T17:16:05.731 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2021-02-12T17:16:05.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.818+0000 7f243eb5d700 1 Processor -- start 2021-02-12T17:16:05.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.818+0000 7f243eb5d700 1 -- start start 2021-02-12T17:16:05.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f243eb5d700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f24380bc2b0 0x7f2438151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f243eb5d700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f24380b0940 0x7f2438151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f243eb5d700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2438066b70 con 0x7f243809ada0 2021-02-12T17:16:05.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f243eb5d700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24380b27d0 con 0x7f24380b0940 2021-02-12T17:16:05.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f243eb5d700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24380b7110 con 0x7f24380bc2b0 2021-02-12T17:16:05.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f243d0fa700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f243809ada0 0x7f243814d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53100/0 (socket says 172.21.2.102:53100) 2021-02-12T17:16:05.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f243d0fa700 1 -- 172.21.2.102:0/3565478425 learned_addr learned my addr 172.21.2.102:0/3565478425 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:05.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f24377fe700 1 -- 172.21.2.102:0/3565478425 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267985861 0 0) 0x7f2438066b70 con 0x7f243809ada0 2021-02-12T17:16:05.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f24377fe700 1 -- 172.21.2.102:0/3565478425 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2418003230 con 0x7f243809ada0 2021-02-12T17:16:05.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f243c8f9700 1 --2- 172.21.2.102:0/3565478425 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f24380bc2b0 0x7f2438151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f2437fff700 1 --2- 172.21.2.102:0/3565478425 >> v2:172.21.2.104:3300/0 conn(0x7f24380b0940 0x7f2438151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f24377fe700 1 -- 172.21.2.102:0/3565478425 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 112027341 0 0) 0x7f2418003230 con 0x7f243809ada0 2021-02-12T17:16:05.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f24377fe700 1 -- 172.21.2.102:0/3565478425 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f24380bc2b0 msgr2=0x7f2438151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:05.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f24377fe700 1 --2- 172.21.2.102:0/3565478425 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f24380bc2b0 0x7f2438151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f24377fe700 1 -- 172.21.2.102:0/3565478425 >> v2:172.21.2.104:3300/0 conn(0x7f24380b0940 msgr2=0x7f2438151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:05.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f24377fe700 1 --2- 172.21.2.102:0/3565478425 >> v2:172.21.2.104:3300/0 conn(0x7f24380b0940 0x7f2438151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f24377fe700 1 -- 172.21.2.102:0/3565478425 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380685b0 con 0x7f243809ada0 2021-02-12T17:16:05.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f24377fe700 1 -- 172.21.2.102:0/3565478425 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f2430001860 con 0x7f243809ada0 2021-02-12T17:16:05.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.819+0000 7f24377fe700 1 -- 172.21.2.102:0/3565478425 >> v1:172.21.2.102:6789/0 conn(0x7f243809ada0 legacy=0x7f243814d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f24377fe700 1 --2- 172.21.2.102:0/3565478425 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f24180037a0 0x7f2418003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f24377fe700 1 --2- 172.21.2.102:0/3565478425 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24180044d0 0x7f2418004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f24377fe700 1 --2- 172.21.2.102:0/3565478425 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f24380bc2b0 0x7f2418004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f24377fe700 1 -- 172.21.2.102:0/3565478425 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24380b27d0 con 0x7f24180037a0 2021-02-12T17:16:05.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f24377fe700 1 -- 172.21.2.102:0/3565478425 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24380b7110 con 0x7f24180044d0 2021-02-12T17:16:05.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f24377fe700 1 -- 172.21.2.102:0/3565478425 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2418005330 con 0x7f24380bc2b0 2021-02-12T17:16:05.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243c8f9700 1 --2- 172.21.2.102:0/3565478425 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f24180037a0 0x7f2418003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243d0fa700 1 --2- 172.21.2.102:0/3565478425 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f24380bc2b0 0x7f2418004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243c8f9700 1 -- 172.21.2.102:0/3565478425 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f24380bc2b0 msgr2=0x7f2418004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:05.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243c8f9700 1 --2- 172.21.2.102:0/3565478425 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f24380bc2b0 0x7f2418004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243c8f9700 1 -- 172.21.2.102:0/3565478425 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24180044d0 msgr2=0x7f2418004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:05.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f2437fff700 1 --2- 172.21.2.102:0/3565478425 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24180044d0 0x7f2418004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243c8f9700 1 --2- 172.21.2.102:0/3565478425 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24180044d0 0x7f2418004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243c8f9700 1 -- 172.21.2.102:0/3565478425 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2418003230 con 0x7f24180037a0 2021-02-12T17:16:05.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243d0fa700 1 --2- 172.21.2.102:0/3565478425 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f24380bc2b0 0x7f2418004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:05.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f2437fff700 1 --2- 172.21.2.102:0/3565478425 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24180044d0 0x7f2418004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:05.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243c8f9700 1 --2- 172.21.2.102:0/3565478425 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f24180037a0 0x7f2418003bc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f242000ba70 tx=0x7f2420008040).ready entity=mon.0 client_cookie=af3c382cf82a04f2 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:05.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f24377fe700 1 -- 172.21.2.102:0/3565478425 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000d930 con 0x7f24180037a0 2021-02-12T17:16:05.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f24377fe700 1 -- 172.21.2.102:0/3565478425 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242000da90 con 0x7f24180037a0 2021-02-12T17:16:05.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f24377fe700 1 -- 172.21.2.102:0/3565478425 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000de10 con 0x7f24180037a0 2021-02-12T17:16:05.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243eb5d700 1 -- 172.21.2.102:0/3565478425 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f24180037a0 msgr2=0x7f2418003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243eb5d700 1 --2- 172.21.2.102:0/3565478425 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f24180037a0 0x7f2418003bc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f242000ba70 tx=0x7f2420008040).stop 2021-02-12T17:16:05.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243d0fa700 1 -- 172.21.2.102:0/3565478425 reap_dead start 2021-02-12T17:16:05.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243eb5d700 1 -- 172.21.2.102:0/3565478425 shutdown_connections 2021-02-12T17:16:05.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243eb5d700 1 -- 172.21.2.102:0/3565478425 >> 172.21.2.102:0/3565478425 conn(0x7f2438061830 msgr2=0x7f24380bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:05.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243eb5d700 1 -- 172.21.2.102:0/3565478425 shutdown_connections 2021-02-12T17:16:05.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.820+0000 7f243eb5d700 1 -- 172.21.2.102:0/3565478425 wait complete. 2021-02-12T17:16:05.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.821+0000 7f243eb5d700 1 Processor -- start 2021-02-12T17:16:05.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.821+0000 7f243eb5d700 1 -- start start 2021-02-12T17:16:05.830 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243eb5d700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24180037a0 0x7f243815deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.830 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243eb5d700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f243809e970 0x7f243809c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243eb5d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f243809ee40 0x7f243809d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243eb5d700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2438063c60 con 0x7f243809ee40 2021-02-12T17:16:05.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243eb5d700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2438062ca0 con 0x7f24180037a0 2021-02-12T17:16:05.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243eb5d700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2438062ed0 con 0x7f243809e970 2021-02-12T17:16:05.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243d0fa700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f243809ee40 0x7f243809d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243d0fa700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f243809ee40 0x7f243809d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44468/0 (socket says 172.21.2.102:44468) 2021-02-12T17:16:05.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243d0fa700 1 -- 172.21.2.102:0/1792609072 learned_addr learned my addr 172.21.2.102:0/1792609072 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:05.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243c8f9700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24180037a0 0x7f243815deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f2437fff700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f243809e970 0x7f243809c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243d0fa700 1 -- 172.21.2.102:0/1792609072 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f243809e970 msgr2=0x7f243809c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243d0fa700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f243809e970 0x7f243809c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243d0fa700 1 -- 172.21.2.102:0/1792609072 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24180037a0 msgr2=0x7f243815deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243d0fa700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24180037a0 0x7f243815deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243d0fa700 1 -- 172.21.2.102:0/1792609072 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243815d4d0 con 0x7f243809ee40 2021-02-12T17:16:05.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243c8f9700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24180037a0 0x7f243815deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:05.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f2437fff700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f243809e970 0x7f243809c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:05.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f243d0fa700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f243809ee40 0x7f243809d1d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2430001990 tx=0x7f2430009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:05.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.822+0000 7f2434ff9700 1 -- 172.21.2.102:0/1792609072 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430004b40 con 0x7f243809ee40 2021-02-12T17:16:05.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.823+0000 7f2434ff9700 1 -- 172.21.2.102:0/1792609072 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2430004ca0 con 0x7f243809ee40 2021-02-12T17:16:05.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.823+0000 7f243eb5d700 1 -- 172.21.2.102:0/1792609072 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243815d770 con 0x7f243809ee40 2021-02-12T17:16:05.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.823+0000 7f2434ff9700 1 -- 172.21.2.102:0/1792609072 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430007260 con 0x7f243809ee40 2021-02-12T17:16:05.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.823+0000 7f243eb5d700 1 -- 172.21.2.102:0/1792609072 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243815d1d0 con 0x7f243809ee40 2021-02-12T17:16:05.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.823+0000 7f243eb5d700 1 -- 172.21.2.102:0/1792609072 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243815dbd0 con 0x7f243809ee40 2021-02-12T17:16:05.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.823+0000 7f2434ff9700 1 -- 172.21.2.102:0/1792609072 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f243001c060 con 0x7f243809ee40 2021-02-12T17:16:05.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.824+0000 7f2434ff9700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f241c059d30 0x7f241c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:05.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.824+0000 7f2434ff9700 1 -- 172.21.2.102:0/1792609072 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f2430073240 con 0x7f243809ee40 2021-02-12T17:16:05.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.824+0000 7f243c8f9700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f241c059d30 0x7f241c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:05.834 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.824+0000 7f243c8f9700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f241c059d30 0x7f241c05c1f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2420008010 tx=0x7f2420008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:05.834 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.827+0000 7f2434ff9700 1 -- 172.21.2.102:0/1792609072 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f2430046d90 con 0x7f243809ee40 2021-02-12T17:16:05.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.954+0000 7f243eb5d700 1 -- 172.21.2.102:0/1792609072 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2438045460 con 0x7f243809ee40 2021-02-12T17:16:05.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.954+0000 7f2434ff9700 1 -- 172.21.2.102:0/1792609072 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v23) v1 ==== 99+0+10 (secure 0 0 0) 0x7f243001a030 con 0x7f243809ee40 2021-02-12T17:16:05.956 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:05.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.955+0000 7f243eb5d700 1 -- 172.21.2.102:0/1792609072 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f241c059d30 msgr2=0x7f241c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.955+0000 7f243eb5d700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f241c059d30 0x7f241c05c1f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2420008010 tx=0x7f2420008040).stop 2021-02-12T17:16:05.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.955+0000 7f243eb5d700 1 -- 172.21.2.102:0/1792609072 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f243809ee40 msgr2=0x7f243809d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:05.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.955+0000 7f243eb5d700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f243809ee40 0x7f243809d1d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2430001990 tx=0x7f2430009040).stop 2021-02-12T17:16:05.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.956+0000 7f243eb5d700 1 -- 172.21.2.102:0/1792609072 shutdown_connections 2021-02-12T17:16:05.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.956+0000 7f243eb5d700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f241c059d30 0x7f241c05c1f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.956+0000 7f243eb5d700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f243809ee40 0x7f243809d1d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.956+0000 7f243eb5d700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24180037a0 0x7f243815deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.956+0000 7f243eb5d700 1 --2- 172.21.2.102:0/1792609072 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f243809e970 0x7f243809c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:05.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.956+0000 7f243eb5d700 1 -- 172.21.2.102:0/1792609072 >> 172.21.2.102:0/1792609072 conn(0x7f2438061830 msgr2=0x7f243814cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:05.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.956+0000 7f243eb5d700 1 -- 172.21.2.102:0/1792609072 shutdown_connections 2021-02-12T17:16:05.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:05.956+0000 7f243eb5d700 1 -- 172.21.2.102:0/1792609072 wait complete. 2021-02-12T17:16:05.966 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2021-02-12T17:16:06.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.054+0000 7f4a7a2e7700 1 Processor -- start 2021-02-12T17:16:06.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.054+0000 7f4a7a2e7700 1 -- start start 2021-02-12T17:16:06.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.054+0000 7f4a7a2e7700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4a740bc2b0 0x7f4a74151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.054+0000 7f4a7a2e7700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f4a740b0940 0x7f4a74151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.054+0000 7f4a7a2e7700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a74066b70 con 0x7f4a7409ada0 2021-02-12T17:16:06.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.054+0000 7f4a7a2e7700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a740b27d0 con 0x7f4a740b0940 2021-02-12T17:16:06.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.054+0000 7f4a7a2e7700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740b7110 con 0x7f4a740bc2b0 2021-02-12T17:16:06.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.055+0000 7f4a78884700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f4a7409ada0 0x7f4a7414d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:35486/0 (socket says 172.21.2.102:35486) 2021-02-12T17:16:06.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.055+0000 7f4a78884700 1 -- 172.21.2.102:0/57819354 learned_addr learned my addr 172.21.2.102:0/57819354 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:06.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.055+0000 7f4a737fe700 1 --2- 172.21.2.102:0/57819354 >> v2:172.21.2.104:3300/0 conn(0x7f4a740b0940 0x7f4a74151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.055+0000 7f4a73fff700 1 --2- 172.21.2.102:0/57819354 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4a740bc2b0 0x7f4a74151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a72ffd700 1 -- 172.21.2.102:0/57819354 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496625060 0 0) 0x7f4a74066b70 con 0x7f4a7409ada0 2021-02-12T17:16:06.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a72ffd700 1 -- 172.21.2.102:0/57819354 --> v1:172.21.2.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a54003230 con 0x7f4a7409ada0 2021-02-12T17:16:06.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a737fe700 1 -- 172.21.2.102:0/57819354 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4a740bc2b0 msgr2=0x7f4a74151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:06.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a737fe700 1 --2- 172.21.2.102:0/57819354 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4a740bc2b0 0x7f4a74151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a737fe700 1 -- 172.21.2.102:0/57819354 >> v1:172.21.2.104:6789/0 conn(0x7f4a7409ada0 legacy=0x7f4a7414d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a737fe700 1 -- 172.21.2.102:0/57819354 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a740685b0 con 0x7f4a740b0940 2021-02-12T17:16:06.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a737fe700 1 --2- 172.21.2.102:0/57819354 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4a740b0940 0x7f4a74151610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4a6400b980 tx=0x7f4a64006de0).ready entity=mon.1 client_cookie=4d4e7e2b0341cf53 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:06.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a72ffd700 1 -- 172.21.2.102:0/57819354 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64009650 con 0x7f4a740b0940 2021-02-12T17:16:06.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a72ffd700 1 -- 172.21.2.102:0/57819354 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a640097b0 con 0x7f4a740b0940 2021-02-12T17:16:06.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a72ffd700 1 -- 172.21.2.102:0/57819354 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64009b30 con 0x7f4a740b0940 2021-02-12T17:16:06.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/57819354 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4a740b0940 msgr2=0x7f4a74151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a7a2e7700 1 --2- 172.21.2.102:0/57819354 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4a740b0940 0x7f4a74151610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4a6400b980 tx=0x7f4a64006de0).stop 2021-02-12T17:16:06.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/57819354 shutdown_connections 2021-02-12T17:16:06.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a7a2e7700 1 --2- 172.21.2.102:0/57819354 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4a740bc2b0 0x7f4a74151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a7a2e7700 1 --2- 172.21.2.102:0/57819354 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4a740b0940 0x7f4a74151610 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0x7f4a6400b980 tx=0x7f4a64006de0).stop 2021-02-12T17:16:06.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/57819354 >> 172.21.2.102:0/57819354 conn(0x7f4a74061830 msgr2=0x7f4a740bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:06.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/57819354 shutdown_connections 2021-02-12T17:16:06.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.056+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/57819354 wait complete. 2021-02-12T17:16:06.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.057+0000 7f4a7a2e7700 1 Processor -- start 2021-02-12T17:16:06.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.057+0000 7f4a7a2e7700 1 -- start start 2021-02-12T17:16:06.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a7a2e7700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4a7409ada0 0x7f4a7413e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a7a2e7700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4a740bc2b0 0x7f4a74160c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a7a2e7700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4a7409b3a0 0x7f4a74161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a7a2e7700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7409cd30 con 0x7f4a7409b3a0 2021-02-12T17:16:06.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a7a2e7700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74161620 con 0x7f4a7409ada0 2021-02-12T17:16:06.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a7a2e7700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7409f410 con 0x7f4a740bc2b0 2021-02-12T17:16:06.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a78884700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4a7409b3a0 0x7f4a74161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a78884700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4a7409b3a0 0x7f4a74161130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44482/0 (socket says 172.21.2.102:44482) 2021-02-12T17:16:06.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a78884700 1 -- 172.21.2.102:0/1831102110 learned_addr learned my addr 172.21.2.102:0/1831102110 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:06.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a737fe700 1 --2- 172.21.2.102:0/1831102110 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4a740bc2b0 0x7f4a74160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a73fff700 1 --2- 172.21.2.102:0/1831102110 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4a7409ada0 0x7f4a7413e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a78884700 1 -- 172.21.2.102:0/1831102110 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4a740bc2b0 msgr2=0x7f4a74160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a78884700 1 --2- 172.21.2.102:0/1831102110 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4a740bc2b0 0x7f4a74160c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a78884700 1 -- 172.21.2.102:0/1831102110 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4a7409ada0 msgr2=0x7f4a7413e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a78884700 1 --2- 172.21.2.102:0/1831102110 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4a7409ada0 0x7f4a7413e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a78884700 1 -- 172.21.2.102:0/1831102110 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7409cf60 con 0x7f4a7409b3a0 2021-02-12T17:16:06.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.058+0000 7f4a78884700 1 --2- 172.21.2.102:0/1831102110 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4a7409b3a0 0x7f4a74161130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f4a6c005910 tx=0x7f4a6c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:06.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.059+0000 7f4a6bfff700 1 -- 172.21.2.102:0/1831102110 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c005b70 con 0x7f4a7409b3a0 2021-02-12T17:16:06.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.059+0000 7f4a6bfff700 1 -- 172.21.2.102:0/1831102110 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c005cd0 con 0x7f4a7409b3a0 2021-02-12T17:16:06.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.059+0000 7f4a6bfff700 1 -- 172.21.2.102:0/1831102110 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c007320 con 0x7f4a7409b3a0 2021-02-12T17:16:06.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.059+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/1831102110 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7409d200 con 0x7f4a7409b3a0 2021-02-12T17:16:06.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.059+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/1831102110 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7409d6a0 con 0x7f4a7409b3a0 2021-02-12T17:16:06.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.060+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/1831102110 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a74045460 con 0x7f4a7409b3a0 2021-02-12T17:16:06.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.060+0000 7f4a6bfff700 1 -- 172.21.2.102:0/1831102110 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f4a6c010030 con 0x7f4a7409b3a0 2021-02-12T17:16:06.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.060+0000 7f4a6bfff700 1 --2- 172.21.2.102:0/1831102110 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4a58059d80 0x7f4a5805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.060+0000 7f4a6bfff700 1 -- 172.21.2.102:0/1831102110 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f4a6c073910 con 0x7f4a7409b3a0 2021-02-12T17:16:06.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.060+0000 7f4a73fff700 1 --2- 172.21.2.102:0/1831102110 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4a58059d80 0x7f4a5805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.060+0000 7f4a73fff700 1 --2- 172.21.2.102:0/1831102110 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4a58059d80 0x7f4a5805c240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4a5c00caf0 tx=0x7f4a5c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:06.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.063+0000 7f4a6bfff700 1 -- 172.21.2.102:0/1831102110 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f4a6c0473d0 con 0x7f4a7409b3a0 2021-02-12T17:16:06.193 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.192+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/1831102110 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f4a74150e20 con 0x7f4a7409b3a0 2021-02-12T17:16:06.194 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.192+0000 7f4a6bfff700 1 -- 172.21.2.102:0/1831102110 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v23) v1 ==== 95+0+10 (secure 0 0 0) 0x7f4a6c04a9f0 con 0x7f4a7409b3a0 2021-02-12T17:16:06.194 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:06.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.193+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/1831102110 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4a58059d80 msgr2=0x7f4a5805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.193+0000 7f4a7a2e7700 1 --2- 172.21.2.102:0/1831102110 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4a58059d80 0x7f4a5805c240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4a5c00caf0 tx=0x7f4a5c008040).stop 2021-02-12T17:16:06.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.193+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/1831102110 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4a7409b3a0 msgr2=0x7f4a74161130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.193+0000 7f4a7a2e7700 1 --2- 172.21.2.102:0/1831102110 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4a7409b3a0 0x7f4a74161130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f4a6c005910 tx=0x7f4a6c007e10).stop 2021-02-12T17:16:06.196 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.194+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/1831102110 shutdown_connections 2021-02-12T17:16:06.196 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.194+0000 7f4a7a2e7700 1 --2- 172.21.2.102:0/1831102110 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4a58059d80 0x7f4a5805c240 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.196 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.194+0000 7f4a7a2e7700 1 --2- 172.21.2.102:0/1831102110 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4a7409b3a0 0x7f4a74161130 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.196 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.194+0000 7f4a7a2e7700 1 --2- 172.21.2.102:0/1831102110 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4a7409ada0 0x7f4a7413e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.196 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.194+0000 7f4a7a2e7700 1 --2- 172.21.2.102:0/1831102110 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4a740bc2b0 0x7f4a74160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.196 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.194+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/1831102110 >> 172.21.2.102:0/1831102110 conn(0x7f4a74061830 msgr2=0x7f4a740b98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:06.197 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.194+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/1831102110 shutdown_connections 2021-02-12T17:16:06.197 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.194+0000 7f4a7a2e7700 1 -- 172.21.2.102:0/1831102110 wait complete. 2021-02-12T17:16:06.204 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-02-12T17:16:06.291 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.290+0000 7f1dbf480700 1 Processor -- start 2021-02-12T17:16:06.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.290+0000 7f1dbf480700 1 -- start start 2021-02-12T17:16:06.295 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.291+0000 7f1dbf480700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f1db814e530 0x7f1db8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.295 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.291+0000 7f1dbf480700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db80b7960 con 0x7f1db80b8d20 2021-02-12T17:16:06.295 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.291+0000 7f1dbf480700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db80622a0 con 0x7f1db8062740 2021-02-12T17:16:06.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.291+0000 7f1dbf480700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db8068d20 con 0x7f1db814e530 2021-02-12T17:16:06.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.291+0000 7f1dbd21c700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f1db80b8d20 0x7f1db80b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53130/0 (socket says 172.21.2.102:53130) 2021-02-12T17:16:06.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.291+0000 7f1dbd21c700 1 -- 172.21.2.102:0/1103397603 learned_addr learned my addr 172.21.2.102:0/1103397603 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:06.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.291+0000 7f1dbca1b700 1 --2- 172.21.2.102:0/1103397603 >> v2:172.21.2.104:3300/0 conn(0x7f1db814e530 0x7f1db8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.291+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925320741 0 0) 0x7f1db80b7960 con 0x7f1db80b8d20 2021-02-12T17:16:06.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.291+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1da0003230 con 0x7f1db80b8d20 2021-02-12T17:16:06.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080275516 0 0) 0x7f1db80622a0 con 0x7f1db8062740 2021-02-12T17:16:06.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 --> v1:172.21.2.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db80b7960 con 0x7f1db8062740 2021-02-12T17:16:06.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2912448797 0 0) 0x7f1da0003230 con 0x7f1db80b8d20 2021-02-12T17:16:06.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 >> v2:172.21.2.104:3300/0 conn(0x7f1db814e530 msgr2=0x7f1db8068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:06.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 --2- 172.21.2.102:0/1103397603 >> v2:172.21.2.104:3300/0 conn(0x7f1db814e530 0x7f1db8068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 >> v1:172.21.2.104:6789/0 conn(0x7f1db8062740 legacy=0x7f1db8062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db814ea10 con 0x7f1db80b8d20 2021-02-12T17:16:06.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f1da8001460 con 0x7f1db80b8d20 2021-02-12T17:16:06.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 >> v1:172.21.2.102:6789/0 conn(0x7f1db80b8d20 legacy=0x7f1db80b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 --2- 172.21.2.102:0/1103397603 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1da0003900 0x7f1da0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 --2- 172.21.2.102:0/1103397603 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1da00044d0 0x7f1da0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.301 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 --2- 172.21.2.102:0/1103397603 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1da0004e40 0x7f1da000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.301 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db8068d20 con 0x7f1da0003900 2021-02-12T17:16:06.301 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da000bc10 con 0x7f1da00044d0 2021-02-12T17:16:06.301 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da000bd80 con 0x7f1da0004e40 2021-02-12T17:16:06.301 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1dbd21c700 1 --2- 172.21.2.102:0/1103397603 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1da0003900 0x7f1da0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.301 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1dbca1b700 1 --2- 172.21.2.102:0/1103397603 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1da00044d0 0x7f1da0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.301 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1dbda1d700 1 --2- 172.21.2.102:0/1103397603 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1da0004e40 0x7f1da000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.301 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1dbd21c700 1 -- 172.21.2.102:0/1103397603 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1da0004e40 msgr2=0x7f1da000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:06.301 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1dbd21c700 1 --2- 172.21.2.102:0/1103397603 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1da0004e40 0x7f1da000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.301 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1dbd21c700 1 -- 172.21.2.102:0/1103397603 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1da00044d0 msgr2=0x7f1da0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:06.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1dbd21c700 1 --2- 172.21.2.102:0/1103397603 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1da00044d0 0x7f1da0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1dbda1d700 1 -- 172.21.2.102:0/1103397603 reap_dead start 2021-02-12T17:16:06.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1dbd21c700 1 -- 172.21.2.102:0/1103397603 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da0003230 con 0x7f1da0003900 2021-02-12T17:16:06.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1dbd21c700 1 --2- 172.21.2.102:0/1103397603 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1da0003900 0x7f1da0003d00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f1da800c190 tx=0x7f1db814eba0).ready entity=mon.0 client_cookie=ff28651f6d703178 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:06.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da800cda0 con 0x7f1da0003900 2021-02-12T17:16:06.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da80070d0 con 0x7f1da0003900 2021-02-12T17:16:06.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.292+0000 7f1da7fff700 1 -- 172.21.2.102:0/1103397603 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8007490 con 0x7f1da0003900 2021-02-12T17:16:06.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.293+0000 7f1dbf480700 1 -- 172.21.2.102:0/1103397603 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1da0003900 msgr2=0x7f1da0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.293+0000 7f1dbf480700 1 --2- 172.21.2.102:0/1103397603 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1da0003900 0x7f1da0003d00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f1da800c190 tx=0x7f1db814eba0).stop 2021-02-12T17:16:06.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.293+0000 7f1dbf480700 1 -- 172.21.2.102:0/1103397603 shutdown_connections 2021-02-12T17:16:06.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.293+0000 7f1dbf480700 1 --2- 172.21.2.102:0/1103397603 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1da0003900 0x7f1da0003d00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.293+0000 7f1dbf480700 1 -- 172.21.2.102:0/1103397603 >> 172.21.2.102:0/1103397603 conn(0x7f1db80bc480 msgr2=0x7f1db80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:06.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.293+0000 7f1dbf480700 1 -- 172.21.2.102:0/1103397603 shutdown_connections 2021-02-12T17:16:06.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.293+0000 7f1dbf480700 1 -- 172.21.2.102:0/1103397603 wait complete. 2021-02-12T17:16:06.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.294+0000 7f1dbf480700 1 Processor -- start 2021-02-12T17:16:06.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.294+0000 7f1dbf480700 1 -- start start 2021-02-12T17:16:06.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.294+0000 7f1dbf480700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1da0003900 0x7f1db80afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.294+0000 7f1dbf480700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1db8151c70 0x7f1db80b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbf480700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1db80b8130 0x7f1db81507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbf480700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80b0010 con 0x7f1db80b8130 2021-02-12T17:16:06.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbf480700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80b02b0 con 0x7f1da0003900 2021-02-12T17:16:06.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbf480700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80b0550 con 0x7f1db8151c70 2021-02-12T17:16:06.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbda1d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1db80b8130 0x7f1db81507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbda1d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1db80b8130 0x7f1db81507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44498/0 (socket says 172.21.2.102:44498) 2021-02-12T17:16:06.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbda1d700 1 -- 172.21.2.102:0/1697393484 learned_addr learned my addr 172.21.2.102:0/1697393484 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:06.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbd21c700 1 --2- 172.21.2.102:0/1697393484 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1da0003900 0x7f1db80afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbca1b700 1 --2- 172.21.2.102:0/1697393484 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1db8151c70 0x7f1db80b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbda1d700 1 -- 172.21.2.102:0/1697393484 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1db8151c70 msgr2=0x7f1db80b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbda1d700 1 --2- 172.21.2.102:0/1697393484 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1db8151c70 0x7f1db80b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbda1d700 1 -- 172.21.2.102:0/1697393484 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1da0003900 msgr2=0x7f1db80afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbda1d700 1 --2- 172.21.2.102:0/1697393484 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1da0003900 0x7f1db80afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbda1d700 1 -- 172.21.2.102:0/1697393484 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db8150090 con 0x7f1db80b8130 2021-02-12T17:16:06.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbda1d700 1 --2- 172.21.2.102:0/1697393484 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1db80b8130 0x7f1db81507d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f1db8065550 tx=0x7f1db0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:06.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1da57fa700 1 -- 172.21.2.102:0/1697393484 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00040d0 con 0x7f1db80b8130 2021-02-12T17:16:06.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1da57fa700 1 -- 172.21.2.102:0/1697393484 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db0006a70 con 0x7f1db80b8130 2021-02-12T17:16:06.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbf480700 1 -- 172.21.2.102:0/1697393484 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db8150330 con 0x7f1db80b8130 2021-02-12T17:16:06.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1da57fa700 1 -- 172.21.2.102:0/1697393484 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0006df0 con 0x7f1db80b8130 2021-02-12T17:16:06.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.295+0000 7f1dbf480700 1 -- 172.21.2.102:0/1697393484 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db80b85b0 con 0x7f1db80b8130 2021-02-12T17:16:06.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.296+0000 7f1dbf480700 1 -- 172.21.2.102:0/1697393484 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db8045460 con 0x7f1db80b8130 2021-02-12T17:16:06.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.296+0000 7f1da57fa700 1 -- 172.21.2.102:0/1697393484 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f1db001c060 con 0x7f1db80b8130 2021-02-12T17:16:06.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.296+0000 7f1da57fa700 1 --2- 172.21.2.102:0/1697393484 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1d98059d30 0x7f1d9805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.296+0000 7f1da57fa700 1 -- 172.21.2.102:0/1697393484 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f1db00732e0 con 0x7f1db80b8130 2021-02-12T17:16:06.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.297+0000 7f1dbd21c700 1 --2- 172.21.2.102:0/1697393484 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1d98059d30 0x7f1d9805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.297+0000 7f1dbd21c700 1 --2- 172.21.2.102:0/1697393484 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1d98059d30 0x7f1d9805c1f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1da8000bc0 tx=0x7f1da8013000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:06.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.299+0000 7f1da57fa700 1 -- 172.21.2.102:0/1697393484 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f1db0046e30 con 0x7f1db80b8130 2021-02-12T17:16:06.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.430+0000 7f1dbf480700 1 -- 172.21.2.102:0/1697393484 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1db8063670 con 0x7f1db80b8130 2021-02-12T17:16:06.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.430+0000 7f1da57fa700 1 -- 172.21.2.102:0/1697393484 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v23) v1 ==== 84+0+275 (secure 0 0 0) 0x7f1db001a070 con 0x7f1db80b8130 2021-02-12T17:16:06.431 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:06.432 INFO:teuthology.orchestra.run.gibba002.stdout:[ 2021-02-12T17:16:06.432 INFO:teuthology.orchestra.run.gibba002.stdout: { 2021-02-12T17:16:06.432 INFO:teuthology.orchestra.run.gibba002.stdout: "poolnum": 1, 2021-02-12T17:16:06.432 INFO:teuthology.orchestra.run.gibba002.stdout: "poolname": "device_health_metrics" 2021-02-12T17:16:06.432 INFO:teuthology.orchestra.run.gibba002.stdout: }, 2021-02-12T17:16:06.432 INFO:teuthology.orchestra.run.gibba002.stdout: { 2021-02-12T17:16:06.432 INFO:teuthology.orchestra.run.gibba002.stdout: "poolnum": 2, 2021-02-12T17:16:06.432 INFO:teuthology.orchestra.run.gibba002.stdout: "poolname": "rbd" 2021-02-12T17:16:06.432 INFO:teuthology.orchestra.run.gibba002.stdout: }, 2021-02-12T17:16:06.432 INFO:teuthology.orchestra.run.gibba002.stdout: { 2021-02-12T17:16:06.432 INFO:teuthology.orchestra.run.gibba002.stdout: "poolnum": 3, 2021-02-12T17:16:06.432 INFO:teuthology.orchestra.run.gibba002.stdout: "poolname": "a_metadata" 2021-02-12T17:16:06.433 INFO:teuthology.orchestra.run.gibba002.stdout: }, 2021-02-12T17:16:06.433 INFO:teuthology.orchestra.run.gibba002.stdout: { 2021-02-12T17:16:06.433 INFO:teuthology.orchestra.run.gibba002.stdout: "poolnum": 4, 2021-02-12T17:16:06.433 INFO:teuthology.orchestra.run.gibba002.stdout: "poolname": "a_data" 2021-02-12T17:16:06.433 INFO:teuthology.orchestra.run.gibba002.stdout: } 2021-02-12T17:16:06.433 INFO:teuthology.orchestra.run.gibba002.stdout:] 2021-02-12T17:16:06.434 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.431+0000 7f1dbf480700 1 -- 172.21.2.102:0/1697393484 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1d98059d30 msgr2=0x7f1d9805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.434 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.431+0000 7f1dbf480700 1 --2- 172.21.2.102:0/1697393484 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1d98059d30 0x7f1d9805c1f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1da8000bc0 tx=0x7f1da8013000).stop 2021-02-12T17:16:06.434 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.431+0000 7f1dbf480700 1 -- 172.21.2.102:0/1697393484 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1db80b8130 msgr2=0x7f1db81507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.434 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.431+0000 7f1dbf480700 1 --2- 172.21.2.102:0/1697393484 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1db80b8130 0x7f1db81507d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f1db8065550 tx=0x7f1db0009040).stop 2021-02-12T17:16:06.434 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.431+0000 7f1dbf480700 1 -- 172.21.2.102:0/1697393484 shutdown_connections 2021-02-12T17:16:06.434 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.431+0000 7f1dbf480700 1 --2- 172.21.2.102:0/1697393484 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1d98059d30 0x7f1d9805c1f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.434 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.431+0000 7f1dbf480700 1 --2- 172.21.2.102:0/1697393484 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1db80b8130 0x7f1db81507d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.434 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.431+0000 7f1dbf480700 1 --2- 172.21.2.102:0/1697393484 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1da0003900 0x7f1db80afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.434 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.431+0000 7f1dbf480700 1 --2- 172.21.2.102:0/1697393484 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1db8151c70 0x7f1db80b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.434 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.431+0000 7f1dbf480700 1 -- 172.21.2.102:0/1697393484 >> 172.21.2.102:0/1697393484 conn(0x7f1db80bc480 msgr2=0x7f1db814cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:06.435 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.431+0000 7f1dbf480700 1 -- 172.21.2.102:0/1697393484 shutdown_connections 2021-02-12T17:16:06.435 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.431+0000 7f1dbf480700 1 -- 172.21.2.102:0/1697393484 wait complete. 2021-02-12T17:16:06.441 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'b' 2021-02-12T17:16:06.441 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_metadata 8 2021-02-12T17:16:06.530 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.529+0000 7f40df4ee700 1 Processor -- start 2021-02-12T17:16:06.530 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.529+0000 7f40df4ee700 1 -- start start 2021-02-12T17:16:06.531 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.529+0000 7f40df4ee700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f40d80bc2b0 0x7f40d8151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.531 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.529+0000 7f40df4ee700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40d80b0940 0x7f40d8151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.531 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.529+0000 7f40df4ee700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d8066b70 con 0x7f40d809ada0 2021-02-12T17:16:06.531 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.529+0000 7f40df4ee700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d80b27d0 con 0x7f40d80bc2b0 2021-02-12T17:16:06.531 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.529+0000 7f40df4ee700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d80b7110 con 0x7f40d80b0940 2021-02-12T17:16:06.532 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.531+0000 7f40dca89700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40d80b0940 0x7f40d8151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.532 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.531+0000 7f40dd28a700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f40d80bc2b0 0x7f40d8151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.532 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.531+0000 7f40dda8b700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f40d809ada0 0x7f40d814d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:35522/0 (socket says 172.21.2.102:35522) 2021-02-12T17:16:06.532 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.531+0000 7f40dda8b700 1 -- 172.21.2.102:0/458501581 learned_addr learned my addr 172.21.2.102:0/458501581 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:06.533 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.531+0000 7f40dca89700 1 -- 172.21.2.102:0/458501581 >> v2:172.21.2.104:3300/0 conn(0x7f40d80bc2b0 msgr2=0x7f40d8151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:06.533 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.531+0000 7f40dca89700 1 --2- 172.21.2.102:0/458501581 >> v2:172.21.2.104:3300/0 conn(0x7f40d80bc2b0 0x7f40d8151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.533 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.531+0000 7f40dca89700 1 -- 172.21.2.102:0/458501581 >> v1:172.21.2.104:6789/0 conn(0x7f40d809ada0 legacy=0x7f40d814d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.533 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.531+0000 7f40dca89700 1 -- 172.21.2.102:0/458501581 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d80685b0 con 0x7f40d80b0940 2021-02-12T17:16:06.533 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.531+0000 7f40dd28a700 1 --2- 172.21.2.102:0/458501581 >> v2:172.21.2.104:3300/0 conn(0x7f40d80bc2b0 0x7f40d8151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:16:06.533 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.531+0000 7f40dca89700 1 --2- 172.21.2.102:0/458501581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40d80b0940 0x7f40d8151610 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f40c800b980 tx=0x7f40c8006de0).ready entity=mon.2 client_cookie=17568e6109e124a1 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:06.534 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.532+0000 7f40c7fff700 1 -- 172.21.2.102:0/458501581 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c800be70 con 0x7f40d80b0940 2021-02-12T17:16:06.534 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.532+0000 7f40c7fff700 1 -- 172.21.2.102:0/458501581 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c8009870 con 0x7f40d80b0940 2021-02-12T17:16:06.534 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.532+0000 7f40c7fff700 1 -- 172.21.2.102:0/458501581 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8009bf0 con 0x7f40d80b0940 2021-02-12T17:16:06.535 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.532+0000 7f40df4ee700 1 -- 172.21.2.102:0/458501581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40d80b0940 msgr2=0x7f40d8151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.535 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.532+0000 7f40df4ee700 1 --2- 172.21.2.102:0/458501581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40d80b0940 0x7f40d8151610 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f40c800b980 tx=0x7f40c8006de0).stop 2021-02-12T17:16:06.535 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.532+0000 7f40df4ee700 1 -- 172.21.2.102:0/458501581 shutdown_connections 2021-02-12T17:16:06.535 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.532+0000 7f40df4ee700 1 --2- 172.21.2.102:0/458501581 >> v2:172.21.2.104:3300/0 conn(0x7f40d80bc2b0 0x7f40d8151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.535 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.532+0000 7f40df4ee700 1 --2- 172.21.2.102:0/458501581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40d80b0940 0x7f40d8151610 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.535 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.532+0000 7f40df4ee700 1 -- 172.21.2.102:0/458501581 >> 172.21.2.102:0/458501581 conn(0x7f40d8061830 msgr2=0x7f40d80bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:06.535 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.533+0000 7f40df4ee700 1 -- 172.21.2.102:0/458501581 shutdown_connections 2021-02-12T17:16:06.535 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.533+0000 7f40df4ee700 1 -- 172.21.2.102:0/458501581 wait complete. 2021-02-12T17:16:06.535 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.533+0000 7f40df4ee700 1 Processor -- start 2021-02-12T17:16:06.535 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.533+0000 7f40df4ee700 1 -- start start 2021-02-12T17:16:06.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40df4ee700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40d809ada0 0x7f40d814faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40df4ee700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40d80b0940 0x7f40d809f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40df4ee700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40d80bc2b0 0x7f40d809fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40df4ee700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8063e00 con 0x7f40d80b0940 2021-02-12T17:16:06.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40df4ee700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d814ee60 con 0x7f40d809ada0 2021-02-12T17:16:06.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40df4ee700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d815d1e0 con 0x7f40d80bc2b0 2021-02-12T17:16:06.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40dda8b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40d80bc2b0 0x7f40d809fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40dca89700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40d80b0940 0x7f40d809f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40dca89700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40d80b0940 0x7f40d809f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44516/0 (socket says 172.21.2.102:44516) 2021-02-12T17:16:06.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40dca89700 1 -- 172.21.2.102:0/1854517060 learned_addr learned my addr 172.21.2.102:0/1854517060 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:06.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40dd28a700 1 --2- 172.21.2.102:0/1854517060 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40d809ada0 0x7f40d814faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40dca89700 1 -- 172.21.2.102:0/1854517060 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40d80bc2b0 msgr2=0x7f40d809fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40dca89700 1 --2- 172.21.2.102:0/1854517060 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40d80bc2b0 0x7f40d809fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40dca89700 1 -- 172.21.2.102:0/1854517060 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40d809ada0 msgr2=0x7f40d814faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:06.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40dca89700 1 --2- 172.21.2.102:0/1854517060 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40d809ada0 0x7f40d814faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:06.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40dca89700 1 -- 172.21.2.102:0/1854517060 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d815d480 con 0x7f40d80b0940 2021-02-12T17:16:06.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.534+0000 7f40dca89700 1 --2- 172.21.2.102:0/1854517060 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40d80b0940 0x7f40d809f6d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f40c800b130 tx=0x7f40c8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:06.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.535+0000 7f40c57fa700 1 -- 172.21.2.102:0/1854517060 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8020070 con 0x7f40d80b0940 2021-02-12T17:16:06.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.535+0000 7f40c57fa700 1 -- 172.21.2.102:0/1854517060 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c8012c50 con 0x7f40d80b0940 2021-02-12T17:16:06.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.535+0000 7f40df4ee700 1 -- 172.21.2.102:0/1854517060 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d814f0c0 con 0x7f40d80b0940 2021-02-12T17:16:06.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.535+0000 7f40c57fa700 1 -- 172.21.2.102:0/1854517060 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c801c420 con 0x7f40d80b0940 2021-02-12T17:16:06.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.535+0000 7f40df4ee700 1 -- 172.21.2.102:0/1854517060 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d814f600 con 0x7f40d80b0940 2021-02-12T17:16:06.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.535+0000 7f40df4ee700 1 -- 172.21.2.102:0/1854517060 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d8045460 con 0x7f40d80b0940 2021-02-12T17:16:06.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.536+0000 7f40c57fa700 1 -- 172.21.2.102:0/1854517060 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f40c800f070 con 0x7f40d80b0940 2021-02-12T17:16:06.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.536+0000 7f40c57fa700 1 --2- 172.21.2.102:0/1854517060 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f40b8059d80 0x7f40b805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:06.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.536+0000 7f40c57fa700 1 -- 172.21.2.102:0/1854517060 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f40c8074960 con 0x7f40d80b0940 2021-02-12T17:16:06.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.536+0000 7f40dd28a700 1 --2- 172.21.2.102:0/1854517060 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f40b8059d80 0x7f40b805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:06.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.536+0000 7f40dd28a700 1 --2- 172.21.2.102:0/1854517060 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f40b8059d80 0x7f40b805c240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f40d400bcf0 tx=0x7f40d4006de0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:06.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.539+0000 7f40c57fa700 1 -- 172.21.2.102:0/1854517060 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f40c8048420 con 0x7f40d80b0940 2021-02-12T17:16:06.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:06.667+0000 7f40df4ee700 1 -- 172.21.2.102:0/1854517060 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_metadata", "pg_num": 8} v 0) v1 -- 0x7f40d80b7650 con 0x7f40d80b0940 2021-02-12T17:16:07.258 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.257+0000 7f40c57fa700 1 -- 172.21.2.102:0/1854517060 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_metadata", "pg_num": 8}]=0 pool 'b_metadata' created v24) v1 ==== 123+0+0 (secure 0 0 0) 0x7f40c804ba40 con 0x7f40d80b0940 2021-02-12T17:16:07.260 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.259+0000 7f40df4ee700 1 -- 172.21.2.102:0/1854517060 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f40b8059d80 msgr2=0x7f40b805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:07.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.259+0000 7f40df4ee700 1 --2- 172.21.2.102:0/1854517060 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f40b8059d80 0x7f40b805c240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f40d400bcf0 tx=0x7f40d4006de0).stop 2021-02-12T17:16:07.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.259+0000 7f40df4ee700 1 -- 172.21.2.102:0/1854517060 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40d80b0940 msgr2=0x7f40d809f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:07.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.259+0000 7f40df4ee700 1 --2- 172.21.2.102:0/1854517060 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40d80b0940 0x7f40d809f6d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f40c800b130 tx=0x7f40c8016000).stop 2021-02-12T17:16:07.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.259+0000 7f40df4ee700 1 -- 172.21.2.102:0/1854517060 shutdown_connections 2021-02-12T17:16:07.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.259+0000 7f40df4ee700 1 --2- 172.21.2.102:0/1854517060 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40d80bc2b0 0x7f40d809fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:07.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.259+0000 7f40df4ee700 1 --2- 172.21.2.102:0/1854517060 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40d809ada0 0x7f40d814faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:07.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.259+0000 7f40df4ee700 1 --2- 172.21.2.102:0/1854517060 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f40b8059d80 0x7f40b805c240 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:07.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.259+0000 7f40df4ee700 1 --2- 172.21.2.102:0/1854517060 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40d80b0940 0x7f40d809f6d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:07.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.259+0000 7f40df4ee700 1 -- 172.21.2.102:0/1854517060 >> 172.21.2.102:0/1854517060 conn(0x7f40d8061830 msgr2=0x7f40d80b83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:07.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.259+0000 7f40df4ee700 1 -- 172.21.2.102:0/1854517060 shutdown_connections 2021-02-12T17:16:07.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.259+0000 7f40df4ee700 1 -- 172.21.2.102:0/1854517060 wait complete. 2021-02-12T17:16:07.263 INFO:teuthology.orchestra.run.gibba002.stderr:pool 'b_metadata' created 2021-02-12T17:16:07.269 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_data 8 2021-02-12T17:16:07.362 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.360+0000 7fc541d27700 1 Processor -- start 2021-02-12T17:16:07.362 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.360+0000 7fc541d27700 1 -- start start 2021-02-12T17:16:07.362 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.361+0000 7fc541d27700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc53c0bc2b0 0x7fc53c151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:07.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.361+0000 7fc541d27700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fc53c0b0940 0x7fc53c151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:07.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.361+0000 7fc541d27700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53c066b70 con 0x7fc53c09ada0 2021-02-12T17:16:07.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.361+0000 7fc541d27700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c0b27d0 con 0x7fc53c0b0940 2021-02-12T17:16:07.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.361+0000 7fc541d27700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0b7110 con 0x7fc53c0bc2b0 2021-02-12T17:16:07.365 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.362+0000 7fc53affd700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fc53c0b0940 0x7fc53c151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:07.365 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.362+0000 7fc53b7fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc53c0bc2b0 0x7fc53c151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:07.365 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.362+0000 7fc53bfff700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7fc53c09ada0 0x7fc53c14d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:35536/0 (socket says 172.21.2.102:35536) 2021-02-12T17:16:07.366 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.362+0000 7fc53bfff700 1 -- 172.21.2.102:0/2647801529 learned_addr learned my addr 172.21.2.102:0/2647801529 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:07.366 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.362+0000 7fc53affd700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fc53c0b0940 0x7fc53c151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:42880/0 (socket says 172.21.2.102:42880) 2021-02-12T17:16:07.366 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.363+0000 7fc53affd700 1 -- 172.21.2.102:0/2647801529 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc53c0bc2b0 msgr2=0x7fc53c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:07.366 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.363+0000 7fc53affd700 1 --2- 172.21.2.102:0/2647801529 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc53c0bc2b0 0x7fc53c151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:07.366 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.363+0000 7fc53affd700 1 -- 172.21.2.102:0/2647801529 >> v1:172.21.2.104:6789/0 conn(0x7fc53c09ada0 legacy=0x7fc53c14d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:07.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.363+0000 7fc53affd700 1 -- 172.21.2.102:0/2647801529 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c0685b0 con 0x7fc53c0b0940 2021-02-12T17:16:07.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.363+0000 7fc53affd700 1 --2- 172.21.2.102:0/2647801529 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc53c0b0940 0x7fc53c151610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc52400b980 tx=0x7fc524006de0).ready entity=mon.1 client_cookie=4d09e12653131e40 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:07.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.363+0000 7fc53a7fc700 1 -- 172.21.2.102:0/2647801529 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52400be70 con 0x7fc53c0b0940 2021-02-12T17:16:07.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.363+0000 7fc53a7fc700 1 -- 172.21.2.102:0/2647801529 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524009870 con 0x7fc53c0b0940 2021-02-12T17:16:07.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.363+0000 7fc53a7fc700 1 -- 172.21.2.102:0/2647801529 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524009bf0 con 0x7fc53c0b0940 2021-02-12T17:16:07.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.363+0000 7fc541d27700 1 -- 172.21.2.102:0/2647801529 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc53c0b0940 msgr2=0x7fc53c151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:07.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.363+0000 7fc541d27700 1 --2- 172.21.2.102:0/2647801529 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc53c0b0940 0x7fc53c151610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc52400b980 tx=0x7fc524006de0).stop 2021-02-12T17:16:07.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.363+0000 7fc541d27700 1 -- 172.21.2.102:0/2647801529 shutdown_connections 2021-02-12T17:16:07.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.363+0000 7fc541d27700 1 --2- 172.21.2.102:0/2647801529 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc53c0bc2b0 0x7fc53c151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:07.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.364+0000 7fc541d27700 1 --2- 172.21.2.102:0/2647801529 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc53c0b0940 0x7fc53c151610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:07.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.364+0000 7fc541d27700 1 -- 172.21.2.102:0/2647801529 >> 172.21.2.102:0/2647801529 conn(0x7fc53c061830 msgr2=0x7fc53c0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:07.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.364+0000 7fc541d27700 1 -- 172.21.2.102:0/2647801529 shutdown_connections 2021-02-12T17:16:07.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.364+0000 7fc541d27700 1 -- 172.21.2.102:0/2647801529 wait complete. 2021-02-12T17:16:07.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.364+0000 7fc541d27700 1 Processor -- start 2021-02-12T17:16:07.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.364+0000 7fc541d27700 1 -- start start 2021-02-12T17:16:07.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc541d27700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc53c09ada0 0x7fc53c062e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:07.374 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc541d27700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc53c0b0940 0x7fc53c063340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:07.374 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc541d27700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc53c0bc2b0 0x7fc53c061df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:07.374 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc541d27700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c063830 con 0x7fc53c0bc2b0 2021-02-12T17:16:07.374 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc541d27700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c064230 con 0x7fc53c09ada0 2021-02-12T17:16:07.375 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc541d27700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0a04c0 con 0x7fc53c0b0940 2021-02-12T17:16:07.375 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc53bfff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc53c0bc2b0 0x7fc53c061df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:07.375 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc53bfff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc53c0bc2b0 0x7fc53c061df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44530/0 (socket says 172.21.2.102:44530) 2021-02-12T17:16:07.375 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc53bfff700 1 -- 172.21.2.102:0/299164582 learned_addr learned my addr 172.21.2.102:0/299164582 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:07.375 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc53b7fe700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc53c09ada0 0x7fc53c062e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:07.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc53affd700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc53c0b0940 0x7fc53c063340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:07.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc53bfff700 1 -- 172.21.2.102:0/299164582 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc53c0b0940 msgr2=0x7fc53c063340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:07.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc53bfff700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc53c0b0940 0x7fc53c063340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:07.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc53bfff700 1 -- 172.21.2.102:0/299164582 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc53c09ada0 msgr2=0x7fc53c062e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:07.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc53bfff700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc53c09ada0 0x7fc53c062e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:07.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc53bfff700 1 -- 172.21.2.102:0/299164582 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c0a0760 con 0x7fc53c0bc2b0 2021-02-12T17:16:07.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc53affd700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc53c0b0940 0x7fc53c063340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:07.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc53b7fe700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc53c09ada0 0x7fc53c062e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:07.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc53bfff700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc53c0bc2b0 0x7fc53c061df0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc53400ca90 tx=0x7fc534007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:07.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc5337fe700 1 -- 172.21.2.102:0/299164582 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534005b70 con 0x7fc53c0bc2b0 2021-02-12T17:16:07.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc5337fe700 1 -- 172.21.2.102:0/299164582 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc534005cd0 con 0x7fc53c0bc2b0 2021-02-12T17:16:07.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc5337fe700 1 -- 172.21.2.102:0/299164582 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534007340 con 0x7fc53c0bc2b0 2021-02-12T17:16:07.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc541d27700 1 -- 172.21.2.102:0/299164582 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c0a0a00 con 0x7fc53c0bc2b0 2021-02-12T17:16:07.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.365+0000 7fc541d27700 1 -- 172.21.2.102:0/299164582 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c14b5e0 con 0x7fc53c0bc2b0 2021-02-12T17:16:07.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.366+0000 7fc541d27700 1 -- 172.21.2.102:0/299164582 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53c0a0310 con 0x7fc53c0bc2b0 2021-02-12T17:16:07.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.366+0000 7fc5337fe700 1 -- 172.21.2.102:0/299164582 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fc534010030 con 0x7fc53c0bc2b0 2021-02-12T17:16:07.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.367+0000 7fc5337fe700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc520059d30 0x7fc52005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:07.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.367+0000 7fc5337fe700 1 -- 172.21.2.102:0/299164582 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6398+0+0 (secure 0 0 0) 0x7fc534073b50 con 0x7fc53c0bc2b0 2021-02-12T17:16:07.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.367+0000 7fc53b7fe700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc520059d30 0x7fc52005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:07.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.367+0000 7fc53b7fe700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc520059d30 0x7fc52005c1f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc52c00ca90 tx=0x7fc52c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:07.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.370+0000 7fc5337fe700 1 -- 172.21.2.102:0/299164582 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fc534047440 con 0x7fc53c0bc2b0 2021-02-12T17:16:07.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:07.500+0000 7fc541d27700 1 -- 172.21.2.102:0/299164582 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_data", "pg_num": 8} v 0) v1 -- 0x7fc53c0a0b90 con 0x7fc53c0bc2b0 2021-02-12T17:16:08.264 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.263+0000 7fc5337fe700 1 -- 172.21.2.102:0/299164582 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_data", "pg_num": 8}]=0 pool 'b_data' created v25) v1 ==== 115+0+0 (secure 0 0 0) 0x7fc53404aa60 con 0x7fc53c0bc2b0 2021-02-12T17:16:08.266 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.265+0000 7fc541d27700 1 -- 172.21.2.102:0/299164582 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc520059d30 msgr2=0x7fc52005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:08.267 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.265+0000 7fc541d27700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc520059d30 0x7fc52005c1f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc52c00ca90 tx=0x7fc52c008040).stop 2021-02-12T17:16:08.267 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.265+0000 7fc541d27700 1 -- 172.21.2.102:0/299164582 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc53c0bc2b0 msgr2=0x7fc53c061df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:08.267 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.265+0000 7fc541d27700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc53c0bc2b0 0x7fc53c061df0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc53400ca90 tx=0x7fc534007f30).stop 2021-02-12T17:16:08.267 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.265+0000 7fc541d27700 1 -- 172.21.2.102:0/299164582 shutdown_connections 2021-02-12T17:16:08.267 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.265+0000 7fc541d27700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc520059d30 0x7fc52005c1f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.267 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.265+0000 7fc541d27700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc53c0bc2b0 0x7fc53c061df0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.267 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.265+0000 7fc541d27700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc53c09ada0 0x7fc53c062e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.267 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.265+0000 7fc541d27700 1 --2- 172.21.2.102:0/299164582 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc53c0b0940 0x7fc53c063340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.267 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.265+0000 7fc541d27700 1 -- 172.21.2.102:0/299164582 >> 172.21.2.102:0/299164582 conn(0x7fc53c061830 msgr2=0x7fc53c0b98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:08.267 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.265+0000 7fc541d27700 1 -- 172.21.2.102:0/299164582 shutdown_connections 2021-02-12T17:16:08.267 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.265+0000 7fc541d27700 1 -- 172.21.2.102:0/299164582 wait complete. 2021-02-12T17:16:08.268 INFO:teuthology.orchestra.run.gibba002.stderr:pool 'b_data' created 2021-02-12T17:16:08.275 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new b b_metadata b_data 2021-02-12T17:16:08.364 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.363+0000 7fa7441b9700 1 Processor -- start 2021-02-12T17:16:08.364 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.363+0000 7fa7441b9700 1 -- start start 2021-02-12T17:16:08.365 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.363+0000 7fa7441b9700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa73c0bc2b0 0x7fa73c151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.365 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.363+0000 7fa7441b9700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fa73c151d20 0x7fa73c14e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.365 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.363+0000 7fa7441b9700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c066b70 con 0x7fa73c0b0940 2021-02-12T17:16:08.365 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.363+0000 7fa7441b9700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0b27d0 con 0x7fa73c151d20 2021-02-12T17:16:08.365 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.363+0000 7fa7441b9700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c14e550 con 0x7fa73c0bc2b0 2021-02-12T17:16:08.365 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.364+0000 7fa742756700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fa73c151d20 0x7fa73c14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:08.365 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.364+0000 7fa742756700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fa73c151d20 0x7fa73c14e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:42894/0 (socket says 172.21.2.102:42894) 2021-02-12T17:16:08.365 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.364+0000 7fa741f55700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa73c0bc2b0 0x7fa73c151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:08.365 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.364+0000 7fa741754700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7fa73c0b0940 0x7fa73c151610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:35550/0 (socket says 172.21.2.102:35550) 2021-02-12T17:16:08.365 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.364+0000 7fa742756700 1 -- 172.21.2.102:0/1973517869 learned_addr learned my addr 172.21.2.102:0/1973517869 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:08.366 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.364+0000 7fa742756700 1 -- 172.21.2.102:0/1973517869 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa73c0bc2b0 msgr2=0x7fa73c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:08.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.364+0000 7fa742756700 1 --2- 172.21.2.102:0/1973517869 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa73c0bc2b0 0x7fa73c151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.364+0000 7fa742756700 1 -- 172.21.2.102:0/1973517869 >> v1:172.21.2.104:6789/0 conn(0x7fa73c0b0940 legacy=0x7fa73c151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:08.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.364+0000 7fa742756700 1 -- 172.21.2.102:0/1973517869 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0685b0 con 0x7fa73c151d20 2021-02-12T17:16:08.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.364+0000 7fa742756700 1 --2- 172.21.2.102:0/1973517869 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa73c151d20 0x7fa73c14e060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fa734009d50 tx=0x7fa734009290).ready entity=mon.1 client_cookie=91d2175fa8b30139 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:08.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.364+0000 7fa740f53700 1 -- 172.21.2.102:0/1973517869 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400bc80 con 0x7fa73c151d20 2021-02-12T17:16:08.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.364+0000 7fa740f53700 1 -- 172.21.2.102:0/1973517869 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73400bde0 con 0x7fa73c151d20 2021-02-12T17:16:08.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.364+0000 7fa740f53700 1 -- 172.21.2.102:0/1973517869 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734011610 con 0x7fa73c151d20 2021-02-12T17:16:08.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.365+0000 7fa7441b9700 1 -- 172.21.2.102:0/1973517869 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa73c151d20 msgr2=0x7fa73c14e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:08.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.365+0000 7fa7441b9700 1 --2- 172.21.2.102:0/1973517869 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa73c151d20 0x7fa73c14e060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fa734009d50 tx=0x7fa734009290).stop 2021-02-12T17:16:08.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.365+0000 7fa7441b9700 1 -- 172.21.2.102:0/1973517869 shutdown_connections 2021-02-12T17:16:08.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.365+0000 7fa7441b9700 1 --2- 172.21.2.102:0/1973517869 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa73c151d20 0x7fa73c14e060 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.365+0000 7fa7441b9700 1 --2- 172.21.2.102:0/1973517869 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa73c0bc2b0 0x7fa73c151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.365+0000 7fa7441b9700 1 -- 172.21.2.102:0/1973517869 >> 172.21.2.102:0/1973517869 conn(0x7fa73c061830 msgr2=0x7fa73c0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:08.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.365+0000 7fa7441b9700 1 -- 172.21.2.102:0/1973517869 shutdown_connections 2021-02-12T17:16:08.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.365+0000 7fa7441b9700 1 -- 172.21.2.102:0/1973517869 wait complete. 2021-02-12T17:16:08.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.366+0000 7fa7441b9700 1 Processor -- start 2021-02-12T17:16:08.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.366+0000 7fa7441b9700 1 -- start start 2021-02-12T17:16:08.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.366+0000 7fa7441b9700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa73c0b0940 0x7fa73c0b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.366+0000 7fa7441b9700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa73c0bc2b0 0x7fa73c0bae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.366+0000 7fa7441b9700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa73c151d20 0x7fa73c14c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.366+0000 7fa7441b9700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c160d20 con 0x7fa73c0b0940 2021-02-12T17:16:08.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.366+0000 7fa7441b9700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c160fc0 con 0x7fa73c151d20 2021-02-12T17:16:08.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.366+0000 7fa7441b9700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c161260 con 0x7fa73c0bc2b0 2021-02-12T17:16:08.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.366+0000 7fa741f55700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa73c0b0940 0x7fa73c0b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:08.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.366+0000 7fa741f55700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa73c0b0940 0x7fa73c0b57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44540/0 (socket says 172.21.2.102:44540) 2021-02-12T17:16:08.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.366+0000 7fa741f55700 1 -- 172.21.2.102:0/2140148738 learned_addr learned my addr 172.21.2.102:0/2140148738 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:08.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.366+0000 7fa742756700 1 --2- 172.21.2.102:0/2140148738 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa73c151d20 0x7fa73c14c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:08.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.366+0000 7fa741754700 1 --2- 172.21.2.102:0/2140148738 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa73c0bc2b0 0x7fa73c0bae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:08.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.367+0000 7fa741f55700 1 -- 172.21.2.102:0/2140148738 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa73c0bc2b0 msgr2=0x7fa73c0bae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:08.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.367+0000 7fa741f55700 1 --2- 172.21.2.102:0/2140148738 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa73c0bc2b0 0x7fa73c0bae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.367+0000 7fa741f55700 1 -- 172.21.2.102:0/2140148738 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa73c151d20 msgr2=0x7fa73c14c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:08.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.367+0000 7fa741f55700 1 --2- 172.21.2.102:0/2140148738 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa73c151d20 0x7fa73c14c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.367+0000 7fa741f55700 1 -- 172.21.2.102:0/2140148738 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c161500 con 0x7fa73c0b0940 2021-02-12T17:16:08.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.367+0000 7fa741f55700 1 --2- 172.21.2.102:0/2140148738 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa73c0b0940 0x7fa73c0b57e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fa73000eb20 tx=0x7fa730006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:08.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.367+0000 7fa72dffb700 1 -- 172.21.2.102:0/2140148738 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73000c8e0 con 0x7fa73c0b0940 2021-02-12T17:16:08.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.367+0000 7fa72dffb700 1 -- 172.21.2.102:0/2140148738 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73000ca40 con 0x7fa73c0b0940 2021-02-12T17:16:08.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.367+0000 7fa72dffb700 1 -- 172.21.2.102:0/2140148738 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73000cdc0 con 0x7fa73c0b0940 2021-02-12T17:16:08.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.367+0000 7fa7441b9700 1 -- 172.21.2.102:0/2140148738 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c1617a0 con 0x7fa73c0b0940 2021-02-12T17:16:08.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.367+0000 7fa7441b9700 1 -- 172.21.2.102:0/2140148738 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c0b5cd0 con 0x7fa73c0b0940 2021-02-12T17:16:08.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.368+0000 7fa7441b9700 1 -- 172.21.2.102:0/2140148738 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c161b40 con 0x7fa73c0b0940 2021-02-12T17:16:08.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.368+0000 7fa72dffb700 1 -- 172.21.2.102:0/2140148738 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fa730012600 con 0x7fa73c0b0940 2021-02-12T17:16:08.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.368+0000 7fa72dffb700 1 --2- 172.21.2.102:0/2140148738 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa71c059d30 0x7fa71c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.368+0000 7fa72dffb700 1 -- 172.21.2.102:0/2140148738 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6743+0+0 (secure 0 0 0) 0x7fa730074110 con 0x7fa73c0b0940 2021-02-12T17:16:08.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.368+0000 7fa741754700 1 --2- 172.21.2.102:0/2140148738 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa71c059d30 0x7fa71c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:08.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.369+0000 7fa741754700 1 --2- 172.21.2.102:0/2140148738 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa71c059d30 0x7fa71c05c1f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa73c0bbc50 tx=0x7fa738007b70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:08.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.371+0000 7fa72dffb700 1 -- 172.21.2.102:0/2140148738 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fa7300478a0 con 0x7fa73c0b0940 2021-02-12T17:16:08.529 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.528+0000 7fa7441b9700 1 -- 172.21.2.102:0/2140148738 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"} v 0) v1 -- 0x7fa73c045460 con 0x7fa73c0b0940 2021-02-12T17:16:08.533 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.532+0000 7fa72dffb700 1 -- 172.21.2.102:0/2140148738 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"}]=0 new fs with metadata pool 5 and data pool 6 v8) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa73004aec0 con 0x7fa73c0b0940 2021-02-12T17:16:08.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.534+0000 7fa7441b9700 1 -- 172.21.2.102:0/2140148738 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa71c059d30 msgr2=0x7fa71c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:08.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.534+0000 7fa7441b9700 1 --2- 172.21.2.102:0/2140148738 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa71c059d30 0x7fa71c05c1f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa73c0bbc50 tx=0x7fa738007b70).stop 2021-02-12T17:16:08.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.534+0000 7fa7441b9700 1 -- 172.21.2.102:0/2140148738 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa73c0b0940 msgr2=0x7fa73c0b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:08.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.534+0000 7fa7441b9700 1 --2- 172.21.2.102:0/2140148738 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa73c0b0940 0x7fa73c0b57e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fa73000eb20 tx=0x7fa730006de0).stop 2021-02-12T17:16:08.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.534+0000 7fa7441b9700 1 -- 172.21.2.102:0/2140148738 shutdown_connections 2021-02-12T17:16:08.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.534+0000 7fa7441b9700 1 --2- 172.21.2.102:0/2140148738 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa73c151d20 0x7fa73c14c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.534+0000 7fa7441b9700 1 --2- 172.21.2.102:0/2140148738 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa71c059d30 0x7fa71c05c1f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.534+0000 7fa7441b9700 1 --2- 172.21.2.102:0/2140148738 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa73c0b0940 0x7fa73c0b57e0 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0x7fa73000eb20 tx=0x7fa730006de0).stop 2021-02-12T17:16:08.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.534+0000 7fa7441b9700 1 --2- 172.21.2.102:0/2140148738 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa73c0bc2b0 0x7fa73c0bae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.534+0000 7fa7441b9700 1 -- 172.21.2.102:0/2140148738 >> 172.21.2.102:0/2140148738 conn(0x7fa73c061830 msgr2=0x7fa73c0b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:08.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.535+0000 7fa7441b9700 1 -- 172.21.2.102:0/2140148738 shutdown_connections 2021-02-12T17:16:08.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.535+0000 7fa7441b9700 1 -- 172.21.2.102:0/2140148738 wait complete. 2021-02-12T17:16:08.538 INFO:teuthology.orchestra.run.gibba002.stderr:new fs with metadata pool 5 and data pool 6 2021-02-12T17:16:08.547 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:08.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.634+0000 7fd2cb3d3700 1 Processor -- start 2021-02-12T17:16:08.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.634+0000 7fd2cb3d3700 1 -- start start 2021-02-12T17:16:08.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.634+0000 7fd2cb3d3700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fd2c40b8d20 0x7fd2c4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.634+0000 7fd2cb3d3700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fd2c414e530 0x7fd2c40b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.634+0000 7fd2cb3d3700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd2c4062740 0x7fd2c4062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.634+0000 7fd2cb3d3700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c4068d20 con 0x7fd2c414e530 2021-02-12T17:16:08.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.634+0000 7fd2cb3d3700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c40622a0 con 0x7fd2c40b8d20 2021-02-12T17:16:08.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.634+0000 7fd2cb3d3700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c414ea10 con 0x7fd2c4062740 2021-02-12T17:16:08.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.634+0000 7fd2c896e700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fd2c414e530 0x7fd2c40b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:08.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.634+0000 7fd2c896e700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fd2c414e530 0x7fd2c40b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44560/0 (socket says 172.21.2.102:44560) 2021-02-12T17:16:08.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.634+0000 7fd2c896e700 1 -- 172.21.2.102:0/734504365 learned_addr learned my addr 172.21.2.102:0/734504365 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:08.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2c896e700 1 -- 172.21.2.102:0/734504365 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd2c4062740 msgr2=0x7fd2c4062bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:08.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2c896e700 1 --2- 172.21.2.102:0/734504365 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd2c4062740 0x7fd2c4062bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:08.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2c896e700 1 -- 172.21.2.102:0/734504365 >> v2:172.21.2.104:3300/0 conn(0x7fd2c40b8d20 msgr2=0x7fd2c4068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:08.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2c896e700 1 --2- 172.21.2.102:0/734504365 >> v2:172.21.2.104:3300/0 conn(0x7fd2c40b8d20 0x7fd2c4068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:08.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2c896e700 1 -- 172.21.2.102:0/734504365 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c40b63f0 con 0x7fd2c414e530 2021-02-12T17:16:08.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2c896e700 1 --2- 172.21.2.102:0/734504365 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd2c414e530 0x7fd2c40b7250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fd2c406abc0 tx=0x7fd2b8006ea0).ready entity=mon.0 client_cookie=4d1fcda6116eb9b1 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:08.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2c3fff700 1 -- 172.21.2.102:0/734504365 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8009840 con 0x7fd2c414e530 2021-02-12T17:16:08.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2c3fff700 1 -- 172.21.2.102:0/734504365 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b80099a0 con 0x7fd2c414e530 2021-02-12T17:16:08.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2c3fff700 1 -- 172.21.2.102:0/734504365 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8009d20 con 0x7fd2c414e530 2021-02-12T17:16:08.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/734504365 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd2c414e530 msgr2=0x7fd2c40b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:08.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2cb3d3700 1 --2- 172.21.2.102:0/734504365 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd2c414e530 0x7fd2c40b7250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fd2c406abc0 tx=0x7fd2b8006ea0).stop 2021-02-12T17:16:08.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/734504365 shutdown_connections 2021-02-12T17:16:08.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2cb3d3700 1 --2- 172.21.2.102:0/734504365 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd2c4062740 0x7fd2c4062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:08.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2cb3d3700 1 --2- 172.21.2.102:0/734504365 >> v2:172.21.2.104:3300/0 conn(0x7fd2c40b8d20 0x7fd2c4068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:08.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2cb3d3700 1 --2- 172.21.2.102:0/734504365 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd2c414e530 0x7fd2c40b7250 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/734504365 >> 172.21.2.102:0/734504365 conn(0x7fd2c40bc480 msgr2=0x7fd2c40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:08.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/734504365 shutdown_connections 2021-02-12T17:16:08.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.635+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/734504365 wait complete. 2021-02-12T17:16:08.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.636+0000 7fd2cb3d3700 1 Processor -- start 2021-02-12T17:16:08.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.636+0000 7fd2cb3d3700 1 -- start start 2021-02-12T17:16:08.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2cb3d3700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd2c4062740 0x7fd2c40b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2cb3d3700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd2c40b8d20 0x7fd2c40b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2cb3d3700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd2c414e530 0x7fd2c4160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2cb3d3700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c40b4e60 con 0x7fd2c4062740 2021-02-12T17:16:08.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2cb3d3700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c41608c0 con 0x7fd2c414e530 2021-02-12T17:16:08.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2cb3d3700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c40b5b00 con 0x7fd2c40b8d20 2021-02-12T17:16:08.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2c916f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd2c4062740 0x7fd2c40b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:08.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2c916f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd2c4062740 0x7fd2c40b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44566/0 (socket says 172.21.2.102:44566) 2021-02-12T17:16:08.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2c916f700 1 -- 172.21.2.102:0/1794977126 learned_addr learned my addr 172.21.2.102:0/1794977126 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:08.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2c916f700 1 -- 172.21.2.102:0/1794977126 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd2c40b8d20 msgr2=0x7fd2c40b9e60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:08.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2c916f700 1 --2- 172.21.2.102:0/1794977126 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd2c40b8d20 0x7fd2c40b9e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:08.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2c916f700 1 -- 172.21.2.102:0/1794977126 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd2c414e530 msgr2=0x7fd2c4160cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:08.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2c916f700 1 --2- 172.21.2.102:0/1794977126 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd2c414e530 0x7fd2c4160cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:08.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2c916f700 1 -- 172.21.2.102:0/1794977126 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c40b5da0 con 0x7fd2c4062740 2021-02-12T17:16:08.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2c916f700 1 --2- 172.21.2.102:0/1794977126 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd2c4062740 0x7fd2c40b5090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd2b40096b0 tx=0x7fd2b4006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:08.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2c17fa700 1 -- 172.21.2.102:0/1794977126 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b400d590 con 0x7fd2c4062740 2021-02-12T17:16:08.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2c17fa700 1 -- 172.21.2.102:0/1794977126 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b400d710 con 0x7fd2c4062740 2021-02-12T17:16:08.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/1794977126 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c40b3de0 con 0x7fd2c4062740 2021-02-12T17:16:08.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2c17fa700 1 -- 172.21.2.102:0/1794977126 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b400dad0 con 0x7fd2c4062740 2021-02-12T17:16:08.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.637+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/1794977126 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c40b5810 con 0x7fd2c4062740 2021-02-12T17:16:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.638+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/1794977126 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c40b4480 con 0x7fd2c4062740 2021-02-12T17:16:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.638+0000 7fd2c17fa700 1 -- 172.21.2.102:0/1794977126 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fd2b4017030 con 0x7fd2c4062740 2021-02-12T17:16:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.638+0000 7fd2c17fa700 1 --2- 172.21.2.102:0/1794977126 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd2a4059d30 0x7fd2a405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.638+0000 7fd2c17fa700 1 -- 172.21.2.102:0/1794977126 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fd2b4072ea0 con 0x7fd2c4062740 2021-02-12T17:16:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.638+0000 7fd2c896e700 1 --2- 172.21.2.102:0/1794977126 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd2a4059d30 0x7fd2a405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.639+0000 7fd2c896e700 1 --2- 172.21.2.102:0/1794977126 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd2a4059d30 0x7fd2a405c1f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd2c40b5580 tx=0x7fd2b8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.641+0000 7fd2c17fa700 1 -- 172.21.2.102:0/1794977126 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fd2b4046670 con 0x7fd2c4062740 2021-02-12T17:16:08.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.770+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/1794977126 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2c4045460 con 0x7fd2c4062740 2021-02-12T17:16:08.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.771+0000 7fd2c17fa700 1 -- 172.21.2.102:0/1794977126 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19901 (secure 0 0 0) 0x7fd2b4049c90 con 0x7fd2c4062740 2021-02-12T17:16:08.772 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:08.772 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":26,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:08.529472+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}},{"pool":5,"pool_name":"b_metadata","create_time":"2021-02-12T17:16:06.678651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}}},{"pool":6,"pool_name":"b_data","create_time":"2021-02-12T17:16:07.511756+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"b"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:08.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.772+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/1794977126 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd2a4059d30 msgr2=0x7fd2a405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:08.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.772+0000 7fd2cb3d3700 1 --2- 172.21.2.102:0/1794977126 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd2a4059d30 0x7fd2a405c1f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd2c40b5580 tx=0x7fd2b8016000).stop 2021-02-12T17:16:08.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.772+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/1794977126 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd2c4062740 msgr2=0x7fd2c40b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:08.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.772+0000 7fd2cb3d3700 1 --2- 172.21.2.102:0/1794977126 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd2c4062740 0x7fd2c40b5090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd2b40096b0 tx=0x7fd2b4006de0).stop 2021-02-12T17:16:08.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.772+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/1794977126 shutdown_connections 2021-02-12T17:16:08.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.772+0000 7fd2cb3d3700 1 --2- 172.21.2.102:0/1794977126 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd2c414e530 0x7fd2c4160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:08.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.772+0000 7fd2cb3d3700 1 --2- 172.21.2.102:0/1794977126 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd2a4059d30 0x7fd2a405c1f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.772+0000 7fd2cb3d3700 1 --2- 172.21.2.102:0/1794977126 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd2c4062740 0x7fd2c40b5090 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.772+0000 7fd2cb3d3700 1 --2- 172.21.2.102:0/1794977126 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd2c40b8d20 0x7fd2c40b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:08.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.772+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/1794977126 >> 172.21.2.102:0/1794977126 conn(0x7fd2c40bc480 msgr2=0x7fd2c414db30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:08.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.772+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/1794977126 shutdown_connections 2021-02-12T17:16:08.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.772+0000 7fd2cb3d3700 1 -- 172.21.2.102:0/1794977126 wait complete. 2021-02-12T17:16:08.782 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:08.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.869+0000 7efd5ee21700 1 Processor -- start 2021-02-12T17:16:08.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.869+0000 7efd5ee21700 1 -- start start 2021-02-12T17:16:08.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.869+0000 7efd5ee21700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7efd5814e530 0x7efd58068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.869+0000 7efd5ee21700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7efd58062740 0x7efd58062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.869+0000 7efd5ee21700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd580b7960 con 0x7efd580b8d20 2021-02-12T17:16:08.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.869+0000 7efd5ee21700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd58068d20 con 0x7efd5814e530 2021-02-12T17:16:08.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.869+0000 7efd5ee21700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd580622a0 con 0x7efd58062740 2021-02-12T17:16:08.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.870+0000 7efd57fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7efd5814e530 0x7efd58068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:08.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.870+0000 7efd57fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7efd5814e530 0x7efd58068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44576/0 (socket says 172.21.2.102:44576) 2021-02-12T17:16:08.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.870+0000 7efd57fff700 1 -- 172.21.2.102:0/2008304259 learned_addr learned my addr 172.21.2.102:0/2008304259 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:08.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.870+0000 7efd57fff700 1 -- 172.21.2.102:0/2008304259 >> v2:172.21.2.104:3300/0 conn(0x7efd58062740 msgr2=0x7efd58062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:08.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.870+0000 7efd57fff700 1 --2- 172.21.2.102:0/2008304259 >> v2:172.21.2.104:3300/0 conn(0x7efd58062740 0x7efd58062bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:08.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.870+0000 7efd57fff700 1 -- 172.21.2.102:0/2008304259 >> v1:172.21.2.104:6789/0 conn(0x7efd580b8d20 legacy=0x7efd580b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:08.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.870+0000 7efd57fff700 1 -- 172.21.2.102:0/2008304259 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5814ea10 con 0x7efd5814e530 2021-02-12T17:16:08.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.870+0000 7efd57fff700 1 --2- 172.21.2.102:0/2008304259 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd5814e530 0x7efd58068830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7efd58068710 tx=0x7efd48006ea0).ready entity=mon.0 client_cookie=62a81892892bbf4a server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:08.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.870+0000 7efd577fe700 1 -- 172.21.2.102:0/2008304259 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48009800 con 0x7efd5814e530 2021-02-12T17:16:08.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.870+0000 7efd577fe700 1 -- 172.21.2.102:0/2008304259 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd48009960 con 0x7efd5814e530 2021-02-12T17:16:08.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.870+0000 7efd577fe700 1 -- 172.21.2.102:0/2008304259 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48009ce0 con 0x7efd5814e530 2021-02-12T17:16:08.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.871+0000 7efd5ee21700 1 -- 172.21.2.102:0/2008304259 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd5814e530 msgr2=0x7efd58068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:08.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.871+0000 7efd5ee21700 1 --2- 172.21.2.102:0/2008304259 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd5814e530 0x7efd58068830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7efd58068710 tx=0x7efd48006ea0).stop 2021-02-12T17:16:08.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.871+0000 7efd5ee21700 1 -- 172.21.2.102:0/2008304259 shutdown_connections 2021-02-12T17:16:08.874 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.871+0000 7efd5ee21700 1 --2- 172.21.2.102:0/2008304259 >> v2:172.21.2.104:3300/0 conn(0x7efd58062740 0x7efd58062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:08.874 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.871+0000 7efd5ee21700 1 --2- 172.21.2.102:0/2008304259 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd5814e530 0x7efd58068830 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:08.874 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.871+0000 7efd5ee21700 1 -- 172.21.2.102:0/2008304259 >> 172.21.2.102:0/2008304259 conn(0x7efd580bc480 msgr2=0x7efd580b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:08.874 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.871+0000 7efd5ee21700 1 -- 172.21.2.102:0/2008304259 shutdown_connections 2021-02-12T17:16:08.874 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.871+0000 7efd5ee21700 1 -- 172.21.2.102:0/2008304259 wait complete. 2021-02-12T17:16:08.874 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.872+0000 7efd5ee21700 1 Processor -- start 2021-02-12T17:16:08.874 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.872+0000 7efd5ee21700 1 -- start start 2021-02-12T17:16:08.875 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.872+0000 7efd5ee21700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd58062740 0x7efd580b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.875 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.872+0000 7efd5ee21700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7efd580b8d20 0x7efd580ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.875 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.872+0000 7efd5ee21700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efd5814e530 0x7efd5813f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.875 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.872+0000 7efd5ee21700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5815d940 con 0x7efd58062740 2021-02-12T17:16:08.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.872+0000 7efd5ee21700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5815dbe0 con 0x7efd580b8d20 2021-02-12T17:16:08.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.872+0000 7efd5ee21700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5815de80 con 0x7efd5814e530 2021-02-12T17:16:08.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.872+0000 7efd5cbbd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd58062740 0x7efd580b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:08.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.873+0000 7efd5cbbd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd58062740 0x7efd580b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44582/0 (socket says 172.21.2.102:44582) 2021-02-12T17:16:08.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.873+0000 7efd5cbbd700 1 -- 172.21.2.102:0/1337562802 learned_addr learned my addr 172.21.2.102:0/1337562802 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:08.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.873+0000 7efd5cbbd700 1 -- 172.21.2.102:0/1337562802 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efd5814e530 msgr2=0x7efd5813f6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:08.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.873+0000 7efd5cbbd700 1 --2- 172.21.2.102:0/1337562802 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efd5814e530 0x7efd5813f6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:08.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.873+0000 7efd5cbbd700 1 -- 172.21.2.102:0/1337562802 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7efd580b8d20 msgr2=0x7efd580ae7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:08.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.873+0000 7efd5cbbd700 1 --2- 172.21.2.102:0/1337562802 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7efd580b8d20 0x7efd580ae7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:08.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.873+0000 7efd5cbbd700 1 -- 172.21.2.102:0/1337562802 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5815e120 con 0x7efd58062740 2021-02-12T17:16:08.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.873+0000 7efd5cbbd700 1 --2- 172.21.2.102:0/1337562802 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd58062740 0x7efd580b5270 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7efd400096b0 tx=0x7efd40006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:08.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.873+0000 7efd54ff9700 1 -- 172.21.2.102:0/1337562802 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4000d500 con 0x7efd58062740 2021-02-12T17:16:08.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.873+0000 7efd54ff9700 1 -- 172.21.2.102:0/1337562802 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4000d680 con 0x7efd58062740 2021-02-12T17:16:08.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.873+0000 7efd5ee21700 1 -- 172.21.2.102:0/1337562802 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5815e3c0 con 0x7efd58062740 2021-02-12T17:16:08.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.873+0000 7efd54ff9700 1 -- 172.21.2.102:0/1337562802 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4000da40 con 0x7efd58062740 2021-02-12T17:16:08.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.873+0000 7efd5ee21700 1 -- 172.21.2.102:0/1337562802 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd580ae530 con 0x7efd58062740 2021-02-12T17:16:08.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.874+0000 7efd5ee21700 1 -- 172.21.2.102:0/1337562802 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd58045460 con 0x7efd58062740 2021-02-12T17:16:08.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.874+0000 7efd54ff9700 1 -- 172.21.2.102:0/1337562802 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7efd40012420 con 0x7efd58062740 2021-02-12T17:16:08.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.874+0000 7efd54ff9700 1 --2- 172.21.2.102:0/1337562802 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efd3c059d80 0x7efd3c05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:08.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.874+0000 7efd54ff9700 1 -- 172.21.2.102:0/1337562802 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6849+0+0 (secure 0 0 0) 0x7efd40073c50 con 0x7efd58062740 2021-02-12T17:16:08.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.875+0000 7efd57fff700 1 --2- 172.21.2.102:0/1337562802 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efd3c059d80 0x7efd3c05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:08.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.875+0000 7efd57fff700 1 --2- 172.21.2.102:0/1337562802 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efd3c059d80 0x7efd3c05c240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7efd580b7770 tx=0x7efd48016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:08.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:08.877+0000 7efd54ff9700 1 -- 172.21.2.102:0/1337562802 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7efd40047390 con 0x7efd58062740 2021-02-12T17:16:09.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.005+0000 7efd5ee21700 1 -- 172.21.2.102:0/1337562802 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd58063670 con 0x7efd58062740 2021-02-12T17:16:09.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.006+0000 7efd54ff9700 1 -- 172.21.2.102:0/1337562802 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19901 (secure 0 0 0) 0x7efd4004a9b0 con 0x7efd58062740 2021-02-12T17:16:09.008 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:09.008 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":26,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:08.529472+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}},{"pool":5,"pool_name":"b_metadata","create_time":"2021-02-12T17:16:06.678651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}}},{"pool":6,"pool_name":"b_data","create_time":"2021-02-12T17:16:07.511756+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"b"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:09.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.007+0000 7efd5ee21700 1 -- 172.21.2.102:0/1337562802 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efd3c059d80 msgr2=0x7efd3c05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:09.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.007+0000 7efd5ee21700 1 --2- 172.21.2.102:0/1337562802 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efd3c059d80 0x7efd3c05c240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7efd580b7770 tx=0x7efd48016000).stop 2021-02-12T17:16:09.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.007+0000 7efd5ee21700 1 -- 172.21.2.102:0/1337562802 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd58062740 msgr2=0x7efd580b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:09.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.007+0000 7efd5ee21700 1 --2- 172.21.2.102:0/1337562802 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd58062740 0x7efd580b5270 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7efd400096b0 tx=0x7efd40006de0).stop 2021-02-12T17:16:09.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.007+0000 7efd5ee21700 1 -- 172.21.2.102:0/1337562802 shutdown_connections 2021-02-12T17:16:09.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.007+0000 7efd5ee21700 1 --2- 172.21.2.102:0/1337562802 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efd5814e530 0x7efd5813f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:09.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.007+0000 7efd5ee21700 1 --2- 172.21.2.102:0/1337562802 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efd3c059d80 0x7efd3c05c240 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:09.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.007+0000 7efd5ee21700 1 --2- 172.21.2.102:0/1337562802 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd58062740 0x7efd580b5270 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:09.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.007+0000 7efd5ee21700 1 --2- 172.21.2.102:0/1337562802 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7efd580b8d20 0x7efd580ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:09.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.007+0000 7efd5ee21700 1 -- 172.21.2.102:0/1337562802 >> 172.21.2.102:0/1337562802 conn(0x7efd580bc480 msgr2=0x7efd5814cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:09.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.008+0000 7efd5ee21700 1 -- 172.21.2.102:0/1337562802 shutdown_connections 2021-02-12T17:16:09.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.008+0000 7efd5ee21700 1 -- 172.21.2.102:0/1337562802 wait complete. 2021-02-12T17:16:09.018 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b standby_count_wanted 0 2021-02-12T17:16:09.107 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.106+0000 7f5396dc5700 1 Processor -- start 2021-02-12T17:16:09.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.106+0000 7f5396dc5700 1 -- start start 2021-02-12T17:16:09.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.106+0000 7f5396dc5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f539009ada0 0x7f539014e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:09.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.106+0000 7f5396dc5700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5390066b70 con 0x7f53900bc2b0 2021-02-12T17:16:09.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.106+0000 7f5396dc5700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53900685b0 con 0x7f53900b0940 2021-02-12T17:16:09.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.106+0000 7f5396dc5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53900b27d0 con 0x7f539009ada0 2021-02-12T17:16:09.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f5394b61700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f53900bc2b0 0x7f5390151120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53232/0 (socket says 172.21.2.102:53232) 2021-02-12T17:16:09.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f5394b61700 1 -- 172.21.2.102:0/4289094189 learned_addr learned my addr 172.21.2.102:0/4289094189 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:09.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f5395362700 1 --2- 172.21.2.102:0/4289094189 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f539009ada0 0x7f539014e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:09.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 -- 172.21.2.102:0/4289094189 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168371962 0 0) 0x7f5390066b70 con 0x7f53900bc2b0 2021-02-12T17:16:09.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 -- 172.21.2.102:0/4289094189 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5370003230 con 0x7f53900bc2b0 2021-02-12T17:16:09.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 -- 172.21.2.102:0/4289094189 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 875693882 0 0) 0x7f5370003230 con 0x7f53900bc2b0 2021-02-12T17:16:09.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 -- 172.21.2.102:0/4289094189 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f539009ada0 msgr2=0x7f539014e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:09.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 --2- 172.21.2.102:0/4289094189 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f539009ada0 0x7f539014e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:09.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 -- 172.21.2.102:0/4289094189 >> v1:172.21.2.104:6789/0 conn(0x7f53900b0940 legacy=0x7f5390151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:09.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 -- 172.21.2.102:0/4289094189 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539014e550 con 0x7f53900bc2b0 2021-02-12T17:16:09.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 -- 172.21.2.102:0/4289094189 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f53780014e0 con 0x7f53900bc2b0 2021-02-12T17:16:09.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 -- 172.21.2.102:0/4289094189 >> v1:172.21.2.102:6789/0 conn(0x7f53900bc2b0 legacy=0x7f5390151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:09.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 --2- 172.21.2.102:0/4289094189 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f539009ada0 0x7f5370003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:09.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 --2- 172.21.2.102:0/4289094189 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5370003cb0 0x7f53700044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:09.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 --2- 172.21.2.102:0/4289094189 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53700049c0 0x7f5370004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:09.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 -- 172.21.2.102:0/4289094189 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53900b27d0 con 0x7f53700049c0 2021-02-12T17:16:09.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 -- 172.21.2.102:0/4289094189 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5370004240 con 0x7f5370003cb0 2021-02-12T17:16:09.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f538f7fe700 1 -- 172.21.2.102:0/4289094189 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537000b720 con 0x7f539009ada0 2021-02-12T17:16:09.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.107+0000 7f5395362700 1 --2- 172.21.2.102:0/4289094189 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53700049c0 0x7f5370004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:09.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5394b61700 1 --2- 172.21.2.102:0/4289094189 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f539009ada0 0x7f5370003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:09.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f538ffff700 1 --2- 172.21.2.102:0/4289094189 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5370003cb0 0x7f53700044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:09.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5395362700 1 -- 172.21.2.102:0/4289094189 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f539009ada0 msgr2=0x7f5370003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:09.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5395362700 1 --2- 172.21.2.102:0/4289094189 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f539009ada0 0x7f5370003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:09.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5395362700 1 -- 172.21.2.102:0/4289094189 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5370003cb0 msgr2=0x7f53700044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:09.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5395362700 1 --2- 172.21.2.102:0/4289094189 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5370003cb0 0x7f53700044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:09.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5395362700 1 -- 172.21.2.102:0/4289094189 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5370003230 con 0x7f53700049c0 2021-02-12T17:16:09.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5394b61700 1 --2- 172.21.2.102:0/4289094189 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f539009ada0 0x7f5370003750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:09.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5395362700 1 --2- 172.21.2.102:0/4289094189 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53700049c0 0x7f5370004e40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f5388009e90 tx=0x7f53880091d0).ready entity=mon.0 client_cookie=dca25f4d5db7a7b5 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:09.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f538f7fe700 1 -- 172.21.2.102:0/4289094189 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538800ecd0 con 0x7f53700049c0 2021-02-12T17:16:09.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f538f7fe700 1 -- 172.21.2.102:0/4289094189 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538800ee30 con 0x7f53700049c0 2021-02-12T17:16:09.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f538f7fe700 1 -- 172.21.2.102:0/4289094189 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388012600 con 0x7f53700049c0 2021-02-12T17:16:09.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5396dc5700 1 -- 172.21.2.102:0/4289094189 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53700049c0 msgr2=0x7f5370004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:09.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5396dc5700 1 --2- 172.21.2.102:0/4289094189 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53700049c0 0x7f5370004e40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f5388009e90 tx=0x7f53880091d0).stop 2021-02-12T17:16:09.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5395362700 1 -- 172.21.2.102:0/4289094189 reap_dead start 2021-02-12T17:16:09.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5396dc5700 1 -- 172.21.2.102:0/4289094189 shutdown_connections 2021-02-12T17:16:09.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5396dc5700 1 -- 172.21.2.102:0/4289094189 >> 172.21.2.102:0/4289094189 conn(0x7f5390061830 msgr2=0x7f53900bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:09.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5396dc5700 1 -- 172.21.2.102:0/4289094189 shutdown_connections 2021-02-12T17:16:09.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.108+0000 7f5396dc5700 1 -- 172.21.2.102:0/4289094189 wait complete. 2021-02-12T17:16:09.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.109+0000 7f5396dc5700 1 Processor -- start 2021-02-12T17:16:09.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.109+0000 7f5396dc5700 1 -- start start 2021-02-12T17:16:09.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f5396dc5700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f53700049c0 0x7f539015d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:09.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f5396dc5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5390061df0 0x7f53900b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:09.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f5396dc5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5390062270 0x7f53900b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:09.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f5396dc5700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539015cdf0 con 0x7f5390061df0 2021-02-12T17:16:09.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f5396dc5700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53900b4f60 con 0x7f53700049c0 2021-02-12T17:16:09.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f5396dc5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539015d010 con 0x7f5390062270 2021-02-12T17:16:09.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f538ffff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5390061df0 0x7f53900b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:09.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f538ffff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5390061df0 0x7f53900b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44604/0 (socket says 172.21.2.102:44604) 2021-02-12T17:16:09.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f538ffff700 1 -- 172.21.2.102:0/3252373834 learned_addr learned my addr 172.21.2.102:0/3252373834 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:09.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f5394b61700 1 --2- 172.21.2.102:0/3252373834 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f53700049c0 0x7f539015d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:09.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f5395362700 1 --2- 172.21.2.102:0/3252373834 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5390062270 0x7f53900b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:09.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f538ffff700 1 -- 172.21.2.102:0/3252373834 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5390062270 msgr2=0x7f53900b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:09.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f538ffff700 1 --2- 172.21.2.102:0/3252373834 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5390062270 0x7f53900b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:09.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f538ffff700 1 -- 172.21.2.102:0/3252373834 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f53700049c0 msgr2=0x7f539015d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:09.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f538ffff700 1 --2- 172.21.2.102:0/3252373834 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f53700049c0 0x7f539015d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:09.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f538ffff700 1 -- 172.21.2.102:0/3252373834 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539015d2b0 con 0x7f5390061df0 2021-02-12T17:16:09.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f538ffff700 1 --2- 172.21.2.102:0/3252373834 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5390061df0 0x7f53900b42a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f538000e700 tx=0x7f5380009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:09.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f538cff9700 1 -- 172.21.2.102:0/3252373834 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380015400 con 0x7f5390061df0 2021-02-12T17:16:09.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f538cff9700 1 -- 172.21.2.102:0/3252373834 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5380010040 con 0x7f5390061df0 2021-02-12T17:16:09.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f5396dc5700 1 -- 172.21.2.102:0/3252373834 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539015d550 con 0x7f5390061df0 2021-02-12T17:16:09.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f538cff9700 1 -- 172.21.2.102:0/3252373834 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380015770 con 0x7f5390061df0 2021-02-12T17:16:09.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.110+0000 7f5396dc5700 1 -- 172.21.2.102:0/3252373834 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539009eb40 con 0x7f5390061df0 2021-02-12T17:16:09.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.111+0000 7f5396dc5700 1 -- 172.21.2.102:0/3252373834 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5390045460 con 0x7f5390061df0 2021-02-12T17:16:09.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.111+0000 7f538cff9700 1 -- 172.21.2.102:0/3252373834 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f5380015b20 con 0x7f5390061df0 2021-02-12T17:16:09.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.111+0000 7f538cff9700 1 --2- 172.21.2.102:0/3252373834 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5374059d30 0x7f537405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:09.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.111+0000 7f538cff9700 1 -- 172.21.2.102:0/3252373834 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f5380073c70 con 0x7f5390061df0 2021-02-12T17:16:09.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.111+0000 7f5394b61700 1 --2- 172.21.2.102:0/3252373834 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5374059d30 0x7f537405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:09.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.112+0000 7f5394b61700 1 --2- 172.21.2.102:0/3252373834 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5374059d30 0x7f537405c1f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5378004550 tx=0x7f5378009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:09.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.114+0000 7f538cff9700 1 -- 172.21.2.102:0/3252373834 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f5380047390 con 0x7f5390061df0 2021-02-12T17:16:09.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.274+0000 7f5396dc5700 1 -- 172.21.2.102:0/3252373834 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f539009ef20 con 0x7f5390061df0 2021-02-12T17:16:09.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.534+0000 7f538cff9700 1 -- 172.21.2.102:0/3252373834 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"}]=0 v9) v1 ==== 113+0+0 (secure 0 0 0) 0x7f5380015db0 con 0x7f5390061df0 2021-02-12T17:16:09.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.536+0000 7f5396dc5700 1 -- 172.21.2.102:0/3252373834 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5374059d30 msgr2=0x7f537405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:09.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.536+0000 7f5396dc5700 1 --2- 172.21.2.102:0/3252373834 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5374059d30 0x7f537405c1f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5378004550 tx=0x7f5378009040).stop 2021-02-12T17:16:09.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.536+0000 7f5396dc5700 1 -- 172.21.2.102:0/3252373834 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5390061df0 msgr2=0x7f53900b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:09.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.536+0000 7f5396dc5700 1 --2- 172.21.2.102:0/3252373834 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5390061df0 0x7f53900b42a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f538000e700 tx=0x7f5380009040).stop 2021-02-12T17:16:09.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.536+0000 7f5396dc5700 1 -- 172.21.2.102:0/3252373834 shutdown_connections 2021-02-12T17:16:09.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.536+0000 7f5396dc5700 1 --2- 172.21.2.102:0/3252373834 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5390062270 0x7f53900b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:09.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.536+0000 7f5396dc5700 1 --2- 172.21.2.102:0/3252373834 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f53700049c0 0x7f539015d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:09.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.536+0000 7f5396dc5700 1 --2- 172.21.2.102:0/3252373834 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5374059d30 0x7f537405c1f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:09.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.536+0000 7f5396dc5700 1 --2- 172.21.2.102:0/3252373834 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5390061df0 0x7f53900b42a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:09.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.536+0000 7f5396dc5700 1 -- 172.21.2.102:0/3252373834 >> 172.21.2.102:0/3252373834 conn(0x7f5390061830 msgr2=0x7f53900bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:09.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.536+0000 7f5396dc5700 1 -- 172.21.2.102:0/3252373834 shutdown_connections 2021-02-12T17:16:09.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.536+0000 7f5396dc5700 1 -- 172.21.2.102:0/3252373834 wait complete. 2021-02-12T17:16:09.546 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b session_timeout 300 2021-02-12T17:16:09.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.636+0000 7f879efae700 1 Processor -- start 2021-02-12T17:16:09.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.636+0000 7f879efae700 1 -- start start 2021-02-12T17:16:09.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.637+0000 7f879efae700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f87980b0d60 0x7f8798067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:09.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.637+0000 7f879efae700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f87980b7c10 0x7f87980b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:09.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.637+0000 7f879efae700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8798145ec0 con 0x7f8798067530 2021-02-12T17:16:09.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.637+0000 7f879efae700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8798146160 con 0x7f87980b0d60 2021-02-12T17:16:09.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.637+0000 7f879efae700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8798146400 con 0x7f87980b7c10 2021-02-12T17:16:09.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.637+0000 7f879cd4a700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f87980b0d60 0x7f8798067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:09.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.637+0000 7f879cd4a700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f87980b0d60 0x7f8798067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44608/0 (socket says 172.21.2.102:44608) 2021-02-12T17:16:09.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.637+0000 7f879cd4a700 1 -- 172.21.2.102:0/3811867642 learned_addr learned my addr 172.21.2.102:0/3811867642 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:09.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.637+0000 7f879cd4a700 1 -- 172.21.2.102:0/3811867642 >> v2:172.21.2.104:3300/0 conn(0x7f87980b7c10 msgr2=0x7f87980b6460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:09.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.637+0000 7f879cd4a700 1 --2- 172.21.2.102:0/3811867642 >> v2:172.21.2.104:3300/0 conn(0x7f87980b7c10 0x7f87980b6460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:09.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.637+0000 7f879cd4a700 1 -- 172.21.2.102:0/3811867642 >> v1:172.21.2.104:6789/0 conn(0x7f8798067530 legacy=0x7f87980b7500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:09.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.637+0000 7f879cd4a700 1 -- 172.21.2.102:0/3811867642 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87981466a0 con 0x7f87980b0d60 2021-02-12T17:16:09.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.637+0000 7f879cd4a700 1 --2- 172.21.2.102:0/3811867642 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87980b0d60 0x7f8798067040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f87980b8450 tx=0x7f8788006e30).ready entity=mon.0 client_cookie=688b0d2d5ff1cb22 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:09.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.637+0000 7f87977fe700 1 -- 172.21.2.102:0/3811867642 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800bea0 con 0x7f87980b0d60 2021-02-12T17:16:09.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.638+0000 7f87977fe700 1 -- 172.21.2.102:0/3811867642 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8788016440 con 0x7f87980b0d60 2021-02-12T17:16:09.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.638+0000 7f87977fe700 1 -- 172.21.2.102:0/3811867642 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880167c0 con 0x7f87980b0d60 2021-02-12T17:16:09.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.638+0000 7f879efae700 1 -- 172.21.2.102:0/3811867642 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87980b0d60 msgr2=0x7f8798067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:09.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.638+0000 7f879efae700 1 --2- 172.21.2.102:0/3811867642 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87980b0d60 0x7f8798067040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f87980b8450 tx=0x7f8788006e30).stop 2021-02-12T17:16:09.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.638+0000 7f879efae700 1 -- 172.21.2.102:0/3811867642 shutdown_connections 2021-02-12T17:16:09.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.638+0000 7f879efae700 1 --2- 172.21.2.102:0/3811867642 >> v2:172.21.2.104:3300/0 conn(0x7f87980b7c10 0x7f87980b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:09.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.638+0000 7f879efae700 1 --2- 172.21.2.102:0/3811867642 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87980b0d60 0x7f8798067040 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:09.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.638+0000 7f879efae700 1 -- 172.21.2.102:0/3811867642 >> 172.21.2.102:0/3811867642 conn(0x7f8798061830 msgr2=0x7f87980bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:09.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.638+0000 7f879efae700 1 -- 172.21.2.102:0/3811867642 shutdown_connections 2021-02-12T17:16:09.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.638+0000 7f879efae700 1 -- 172.21.2.102:0/3811867642 wait complete. 2021-02-12T17:16:09.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.639+0000 7f879efae700 1 Processor -- start 2021-02-12T17:16:09.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.639+0000 7f879efae700 1 -- start start 2021-02-12T17:16:09.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.639+0000 7f879efae700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8798067530 0x7f879815dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:09.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.639+0000 7f879efae700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f87980b0d60 0x7f87980a1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:09.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.639+0000 7f879efae700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f87980b7c10 0x7f879809c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:09.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.639+0000 7f879efae700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879809c470 con 0x7f8798067530 2021-02-12T17:16:09.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.639+0000 7f879efae700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879815d2f0 con 0x7f87980b7c10 2021-02-12T17:16:09.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.639+0000 7f879efae700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879815d590 con 0x7f87980b0d60 2021-02-12T17:16:09.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.639+0000 7f879cd4a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8798067530 0x7f879815dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:09.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.639+0000 7f879cd4a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8798067530 0x7f879815dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44614/0 (socket says 172.21.2.102:44614) 2021-02-12T17:16:09.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.639+0000 7f879cd4a700 1 -- 172.21.2.102:0/3192391279 learned_addr learned my addr 172.21.2.102:0/3192391279 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:09.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.640+0000 7f879cd4a700 1 -- 172.21.2.102:0/3192391279 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f87980b0d60 msgr2=0x7f87980a1190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:09.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.640+0000 7f879cd4a700 1 --2- 172.21.2.102:0/3192391279 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f87980b0d60 0x7f87980a1190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:09.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.640+0000 7f879cd4a700 1 -- 172.21.2.102:0/3192391279 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f87980b7c10 msgr2=0x7f879809c7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:09.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.640+0000 7f879cd4a700 1 --2- 172.21.2.102:0/3192391279 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f87980b7c10 0x7f879809c7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:09.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.640+0000 7f879cd4a700 1 -- 172.21.2.102:0/3192391279 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879815d830 con 0x7f8798067530 2021-02-12T17:16:09.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.640+0000 7f879cd4a700 1 --2- 172.21.2.102:0/3192391279 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8798067530 0x7f879815dcd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f8788006fd0 tx=0x7f8788019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:09.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.640+0000 7f8794ff9700 1 -- 172.21.2.102:0/3192391279 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788009030 con 0x7f8798067530 2021-02-12T17:16:09.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.640+0000 7f8794ff9700 1 -- 172.21.2.102:0/3192391279 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878800a040 con 0x7f8798067530 2021-02-12T17:16:09.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.640+0000 7f879efae700 1 -- 172.21.2.102:0/3192391279 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87980a1680 con 0x7f8798067530 2021-02-12T17:16:09.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.640+0000 7f879efae700 1 -- 172.21.2.102:0/3192391279 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8798098dd0 con 0x7f8798067530 2021-02-12T17:16:09.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.640+0000 7f8794ff9700 1 -- 172.21.2.102:0/3192391279 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880159f0 con 0x7f8798067530 2021-02-12T17:16:09.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.641+0000 7f879efae700 1 -- 172.21.2.102:0/3192391279 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8770004f60 con 0x7f8798067530 2021-02-12T17:16:09.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.641+0000 7f8794ff9700 1 -- 172.21.2.102:0/3192391279 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f8788015d60 con 0x7f8798067530 2021-02-12T17:16:09.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.641+0000 7f8794ff9700 1 --2- 172.21.2.102:0/3192391279 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8778059db0 0x7f877805c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:09.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.641+0000 7f8794ff9700 1 -- 172.21.2.102:0/3192391279 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f8788076020 con 0x7f8798067530 2021-02-12T17:16:09.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.641+0000 7f8797fff700 1 --2- 172.21.2.102:0/3192391279 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8778059db0 0x7f877805c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:09.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.641+0000 7f8797fff700 1 --2- 172.21.2.102:0/3192391279 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8778059db0 0x7f877805c270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f8798061e10 tx=0x7f878c006920).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:09.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.644+0000 7f8794ff9700 1 -- 172.21.2.102:0/3192391279 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f8788049740 con 0x7f8798067530 2021-02-12T17:16:09.702 INFO:tasks.ceph.mds.a.gibba002.stderr:2021-02-12T17:16:09.701+0000 7f93c8d89700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-02-12T17:16:09.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:09.807+0000 7f879efae700 1 -- 172.21.2.102:0/3192391279 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f8770005210 con 0x7f8798067530 2021-02-12T17:16:10.405 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:16:10.408 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:16:10.542 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.541+0000 7f8794ff9700 1 -- 172.21.2.102:0/3192391279 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"}]=0 v10) v1 ==== 110+0+0 (secure 0 0 0) 0x7f8788006a10 con 0x7f8798067530 2021-02-12T17:16:10.544 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.542+0000 7f879efae700 1 -- 172.21.2.102:0/3192391279 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8778059db0 msgr2=0x7f877805c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:10.544 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.542+0000 7f879efae700 1 --2- 172.21.2.102:0/3192391279 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8778059db0 0x7f877805c270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f8798061e10 tx=0x7f878c006920).stop 2021-02-12T17:16:10.544 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.542+0000 7f879efae700 1 -- 172.21.2.102:0/3192391279 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8798067530 msgr2=0x7f879815dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:10.544 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.542+0000 7f879efae700 1 --2- 172.21.2.102:0/3192391279 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8798067530 0x7f879815dcd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f8788006fd0 tx=0x7f8788019000).stop 2021-02-12T17:16:10.544 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.542+0000 7f879efae700 1 -- 172.21.2.102:0/3192391279 shutdown_connections 2021-02-12T17:16:10.544 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.542+0000 7f879efae700 1 --2- 172.21.2.102:0/3192391279 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f87980b7c10 0x7f879809c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:10.544 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.542+0000 7f879efae700 1 --2- 172.21.2.102:0/3192391279 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8778059db0 0x7f877805c270 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:10.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.542+0000 7f879efae700 1 --2- 172.21.2.102:0/3192391279 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8798067530 0x7f879815dcd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:10.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.542+0000 7f879efae700 1 --2- 172.21.2.102:0/3192391279 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f87980b0d60 0x7f87980a1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:10.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.542+0000 7f879efae700 1 -- 172.21.2.102:0/3192391279 >> 172.21.2.102:0/3192391279 conn(0x7f8798061830 msgr2=0x7f87980b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:10.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.542+0000 7f879efae700 1 -- 172.21.2.102:0/3192391279 shutdown_connections 2021-02-12T17:16:10.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.543+0000 7f879efae700 1 -- 172.21.2.102:0/3192391279 wait complete. 2021-02-12T17:16:10.552 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:16:10.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.640+0000 7f202e486700 1 Processor -- start 2021-02-12T17:16:10.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.640+0000 7f202e486700 1 -- start start 2021-02-12T17:16:10.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.641+0000 7f202e486700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f20280b8d20 0x7f2028068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:10.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.641+0000 7f202e486700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f202814e530 0x7f20280b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:10.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.641+0000 7f202e486700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20280622a0 con 0x7f2028062740 2021-02-12T17:16:10.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.641+0000 7f202e486700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2028068d20 con 0x7f20280b8d20 2021-02-12T17:16:10.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.641+0000 7f202e486700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202814ea10 con 0x7f202814e530 2021-02-12T17:16:10.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.642+0000 7f20277fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f202814e530 0x7f20280b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:10.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.642+0000 7f2027fff700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f20280b8d20 0x7f2028068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:10.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.642+0000 7f2027fff700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f20280b8d20 0x7f2028068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:42982/0 (socket says 172.21.2.102:42982) 2021-02-12T17:16:10.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.642+0000 7f2027fff700 1 -- 172.21.2.102:0/1783517998 learned_addr learned my addr 172.21.2.102:0/1783517998 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:10.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.642+0000 7f20277fe700 1 -- 172.21.2.102:0/1783517998 >> v2:172.21.2.104:3300/0 conn(0x7f20280b8d20 msgr2=0x7f2028068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:10.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.642+0000 7f20277fe700 1 --2- 172.21.2.102:0/1783517998 >> v2:172.21.2.104:3300/0 conn(0x7f20280b8d20 0x7f2028068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:10.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.642+0000 7f20277fe700 1 -- 172.21.2.102:0/1783517998 >> v1:172.21.2.104:6789/0 conn(0x7f2028062740 legacy=0x7f2028062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:10.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.642+0000 7f20277fe700 1 -- 172.21.2.102:0/1783517998 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20280b63f0 con 0x7f202814e530 2021-02-12T17:16:10.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.642+0000 7f20277fe700 1 --2- 172.21.2.102:0/1783517998 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f202814e530 0x7f20280b7250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f201000b980 tx=0x7f2010006de0).ready entity=mon.2 client_cookie=42c73dc8c236c08d server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:10.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.642+0000 7f2026ffd700 1 -- 172.21.2.102:0/1783517998 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201000be70 con 0x7f202814e530 2021-02-12T17:16:10.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.642+0000 7f2026ffd700 1 -- 172.21.2.102:0/1783517998 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20100097e0 con 0x7f202814e530 2021-02-12T17:16:10.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.642+0000 7f2026ffd700 1 -- 172.21.2.102:0/1783517998 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2010009b60 con 0x7f202814e530 2021-02-12T17:16:10.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.643+0000 7f202e486700 1 -- 172.21.2.102:0/1783517998 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f202814e530 msgr2=0x7f20280b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:10.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.643+0000 7f202e486700 1 --2- 172.21.2.102:0/1783517998 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f202814e530 0x7f20280b7250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f201000b980 tx=0x7f2010006de0).stop 2021-02-12T17:16:10.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.643+0000 7f202e486700 1 -- 172.21.2.102:0/1783517998 shutdown_connections 2021-02-12T17:16:10.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.643+0000 7f202e486700 1 --2- 172.21.2.102:0/1783517998 >> v2:172.21.2.104:3300/0 conn(0x7f20280b8d20 0x7f2028068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:10.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.643+0000 7f202e486700 1 --2- 172.21.2.102:0/1783517998 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f202814e530 0x7f20280b7250 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:10.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.643+0000 7f202e486700 1 -- 172.21.2.102:0/1783517998 >> 172.21.2.102:0/1783517998 conn(0x7f20280bc480 msgr2=0x7f20280b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:10.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.643+0000 7f202e486700 1 -- 172.21.2.102:0/1783517998 shutdown_connections 2021-02-12T17:16:10.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.643+0000 7f202e486700 1 -- 172.21.2.102:0/1783517998 wait complete. 2021-02-12T17:16:10.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.644+0000 7f202e486700 1 Processor -- start 2021-02-12T17:16:10.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.644+0000 7f202e486700 1 -- start start 2021-02-12T17:16:10.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.644+0000 7f202e486700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2028062740 0x7f202814cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:10.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.644+0000 7f202e486700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f20280b8d20 0x7f20280adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:10.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.644+0000 7f202e486700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f202814e530 0x7f20280ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:10.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.644+0000 7f202e486700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20280af4a0 con 0x7f2028062740 2021-02-12T17:16:10.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.644+0000 7f202e486700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202815d110 con 0x7f202814e530 2021-02-12T17:16:10.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.644+0000 7f202e486700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202815d3a0 con 0x7f20280b8d20 2021-02-12T17:16:10.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.644+0000 7f2027fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2028062740 0x7f202814cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:10.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.644+0000 7f2027fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2028062740 0x7f202814cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44632/0 (socket says 172.21.2.102:44632) 2021-02-12T17:16:10.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.644+0000 7f2027fff700 1 -- 172.21.2.102:0/2020687873 learned_addr learned my addr 172.21.2.102:0/2020687873 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:10.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.645+0000 7f2027fff700 1 -- 172.21.2.102:0/2020687873 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f20280b8d20 msgr2=0x7f20280adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:10.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.645+0000 7f20277fe700 1 --2- 172.21.2.102:0/2020687873 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f20280b8d20 0x7f20280adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:10.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.645+0000 7f2027fff700 1 --2- 172.21.2.102:0/2020687873 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f20280b8d20 0x7f20280adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:10.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.645+0000 7f2027fff700 1 -- 172.21.2.102:0/2020687873 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f202814e530 msgr2=0x7f20280ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:10.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.645+0000 7f2027fff700 1 --2- 172.21.2.102:0/2020687873 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f202814e530 0x7f20280ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:10.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.645+0000 7f2027fff700 1 -- 172.21.2.102:0/2020687873 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202815d640 con 0x7f2028062740 2021-02-12T17:16:10.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.645+0000 7f20277fe700 1 --2- 172.21.2.102:0/2020687873 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f20280b8d20 0x7f20280adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:10.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.645+0000 7f2027fff700 1 --2- 172.21.2.102:0/2020687873 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2028062740 0x7f202814cf30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f201800ebd0 tx=0x7f2018006ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:10.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.645+0000 7f201ffff700 1 -- 172.21.2.102:0/2020687873 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201800c950 con 0x7f2028062740 2021-02-12T17:16:10.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.645+0000 7f201ffff700 1 -- 172.21.2.102:0/2020687873 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201800cab0 con 0x7f2028062740 2021-02-12T17:16:10.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.645+0000 7f202e486700 1 -- 172.21.2.102:0/2020687873 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202815d8e0 con 0x7f2028062740 2021-02-12T17:16:10.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.645+0000 7f202e486700 1 -- 172.21.2.102:0/2020687873 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202815de20 con 0x7f2028062740 2021-02-12T17:16:10.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.645+0000 7f201ffff700 1 -- 172.21.2.102:0/2020687873 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201800ce30 con 0x7f2028062740 2021-02-12T17:16:10.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.646+0000 7f201ffff700 1 -- 172.21.2.102:0/2020687873 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f2018022070 con 0x7f2028062740 2021-02-12T17:16:10.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.646+0000 7f202e486700 1 -- 172.21.2.102:0/2020687873 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202815e000 con 0x7f2028062740 2021-02-12T17:16:10.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.646+0000 7f201ffff700 1 --2- 172.21.2.102:0/2020687873 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f200c059d30 0x7f200c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:10.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.646+0000 7f201ffff700 1 -- 172.21.2.102:0/2020687873 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f2018074010 con 0x7f2028062740 2021-02-12T17:16:10.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.646+0000 7f20277fe700 1 --2- 172.21.2.102:0/2020687873 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f200c059d30 0x7f200c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:10.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.646+0000 7f20277fe700 1 --2- 172.21.2.102:0/2020687873 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f200c059d30 0x7f200c05c1f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2028152c10 tx=0x7f2010016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:10.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.649+0000 7f201ffff700 1 -- 172.21.2.102:0/2020687873 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f202815e000 con 0x7f2028062740 2021-02-12T17:16:10.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.808+0000 7f202e486700 1 -- 172.21.2.102:0/2020687873 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f202815dfb0 con 0x7f2028062740 2021-02-12T17:16:10.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.808+0000 7f201ffff700 1 -- 172.21.2.102:0/2020687873 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7f2018016020 con 0x7f2028062740 2021-02-12T17:16:10.810 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:10.810 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:16:10.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.809+0000 7f202e486700 1 -- 172.21.2.102:0/2020687873 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f200c059d30 msgr2=0x7f200c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:10.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.809+0000 7f202e486700 1 --2- 172.21.2.102:0/2020687873 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f200c059d30 0x7f200c05c1f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2028152c10 tx=0x7f2010016000).stop 2021-02-12T17:16:10.811 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.809+0000 7f202e486700 1 -- 172.21.2.102:0/2020687873 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2028062740 msgr2=0x7f202814cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:10.811 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.809+0000 7f202e486700 1 --2- 172.21.2.102:0/2020687873 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2028062740 0x7f202814cf30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f201800ebd0 tx=0x7f2018006ea0).stop 2021-02-12T17:16:10.811 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.809+0000 7f202e486700 1 -- 172.21.2.102:0/2020687873 shutdown_connections 2021-02-12T17:16:10.811 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.809+0000 7f202e486700 1 --2- 172.21.2.102:0/2020687873 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f202814e530 0x7f20280ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:10.811 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.809+0000 7f202e486700 1 --2- 172.21.2.102:0/2020687873 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f200c059d30 0x7f200c05c1f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:10.811 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.809+0000 7f202e486700 1 --2- 172.21.2.102:0/2020687873 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2028062740 0x7f202814cf30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:10.812 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.809+0000 7f202e486700 1 --2- 172.21.2.102:0/2020687873 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f20280b8d20 0x7f20280adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:10.812 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.809+0000 7f202e486700 1 -- 172.21.2.102:0/2020687873 >> 172.21.2.102:0/2020687873 conn(0x7f20280bc480 msgr2=0x7f2028151a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:10.812 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.809+0000 7f202e486700 1 -- 172.21.2.102:0/2020687873 shutdown_connections 2021-02-12T17:16:10.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.810+0000 7f202e486700 1 -- 172.21.2.102:0/2020687873 wait complete. 2021-02-12T17:16:10.813 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:16:10.820 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:10.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.906+0000 7fed0227f700 1 Processor -- start 2021-02-12T17:16:10.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.906+0000 7fed0227f700 1 -- start start 2021-02-12T17:16:10.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.907+0000 7fed0227f700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fecfc0b6350 0x7fecfc1463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:10.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.907+0000 7fed0227f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecfc144ea0 0x7fecfc145330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:10.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.907+0000 7fed0227f700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecfc0b2930 con 0x7fecfc067720 2021-02-12T17:16:10.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.907+0000 7fed0227f700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecfc068980 con 0x7fecfc0b6350 2021-02-12T17:16:10.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.907+0000 7fed0227f700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0b67b0 con 0x7fecfc144ea0 2021-02-12T17:16:10.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.908+0000 7fecfbfff700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7fecfc067720 0x7fecfc062580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:35650/0 (socket says 172.21.2.102:35650) 2021-02-12T17:16:10.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.908+0000 7fecfbfff700 1 -- 172.21.2.102:0/3516307840 learned_addr learned my addr 172.21.2.102:0/3516307840 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:10.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.908+0000 7fecfb7fe700 1 --2- 172.21.2.102:0/3516307840 >> v2:172.21.2.104:3300/0 conn(0x7fecfc0b6350 0x7fecfc1463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:10.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.908+0000 7fed0081c700 1 --2- 172.21.2.102:0/3516307840 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecfc144ea0 0x7fecfc145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:10.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.908+0000 7fecfaffd700 1 -- 172.21.2.102:0/3516307840 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311612980 0 0) 0x7fece40010d0 con 0x7fecfc067720 2021-02-12T17:16:10.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.908+0000 7fecfaffd700 1 -- 172.21.2.102:0/3516307840 --> v1:172.21.2.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecdc003230 con 0x7fecfc067720 2021-02-12T17:16:10.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.909+0000 7fed0081c700 1 -- 172.21.2.102:0/3516307840 >> v2:172.21.2.104:3300/0 conn(0x7fecfc0b6350 msgr2=0x7fecfc1463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:10.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.909+0000 7fed0081c700 1 --2- 172.21.2.102:0/3516307840 >> v2:172.21.2.104:3300/0 conn(0x7fecfc0b6350 0x7fecfc1463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:10.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.909+0000 7fed0081c700 1 -- 172.21.2.102:0/3516307840 >> v1:172.21.2.104:6789/0 conn(0x7fecfc067720 legacy=0x7fecfc062580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:10.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.909+0000 7fed0081c700 1 -- 172.21.2.102:0/3516307840 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc066db0 con 0x7fecfc144ea0 2021-02-12T17:16:10.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.909+0000 7fecfb7fe700 1 --2- 172.21.2.102:0/3516307840 >> v2:172.21.2.104:3300/0 conn(0x7fecfc0b6350 0x7fecfc1463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:16:10.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.909+0000 7fed0081c700 1 --2- 172.21.2.102:0/3516307840 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecfc144ea0 0x7fecfc145330 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fecf400ae20 tx=0x7fecf400a360).ready entity=mon.2 client_cookie=2a7eae279bbd3cce server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:10.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.909+0000 7fecfaffd700 1 -- 172.21.2.102:0/3516307840 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf400cce0 con 0x7fecfc144ea0 2021-02-12T17:16:10.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.909+0000 7fecfaffd700 1 -- 172.21.2.102:0/3516307840 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf400ce40 con 0x7fecfc144ea0 2021-02-12T17:16:10.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.909+0000 7fecfaffd700 1 -- 172.21.2.102:0/3516307840 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4010620 con 0x7fecfc144ea0 2021-02-12T17:16:10.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.909+0000 7fed0227f700 1 -- 172.21.2.102:0/3516307840 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecfc144ea0 msgr2=0x7fecfc145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:10.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.909+0000 7fed0227f700 1 --2- 172.21.2.102:0/3516307840 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecfc144ea0 0x7fecfc145330 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fecf400ae20 tx=0x7fecf400a360).stop 2021-02-12T17:16:10.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.910+0000 7fed0227f700 1 -- 172.21.2.102:0/3516307840 shutdown_connections 2021-02-12T17:16:10.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.910+0000 7fed0227f700 1 --2- 172.21.2.102:0/3516307840 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecfc144ea0 0x7fecfc145330 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:10.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.910+0000 7fed0227f700 1 --2- 172.21.2.102:0/3516307840 >> v2:172.21.2.104:3300/0 conn(0x7fecfc0b6350 0x7fecfc1463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:10.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.910+0000 7fed0227f700 1 -- 172.21.2.102:0/3516307840 >> 172.21.2.102:0/3516307840 conn(0x7fecfc0bc480 msgr2=0x7fecfc0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:10.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.910+0000 7fed0227f700 1 -- 172.21.2.102:0/3516307840 shutdown_connections 2021-02-12T17:16:10.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.910+0000 7fed0227f700 1 -- 172.21.2.102:0/3516307840 wait complete. 2021-02-12T17:16:10.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.910+0000 7fed0227f700 1 Processor -- start 2021-02-12T17:16:10.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.911+0000 7fed0227f700 1 -- start start 2021-02-12T17:16:10.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.911+0000 7fed0227f700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fecfc067720 0x7fecfc143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:10.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.911+0000 7fed0227f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecfc0b6350 0x7fecfc1609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:10.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.911+0000 7fed0227f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecfc144ea0 0x7fecfc160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:10.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.911+0000 7fed0227f700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0afc20 con 0x7fecfc144ea0 2021-02-12T17:16:10.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.911+0000 7fed0227f700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0af440 con 0x7fecfc067720 2021-02-12T17:16:10.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.911+0000 7fed0227f700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0af6e0 con 0x7fecfc0b6350 2021-02-12T17:16:10.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.911+0000 7fecfbfff700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fecfc067720 0x7fecfc143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:10.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.911+0000 7fecfbfff700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fecfc067720 0x7fecfc143420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:43002/0 (socket says 172.21.2.102:43002) 2021-02-12T17:16:10.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.911+0000 7fed0081c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecfc144ea0 0x7fecfc160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:10.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.911+0000 7fecfbfff700 1 -- 172.21.2.102:0/243321454 learned_addr learned my addr 172.21.2.102:0/243321454 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:10.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.911+0000 7fecfb7fe700 1 --2- 172.21.2.102:0/243321454 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecfc0b6350 0x7fecfc1609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:10.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.912+0000 7fed0081c700 1 -- 172.21.2.102:0/243321454 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecfc0b6350 msgr2=0x7fecfc1609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:10.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.912+0000 7fed0081c700 1 --2- 172.21.2.102:0/243321454 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecfc0b6350 0x7fecfc1609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:10.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.912+0000 7fed0081c700 1 -- 172.21.2.102:0/243321454 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fecfc067720 msgr2=0x7fecfc143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:10.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.912+0000 7fed0081c700 1 --2- 172.21.2.102:0/243321454 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fecfc067720 0x7fecfc143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:10.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.912+0000 7fed0081c700 1 -- 172.21.2.102:0/243321454 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc0af980 con 0x7fecfc144ea0 2021-02-12T17:16:10.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.912+0000 7fed0081c700 1 --2- 172.21.2.102:0/243321454 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecfc144ea0 0x7fecfc160ec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fecf4015000 tx=0x7fecfc0b2c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:10.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.912+0000 7fecf3fff700 1 -- 172.21.2.102:0/243321454 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4010e30 con 0x7fecfc144ea0 2021-02-12T17:16:10.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.912+0000 7fecf3fff700 1 -- 172.21.2.102:0/243321454 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf401aaf0 con 0x7fecfc144ea0 2021-02-12T17:16:10.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.912+0000 7fed0227f700 1 -- 172.21.2.102:0/243321454 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecfc160530 con 0x7fecfc144ea0 2021-02-12T17:16:10.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.912+0000 7fecf3fff700 1 -- 172.21.2.102:0/243321454 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf401ae90 con 0x7fecfc144ea0 2021-02-12T17:16:10.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.912+0000 7fed0227f700 1 -- 172.21.2.102:0/243321454 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecfc0af0c0 con 0x7fecfc144ea0 2021-02-12T17:16:10.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.913+0000 7fed0227f700 1 -- 172.21.2.102:0/243321454 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecfc1606c0 con 0x7fecfc144ea0 2021-02-12T17:16:10.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.913+0000 7fecf3fff700 1 -- 172.21.2.102:0/243321454 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fecf400e040 con 0x7fecfc144ea0 2021-02-12T17:16:10.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.913+0000 7fecf3fff700 1 --2- 172.21.2.102:0/243321454 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fece0059d80 0x7fece005c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:10.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.913+0000 7fecf3fff700 1 -- 172.21.2.102:0/243321454 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fecf40750d0 con 0x7fecfc144ea0 2021-02-12T17:16:10.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.913+0000 7fecfbfff700 1 --2- 172.21.2.102:0/243321454 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fece0059d80 0x7fece005c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:10.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.913+0000 7fecfbfff700 1 --2- 172.21.2.102:0/243321454 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fece0059d80 0x7fece005c240 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fece4001750 tx=0x7fece4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:10.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:10.916+0000 7fecf3fff700 1 -- 172.21.2.102:0/243321454 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fecf4048870 con 0x7fecfc144ea0 2021-02-12T17:16:11.046 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.045+0000 7fed0227f700 1 -- 172.21.2.102:0/243321454 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecfc045460 con 0x7fecfc144ea0 2021-02-12T17:16:11.047 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.045+0000 7fecf3fff700 1 -- 172.21.2.102:0/243321454 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19888 (secure 0 0 0) 0x7fecf4014020 con 0x7fecfc144ea0 2021-02-12T17:16:11.048 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:11.048 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":27,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:09.532002+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}},{"pool":5,"pool_name":"b_metadata","create_time":"2021-02-12T17:16:06.678651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}}},{"pool":6,"pool_name":"b_data","create_time":"2021-02-12T17:16:07.511756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"b"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:11.049 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.047+0000 7fed0227f700 1 -- 172.21.2.102:0/243321454 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fece0059d80 msgr2=0x7fece005c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.049 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.047+0000 7fed0227f700 1 --2- 172.21.2.102:0/243321454 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fece0059d80 0x7fece005c240 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fece4001750 tx=0x7fece4009040).stop 2021-02-12T17:16:11.049 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.047+0000 7fed0227f700 1 -- 172.21.2.102:0/243321454 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecfc144ea0 msgr2=0x7fecfc160ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.047+0000 7fed0227f700 1 --2- 172.21.2.102:0/243321454 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecfc144ea0 0x7fecfc160ec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fecf4015000 tx=0x7fecfc0b2c00).stop 2021-02-12T17:16:11.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.047+0000 7fed0227f700 1 -- 172.21.2.102:0/243321454 shutdown_connections 2021-02-12T17:16:11.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.047+0000 7fed0227f700 1 --2- 172.21.2.102:0/243321454 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fece0059d80 0x7fece005c240 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.047+0000 7fed0227f700 1 --2- 172.21.2.102:0/243321454 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecfc144ea0 0x7fecfc160ec0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.047+0000 7fed0227f700 1 --2- 172.21.2.102:0/243321454 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fecfc067720 0x7fecfc143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.047+0000 7fed0227f700 1 --2- 172.21.2.102:0/243321454 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecfc0b6350 0x7fecfc1609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.047+0000 7fed0227f700 1 -- 172.21.2.102:0/243321454 >> 172.21.2.102:0/243321454 conn(0x7fecfc0bc480 msgr2=0x7fecfc0bb050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:11.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.047+0000 7fed0227f700 1 -- 172.21.2.102:0/243321454 shutdown_connections 2021-02-12T17:16:11.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.047+0000 7fed0227f700 1 -- 172.21.2.102:0/243321454 wait complete. 2021-02-12T17:16:11.059 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:11.059 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-02-12T17:16:11.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.146+0000 7fd3a72bc700 1 Processor -- start 2021-02-12T17:16:11.148 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.146+0000 7fd3a72bc700 1 -- start start 2021-02-12T17:16:11.149 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a72bc700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd3a00b8d20 0x7fd3a0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.149 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a72bc700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fd3a014e530 0x7fd3a00b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.149 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a72bc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fd3a0062740 0x7fd3a0062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.149 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a72bc700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a0068d20 con 0x7fd3a0062740 2021-02-12T17:16:11.150 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a72bc700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a00622a0 con 0x7fd3a014e530 2021-02-12T17:16:11.150 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a72bc700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a014ea10 con 0x7fd3a00b8d20 2021-02-12T17:16:11.150 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a5859700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fd3a0062740 0x7fd3a0062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.150 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a5859700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fd3a0062740 0x7fd3a0062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44654/0 (socket says 172.21.2.102:44654) 2021-02-12T17:16:11.150 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a5859700 1 -- 172.21.2.102:0/1785199271 learned_addr learned my addr 172.21.2.102:0/1785199271 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:11.150 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a5859700 1 -- 172.21.2.102:0/1785199271 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd3a00b8d20 msgr2=0x7fd3a0068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:11.150 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a5859700 1 --2- 172.21.2.102:0/1785199271 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd3a00b8d20 0x7fd3a0068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:11.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a5859700 1 -- 172.21.2.102:0/1785199271 >> v2:172.21.2.104:3300/0 conn(0x7fd3a014e530 msgr2=0x7fd3a00b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:11.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a5859700 1 --2- 172.21.2.102:0/1785199271 >> v2:172.21.2.104:3300/0 conn(0x7fd3a014e530 0x7fd3a00b7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:11.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a5859700 1 -- 172.21.2.102:0/1785199271 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a00b63f0 con 0x7fd3a0062740 2021-02-12T17:16:11.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd3a5859700 1 --2- 172.21.2.102:0/1785199271 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd3a0062740 0x7fd3a0062bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fd3a006aa60 tx=0x7fd398009290).ready entity=mon.0 client_cookie=3e39c67e8d4720d7 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:11.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.147+0000 7fd38ffff700 1 -- 172.21.2.102:0/1785199271 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39800bbf0 con 0x7fd3a0062740 2021-02-12T17:16:11.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.148+0000 7fd38ffff700 1 -- 172.21.2.102:0/1785199271 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39800bd50 con 0x7fd3a0062740 2021-02-12T17:16:11.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.148+0000 7fd38ffff700 1 -- 172.21.2.102:0/1785199271 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd398011610 con 0x7fd3a0062740 2021-02-12T17:16:11.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.148+0000 7fd3a72bc700 1 -- 172.21.2.102:0/1785199271 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd3a0062740 msgr2=0x7fd3a0062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.148+0000 7fd3a72bc700 1 --2- 172.21.2.102:0/1785199271 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd3a0062740 0x7fd3a0062bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fd3a006aa60 tx=0x7fd398009290).stop 2021-02-12T17:16:11.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.148+0000 7fd3a72bc700 1 -- 172.21.2.102:0/1785199271 shutdown_connections 2021-02-12T17:16:11.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.148+0000 7fd3a72bc700 1 --2- 172.21.2.102:0/1785199271 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd3a00b8d20 0x7fd3a0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:11.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.148+0000 7fd3a72bc700 1 --2- 172.21.2.102:0/1785199271 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd3a0062740 0x7fd3a0062bf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.152 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.148+0000 7fd3a72bc700 1 --2- 172.21.2.102:0/1785199271 >> v2:172.21.2.104:3300/0 conn(0x7fd3a014e530 0x7fd3a00b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:11.152 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.148+0000 7fd3a72bc700 1 -- 172.21.2.102:0/1785199271 >> 172.21.2.102:0/1785199271 conn(0x7fd3a00bc480 msgr2=0x7fd3a00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:11.152 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.148+0000 7fd3a72bc700 1 -- 172.21.2.102:0/1785199271 shutdown_connections 2021-02-12T17:16:11.152 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.148+0000 7fd3a72bc700 1 -- 172.21.2.102:0/1785199271 wait complete. 2021-02-12T17:16:11.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.149+0000 7fd3a72bc700 1 Processor -- start 2021-02-12T17:16:11.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.149+0000 7fd3a72bc700 1 -- start start 2021-02-12T17:16:11.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.149+0000 7fd3a72bc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd3a0062740 0x7fd3a015e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.149+0000 7fd3a72bc700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd3a00b8d20 0x7fd3a00b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.149+0000 7fd3a72bc700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd3a014e530 0x7fd3a014a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.149+0000 7fd3a72bc700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a015e6d0 con 0x7fd3a0062740 2021-02-12T17:16:11.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.149+0000 7fd3a72bc700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a00b4fa0 con 0x7fd3a014e530 2021-02-12T17:16:11.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.149+0000 7fd3a72bc700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a00b5240 con 0x7fd3a00b8d20 2021-02-12T17:16:11.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.149+0000 7fd3a5058700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd3a0062740 0x7fd3a015e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd3a5058700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd3a0062740 0x7fd3a015e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44660/0 (socket says 172.21.2.102:44660) 2021-02-12T17:16:11.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd3a5058700 1 -- 172.21.2.102:0/3892660952 learned_addr learned my addr 172.21.2.102:0/3892660952 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:11.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd3a5859700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd3a014e530 0x7fd3a014a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd3a4857700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd3a00b8d20 0x7fd3a00b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd3a5058700 1 -- 172.21.2.102:0/3892660952 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd3a00b8d20 msgr2=0x7fd3a00b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd3a5058700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd3a00b8d20 0x7fd3a00b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd3a5058700 1 -- 172.21.2.102:0/3892660952 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd3a014e530 msgr2=0x7fd3a014a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd3a5058700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd3a014e530 0x7fd3a014a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd3a5058700 1 -- 172.21.2.102:0/3892660952 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a00b54e0 con 0x7fd3a0062740 2021-02-12T17:16:11.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd3a4857700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd3a00b8d20 0x7fd3a00b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:11.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd3a5058700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd3a0062740 0x7fd3a015e1e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fd39c0096b0 tx=0x7fd39c006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:11.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd38d7fa700 1 -- 172.21.2.102:0/3892660952 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c00d4a0 con 0x7fd3a0062740 2021-02-12T17:16:11.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd38d7fa700 1 -- 172.21.2.102:0/3892660952 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39c00d620 con 0x7fd3a0062740 2021-02-12T17:16:11.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd3a72bc700 1 -- 172.21.2.102:0/3892660952 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a00b5780 con 0x7fd3a0062740 2021-02-12T17:16:11.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd38d7fa700 1 -- 172.21.2.102:0/3892660952 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c00d9e0 con 0x7fd3a0062740 2021-02-12T17:16:11.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.150+0000 7fd3a72bc700 1 -- 172.21.2.102:0/3892660952 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a00b0700 con 0x7fd3a0062740 2021-02-12T17:16:11.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.151+0000 7fd3a72bc700 1 -- 172.21.2.102:0/3892660952 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a0045460 con 0x7fd3a0062740 2021-02-12T17:16:11.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.151+0000 7fd38d7fa700 1 -- 172.21.2.102:0/3892660952 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fd39c01a060 con 0x7fd3a0062740 2021-02-12T17:16:11.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.151+0000 7fd38d7fa700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd380059d60 0x7fd38005c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.152+0000 7fd38d7fa700 1 -- 172.21.2.102:0/3892660952 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fd39c073530 con 0x7fd3a0062740 2021-02-12T17:16:11.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.152+0000 7fd3a4857700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd380059d60 0x7fd38005c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.152+0000 7fd3a4857700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd380059d60 0x7fd38005c220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fd3a0062e40 tx=0x7fd390008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:11.158 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.154+0000 7fd38d7fa700 1 -- 172.21.2.102:0/3892660952 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fd39c04a790 con 0x7fd3a0062740 2021-02-12T17:16:11.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.284+0000 7fd3a72bc700 1 -- 172.21.2.102:0/3892660952 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3a00b2650 con 0x7fd3a0062740 2021-02-12T17:16:11.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.285+0000 7fd38d7fa700 1 -- 172.21.2.102:0/3892660952 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19888 (secure 0 0 0) 0x7fd39c018030 con 0x7fd3a0062740 2021-02-12T17:16:11.287 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:11.287 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":27,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:09.532002+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}},{"pool":5,"pool_name":"b_metadata","create_time":"2021-02-12T17:16:06.678651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}}},{"pool":6,"pool_name":"b_data","create_time":"2021-02-12T17:16:07.511756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"b"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:11.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.286+0000 7fd3a72bc700 1 -- 172.21.2.102:0/3892660952 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd380059d60 msgr2=0x7fd38005c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.286+0000 7fd3a72bc700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd380059d60 0x7fd38005c220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fd3a0062e40 tx=0x7fd390008040).stop 2021-02-12T17:16:11.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.286+0000 7fd3a72bc700 1 -- 172.21.2.102:0/3892660952 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd3a0062740 msgr2=0x7fd3a015e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.286+0000 7fd3a72bc700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd3a0062740 0x7fd3a015e1e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fd39c0096b0 tx=0x7fd39c006de0).stop 2021-02-12T17:16:11.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.286+0000 7fd3a72bc700 1 -- 172.21.2.102:0/3892660952 shutdown_connections 2021-02-12T17:16:11.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.286+0000 7fd3a72bc700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd3a014e530 0x7fd3a014a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.286+0000 7fd3a72bc700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd380059d60 0x7fd38005c220 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.286+0000 7fd3a72bc700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd3a0062740 0x7fd3a015e1e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.286+0000 7fd3a72bc700 1 --2- 172.21.2.102:0/3892660952 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd3a00b8d20 0x7fd3a00b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.286+0000 7fd3a72bc700 1 -- 172.21.2.102:0/3892660952 >> 172.21.2.102:0/3892660952 conn(0x7fd3a00bc480 msgr2=0x7fd3a0151990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:11.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.286+0000 7fd3a72bc700 1 -- 172.21.2.102:0/3892660952 shutdown_connections 2021-02-12T17:16:11.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.286+0000 7fd3a72bc700 1 -- 172.21.2.102:0/3892660952 wait complete. 2021-02-12T17:16:11.298 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-12T17:15:54.614238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-12T17:15:56.701902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'a_metadata', 'create_time': '2021-02-12T17:15:59.832660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}}, {'pool': 4, 'pool_name': 'a_data', 'create_time': '2021-02-12T17:16:00.965024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'a'}}}, {'pool': 5, 'pool_name': 'b_metadata', 'create_time': '2021-02-12T17:16:06.678651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}}, {'pool': 6, 'pool_name': 'b_data', 'create_time': '2021-02-12T17:16:07.511756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'b'}}}] 2021-02-12T17:16:11.298 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-02-12T17:16:11.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.388+0000 7f2f24098700 1 Processor -- start 2021-02-12T17:16:11.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.388+0000 7f2f24098700 1 -- start start 2021-02-12T17:16:11.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.389+0000 7f2f24098700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f1c09ada0 0x7f2f1c14e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.389+0000 7f2f24098700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c066b70 con 0x7f2f1c0bc2b0 2021-02-12T17:16:11.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.389+0000 7f2f24098700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c0685b0 con 0x7f2f1c0b0940 2021-02-12T17:16:11.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.389+0000 7f2f24098700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c0b27d0 con 0x7f2f1c09ada0 2021-02-12T17:16:11.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.389+0000 7f2f21e34700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f2f1c0bc2b0 0x7f2f1c151120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53308/0 (socket says 172.21.2.102:53308) 2021-02-12T17:16:11.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.389+0000 7f2f21e34700 1 -- 172.21.2.102:0/4082576348 learned_addr learned my addr 172.21.2.102:0/4082576348 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:11.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.389+0000 7f2f20e32700 1 -- 172.21.2.102:0/4082576348 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895880929 0 0) 0x7f2f1c066b70 con 0x7f2f1c0bc2b0 2021-02-12T17:16:11.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f20e32700 1 -- 172.21.2.102:0/4082576348 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f04003230 con 0x7f2f1c0bc2b0 2021-02-12T17:16:11.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f22635700 1 --2- 172.21.2.102:0/4082576348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f1c09ada0 0x7f2f1c14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f20e32700 1 -- 172.21.2.102:0/4082576348 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 424779492 0 0) 0x7f2f04003230 con 0x7f2f1c0bc2b0 2021-02-12T17:16:11.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f20e32700 1 -- 172.21.2.102:0/4082576348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f1c09ada0 msgr2=0x7f2f1c14e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f20e32700 1 --2- 172.21.2.102:0/4082576348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f1c09ada0 0x7f2f1c14e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f20e32700 1 -- 172.21.2.102:0/4082576348 >> v1:172.21.2.104:6789/0 conn(0x7f2f1c0b0940 legacy=0x7f2f1c151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f20e32700 1 -- 172.21.2.102:0/4082576348 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c14e550 con 0x7f2f1c0bc2b0 2021-02-12T17:16:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f20e32700 1 -- 172.21.2.102:0/4082576348 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f2f180014e0 con 0x7f2f1c0bc2b0 2021-02-12T17:16:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f20e32700 1 -- 172.21.2.102:0/4082576348 >> v1:172.21.2.102:6789/0 conn(0x7f2f1c0bc2b0 legacy=0x7f2f1c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f20e32700 1 --2- 172.21.2.102:0/4082576348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f1c09ada0 0x7f2f04003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f20e32700 1 --2- 172.21.2.102:0/4082576348 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f04003c60 0x7f2f040044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f20e32700 1 --2- 172.21.2.102:0/4082576348 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f040049c0 0x7f2f04004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f20e32700 1 -- 172.21.2.102:0/4082576348 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c0b27d0 con 0x7f2f04003c60 2021-02-12T17:16:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f20e32700 1 -- 172.21.2.102:0/4082576348 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f040041a0 con 0x7f2f040049c0 2021-02-12T17:16:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f20e32700 1 -- 172.21.2.102:0/4082576348 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0400b720 con 0x7f2f1c09ada0 2021-02-12T17:16:11.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f21633700 1 --2- 172.21.2.102:0/4082576348 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f04003c60 0x7f2f040044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f22635700 1 --2- 172.21.2.102:0/4082576348 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f040049c0 0x7f2f04004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f21e34700 1 --2- 172.21.2.102:0/4082576348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f1c09ada0 0x7f2f04003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f21633700 1 -- 172.21.2.102:0/4082576348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f1c09ada0 msgr2=0x7f2f04003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:11.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f21633700 1 --2- 172.21.2.102:0/4082576348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f1c09ada0 0x7f2f04003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f21633700 1 -- 172.21.2.102:0/4082576348 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f040049c0 msgr2=0x7f2f04004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:11.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f21633700 1 --2- 172.21.2.102:0/4082576348 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f040049c0 0x7f2f04004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f21633700 1 -- 172.21.2.102:0/4082576348 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c14e550 con 0x7f2f04003c60 2021-02-12T17:16:11.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.390+0000 7f2f21e34700 1 --2- 172.21.2.102:0/4082576348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f1c09ada0 0x7f2f04003750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:11.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.391+0000 7f2f21633700 1 --2- 172.21.2.102:0/4082576348 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f04003c60 0x7f2f040044d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f2f10001920 tx=0x7f2f10007b80).ready entity=mon.0 client_cookie=3639c935beab8688 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:11.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.391+0000 7f2f20e32700 1 -- 172.21.2.102:0/4082576348 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10007020 con 0x7f2f04003c60 2021-02-12T17:16:11.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.391+0000 7f2f20e32700 1 -- 172.21.2.102:0/4082576348 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f10007180 con 0x7f2f04003c60 2021-02-12T17:16:11.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.391+0000 7f2f20e32700 1 -- 172.21.2.102:0/4082576348 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000c5f0 con 0x7f2f04003c60 2021-02-12T17:16:11.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.391+0000 7f2f24098700 1 -- 172.21.2.102:0/4082576348 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f04003c60 msgr2=0x7f2f040044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.391+0000 7f2f24098700 1 --2- 172.21.2.102:0/4082576348 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f04003c60 0x7f2f040044d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f2f10001920 tx=0x7f2f10007b80).stop 2021-02-12T17:16:11.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.391+0000 7f2f22635700 1 -- 172.21.2.102:0/4082576348 reap_dead start 2021-02-12T17:16:11.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.391+0000 7f2f24098700 1 -- 172.21.2.102:0/4082576348 shutdown_connections 2021-02-12T17:16:11.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.391+0000 7f2f24098700 1 -- 172.21.2.102:0/4082576348 >> 172.21.2.102:0/4082576348 conn(0x7f2f1c061830 msgr2=0x7f2f1c0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:11.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.391+0000 7f2f24098700 1 -- 172.21.2.102:0/4082576348 shutdown_connections 2021-02-12T17:16:11.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.391+0000 7f2f24098700 1 -- 172.21.2.102:0/4082576348 wait complete. 2021-02-12T17:16:11.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.392+0000 7f2f24098700 1 Processor -- start 2021-02-12T17:16:11.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.392+0000 7f2f24098700 1 -- start start 2021-02-12T17:16:11.399 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f24098700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f04003c60 0x7f2f1c09d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.399 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f24098700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f1c09c9d0 0x7f2f1c15d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.399 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f24098700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f1c15d840 0x7f2f1c154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.399 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f24098700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c153010 con 0x7f2f04003c60 2021-02-12T17:16:11.399 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f24098700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c09b730 con 0x7f2f1c15d840 2021-02-12T17:16:11.400 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f24098700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c09de60 con 0x7f2f1c09c9d0 2021-02-12T17:16:11.400 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f21e34700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f04003c60 0x7f2f1c09d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.400 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f21e34700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f04003c60 0x7f2f1c09d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44676/0 (socket says 172.21.2.102:44676) 2021-02-12T17:16:11.400 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f21e34700 1 -- 172.21.2.102:0/559009061 learned_addr learned my addr 172.21.2.102:0/559009061 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:11.400 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f21633700 1 --2- 172.21.2.102:0/559009061 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f1c09c9d0 0x7f2f1c15d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.400 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f22635700 1 --2- 172.21.2.102:0/559009061 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f1c15d840 0x7f2f1c154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.400 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f21e34700 1 -- 172.21.2.102:0/559009061 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f1c09c9d0 msgr2=0x7f2f1c15d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.400 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f21e34700 1 --2- 172.21.2.102:0/559009061 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f1c09c9d0 0x7f2f1c15d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.400 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f21e34700 1 -- 172.21.2.102:0/559009061 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f1c15d840 msgr2=0x7f2f1c154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.400 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f21e34700 1 --2- 172.21.2.102:0/559009061 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f1c15d840 0x7f2f1c154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f21e34700 1 -- 172.21.2.102:0/559009061 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c09e100 con 0x7f2f04003c60 2021-02-12T17:16:11.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f21e34700 1 --2- 172.21.2.102:0/559009061 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f04003c60 0x7f2f1c09d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f2f18004550 tx=0x7f2f180055c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:11.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f0dffb700 1 -- 172.21.2.102:0/559009061 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800cb20 con 0x7f2f04003c60 2021-02-12T17:16:11.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f0dffb700 1 -- 172.21.2.102:0/559009061 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1800cc80 con 0x7f2f04003c60 2021-02-12T17:16:11.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.393+0000 7f2f0dffb700 1 -- 172.21.2.102:0/559009061 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18014430 con 0x7f2f04003c60 2021-02-12T17:16:11.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.394+0000 7f2f24098700 1 -- 172.21.2.102:0/559009061 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1c09b960 con 0x7f2f04003c60 2021-02-12T17:16:11.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.394+0000 7f2f24098700 1 -- 172.21.2.102:0/559009061 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c15cdb0 con 0x7f2f04003c60 2021-02-12T17:16:11.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.394+0000 7f2f24098700 1 -- 172.21.2.102:0/559009061 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c045460 con 0x7f2f04003c60 2021-02-12T17:16:11.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.394+0000 7f2f0dffb700 1 -- 172.21.2.102:0/559009061 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f2f180147a0 con 0x7f2f04003c60 2021-02-12T17:16:11.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.395+0000 7f2f0dffb700 1 --2- 172.21.2.102:0/559009061 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2efc059d30 0x7f2efc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.395+0000 7f2f0dffb700 1 -- 172.21.2.102:0/559009061 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f2f18073b90 con 0x7f2f04003c60 2021-02-12T17:16:11.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.395+0000 7f2f21633700 1 --2- 172.21.2.102:0/559009061 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2efc059d30 0x7f2efc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.395+0000 7f2f21633700 1 --2- 172.21.2.102:0/559009061 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2efc059d30 0x7f2efc05c1f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2f10001920 tx=0x7f2f10015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:11.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.398+0000 7f2f0dffb700 1 -- 172.21.2.102:0/559009061 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f2f18046580 con 0x7f2f04003c60 2021-02-12T17:16:11.527 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.526+0000 7f2f24098700 1 -- 172.21.2.102:0/559009061 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2f1c0b7650 con 0x7f2f04003c60 2021-02-12T17:16:11.528 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.526+0000 7f2f0dffb700 1 -- 172.21.2.102:0/559009061 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v27) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2f180473c0 con 0x7f2f04003c60 2021-02-12T17:16:11.528 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 1 2021-02-12T17:16:11.529 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.527+0000 7f2f24098700 1 -- 172.21.2.102:0/559009061 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2efc059d30 msgr2=0x7f2efc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.529 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.527+0000 7f2f24098700 1 --2- 172.21.2.102:0/559009061 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2efc059d30 0x7f2efc05c1f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2f10001920 tx=0x7f2f10015000).stop 2021-02-12T17:16:11.529 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.527+0000 7f2f24098700 1 -- 172.21.2.102:0/559009061 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f04003c60 msgr2=0x7f2f1c09d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.529 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.527+0000 7f2f24098700 1 --2- 172.21.2.102:0/559009061 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f04003c60 0x7f2f1c09d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f2f18004550 tx=0x7f2f180055c0).stop 2021-02-12T17:16:11.529 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.527+0000 7f2f24098700 1 -- 172.21.2.102:0/559009061 shutdown_connections 2021-02-12T17:16:11.529 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.527+0000 7f2f24098700 1 --2- 172.21.2.102:0/559009061 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f1c15d840 0x7f2f1c154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.529 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.528+0000 7f2f24098700 1 --2- 172.21.2.102:0/559009061 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2efc059d30 0x7f2efc05c1f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.530 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.528+0000 7f2f24098700 1 --2- 172.21.2.102:0/559009061 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f04003c60 0x7f2f1c09d330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.530 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.528+0000 7f2f24098700 1 --2- 172.21.2.102:0/559009061 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f1c09c9d0 0x7f2f1c15d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.530 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.528+0000 7f2f24098700 1 -- 172.21.2.102:0/559009061 >> 172.21.2.102:0/559009061 conn(0x7f2f1c061830 msgr2=0x7f2f1c063e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:11.530 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.528+0000 7f2f24098700 1 -- 172.21.2.102:0/559009061 shutdown_connections 2021-02-12T17:16:11.530 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.528+0000 7f2f24098700 1 -- 172.21.2.102:0/559009061 wait complete. 2021-02-12T17:16:11.537 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-02-12T17:16:11.627 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.626+0000 7f5eb258d700 1 Processor -- start 2021-02-12T17:16:11.627 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.626+0000 7f5eb258d700 1 -- start start 2021-02-12T17:16:11.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.626+0000 7f5eb258d700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f5eac0b0940 0x7f5eac14e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.626+0000 7f5eb258d700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eac066b70 con 0x7f5eac09ada0 2021-02-12T17:16:11.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.626+0000 7f5eb258d700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eac0685b0 con 0x7f5eac0bc2b0 2021-02-12T17:16:11.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.626+0000 7f5eb258d700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eac0b27d0 con 0x7f5eac0b0940 2021-02-12T17:16:11.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.626+0000 7f5eab7fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f5eac0b0940 0x7f5eac14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.626+0000 7f5eb0b2a700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f5eac09ada0 0x7f5eac151830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53330/0 (socket says 172.21.2.102:53330) 2021-02-12T17:16:11.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.626+0000 7f5eb0b2a700 1 -- 172.21.2.102:0/2195245953 learned_addr learned my addr 172.21.2.102:0/2195245953 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:11.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.627+0000 7f5eaaffd700 1 -- 172.21.2.102:0/2195245953 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866778571 0 0) 0x7f5eac066b70 con 0x7f5eac09ada0 2021-02-12T17:16:11.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.627+0000 7f5eaaffd700 1 -- 172.21.2.102:0/2195245953 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e8c003230 con 0x7f5eac09ada0 2021-02-12T17:16:11.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.627+0000 7f5eab7fe700 1 -- 172.21.2.102:0/2195245953 >> v1:172.21.2.104:6789/0 conn(0x7f5eac0bc2b0 legacy=0x7f5eac151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:11.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.627+0000 7f5eab7fe700 1 -- 172.21.2.102:0/2195245953 >> v1:172.21.2.102:6789/0 conn(0x7f5eac09ada0 legacy=0x7f5eac151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.627+0000 7f5eab7fe700 1 -- 172.21.2.102:0/2195245953 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac14e550 con 0x7f5eac0b0940 2021-02-12T17:16:11.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.627+0000 7f5eab7fe700 1 --2- 172.21.2.102:0/2195245953 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5eac0b0940 0x7f5eac14e060 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f5e9400b980 tx=0x7f5e94006de0).ready entity=mon.0 client_cookie=2dcde58219f68fdc server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:11.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.627+0000 7f5eaaffd700 1 -- 172.21.2.102:0/2195245953 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400be70 con 0x7f5eac0b0940 2021-02-12T17:16:11.630 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.627+0000 7f5eaaffd700 1 -- 172.21.2.102:0/2195245953 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e940097a0 con 0x7f5eac0b0940 2021-02-12T17:16:11.630 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.627+0000 7f5eaaffd700 1 -- 172.21.2.102:0/2195245953 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94009b20 con 0x7f5eac0b0940 2021-02-12T17:16:11.631 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.628+0000 7f5eb258d700 1 -- 172.21.2.102:0/2195245953 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5eac0b0940 msgr2=0x7f5eac14e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.631 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.628+0000 7f5eb258d700 1 --2- 172.21.2.102:0/2195245953 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5eac0b0940 0x7f5eac14e060 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f5e9400b980 tx=0x7f5e94006de0).stop 2021-02-12T17:16:11.631 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.628+0000 7f5eb258d700 1 -- 172.21.2.102:0/2195245953 shutdown_connections 2021-02-12T17:16:11.631 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.628+0000 7f5eb258d700 1 --2- 172.21.2.102:0/2195245953 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5eac0b0940 0x7f5eac14e060 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.631 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.628+0000 7f5eb258d700 1 -- 172.21.2.102:0/2195245953 >> 172.21.2.102:0/2195245953 conn(0x7f5eac061830 msgr2=0x7f5eac0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:11.631 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.628+0000 7f5eb258d700 1 -- 172.21.2.102:0/2195245953 shutdown_connections 2021-02-12T17:16:11.631 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.628+0000 7f5eb258d700 1 -- 172.21.2.102:0/2195245953 wait complete. 2021-02-12T17:16:11.631 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.629+0000 7f5eb258d700 1 Processor -- start 2021-02-12T17:16:11.631 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.629+0000 7f5eb258d700 1 -- start start 2021-02-12T17:16:11.631 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.629+0000 7f5eb258d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5eac09ada0 0x7f5eac149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.631 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.629+0000 7f5eb258d700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5eac0b0940 0x7f5eac14ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.629+0000 7f5eb258d700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5eac0bc2b0 0x7f5eac14c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.629+0000 7f5eb258d700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0bb550 con 0x7f5eac09ada0 2021-02-12T17:16:11.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.629+0000 7f5eb258d700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0bb050 con 0x7f5eac0b0940 2021-02-12T17:16:11.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.629+0000 7f5eb258d700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac14b250 con 0x7f5eac0bc2b0 2021-02-12T17:16:11.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5eabfff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5eac09ada0 0x7f5eac149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5eabfff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5eac09ada0 0x7f5eac149af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44690/0 (socket says 172.21.2.102:44690) 2021-02-12T17:16:11.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5eabfff700 1 -- 172.21.2.102:0/1395047493 learned_addr learned my addr 172.21.2.102:0/1395047493 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:11.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5eb0b2a700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5eac0bc2b0 0x7f5eac14c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5eab7fe700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5eac0b0940 0x7f5eac14ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5eabfff700 1 -- 172.21.2.102:0/1395047493 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5eac0bc2b0 msgr2=0x7f5eac14c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5eabfff700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5eac0bc2b0 0x7f5eac14c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5eabfff700 1 -- 172.21.2.102:0/1395047493 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5eac0b0940 msgr2=0x7f5eac14ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5eabfff700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5eac0b0940 0x7f5eac14ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5eabfff700 1 -- 172.21.2.102:0/1395047493 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac14afb0 con 0x7f5eac09ada0 2021-02-12T17:16:11.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5eab7fe700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5eac0b0940 0x7f5eac14ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:11.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5eabfff700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5eac09ada0 0x7f5eac149af0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f5e9c0096e0 tx=0x7f5e9c006d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:11.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5ea3fff700 1 -- 172.21.2.102:0/1395047493 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c00d4a0 con 0x7f5eac09ada0 2021-02-12T17:16:11.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5ea3fff700 1 -- 172.21.2.102:0/1395047493 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c000e90 con 0x7f5eac09ada0 2021-02-12T17:16:11.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5eb258d700 1 -- 172.21.2.102:0/1395047493 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eac0bb2b0 con 0x7f5eac09ada0 2021-02-12T17:16:11.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5ea3fff700 1 -- 172.21.2.102:0/1395047493 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c00d870 con 0x7f5eac09ada0 2021-02-12T17:16:11.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.630+0000 7f5eb258d700 1 -- 172.21.2.102:0/1395047493 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eac0b5ae0 con 0x7f5eac09ada0 2021-02-12T17:16:11.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.631+0000 7f5eb258d700 1 -- 172.21.2.102:0/1395047493 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac045460 con 0x7f5eac09ada0 2021-02-12T17:16:11.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.631+0000 7f5ea3fff700 1 -- 172.21.2.102:0/1395047493 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f5e9c00f030 con 0x7f5eac09ada0 2021-02-12T17:16:11.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.631+0000 7f5ea3fff700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5e90059d30 0x7f5e9005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.631+0000 7f5ea3fff700 1 -- 172.21.2.102:0/1395047493 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f5e9c073900 con 0x7f5eac09ada0 2021-02-12T17:16:11.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.632+0000 7f5eab7fe700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5e90059d30 0x7f5e9005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.632+0000 7f5eab7fe700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5e90059d30 0x7f5e9005c1f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f5eac0b0d40 tx=0x7f5e94016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:11.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.634+0000 7f5ea3fff700 1 -- 172.21.2.102:0/1395047493 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f5e9c047020 con 0x7f5eac09ada0 2021-02-12T17:16:11.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.761+0000 7f5eb258d700 1 -- 172.21.2.102:0/1395047493 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5eac14acf0 con 0x7f5eac09ada0 2021-02-12T17:16:11.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.762+0000 7f5ea3fff700 1 -- 172.21.2.102:0/1395047493 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5e9c006e60 con 0x7f5eac09ada0 2021-02-12T17:16:11.763 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:11.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.763+0000 7f5eb258d700 1 -- 172.21.2.102:0/1395047493 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5e90059d30 msgr2=0x7f5e9005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.763+0000 7f5eb258d700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5e90059d30 0x7f5e9005c1f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f5eac0b0d40 tx=0x7f5e94016000).stop 2021-02-12T17:16:11.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.763+0000 7f5eb258d700 1 -- 172.21.2.102:0/1395047493 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5eac09ada0 msgr2=0x7f5eac149af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.763+0000 7f5eb258d700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5eac09ada0 0x7f5eac149af0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f5e9c0096e0 tx=0x7f5e9c006d40).stop 2021-02-12T17:16:11.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.763+0000 7f5eb258d700 1 -- 172.21.2.102:0/1395047493 shutdown_connections 2021-02-12T17:16:11.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.763+0000 7f5eb258d700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5eac0bc2b0 0x7f5eac14c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.763+0000 7f5eb258d700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5e90059d30 0x7f5e9005c1f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.763+0000 7f5eb258d700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5eac09ada0 0x7f5eac149af0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.763+0000 7f5eb258d700 1 --2- 172.21.2.102:0/1395047493 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5eac0b0940 0x7f5eac14ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.763+0000 7f5eb258d700 1 -- 172.21.2.102:0/1395047493 >> 172.21.2.102:0/1395047493 conn(0x7f5eac061830 msgr2=0x7f5eac0b7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:11.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.763+0000 7f5eb258d700 1 -- 172.21.2.102:0/1395047493 shutdown_connections 2021-02-12T17:16:11.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.763+0000 7f5eb258d700 1 -- 172.21.2.102:0/1395047493 wait complete. 2021-02-12T17:16:11.773 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2021-02-12T17:16:11.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.861+0000 7f1fa9d71700 1 Processor -- start 2021-02-12T17:16:11.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.861+0000 7f1fa9d71700 1 -- start start 2021-02-12T17:16:11.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.862+0000 7f1fa9d71700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f1fa40b0d60 0x7f1fa4067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.862+0000 7f1fa9d71700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1fa4067530 0x7f1fa40b7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.862+0000 7f1fa9d71700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa4145ec0 con 0x7f1fa40b79f0 2021-02-12T17:16:11.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.862+0000 7f1fa9d71700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa4146160 con 0x7f1fa40b0d60 2021-02-12T17:16:11.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.862+0000 7f1fa9d71700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4146400 con 0x7f1fa4067530 2021-02-12T17:16:11.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.862+0000 7f1fa37fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f1fa40b0d60 0x7f1fa4067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.862+0000 7f1fa37fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f1fa40b0d60 0x7f1fa4067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44696/0 (socket says 172.21.2.102:44696) 2021-02-12T17:16:11.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.862+0000 7f1fa37fe700 1 -- 172.21.2.102:0/3878396649 learned_addr learned my addr 172.21.2.102:0/3878396649 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:11.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.862+0000 7f1fa37fe700 1 -- 172.21.2.102:0/3878396649 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1fa4067530 msgr2=0x7f1fa40b7500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:11.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.862+0000 7f1fa37fe700 1 --2- 172.21.2.102:0/3878396649 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1fa4067530 0x7f1fa40b7500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:11.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.862+0000 7f1fa37fe700 1 -- 172.21.2.102:0/3878396649 >> v1:172.21.2.104:6789/0 conn(0x7f1fa40b79f0 legacy=0x7f1fa40b6460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:11.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.862+0000 7f1fa37fe700 1 -- 172.21.2.102:0/3878396649 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa41466a0 con 0x7f1fa40b0d60 2021-02-12T17:16:11.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.862+0000 7f1fa37fe700 1 --2- 172.21.2.102:0/3878396649 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1fa40b0d60 0x7f1fa4067040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1f9400ab60 tx=0x7f1f94006f30).ready entity=mon.0 client_cookie=61de32e2fe468b40 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:11.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.863+0000 7f1fa27fc700 1 -- 172.21.2.102:0/3878396649 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9400cac0 con 0x7f1fa40b0d60 2021-02-12T17:16:11.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.863+0000 7f1fa27fc700 1 -- 172.21.2.102:0/3878396649 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9400cc20 con 0x7f1fa40b0d60 2021-02-12T17:16:11.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.863+0000 7f1fa27fc700 1 -- 172.21.2.102:0/3878396649 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f94010410 con 0x7f1fa40b0d60 2021-02-12T17:16:11.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.863+0000 7f1fa9d71700 1 -- 172.21.2.102:0/3878396649 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1fa40b0d60 msgr2=0x7f1fa4067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.863+0000 7f1fa9d71700 1 --2- 172.21.2.102:0/3878396649 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1fa40b0d60 0x7f1fa4067040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1f9400ab60 tx=0x7f1f94006f30).stop 2021-02-12T17:16:11.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.863+0000 7f1fa9d71700 1 -- 172.21.2.102:0/3878396649 shutdown_connections 2021-02-12T17:16:11.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.863+0000 7f1fa9d71700 1 --2- 172.21.2.102:0/3878396649 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1fa40b0d60 0x7f1fa4067040 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:11.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.863+0000 7f1fa9d71700 1 --2- 172.21.2.102:0/3878396649 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1fa4067530 0x7f1fa40b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:11.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.863+0000 7f1fa9d71700 1 -- 172.21.2.102:0/3878396649 >> 172.21.2.102:0/3878396649 conn(0x7f1fa4061830 msgr2=0x7f1fa40bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:11.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.863+0000 7f1fa9d71700 1 -- 172.21.2.102:0/3878396649 shutdown_connections 2021-02-12T17:16:11.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.863+0000 7f1fa9d71700 1 -- 172.21.2.102:0/3878396649 wait complete. 2021-02-12T17:16:11.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.864+0000 7f1fa9d71700 1 Processor -- start 2021-02-12T17:16:11.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.864+0000 7f1fa9d71700 1 -- start start 2021-02-12T17:16:11.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa9d71700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1fa4067530 0x7f1fa40a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa9d71700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1fa40b0d60 0x7f1fa409a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa9d71700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1fa40b79f0 0x7f1fa40b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa9d71700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa40a0fb0 con 0x7f1fa40b79f0 2021-02-12T17:16:11.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa9d71700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa409f620 con 0x7f1fa4067530 2021-02-12T17:16:11.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa9d71700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa409f8c0 con 0x7f1fa40b0d60 2021-02-12T17:16:11.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa3fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1fa40b79f0 0x7f1fa40b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa3fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1fa40b79f0 0x7f1fa40b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44706/0 (socket says 172.21.2.102:44706) 2021-02-12T17:16:11.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa3fff700 1 -- 172.21.2.102:0/598170708 learned_addr learned my addr 172.21.2.102:0/598170708 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:11.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa3fff700 1 -- 172.21.2.102:0/598170708 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1fa40b0d60 msgr2=0x7f1fa409a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa3fff700 1 --2- 172.21.2.102:0/598170708 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1fa40b0d60 0x7f1fa409a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:11.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa3fff700 1 -- 172.21.2.102:0/598170708 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1fa4067530 msgr2=0x7f1fa40a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:11.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa3fff700 1 --2- 172.21.2.102:0/598170708 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1fa4067530 0x7f1fa40a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:11.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa3fff700 1 -- 172.21.2.102:0/598170708 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa409fdb0 con 0x7f1fa40b79f0 2021-02-12T17:16:11.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1fa3fff700 1 --2- 172.21.2.102:0/598170708 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1fa40b79f0 0x7f1fa40b2f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f1f9c00bab0 tx=0x7f1f9c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:11.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.865+0000 7f1f9b7fe700 1 -- 172.21.2.102:0/598170708 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c00c740 con 0x7f1fa40b79f0 2021-02-12T17:16:11.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.866+0000 7f1f9b7fe700 1 -- 172.21.2.102:0/598170708 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c00c8a0 con 0x7f1fa40b79f0 2021-02-12T17:16:11.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.866+0000 7f1f9b7fe700 1 -- 172.21.2.102:0/598170708 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c00ca50 con 0x7f1fa40b79f0 2021-02-12T17:16:11.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.866+0000 7f1fa9d71700 1 -- 172.21.2.102:0/598170708 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa40a0050 con 0x7f1fa40b79f0 2021-02-12T17:16:11.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.866+0000 7f1fa9d71700 1 -- 172.21.2.102:0/598170708 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa409ae30 con 0x7f1fa40b79f0 2021-02-12T17:16:11.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.866+0000 7f1fa9d71700 1 -- 172.21.2.102:0/598170708 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa40a0410 con 0x7f1fa40b79f0 2021-02-12T17:16:11.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.867+0000 7f1f9b7fe700 1 -- 172.21.2.102:0/598170708 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f1f9c01c070 con 0x7f1fa40b79f0 2021-02-12T17:16:11.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.867+0000 7f1f9b7fe700 1 --2- 172.21.2.102:0/598170708 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1f88059d30 0x7f1f8805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:11.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.867+0000 7f1f9b7fe700 1 -- 172.21.2.102:0/598170708 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f1f9c073450 con 0x7f1fa40b79f0 2021-02-12T17:16:11.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.867+0000 7f1fa37fe700 1 --2- 172.21.2.102:0/598170708 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1f88059d30 0x7f1f8805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:11.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.867+0000 7f1fa37fe700 1 --2- 172.21.2.102:0/598170708 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1f88059d30 0x7f1f8805c1f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1fa4151b00 tx=0x7f1f94006f30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:11.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.870+0000 7f1f9b7fe700 1 -- 172.21.2.102:0/598170708 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f1f9c046b70 con 0x7f1fa40b79f0 2021-02-12T17:16:11.998 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.997+0000 7f1fa9d71700 1 -- 172.21.2.102:0/598170708 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1fa40a01e0 con 0x7f1fa40b79f0 2021-02-12T17:16:11.999 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.997+0000 7f1f9b7fe700 1 -- 172.21.2.102:0/598170708 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+10 (secure 0 0 0) 0x7f1f9c01a070 con 0x7f1fa40b79f0 2021-02-12T17:16:11.999 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:12.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.998+0000 7f1fa9d71700 1 -- 172.21.2.102:0/598170708 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1f88059d30 msgr2=0x7f1f8805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.998+0000 7f1fa9d71700 1 --2- 172.21.2.102:0/598170708 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1f88059d30 0x7f1f8805c1f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1fa4151b00 tx=0x7f1f94006f30).stop 2021-02-12T17:16:12.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.998+0000 7f1fa9d71700 1 -- 172.21.2.102:0/598170708 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1fa40b79f0 msgr2=0x7f1fa40b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.998+0000 7f1fa9d71700 1 --2- 172.21.2.102:0/598170708 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1fa40b79f0 0x7f1fa40b2f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f1f9c00bab0 tx=0x7f1f9c0090f0).stop 2021-02-12T17:16:12.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.998+0000 7f1fa9d71700 1 -- 172.21.2.102:0/598170708 shutdown_connections 2021-02-12T17:16:12.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.998+0000 7f1fa9d71700 1 --2- 172.21.2.102:0/598170708 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1f88059d30 0x7f1f8805c1f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.998+0000 7f1fa9d71700 1 --2- 172.21.2.102:0/598170708 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1fa40b79f0 0x7f1fa40b2f20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.001 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.998+0000 7f1fa9d71700 1 --2- 172.21.2.102:0/598170708 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1fa4067530 0x7f1fa40a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:12.001 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.998+0000 7f1fa9d71700 1 --2- 172.21.2.102:0/598170708 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1fa40b0d60 0x7f1fa409a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:12.001 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.998+0000 7f1fa9d71700 1 -- 172.21.2.102:0/598170708 >> 172.21.2.102:0/598170708 conn(0x7f1fa4061830 msgr2=0x7f1fa4064030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:12.001 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.999+0000 7f1fa9d71700 1 -- 172.21.2.102:0/598170708 shutdown_connections 2021-02-12T17:16:12.001 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:11.999+0000 7f1fa9d71700 1 -- 172.21.2.102:0/598170708 wait complete. 2021-02-12T17:16:12.008 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2021-02-12T17:16:12.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.096+0000 7fcc061cd700 1 Processor -- start 2021-02-12T17:16:12.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.096+0000 7fcc061cd700 1 -- start start 2021-02-12T17:16:12.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.096+0000 7fcc061cd700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcc000bc2b0 0x7fcc00151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.096+0000 7fcc061cd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fcc00151d20 0x7fcc0014e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.096+0000 7fcc061cd700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc00066b70 con 0x7fcc000b0940 2021-02-12T17:16:12.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.096+0000 7fcc061cd700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc000b27d0 con 0x7fcc00151d20 2021-02-12T17:16:12.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.096+0000 7fcc061cd700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0014e550 con 0x7fcc000bc2b0 2021-02-12T17:16:12.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.097+0000 7fcbfeffd700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fcc000b0940 0x7fcc00151610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53354/0 (socket says 172.21.2.102:53354) 2021-02-12T17:16:12.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.097+0000 7fcbfeffd700 1 -- 172.21.2.102:0/1355617169 learned_addr learned my addr 172.21.2.102:0/1355617169 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:12.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.097+0000 7fcbfffff700 1 --2- 172.21.2.102:0/1355617169 >> v2:172.21.2.102:3300/0 conn(0x7fcc00151d20 0x7fcc0014e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.097+0000 7fcbff7fe700 1 --2- 172.21.2.102:0/1355617169 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcc000bc2b0 0x7fcc00151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.097+0000 7fcbfe7fc700 1 -- 172.21.2.102:0/1355617169 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277238702 0 0) 0x7fcc00066b70 con 0x7fcc000b0940 2021-02-12T17:16:12.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.097+0000 7fcbfe7fc700 1 -- 172.21.2.102:0/1355617169 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbe0003230 con 0x7fcc000b0940 2021-02-12T17:16:12.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.097+0000 7fcbfffff700 1 -- 172.21.2.102:0/1355617169 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcc000bc2b0 msgr2=0x7fcc00151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:12.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.097+0000 7fcbfffff700 1 --2- 172.21.2.102:0/1355617169 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcc000bc2b0 0x7fcc00151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.097+0000 7fcbfffff700 1 -- 172.21.2.102:0/1355617169 >> v1:172.21.2.102:6789/0 conn(0x7fcc000b0940 legacy=0x7fcc00151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.097+0000 7fcbfffff700 1 -- 172.21.2.102:0/1355617169 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000685b0 con 0x7fcc00151d20 2021-02-12T17:16:12.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.097+0000 7fcbfffff700 1 --2- 172.21.2.102:0/1355617169 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcc00151d20 0x7fcc0014e060 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fcbf8009c90 tx=0x7fcbf80091d0).ready entity=mon.0 client_cookie=18a903201d74e3d8 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:12.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.097+0000 7fcbfe7fc700 1 -- 172.21.2.102:0/1355617169 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf800b9c0 con 0x7fcc00151d20 2021-02-12T17:16:12.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.098+0000 7fcbfe7fc700 1 -- 172.21.2.102:0/1355617169 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf800bb20 con 0x7fcc00151d20 2021-02-12T17:16:12.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.098+0000 7fcbfe7fc700 1 -- 172.21.2.102:0/1355617169 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf800bea0 con 0x7fcc00151d20 2021-02-12T17:16:12.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.098+0000 7fcc061cd700 1 -- 172.21.2.102:0/1355617169 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcc00151d20 msgr2=0x7fcc0014e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.098+0000 7fcc061cd700 1 --2- 172.21.2.102:0/1355617169 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcc00151d20 0x7fcc0014e060 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fcbf8009c90 tx=0x7fcbf80091d0).stop 2021-02-12T17:16:12.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.098+0000 7fcc061cd700 1 -- 172.21.2.102:0/1355617169 shutdown_connections 2021-02-12T17:16:12.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.098+0000 7fcc061cd700 1 --2- 172.21.2.102:0/1355617169 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcc00151d20 0x7fcc0014e060 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.098+0000 7fcc061cd700 1 --2- 172.21.2.102:0/1355617169 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcc000bc2b0 0x7fcc00151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.098+0000 7fcc061cd700 1 -- 172.21.2.102:0/1355617169 >> 172.21.2.102:0/1355617169 conn(0x7fcc00061830 msgr2=0x7fcc000bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:12.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.098+0000 7fcc061cd700 1 -- 172.21.2.102:0/1355617169 shutdown_connections 2021-02-12T17:16:12.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.098+0000 7fcc061cd700 1 -- 172.21.2.102:0/1355617169 wait complete. 2021-02-12T17:16:12.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.099+0000 7fcc061cd700 1 Processor -- start 2021-02-12T17:16:12.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.099+0000 7fcc061cd700 1 -- start start 2021-02-12T17:16:12.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.099+0000 7fcc061cd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcc000b0940 0x7fcc00062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcc061cd700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcc000bc2b0 0x7fcc000b98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcc061cd700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcc00151d20 0x7fcc00160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcc061cd700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000b5570 con 0x7fcc000b0940 2021-02-12T17:16:12.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcc061cd700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0009e310 con 0x7fcc00151d20 2021-02-12T17:16:12.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcc061cd700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000b3ec0 con 0x7fcc000bc2b0 2021-02-12T17:16:12.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcbff7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcc000b0940 0x7fcc00062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcbff7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcc000b0940 0x7fcc00062d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44716/0 (socket says 172.21.2.102:44716) 2021-02-12T17:16:12.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcbff7fe700 1 -- 172.21.2.102:0/2098815661 learned_addr learned my addr 172.21.2.102:0/2098815661 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:12.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcbff7fe700 1 -- 172.21.2.102:0/2098815661 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcc000bc2b0 msgr2=0x7fcc000b98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcbff7fe700 1 --2- 172.21.2.102:0/2098815661 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcc000bc2b0 0x7fcc000b98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:12.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcbff7fe700 1 -- 172.21.2.102:0/2098815661 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcc00151d20 msgr2=0x7fcc00160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcbff7fe700 1 --2- 172.21.2.102:0/2098815661 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcc00151d20 0x7fcc00160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:12.103 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcbff7fe700 1 -- 172.21.2.102:0/2098815661 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000b4160 con 0x7fcc000b0940 2021-02-12T17:16:12.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcbff7fe700 1 --2- 172.21.2.102:0/2098815661 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcc000b0940 0x7fcc00062d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fcbe800eb20 tx=0x7fcbe8006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:12.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcbf77fe700 1 -- 172.21.2.102:0/2098815661 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800c920 con 0x7fcc000b0940 2021-02-12T17:16:12.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcbf77fe700 1 -- 172.21.2.102:0/2098815661 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe800ca80 con 0x7fcc000b0940 2021-02-12T17:16:12.104 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcc061cd700 1 -- 172.21.2.102:0/2098815661 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0009ddd0 con 0x7fcc000b0940 2021-02-12T17:16:12.105 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcbf77fe700 1 -- 172.21.2.102:0/2098815661 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800ce00 con 0x7fcc000b0940 2021-02-12T17:16:12.105 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.100+0000 7fcc061cd700 1 -- 172.21.2.102:0/2098815661 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc000641d0 con 0x7fcc000b0940 2021-02-12T17:16:12.105 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.101+0000 7fcc061cd700 1 -- 172.21.2.102:0/2098815661 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0009e180 con 0x7fcc000b0940 2021-02-12T17:16:12.105 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.101+0000 7fcbf77fe700 1 -- 172.21.2.102:0/2098815661 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fcbe8012600 con 0x7fcc000b0940 2021-02-12T17:16:12.105 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.102+0000 7fcbf77fe700 1 --2- 172.21.2.102:0/2098815661 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcbe4059d30 0x7fcbe405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.105 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.102+0000 7fcbf77fe700 1 -- 172.21.2.102:0/2098815661 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fcbe8074150 con 0x7fcc000b0940 2021-02-12T17:16:12.105 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.102+0000 7fcbfeffd700 1 --2- 172.21.2.102:0/2098815661 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcbe4059d30 0x7fcbe405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.105 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.102+0000 7fcbfeffd700 1 --2- 172.21.2.102:0/2098815661 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcbe4059d30 0x7fcbe405c1f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fcc000626e0 tx=0x7fcbf0007690).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:12.106 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.105+0000 7fcbf77fe700 1 -- 172.21.2.102:0/2098815661 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fcbe8047870 con 0x7fcc000b0940 2021-02-12T17:16:12.234 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.233+0000 7fcc061cd700 1 -- 172.21.2.102:0/2098815661 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7fcc0009df60 con 0x7fcc000b0940 2021-02-12T17:16:12.235 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.233+0000 7fcbf77fe700 1 -- 172.21.2.102:0/2098815661 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+10 (secure 0 0 0) 0x7fcbe804ae90 con 0x7fcc000b0940 2021-02-12T17:16:12.235 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:12.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.234+0000 7fcc061cd700 1 -- 172.21.2.102:0/2098815661 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcbe4059d30 msgr2=0x7fcbe405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.234+0000 7fcc061cd700 1 --2- 172.21.2.102:0/2098815661 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcbe4059d30 0x7fcbe405c1f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fcc000626e0 tx=0x7fcbf0007690).stop 2021-02-12T17:16:12.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.234+0000 7fcc061cd700 1 -- 172.21.2.102:0/2098815661 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcc000b0940 msgr2=0x7fcc00062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.234+0000 7fcc061cd700 1 --2- 172.21.2.102:0/2098815661 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcc000b0940 0x7fcc00062d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fcbe800eb20 tx=0x7fcbe8006de0).stop 2021-02-12T17:16:12.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.235+0000 7fcc061cd700 1 -- 172.21.2.102:0/2098815661 shutdown_connections 2021-02-12T17:16:12.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.235+0000 7fcc061cd700 1 --2- 172.21.2.102:0/2098815661 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcc00151d20 0x7fcc00160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:12.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.235+0000 7fcc061cd700 1 --2- 172.21.2.102:0/2098815661 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcbe4059d30 0x7fcbe405c1f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.235+0000 7fcc061cd700 1 --2- 172.21.2.102:0/2098815661 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcc000b0940 0x7fcc00062d10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.235+0000 7fcc061cd700 1 --2- 172.21.2.102:0/2098815661 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcc000bc2b0 0x7fcc000b98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:12.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.235+0000 7fcc061cd700 1 -- 172.21.2.102:0/2098815661 >> 172.21.2.102:0/2098815661 conn(0x7fcc00061830 msgr2=0x7fcc000bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:12.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.235+0000 7fcc061cd700 1 -- 172.21.2.102:0/2098815661 shutdown_connections 2021-02-12T17:16:12.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.235+0000 7fcc061cd700 1 -- 172.21.2.102:0/2098815661 wait complete. 2021-02-12T17:16:12.245 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2021-02-12T17:16:12.334 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.333+0000 7f79ca6d7700 1 Processor -- start 2021-02-12T17:16:12.335 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.333+0000 7f79ca6d7700 1 -- start start 2021-02-12T17:16:12.335 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.333+0000 7f79ca6d7700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f79c40bc2b0 0x7f79c4151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.335 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.333+0000 7f79ca6d7700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f79c4151d20 0x7f79c414e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.335 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.333+0000 7f79ca6d7700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c4066b70 con 0x7f79c40b0940 2021-02-12T17:16:12.335 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.333+0000 7f79ca6d7700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c40b27d0 con 0x7f79c4151d20 2021-02-12T17:16:12.335 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.333+0000 7f79ca6d7700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c414e550 con 0x7f79c40bc2b0 2021-02-12T17:16:12.336 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.334+0000 7f79c8c74700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f79c4151d20 0x7f79c414e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.336 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.334+0000 7f79c8c74700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f79c4151d20 0x7f79c414e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44722/0 (socket says 172.21.2.102:44722) 2021-02-12T17:16:12.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.334+0000 7f79c8c74700 1 -- 172.21.2.102:0/3425773333 learned_addr learned my addr 172.21.2.102:0/3425773333 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:12.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.334+0000 7f79c8c74700 1 -- 172.21.2.102:0/3425773333 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f79c40bc2b0 msgr2=0x7f79c4151120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:12.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.334+0000 7f79c8c74700 1 --2- 172.21.2.102:0/3425773333 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f79c40bc2b0 0x7f79c4151120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:12.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.334+0000 7f79c8c74700 1 -- 172.21.2.102:0/3425773333 >> v1:172.21.2.104:6789/0 conn(0x7f79c40b0940 legacy=0x7f79c4151610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:12.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.334+0000 7f79c8c74700 1 -- 172.21.2.102:0/3425773333 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c40685b0 con 0x7f79c4151d20 2021-02-12T17:16:12.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.334+0000 7f79c8c74700 1 --2- 172.21.2.102:0/3425773333 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79c4151d20 0x7f79c414e060 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f79bc009d50 tx=0x7f79bc009290).ready entity=mon.0 client_cookie=fa3d5a423aeff18b server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:12.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.334+0000 7f79c2ffd700 1 -- 172.21.2.102:0/3425773333 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00bc40 con 0x7f79c4151d20 2021-02-12T17:16:12.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.334+0000 7f79c2ffd700 1 -- 172.21.2.102:0/3425773333 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc00bda0 con 0x7f79c4151d20 2021-02-12T17:16:12.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.334+0000 7f79c2ffd700 1 -- 172.21.2.102:0/3425773333 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc011610 con 0x7f79c4151d20 2021-02-12T17:16:12.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.335+0000 7f79ca6d7700 1 -- 172.21.2.102:0/3425773333 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79c4151d20 msgr2=0x7f79c414e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.335+0000 7f79ca6d7700 1 --2- 172.21.2.102:0/3425773333 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79c4151d20 0x7f79c414e060 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f79bc009d50 tx=0x7f79bc009290).stop 2021-02-12T17:16:12.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.335+0000 7f79ca6d7700 1 -- 172.21.2.102:0/3425773333 shutdown_connections 2021-02-12T17:16:12.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.335+0000 7f79ca6d7700 1 --2- 172.21.2.102:0/3425773333 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79c4151d20 0x7f79c414e060 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.335+0000 7f79ca6d7700 1 --2- 172.21.2.102:0/3425773333 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f79c40bc2b0 0x7f79c4151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:12.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.335+0000 7f79ca6d7700 1 -- 172.21.2.102:0/3425773333 >> 172.21.2.102:0/3425773333 conn(0x7f79c4061830 msgr2=0x7f79c40bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:12.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.335+0000 7f79ca6d7700 1 -- 172.21.2.102:0/3425773333 shutdown_connections 2021-02-12T17:16:12.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.335+0000 7f79ca6d7700 1 -- 172.21.2.102:0/3425773333 wait complete. 2021-02-12T17:16:12.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.336+0000 7f79ca6d7700 1 Processor -- start 2021-02-12T17:16:12.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.336+0000 7f79ca6d7700 1 -- start start 2021-02-12T17:16:12.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.336+0000 7f79ca6d7700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f79c40b0940 0x7f79c40b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.336+0000 7f79ca6d7700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f79c40bc2b0 0x7f79c4063600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.336+0000 7f79ca6d7700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79c4151d20 0x7f79c415d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.336+0000 7f79ca6d7700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c40b30e0 con 0x7f79c4151d20 2021-02-12T17:16:12.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.336+0000 7f79ca6d7700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c40b3310 con 0x7f79c40b0940 2021-02-12T17:16:12.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.336+0000 7f79ca6d7700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c40b35b0 con 0x7f79c40bc2b0 2021-02-12T17:16:12.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79c8c74700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79c4151d20 0x7f79c415d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79c8c74700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79c4151d20 0x7f79c415d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44730/0 (socket says 172.21.2.102:44730) 2021-02-12T17:16:12.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79c8c74700 1 -- 172.21.2.102:0/1534458728 learned_addr learned my addr 172.21.2.102:0/1534458728 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:12.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79c3fff700 1 --2- 172.21.2.102:0/1534458728 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f79c40b0940 0x7f79c40b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79c8c74700 1 -- 172.21.2.102:0/1534458728 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f79c40bc2b0 msgr2=0x7f79c4063600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79c8c74700 1 --2- 172.21.2.102:0/1534458728 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f79c40bc2b0 0x7f79c4063600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:12.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79c8c74700 1 -- 172.21.2.102:0/1534458728 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f79c40b0940 msgr2=0x7f79c40b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79c8c74700 1 --2- 172.21.2.102:0/1534458728 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f79c40b0940 0x7f79c40b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79c8c74700 1 -- 172.21.2.102:0/1534458728 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c40b3850 con 0x7f79c4151d20 2021-02-12T17:16:12.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79c3fff700 1 --2- 172.21.2.102:0/1534458728 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f79c40b0940 0x7f79c40b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:12.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79c8c74700 1 --2- 172.21.2.102:0/1534458728 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79c4151d20 0x7f79c415d7e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f79c405d280 tx=0x7f79bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:12.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79bbfff700 1 -- 172.21.2.102:0/1534458728 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc011e70 con 0x7f79c4151d20 2021-02-12T17:16:12.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79bbfff700 1 -- 172.21.2.102:0/1534458728 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc010bc0 con 0x7f79c4151d20 2021-02-12T17:16:12.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79ca6d7700 1 -- 172.21.2.102:0/1534458728 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c40b1480 con 0x7f79c4151d20 2021-02-12T17:16:12.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79bbfff700 1 -- 172.21.2.102:0/1534458728 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc01b410 con 0x7f79c4151d20 2021-02-12T17:16:12.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.337+0000 7f79ca6d7700 1 -- 172.21.2.102:0/1534458728 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c409eb30 con 0x7f79c4151d20 2021-02-12T17:16:12.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.338+0000 7f79ca6d7700 1 -- 172.21.2.102:0/1534458728 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c40b3b40 con 0x7f79c4151d20 2021-02-12T17:16:12.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.338+0000 7f79bbfff700 1 -- 172.21.2.102:0/1534458728 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f79bc023030 con 0x7f79c4151d20 2021-02-12T17:16:12.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.339+0000 7f79bbfff700 1 --2- 172.21.2.102:0/1534458728 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f79a8059d30 0x7f79a805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.339+0000 7f79bbfff700 1 -- 172.21.2.102:0/1534458728 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f79bc075370 con 0x7f79c4151d20 2021-02-12T17:16:12.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.339+0000 7f79c3fff700 1 --2- 172.21.2.102:0/1534458728 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f79a8059d30 0x7f79a805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.343 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.339+0000 7f79c3fff700 1 --2- 172.21.2.102:0/1534458728 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f79a8059d30 0x7f79a805c1f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f79c4064300 tx=0x7f79b4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:12.343 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.341+0000 7f79bbfff700 1 -- 172.21.2.102:0/1534458728 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f79bc048b40 con 0x7f79c4151d20 2021-02-12T17:16:12.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.470+0000 7f79ca6d7700 1 -- 172.21.2.102:0/1534458728 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79c4045460 con 0x7f79c4151d20 2021-02-12T17:16:12.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.470+0000 7f79bbfff700 1 -- 172.21.2.102:0/1534458728 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+10 (secure 0 0 0) 0x7f79bc021020 con 0x7f79c4151d20 2021-02-12T17:16:12.472 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:12.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.471+0000 7f79ca6d7700 1 -- 172.21.2.102:0/1534458728 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f79a8059d30 msgr2=0x7f79a805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.471+0000 7f79ca6d7700 1 --2- 172.21.2.102:0/1534458728 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f79a8059d30 0x7f79a805c1f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f79c4064300 tx=0x7f79b4008040).stop 2021-02-12T17:16:12.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.471+0000 7f79ca6d7700 1 -- 172.21.2.102:0/1534458728 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79c4151d20 msgr2=0x7f79c415d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.471+0000 7f79ca6d7700 1 --2- 172.21.2.102:0/1534458728 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79c4151d20 0x7f79c415d7e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f79c405d280 tx=0x7f79bc017000).stop 2021-02-12T17:16:12.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.471+0000 7f79ca6d7700 1 -- 172.21.2.102:0/1534458728 shutdown_connections 2021-02-12T17:16:12.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.471+0000 7f79ca6d7700 1 --2- 172.21.2.102:0/1534458728 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f79a8059d30 0x7f79a805c1f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.471+0000 7f79ca6d7700 1 --2- 172.21.2.102:0/1534458728 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79c4151d20 0x7f79c415d7e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.471+0000 7f79ca6d7700 1 --2- 172.21.2.102:0/1534458728 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f79c40b0940 0x7f79c40b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.471+0000 7f79ca6d7700 1 --2- 172.21.2.102:0/1534458728 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f79c40bc2b0 0x7f79c4063600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:12.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.471+0000 7f79ca6d7700 1 -- 172.21.2.102:0/1534458728 >> 172.21.2.102:0/1534458728 conn(0x7f79c4061830 msgr2=0x7f79c40b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:12.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.471+0000 7f79ca6d7700 1 -- 172.21.2.102:0/1534458728 shutdown_connections 2021-02-12T17:16:12.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.471+0000 7f79ca6d7700 1 -- 172.21.2.102:0/1534458728 wait complete. 2021-02-12T17:16:12.481 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2021-02-12T17:16:12.571 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.569+0000 7f1b0bb14700 1 Processor -- start 2021-02-12T17:16:12.571 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.570+0000 7f1b0bb14700 1 -- start start 2021-02-12T17:16:12.571 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.570+0000 7f1b0bb14700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f1b040bc2b0 0x7f1b04151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.571 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.570+0000 7f1b0bb14700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f1b040b0940 0x7f1b04151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.570+0000 7f1b0bb14700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b04066b70 con 0x7f1b0409ada0 2021-02-12T17:16:12.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.570+0000 7f1b0bb14700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b040b27d0 con 0x7f1b040bc2b0 2021-02-12T17:16:12.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.570+0000 7f1b0bb14700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b040b7110 con 0x7f1b040b0940 2021-02-12T17:16:12.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.570+0000 7f1b098b0700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f1b040bc2b0 0x7f1b04151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.570+0000 7f1b098b0700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f1b040bc2b0 0x7f1b04151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44736/0 (socket says 172.21.2.102:44736) 2021-02-12T17:16:12.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.570+0000 7f1b098b0700 1 -- 172.21.2.102:0/2702253404 learned_addr learned my addr 172.21.2.102:0/2702253404 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:12.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b098b0700 1 -- 172.21.2.102:0/2702253404 >> v2:172.21.2.104:3300/0 conn(0x7f1b040b0940 msgr2=0x7f1b04151610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:12.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b098b0700 1 --2- 172.21.2.102:0/2702253404 >> v2:172.21.2.104:3300/0 conn(0x7f1b040b0940 0x7f1b04151610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:12.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b098b0700 1 -- 172.21.2.102:0/2702253404 >> v1:172.21.2.104:6789/0 conn(0x7f1b0409ada0 legacy=0x7f1b0414d050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:12.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b098b0700 1 -- 172.21.2.102:0/2702253404 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b040685b0 con 0x7f1b040bc2b0 2021-02-12T17:16:12.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b098b0700 1 --2- 172.21.2.102:0/2702253404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1b040bc2b0 0x7f1b04151120 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f1b040b6280 tx=0x7f1b00006ea0).ready entity=mon.0 client_cookie=f690186b02299efa server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:12.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b088ae700 1 -- 172.21.2.102:0/2702253404 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00009800 con 0x7f1b040bc2b0 2021-02-12T17:16:12.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b088ae700 1 -- 172.21.2.102:0/2702253404 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b00009960 con 0x7f1b040bc2b0 2021-02-12T17:16:12.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b088ae700 1 -- 172.21.2.102:0/2702253404 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00009ce0 con 0x7f1b040bc2b0 2021-02-12T17:16:12.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b0bb14700 1 -- 172.21.2.102:0/2702253404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1b040bc2b0 msgr2=0x7f1b04151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b0bb14700 1 --2- 172.21.2.102:0/2702253404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1b040bc2b0 0x7f1b04151120 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f1b040b6280 tx=0x7f1b00006ea0).stop 2021-02-12T17:16:12.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b0bb14700 1 -- 172.21.2.102:0/2702253404 shutdown_connections 2021-02-12T17:16:12.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b0bb14700 1 --2- 172.21.2.102:0/2702253404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1b040bc2b0 0x7f1b04151120 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b0bb14700 1 --2- 172.21.2.102:0/2702253404 >> v2:172.21.2.104:3300/0 conn(0x7f1b040b0940 0x7f1b04151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:12.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b0bb14700 1 -- 172.21.2.102:0/2702253404 >> 172.21.2.102:0/2702253404 conn(0x7f1b04061830 msgr2=0x7f1b040bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:12.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b0bb14700 1 -- 172.21.2.102:0/2702253404 shutdown_connections 2021-02-12T17:16:12.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.571+0000 7f1b0bb14700 1 -- 172.21.2.102:0/2702253404 wait complete. 2021-02-12T17:16:12.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.572+0000 7f1b0bb14700 1 Processor -- start 2021-02-12T17:16:12.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.572+0000 7f1b0bb14700 1 -- start start 2021-02-12T17:16:12.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b0bb14700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1b0409ada0 0x7f1b040b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b0bb14700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1b040b0940 0x7f1b040b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b0bb14700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1b040bc2b0 0x7f1b0409fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b0bb14700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0414d740 con 0x7f1b040b0940 2021-02-12T17:16:12.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b0bb14700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b041614d0 con 0x7f1b040bc2b0 2021-02-12T17:16:12.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b0bb14700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0414d4a0 con 0x7f1b0409ada0 2021-02-12T17:16:12.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b090af700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1b040b0940 0x7f1b040b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b090af700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1b040b0940 0x7f1b040b3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44744/0 (socket says 172.21.2.102:44744) 2021-02-12T17:16:12.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b090af700 1 -- 172.21.2.102:0/3158593352 learned_addr learned my addr 172.21.2.102:0/3158593352 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:12.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b098b0700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1b0409ada0 0x7f1b040b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b090af700 1 -- 172.21.2.102:0/3158593352 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1b0409ada0 msgr2=0x7f1b040b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b090af700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1b0409ada0 0x7f1b040b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b090af700 1 -- 172.21.2.102:0/3158593352 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1b040bc2b0 msgr2=0x7f1b0409fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b0a0b1700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1b040bc2b0 0x7f1b0409fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b090af700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1b040bc2b0 0x7f1b0409fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b090af700 1 -- 172.21.2.102:0/3158593352 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b04161730 con 0x7f1b040b0940 2021-02-12T17:16:12.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b098b0700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1b0409ada0 0x7f1b040b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:12.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b0a0b1700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1b040bc2b0 0x7f1b0409fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:12.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1b090af700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1b040b0940 0x7f1b040b3500 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f1af80096b0 tx=0x7f1af8006dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:12.578 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.573+0000 7f1af5ffb700 1 -- 172.21.2.102:0/3158593352 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af800d500 con 0x7f1b040b0940 2021-02-12T17:16:12.578 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.574+0000 7f1af5ffb700 1 -- 172.21.2.102:0/3158593352 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af800d660 con 0x7f1b040b0940 2021-02-12T17:16:12.578 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.574+0000 7f1b0bb14700 1 -- 172.21.2.102:0/3158593352 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b04061df0 con 0x7f1b040b0940 2021-02-12T17:16:12.578 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.574+0000 7f1af5ffb700 1 -- 172.21.2.102:0/3158593352 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af800da20 con 0x7f1b040b0940 2021-02-12T17:16:12.578 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.574+0000 7f1b0bb14700 1 -- 172.21.2.102:0/3158593352 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b04150b30 con 0x7f1b040b0940 2021-02-12T17:16:12.578 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.574+0000 7f1b0bb14700 1 -- 172.21.2.102:0/3158593352 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b04045460 con 0x7f1b040b0940 2021-02-12T17:16:12.578 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.575+0000 7f1af5ffb700 1 -- 172.21.2.102:0/3158593352 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f1af8012420 con 0x7f1b040b0940 2021-02-12T17:16:12.578 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.575+0000 7f1af5ffb700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1ae4059d30 0x7f1ae405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.578 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.575+0000 7f1af5ffb700 1 -- 172.21.2.102:0/3158593352 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f1af8073cb0 con 0x7f1b040b0940 2021-02-12T17:16:12.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.575+0000 7f1b098b0700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1ae4059d30 0x7f1ae405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.575+0000 7f1b098b0700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1ae4059d30 0x7f1ae405c1f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f1b0000b190 tx=0x7f1b00016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:12.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.578+0000 7f1af5ffb700 1 -- 172.21.2.102:0/3158593352 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f1af8047370 con 0x7f1b040b0940 2021-02-12T17:16:12.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.706+0000 7f1b0bb14700 1 -- 172.21.2.102:0/3158593352 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f1b040b7650 con 0x7f1b040b0940 2021-02-12T17:16:12.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.707+0000 7f1af5ffb700 1 -- 172.21.2.102:0/3158593352 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+10 (secure 0 0 0) 0x7f1af804a990 con 0x7f1b040b0940 2021-02-12T17:16:12.708 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:12.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.708+0000 7f1b0bb14700 1 -- 172.21.2.102:0/3158593352 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1ae4059d30 msgr2=0x7f1ae405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.708+0000 7f1b0bb14700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1ae4059d30 0x7f1ae405c1f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f1b0000b190 tx=0x7f1b00016000).stop 2021-02-12T17:16:12.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.708+0000 7f1b0bb14700 1 -- 172.21.2.102:0/3158593352 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1b040b0940 msgr2=0x7f1b040b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.708+0000 7f1b0bb14700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1b040b0940 0x7f1b040b3500 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f1af80096b0 tx=0x7f1af8006dd0).stop 2021-02-12T17:16:12.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.708+0000 7f1b0bb14700 1 -- 172.21.2.102:0/3158593352 shutdown_connections 2021-02-12T17:16:12.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.708+0000 7f1b0bb14700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1b040bc2b0 0x7f1b0409fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.708+0000 7f1b0bb14700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1b0409ada0 0x7f1b040b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.708+0000 7f1b0bb14700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1ae4059d30 0x7f1ae405c1f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.708+0000 7f1b0bb14700 1 --2- 172.21.2.102:0/3158593352 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1b040b0940 0x7f1b040b3500 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.708+0000 7f1b0bb14700 1 -- 172.21.2.102:0/3158593352 >> 172.21.2.102:0/3158593352 conn(0x7f1b04061830 msgr2=0x7f1b04147730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:12.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.708+0000 7f1b0bb14700 1 -- 172.21.2.102:0/3158593352 shutdown_connections 2021-02-12T17:16:12.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.708+0000 7f1b0bb14700 1 -- 172.21.2.102:0/3158593352 wait complete. 2021-02-12T17:16:12.718 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-02-12T17:16:12.718 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-02-12T17:16:12.718 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-02-12T17:16:12.805 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.804+0000 7fb07847a700 1 Processor -- start 2021-02-12T17:16:12.806 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.804+0000 7fb07847a700 1 -- start start 2021-02-12T17:16:12.806 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb07847a700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb0700b8d20 0x7fb070068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.806 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb07847a700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fb07014e530 0x7fb0700b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.806 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb07847a700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0700622a0 con 0x7fb070062740 2021-02-12T17:16:12.806 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb07847a700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb070068d20 con 0x7fb0700b8d20 2021-02-12T17:16:12.806 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb07847a700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07014ea10 con 0x7fb07014e530 2021-02-12T17:16:12.806 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb076216700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb0700b8d20 0x7fb070068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb076216700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb0700b8d20 0x7fb070068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44750/0 (socket says 172.21.2.102:44750) 2021-02-12T17:16:12.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb076216700 1 -- 172.21.2.102:0/2249104090 learned_addr learned my addr 172.21.2.102:0/2249104090 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:12.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb075a15700 1 --2- 172.21.2.102:0/2249104090 >> v2:172.21.2.104:3300/0 conn(0x7fb07014e530 0x7fb0700b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb076216700 1 -- 172.21.2.102:0/2249104090 >> v2:172.21.2.104:3300/0 conn(0x7fb07014e530 msgr2=0x7fb0700b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:12.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb076216700 1 --2- 172.21.2.102:0/2249104090 >> v2:172.21.2.104:3300/0 conn(0x7fb07014e530 0x7fb0700b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb076216700 1 -- 172.21.2.102:0/2249104090 >> v1:172.21.2.104:6789/0 conn(0x7fb070062740 legacy=0x7fb070062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:12.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb076216700 1 -- 172.21.2.102:0/2249104090 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0700b63f0 con 0x7fb0700b8d20 2021-02-12T17:16:12.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb075a15700 1 --2- 172.21.2.102:0/2249104090 >> v2:172.21.2.104:3300/0 conn(0x7fb07014e530 0x7fb0700b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:12.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.805+0000 7fb076216700 1 --2- 172.21.2.102:0/2249104090 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb0700b8d20 0x7fb070068830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fb0700654b0 tx=0x7fb06c006ea0).ready entity=mon.0 client_cookie=a08110ef70fbe3e9 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:12.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.806+0000 7fb075214700 1 -- 172.21.2.102:0/2249104090 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c009800 con 0x7fb0700b8d20 2021-02-12T17:16:12.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.806+0000 7fb075214700 1 -- 172.21.2.102:0/2249104090 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c009960 con 0x7fb0700b8d20 2021-02-12T17:16:12.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.806+0000 7fb075214700 1 -- 172.21.2.102:0/2249104090 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c009ce0 con 0x7fb0700b8d20 2021-02-12T17:16:12.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.806+0000 7fb07847a700 1 -- 172.21.2.102:0/2249104090 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb0700b8d20 msgr2=0x7fb070068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.806+0000 7fb07847a700 1 --2- 172.21.2.102:0/2249104090 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb0700b8d20 0x7fb070068830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fb0700654b0 tx=0x7fb06c006ea0).stop 2021-02-12T17:16:12.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.806+0000 7fb07847a700 1 -- 172.21.2.102:0/2249104090 shutdown_connections 2021-02-12T17:16:12.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.806+0000 7fb07847a700 1 --2- 172.21.2.102:0/2249104090 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb0700b8d20 0x7fb070068830 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.806+0000 7fb07847a700 1 --2- 172.21.2.102:0/2249104090 >> v2:172.21.2.104:3300/0 conn(0x7fb07014e530 0x7fb0700b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.806+0000 7fb07847a700 1 -- 172.21.2.102:0/2249104090 >> 172.21.2.102:0/2249104090 conn(0x7fb0700bc480 msgr2=0x7fb0700b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:12.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.806+0000 7fb07847a700 1 -- 172.21.2.102:0/2249104090 shutdown_connections 2021-02-12T17:16:12.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.806+0000 7fb07847a700 1 -- 172.21.2.102:0/2249104090 wait complete. 2021-02-12T17:16:12.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.807+0000 7fb07847a700 1 Processor -- start 2021-02-12T17:16:12.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.807+0000 7fb07847a700 1 -- start start 2021-02-12T17:16:12.812 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.807+0000 7fb07847a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb070062740 0x7fb0700b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.812 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.807+0000 7fb07847a700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb0700b8d20 0x7fb07014a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.812 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.807+0000 7fb07847a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb07014e530 0x7fb07014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.812 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.807+0000 7fb07847a700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb070161a40 con 0x7fb070062740 2021-02-12T17:16:12.812 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.807+0000 7fb07847a700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb070160b20 con 0x7fb0700b8d20 2021-02-12T17:16:12.812 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.807+0000 7fb07847a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb070160dc0 con 0x7fb07014e530 2021-02-12T17:16:12.812 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb076216700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb070062740 0x7fb0700b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.812 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb076216700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb070062740 0x7fb0700b4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44756/0 (socket says 172.21.2.102:44756) 2021-02-12T17:16:12.812 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb076216700 1 -- 172.21.2.102:0/2139199732 learned_addr learned my addr 172.21.2.102:0/2139199732 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:12.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb076a17700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb07014e530 0x7fb07014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb075a15700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb0700b8d20 0x7fb07014a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb076216700 1 -- 172.21.2.102:0/2139199732 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb07014e530 msgr2=0x7fb07014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb076216700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb07014e530 0x7fb07014ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb076216700 1 -- 172.21.2.102:0/2139199732 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb0700b8d20 msgr2=0x7fb07014a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb076216700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb0700b8d20 0x7fb07014a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb076216700 1 -- 172.21.2.102:0/2139199732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb070161060 con 0x7fb070062740 2021-02-12T17:16:12.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb076a17700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb07014e530 0x7fb07014ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:12.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb075a15700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb0700b8d20 0x7fb07014a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:12.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb076216700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb070062740 0x7fb0700b4150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fb06c006ee0 tx=0x7fb06c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:12.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb05e7fc700 1 -- 172.21.2.102:0/2139199732 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c01c420 con 0x7fb070062740 2021-02-12T17:16:12.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb05e7fc700 1 -- 172.21.2.102:0/2139199732 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c01c580 con 0x7fb070062740 2021-02-12T17:16:12.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb07847a700 1 -- 172.21.2.102:0/2139199732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb070161300 con 0x7fb070062740 2021-02-12T17:16:12.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb05e7fc700 1 -- 172.21.2.102:0/2139199732 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c01c920 con 0x7fb070062740 2021-02-12T17:16:12.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.808+0000 7fb07847a700 1 -- 172.21.2.102:0/2139199732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0700b4640 con 0x7fb070062740 2021-02-12T17:16:12.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.809+0000 7fb07847a700 1 -- 172.21.2.102:0/2139199732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0700b48f0 con 0x7fb070062740 2021-02-12T17:16:12.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.809+0000 7fb05e7fc700 1 -- 172.21.2.102:0/2139199732 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fb06c00f070 con 0x7fb070062740 2021-02-12T17:16:12.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.809+0000 7fb05e7fc700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb050059d80 0x7fb05005c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:12.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.810+0000 7fb05e7fc700 1 -- 172.21.2.102:0/2139199732 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fb06c0754d0 con 0x7fb070062740 2021-02-12T17:16:12.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.810+0000 7fb075a15700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb050059d80 0x7fb05005c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:12.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.810+0000 7fb075a15700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb050059d80 0x7fb05005c240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb06000b7d0 tx=0x7fb060008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:12.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.812+0000 7fb05e7fc700 1 -- 172.21.2.102:0/2139199732 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fb06c048c70 con 0x7fb070062740 2021-02-12T17:16:12.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.971+0000 7fb07847a700 1 -- 172.21.2.102:0/2139199732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb070045460 con 0x7fb070062740 2021-02-12T17:16:12.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.973+0000 7fb05e7fc700 1 -- 172.21.2.102:0/2139199732 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+139655 (secure 0 0 0) 0x7fb06c04c290 con 0x7fb070062740 2021-02-12T17:16:12.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.974+0000 7fb07847a700 1 -- 172.21.2.102:0/2139199732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb050059d80 msgr2=0x7fb05005c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.974+0000 7fb07847a700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb050059d80 0x7fb05005c240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb06000b7d0 tx=0x7fb060008040).stop 2021-02-12T17:16:12.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.974+0000 7fb07847a700 1 -- 172.21.2.102:0/2139199732 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb070062740 msgr2=0x7fb0700b4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:12.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.974+0000 7fb07847a700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb070062740 0x7fb0700b4150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fb06c006ee0 tx=0x7fb06c016000).stop 2021-02-12T17:16:12.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.975+0000 7fb07847a700 1 -- 172.21.2.102:0/2139199732 shutdown_connections 2021-02-12T17:16:12.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.975+0000 7fb07847a700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb07014e530 0x7fb07014ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.975+0000 7fb07847a700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb050059d80 0x7fb05005c240 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.975+0000 7fb07847a700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb070062740 0x7fb0700b4150 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.975+0000 7fb07847a700 1 --2- 172.21.2.102:0/2139199732 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb0700b8d20 0x7fb07014a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:12.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.975+0000 7fb07847a700 1 -- 172.21.2.102:0/2139199732 >> 172.21.2.102:0/2139199732 conn(0x7fb0700bc480 msgr2=0x7fb07014ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:12.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.975+0000 7fb07847a700 1 -- 172.21.2.102:0/2139199732 shutdown_connections 2021-02-12T17:16:12.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:12.975+0000 7fb07847a700 1 -- 172.21.2.102:0/2139199732 wait complete. 2021-02-12T17:16:12.978 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:12.985 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":4,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6832","nonce":37352},{"type":"v1","addr":"172.21.2.102:6833","nonce":37352}]},"active_addr":"172.21.2.102:6833/37352","active_change":"2021-02-12T17:15:49.578415+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.2.102:0","nonce":348583661}]},{"addrvec":[{"type":"v2","addr":"172.21.2.102:0","nonce":2619725231}]}]}} 2021-02-12T17:16:12.988 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-02-12T17:16:12.988 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-02-12T17:16:12.988 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:13.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.075+0000 7f062b658700 1 Processor -- start 2021-02-12T17:16:13.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.075+0000 7f062b658700 1 -- start start 2021-02-12T17:16:13.077 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.075+0000 7f062b658700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f062414e530 0x7f0624068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.075+0000 7f062b658700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06240b7960 con 0x7f06240b8d20 2021-02-12T17:16:13.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.075+0000 7f062b658700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06240622a0 con 0x7f0624062740 2021-02-12T17:16:13.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.075+0000 7f062b658700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0624068d20 con 0x7f062414e530 2021-02-12T17:16:13.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.076+0000 7f06293f4700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f06240b8d20 0x7f06240b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53408/0 (socket says 172.21.2.102:53408) 2021-02-12T17:16:13.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.076+0000 7f06293f4700 1 -- 172.21.2.102:0/2466868908 learned_addr learned my addr 172.21.2.102:0/2466868908 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:13.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.076+0000 7f0628bf3700 1 --2- 172.21.2.102:0/2466868908 >> v2:172.21.2.104:3300/0 conn(0x7f062414e530 0x7f0624068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.076+0000 7f0617fff700 1 -- 172.21.2.102:0/2466868908 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746287671 0 0) 0x7f06240b7960 con 0x7f06240b8d20 2021-02-12T17:16:13.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.076+0000 7f0617fff700 1 -- 172.21.2.102:0/2466868908 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f060c003230 con 0x7f06240b8d20 2021-02-12T17:16:13.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.076+0000 7f0617fff700 1 -- 172.21.2.102:0/2466868908 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091125703 0 0) 0x7f06240622a0 con 0x7f0624062740 2021-02-12T17:16:13.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.076+0000 7f0617fff700 1 -- 172.21.2.102:0/2466868908 --> v1:172.21.2.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06240b7960 con 0x7f0624062740 2021-02-12T17:16:13.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.076+0000 7f0628bf3700 1 -- 172.21.2.102:0/2466868908 >> v1:172.21.2.104:6789/0 conn(0x7f0624062740 legacy=0x7f0624062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.076+0000 7f0628bf3700 1 -- 172.21.2.102:0/2466868908 >> v1:172.21.2.102:6789/0 conn(0x7f06240b8d20 legacy=0x7f06240b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.076+0000 7f0628bf3700 1 -- 172.21.2.102:0/2466868908 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062414ea10 con 0x7f062414e530 2021-02-12T17:16:13.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.076+0000 7f0628bf3700 1 --2- 172.21.2.102:0/2466868908 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f062414e530 0x7f0624068830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f061800b980 tx=0x7f0618006de0).ready entity=mon.1 client_cookie=54e83d536284d254 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.077+0000 7f0617fff700 1 -- 172.21.2.102:0/2466868908 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06180095c0 con 0x7f062414e530 2021-02-12T17:16:13.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.077+0000 7f0617fff700 1 -- 172.21.2.102:0/2466868908 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0618009720 con 0x7f062414e530 2021-02-12T17:16:13.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.077+0000 7f0617fff700 1 -- 172.21.2.102:0/2466868908 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618009aa0 con 0x7f062414e530 2021-02-12T17:16:13.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.077+0000 7f062b658700 1 -- 172.21.2.102:0/2466868908 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f062414e530 msgr2=0x7f0624068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.077+0000 7f062b658700 1 --2- 172.21.2.102:0/2466868908 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f062414e530 0x7f0624068830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f061800b980 tx=0x7f0618006de0).stop 2021-02-12T17:16:13.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.077+0000 7f062b658700 1 -- 172.21.2.102:0/2466868908 shutdown_connections 2021-02-12T17:16:13.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.077+0000 7f062b658700 1 --2- 172.21.2.102:0/2466868908 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f062414e530 0x7f0624068830 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.077+0000 7f062b658700 1 -- 172.21.2.102:0/2466868908 >> 172.21.2.102:0/2466868908 conn(0x7f06240bc480 msgr2=0x7f06240b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:13.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.077+0000 7f062b658700 1 -- 172.21.2.102:0/2466868908 shutdown_connections 2021-02-12T17:16:13.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.077+0000 7f062b658700 1 -- 172.21.2.102:0/2466868908 wait complete. 2021-02-12T17:16:13.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.078+0000 7f062b658700 1 Processor -- start 2021-02-12T17:16:13.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.078+0000 7f062b658700 1 -- start start 2021-02-12T17:16:13.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f062b658700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0624062740 0x7f062415df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f062b658700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f06240b8d20 0x7f06240b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f062b658700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f062414e530 0x7f062414aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f062b658700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062415e440 con 0x7f062414e530 2021-02-12T17:16:13.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f062b658700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06240b5120 con 0x7f06240b8d20 2021-02-12T17:16:13.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f062b658700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06240b53c0 con 0x7f0624062740 2021-02-12T17:16:13.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f0629bf5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f062414e530 0x7f062414aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f0629bf5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f062414e530 0x7f062414aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44774/0 (socket says 172.21.2.102:44774) 2021-02-12T17:16:13.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f0629bf5700 1 -- 172.21.2.102:0/1140397863 learned_addr learned my addr 172.21.2.102:0/1140397863 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:13.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f06293f4700 1 --2- 172.21.2.102:0/1140397863 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0624062740 0x7f062415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f0628bf3700 1 --2- 172.21.2.102:0/1140397863 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f06240b8d20 0x7f06240b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f0629bf5700 1 -- 172.21.2.102:0/1140397863 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0624062740 msgr2=0x7f062415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f0629bf5700 1 --2- 172.21.2.102:0/1140397863 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0624062740 0x7f062415df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f0629bf5700 1 -- 172.21.2.102:0/1140397863 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f06240b8d20 msgr2=0x7f06240b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f0629bf5700 1 --2- 172.21.2.102:0/1140397863 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f06240b8d20 0x7f06240b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f0629bf5700 1 -- 172.21.2.102:0/1140397863 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06240b5660 con 0x7f062414e530 2021-02-12T17:16:13.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.079+0000 7f0629bf5700 1 --2- 172.21.2.102:0/1140397863 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f062414e530 0x7f062414aac0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f061c00ca90 tx=0x7f061c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.080+0000 7f06157fa700 1 -- 172.21.2.102:0/1140397863 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c002240 con 0x7f062414e530 2021-02-12T17:16:13.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.080+0000 7f06157fa700 1 -- 172.21.2.102:0/1140397863 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c0023a0 con 0x7f062414e530 2021-02-12T17:16:13.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.080+0000 7f062b658700 1 -- 172.21.2.102:0/1140397863 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06240ad8a0 con 0x7f062414e530 2021-02-12T17:16:13.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.080+0000 7f06157fa700 1 -- 172.21.2.102:0/1140397863 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c001820 con 0x7f062414e530 2021-02-12T17:16:13.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.080+0000 7f062b658700 1 -- 172.21.2.102:0/1140397863 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06240b07f0 con 0x7f062414e530 2021-02-12T17:16:13.085 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.080+0000 7f062b658700 1 -- 172.21.2.102:0/1140397863 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0624045460 con 0x7f062414e530 2021-02-12T17:16:13.085 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.081+0000 7f06157fa700 1 -- 172.21.2.102:0/1140397863 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f061c019030 con 0x7f062414e530 2021-02-12T17:16:13.085 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.081+0000 7f06157fa700 1 --2- 172.21.2.102:0/1140397863 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0604059d60 0x7f060405c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.085 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.081+0000 7f06157fa700 1 -- 172.21.2.102:0/1140397863 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f061c073340 con 0x7f062414e530 2021-02-12T17:16:13.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.081+0000 7f06293f4700 1 --2- 172.21.2.102:0/1140397863 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0604059d60 0x7f060405c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.081+0000 7f06293f4700 1 --2- 172.21.2.102:0/1140397863 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0604059d60 0x7f060405c220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0624065cd0 tx=0x7f0620009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.084+0000 7f06157fa700 1 -- 172.21.2.102:0/1140397863 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f061c045580 con 0x7f062414e530 2021-02-12T17:16:13.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.213+0000 7f062b658700 1 -- 172.21.2.102:0/1140397863 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06240b8790 con 0x7f062414e530 2021-02-12T17:16:13.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.214+0000 7f06157fa700 1 -- 172.21.2.102:0/1140397863 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19888 (secure 0 0 0) 0x7f061c025dc0 con 0x7f062414e530 2021-02-12T17:16:13.216 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:13.216 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":27,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:09.532002+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}},{"pool":5,"pool_name":"b_metadata","create_time":"2021-02-12T17:16:06.678651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}}},{"pool":6,"pool_name":"b_data","create_time":"2021-02-12T17:16:07.511756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"b"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:13.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.215+0000 7f062b658700 1 -- 172.21.2.102:0/1140397863 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0604059d60 msgr2=0x7f060405c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.215+0000 7f062b658700 1 --2- 172.21.2.102:0/1140397863 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0604059d60 0x7f060405c220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0624065cd0 tx=0x7f0620009040).stop 2021-02-12T17:16:13.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.215+0000 7f062b658700 1 -- 172.21.2.102:0/1140397863 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f062414e530 msgr2=0x7f062414aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.215+0000 7f062b658700 1 --2- 172.21.2.102:0/1140397863 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f062414e530 0x7f062414aac0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f061c00ca90 tx=0x7f061c007dc0).stop 2021-02-12T17:16:13.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.215+0000 7f062b658700 1 -- 172.21.2.102:0/1140397863 shutdown_connections 2021-02-12T17:16:13.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.215+0000 7f062b658700 1 --2- 172.21.2.102:0/1140397863 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0604059d60 0x7f060405c220 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.215+0000 7f062b658700 1 --2- 172.21.2.102:0/1140397863 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f062414e530 0x7f062414aac0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.215+0000 7f062b658700 1 --2- 172.21.2.102:0/1140397863 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0624062740 0x7f062415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.215+0000 7f062b658700 1 --2- 172.21.2.102:0/1140397863 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f06240b8d20 0x7f06240b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.215+0000 7f062b658700 1 -- 172.21.2.102:0/1140397863 >> 172.21.2.102:0/1140397863 conn(0x7f06240bc480 msgr2=0x7f062414cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:13.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.216+0000 7f062b658700 1 -- 172.21.2.102:0/1140397863 shutdown_connections 2021-02-12T17:16:13.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.216+0000 7f062b658700 1 -- 172.21.2.102:0/1140397863 wait complete. 2021-02-12T17:16:13.226 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-02-12T17:16:13.226 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:13.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.313+0000 7fbcb4d0a700 1 Processor -- start 2021-02-12T17:16:13.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.313+0000 7fbcb4d0a700 1 -- start start 2021-02-12T17:16:13.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.314+0000 7fbcb4d0a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbcb014e530 0x7fbcb0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.314+0000 7fbcb4d0a700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fbcb0062740 0x7fbcb0062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.314+0000 7fbcb4d0a700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb00b7960 con 0x7fbcb00b8d20 2021-02-12T17:16:13.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.314+0000 7fbcb4d0a700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb0068d20 con 0x7fbcb0062740 2021-02-12T17:16:13.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.314+0000 7fbcb4d0a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00622a0 con 0x7fbcb014e530 2021-02-12T17:16:13.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.314+0000 7fbcaed9d700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fbcb0062740 0x7fbcb0062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.314+0000 7fbcae59c700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fbcb00b8d20 0x7fbcb00b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53422/0 (socket says 172.21.2.102:53422) 2021-02-12T17:16:13.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.314+0000 7fbcae59c700 1 -- 172.21.2.102:0/956668258 learned_addr learned my addr 172.21.2.102:0/956668258 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:13.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.314+0000 7fbcaed9d700 1 -- 172.21.2.102:0/956668258 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbcb014e530 msgr2=0x7fbcb0068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:13.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.314+0000 7fbcaed9d700 1 --2- 172.21.2.102:0/956668258 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbcb014e530 0x7fbcb0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:13.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.314+0000 7fbcaed9d700 1 -- 172.21.2.102:0/956668258 >> v1:172.21.2.102:6789/0 conn(0x7fbcb00b8d20 legacy=0x7fbcb00b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.314+0000 7fbcaed9d700 1 -- 172.21.2.102:0/956668258 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb014ea10 con 0x7fbcb0062740 2021-02-12T17:16:13.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.314+0000 7fbcad59a700 1 -- 172.21.2.102:0/956668258 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403052227 0 0) 0x7fbcb00b7960 con 0x7fbcb00b8d20 2021-02-12T17:16:13.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.315+0000 7fbcaed9d700 1 --2- 172.21.2.102:0/956668258 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbcb0062740 0x7fbcb0062bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fbca8009c90 tx=0x7fbca80091d0).ready entity=mon.0 client_cookie=b9ccb044f3610eb8 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.315+0000 7fbcad59a700 1 -- 172.21.2.102:0/956668258 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8009ea0 con 0x7fbcb0062740 2021-02-12T17:16:13.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.315+0000 7fbcad59a700 1 -- 172.21.2.102:0/956668258 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca800bbf0 con 0x7fbcb0062740 2021-02-12T17:16:13.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.315+0000 7fbcad59a700 1 -- 172.21.2.102:0/956668258 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8011400 con 0x7fbcb0062740 2021-02-12T17:16:13.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.315+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/956668258 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbcb0062740 msgr2=0x7fbcb0062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.315+0000 7fbcb4d0a700 1 --2- 172.21.2.102:0/956668258 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbcb0062740 0x7fbcb0062bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fbca8009c90 tx=0x7fbca80091d0).stop 2021-02-12T17:16:13.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.315+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/956668258 shutdown_connections 2021-02-12T17:16:13.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.315+0000 7fbcb4d0a700 1 --2- 172.21.2.102:0/956668258 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbcb0062740 0x7fbcb0062bf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.315+0000 7fbcb4d0a700 1 --2- 172.21.2.102:0/956668258 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbcb014e530 0x7fbcb0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:13.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.315+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/956668258 >> 172.21.2.102:0/956668258 conn(0x7fbcb00bc480 msgr2=0x7fbcb00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:13.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.315+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/956668258 shutdown_connections 2021-02-12T17:16:13.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.315+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/956668258 wait complete. 2021-02-12T17:16:13.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.316+0000 7fbcb4d0a700 1 Processor -- start 2021-02-12T17:16:13.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.316+0000 7fbcb4d0a700 1 -- start start 2021-02-12T17:16:13.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcb4d0a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbcb0062740 0x7fbcb00b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcb4d0a700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbcb00b8d20 0x7fbcb00ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcb4d0a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbcb014e530 0x7fbcb014ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcb4d0a700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00b03c0 con 0x7fbcb0062740 2021-02-12T17:16:13.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcb4d0a700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00b05f0 con 0x7fbcb00b8d20 2021-02-12T17:16:13.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcb4d0a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00b0890 con 0x7fbcb014e530 2021-02-12T17:16:13.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcae59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbcb0062740 0x7fbcb00b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcae59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbcb0062740 0x7fbcb00b51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44780/0 (socket says 172.21.2.102:44780) 2021-02-12T17:16:13.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcae59c700 1 -- 172.21.2.102:0/2261375897 learned_addr learned my addr 172.21.2.102:0/2261375897 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:13.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcaed9d700 1 --2- 172.21.2.102:0/2261375897 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbcb014e530 0x7fbcb014ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcadd9b700 1 --2- 172.21.2.102:0/2261375897 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbcb00b8d20 0x7fbcb00ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcae59c700 1 -- 172.21.2.102:0/2261375897 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbcb014e530 msgr2=0x7fbcb014ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcae59c700 1 --2- 172.21.2.102:0/2261375897 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbcb014e530 0x7fbcb014ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcae59c700 1 -- 172.21.2.102:0/2261375897 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbcb00b8d20 msgr2=0x7fbcb00ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcae59c700 1 --2- 172.21.2.102:0/2261375897 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbcb00b8d20 0x7fbcb00ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcae59c700 1 -- 172.21.2.102:0/2261375897 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb00b0b30 con 0x7fbcb0062740 2021-02-12T17:16:13.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcae59c700 1 --2- 172.21.2.102:0/2261375897 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbcb0062740 0x7fbcb00b51c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fbca000c710 tx=0x7fbca0007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbca67fc700 1 -- 172.21.2.102:0/2261375897 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0007320 con 0x7fbcb0062740 2021-02-12T17:16:13.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbca67fc700 1 -- 172.21.2.102:0/2261375897 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca0007480 con 0x7fbcb0062740 2021-02-12T17:16:13.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbca67fc700 1 -- 172.21.2.102:0/2261375897 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00057f0 con 0x7fbcb0062740 2021-02-12T17:16:13.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.317+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/2261375897 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb00acf10 con 0x7fbcb0062740 2021-02-12T17:16:13.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.318+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/2261375897 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb00aed20 con 0x7fbcb0062740 2021-02-12T17:16:13.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.318+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/2261375897 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb0045460 con 0x7fbcb0062740 2021-02-12T17:16:13.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.318+0000 7fbca67fc700 1 -- 172.21.2.102:0/2261375897 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fbca0010030 con 0x7fbcb0062740 2021-02-12T17:16:13.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.318+0000 7fbca67fc700 1 --2- 172.21.2.102:0/2261375897 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbc94059d30 0x7fbc9405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.319+0000 7fbca67fc700 1 -- 172.21.2.102:0/2261375897 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fbca0073ab0 con 0x7fbcb0062740 2021-02-12T17:16:13.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.319+0000 7fbcadd9b700 1 --2- 172.21.2.102:0/2261375897 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbc94059d30 0x7fbc9405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.319+0000 7fbcadd9b700 1 --2- 172.21.2.102:0/2261375897 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbc94059d30 0x7fbc9405c1f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fbcb01515d0 tx=0x7fbc98008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.322+0000 7fbca67fc700 1 -- 172.21.2.102:0/2261375897 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fbca00472e0 con 0x7fbcb0062740 2021-02-12T17:16:13.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.450+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/2261375897 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcb0063670 con 0x7fbcb0062740 2021-02-12T17:16:13.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.451+0000 7fbca67fc700 1 -- 172.21.2.102:0/2261375897 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19888 (secure 0 0 0) 0x7fbca004a900 con 0x7fbcb0062740 2021-02-12T17:16:13.453 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:13.453 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":27,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:09.532002+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}},{"pool":5,"pool_name":"b_metadata","create_time":"2021-02-12T17:16:06.678651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}}},{"pool":6,"pool_name":"b_data","create_time":"2021-02-12T17:16:07.511756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"b"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:13.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.452+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/2261375897 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbc94059d30 msgr2=0x7fbc9405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.452+0000 7fbcb4d0a700 1 --2- 172.21.2.102:0/2261375897 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbc94059d30 0x7fbc9405c1f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fbcb01515d0 tx=0x7fbc98008040).stop 2021-02-12T17:16:13.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.452+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/2261375897 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbcb0062740 msgr2=0x7fbcb00b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.452+0000 7fbcb4d0a700 1 --2- 172.21.2.102:0/2261375897 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbcb0062740 0x7fbcb00b51c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fbca000c710 tx=0x7fbca0007ab0).stop 2021-02-12T17:16:13.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.452+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/2261375897 shutdown_connections 2021-02-12T17:16:13.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.452+0000 7fbcb4d0a700 1 --2- 172.21.2.102:0/2261375897 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbcb014e530 0x7fbcb014ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.452+0000 7fbcb4d0a700 1 --2- 172.21.2.102:0/2261375897 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbc94059d30 0x7fbc9405c1f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.452+0000 7fbcb4d0a700 1 --2- 172.21.2.102:0/2261375897 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbcb0062740 0x7fbcb00b51c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.452+0000 7fbcb4d0a700 1 --2- 172.21.2.102:0/2261375897 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbcb00b8d20 0x7fbcb00ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.452+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/2261375897 >> 172.21.2.102:0/2261375897 conn(0x7fbcb00bc480 msgr2=0x7fbcb0062b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:13.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.453+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/2261375897 shutdown_connections 2021-02-12T17:16:13.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.453+0000 7fbcb4d0a700 1 -- 172.21.2.102:0/2261375897 wait complete. 2021-02-12T17:16:13.463 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-02-12T17:16:13.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.550+0000 7f357654b700 1 Processor -- start 2021-02-12T17:16:13.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.550+0000 7f357654b700 1 -- start start 2021-02-12T17:16:13.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.551+0000 7f357654b700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f35700b6350 0x7f35701463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.551+0000 7f357654b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3570144ea0 0x7f3570145330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.551+0000 7f357654b700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35700b2930 con 0x7f3570067720 2021-02-12T17:16:13.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.551+0000 7f357654b700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3570068980 con 0x7f3570144ea0 2021-02-12T17:16:13.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.551+0000 7f357654b700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35700b67b0 con 0x7f35700b6350 2021-02-12T17:16:13.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.551+0000 7f3574ae8700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3570144ea0 0x7f3570145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.551+0000 7f3574ae8700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3570144ea0 0x7f3570145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44790/0 (socket says 172.21.2.102:44790) 2021-02-12T17:16:13.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.551+0000 7f3574ae8700 1 -- 172.21.2.102:0/1556796404 learned_addr learned my addr 172.21.2.102:0/1556796404 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:13.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.551+0000 7f3574ae8700 1 -- 172.21.2.102:0/1556796404 >> v2:172.21.2.104:3300/0 conn(0x7f35700b6350 msgr2=0x7f35701463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:13.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.551+0000 7f3574ae8700 1 --2- 172.21.2.102:0/1556796404 >> v2:172.21.2.104:3300/0 conn(0x7f35700b6350 0x7f35701463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:13.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.552+0000 7f3574ae8700 1 -- 172.21.2.102:0/1556796404 >> v1:172.21.2.104:6789/0 conn(0x7f3570067720 legacy=0x7f3570062580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:13.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.552+0000 7f3574ae8700 1 -- 172.21.2.102:0/1556796404 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3570066db0 con 0x7f3570144ea0 2021-02-12T17:16:13.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.552+0000 7f3574ae8700 1 --2- 172.21.2.102:0/1556796404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3570144ea0 0x7f3570145330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3570065c50 tx=0x7f3568009290).ready entity=mon.0 client_cookie=6319b7b6ce732c26 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.552+0000 7f356effd700 1 -- 172.21.2.102:0/1556796404 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356800bc00 con 0x7f3570144ea0 2021-02-12T17:16:13.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.552+0000 7f356effd700 1 -- 172.21.2.102:0/1556796404 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356800bd60 con 0x7f3570144ea0 2021-02-12T17:16:13.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.552+0000 7f356effd700 1 -- 172.21.2.102:0/1556796404 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568011610 con 0x7f3570144ea0 2021-02-12T17:16:13.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.552+0000 7f357654b700 1 -- 172.21.2.102:0/1556796404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3570144ea0 msgr2=0x7f3570145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.552+0000 7f357654b700 1 --2- 172.21.2.102:0/1556796404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3570144ea0 0x7f3570145330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3570065c50 tx=0x7f3568009290).stop 2021-02-12T17:16:13.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.552+0000 7f357654b700 1 -- 172.21.2.102:0/1556796404 shutdown_connections 2021-02-12T17:16:13.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.552+0000 7f357654b700 1 --2- 172.21.2.102:0/1556796404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3570144ea0 0x7f3570145330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.552+0000 7f357654b700 1 --2- 172.21.2.102:0/1556796404 >> v2:172.21.2.104:3300/0 conn(0x7f35700b6350 0x7f35701463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:13.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.552+0000 7f357654b700 1 -- 172.21.2.102:0/1556796404 >> 172.21.2.102:0/1556796404 conn(0x7f35700bc480 msgr2=0x7f35700b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:13.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.552+0000 7f357654b700 1 -- 172.21.2.102:0/1556796404 shutdown_connections 2021-02-12T17:16:13.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.552+0000 7f357654b700 1 -- 172.21.2.102:0/1556796404 wait complete. 2021-02-12T17:16:13.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.553+0000 7f357654b700 1 Processor -- start 2021-02-12T17:16:13.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.553+0000 7f357654b700 1 -- start start 2021-02-12T17:16:13.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f357654b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3570067720 0x7f357015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f357654b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35700b6350 0x7f3570147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f357654b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3570144ea0 0x7f35700b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f357654b700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3570149de0 con 0x7f35700b6350 2021-02-12T17:16:13.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f357654b700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3570149b40 con 0x7f3570067720 2021-02-12T17:16:13.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f357654b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357015d1d0 con 0x7f3570144ea0 2021-02-12T17:16:13.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f356f7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35700b6350 0x7f3570147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f356f7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35700b6350 0x7f3570147ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44796/0 (socket says 172.21.2.102:44796) 2021-02-12T17:16:13.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f356f7fe700 1 -- 172.21.2.102:0/4038205340 learned_addr learned my addr 172.21.2.102:0/4038205340 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:13.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f3574ae8700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3570144ea0 0x7f35700b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f356ffff700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3570067720 0x7f357015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f356f7fe700 1 -- 172.21.2.102:0/4038205340 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3570144ea0 msgr2=0x7f35700b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f356f7fe700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3570144ea0 0x7f35700b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f356f7fe700 1 -- 172.21.2.102:0/4038205340 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3570067720 msgr2=0x7f357015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f356f7fe700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3570067720 0x7f357015dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f356f7fe700 1 -- 172.21.2.102:0/4038205340 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357015d470 con 0x7f35700b6350 2021-02-12T17:16:13.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f356ffff700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3570067720 0x7f357015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:13.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.554+0000 7f356f7fe700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35700b6350 0x7f3570147ea0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f3560009790 tx=0x7f3560006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.555+0000 7f3567fff700 1 -- 172.21.2.102:0/4038205340 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356000d5a0 con 0x7f35700b6350 2021-02-12T17:16:13.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.555+0000 7f3567fff700 1 -- 172.21.2.102:0/4038205340 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3560000e90 con 0x7f35700b6350 2021-02-12T17:16:13.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.555+0000 7f3567fff700 1 -- 172.21.2.102:0/4038205340 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356000d950 con 0x7f35700b6350 2021-02-12T17:16:13.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.555+0000 7f357654b700 1 -- 172.21.2.102:0/4038205340 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357015d710 con 0x7f35700b6350 2021-02-12T17:16:13.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.555+0000 7f357654b700 1 -- 172.21.2.102:0/4038205340 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3570148390 con 0x7f35700b6350 2021-02-12T17:16:13.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.555+0000 7f357654b700 1 -- 172.21.2.102:0/4038205340 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3570045460 con 0x7f35700b6350 2021-02-12T17:16:13.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.556+0000 7f3567fff700 1 -- 172.21.2.102:0/4038205340 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f3560017030 con 0x7f35700b6350 2021-02-12T17:16:13.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.556+0000 7f3567fff700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3554059d80 0x7f355405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.556+0000 7f3567fff700 1 -- 172.21.2.102:0/4038205340 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f3560072f50 con 0x7f35700b6350 2021-02-12T17:16:13.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.556+0000 7f3567fff700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.102:6800/37580,v1:172.21.2.102:6803/37580] conn(0x7f3554062120 0x7f3554064580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.556+0000 7f3567fff700 1 -- 172.21.2.102:0/4038205340 --> [v2:172.21.2.102:6800/37580,v1:172.21.2.102:6803/37580] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3554064c00 con 0x7f3554062120 2021-02-12T17:16:13.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.556+0000 7f3567fff700 1 -- 172.21.2.102:0/4038205340 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35600467a0 con 0x7f35700b6350 2021-02-12T17:16:13.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.556+0000 7f356ffff700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3554059d80 0x7f355405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.556+0000 7f3574ae8700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.102:6800/37580,v1:172.21.2.102:6803/37580] conn(0x7f3554062120 0x7f3554064580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.556+0000 7f356ffff700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3554059d80 0x7f355405c240 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f355800a6d0 tx=0x7f3558008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.557+0000 7f3574ae8700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.102:6800/37580,v1:172.21.2.102:6803/37580] conn(0x7f3554062120 0x7f3554064580 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.557+0000 7f3567fff700 1 -- 172.21.2.102:0/4038205340 <== osd.0 v2:172.21.2.102:6800/37580 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f3554064c00 con 0x7f3554062120 2021-02-12T17:16:13.571 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.570+0000 7f357654b700 1 -- 172.21.2.102:0/4038205340 --> [v2:172.21.2.102:6800/37580,v1:172.21.2.102:6803/37580] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3570064100 con 0x7f3554062120 2021-02-12T17:16:13.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.570+0000 7f3567fff700 1 -- 172.21.2.102:0/4038205340 <== osd.0 v2:172.21.2.102:6800/37580 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3570064100 con 0x7f3554062120 2021-02-12T17:16:13.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.570+0000 7f357654b700 1 -- 172.21.2.102:0/4038205340 >> [v2:172.21.2.102:6800/37580,v1:172.21.2.102:6803/37580] conn(0x7f3554062120 msgr2=0x7f3554064580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.570+0000 7f357654b700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.102:6800/37580,v1:172.21.2.102:6803/37580] conn(0x7f3554062120 0x7f3554064580 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.570+0000 7f357654b700 1 -- 172.21.2.102:0/4038205340 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3554059d80 msgr2=0x7f355405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.570+0000 7f357654b700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3554059d80 0x7f355405c240 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f355800a6d0 tx=0x7f3558008040).stop 2021-02-12T17:16:13.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.571+0000 7f357654b700 1 -- 172.21.2.102:0/4038205340 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35700b6350 msgr2=0x7f3570147ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.571+0000 7f357654b700 1 --2- 172.21.2.102:0/4038205340 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35700b6350 0x7f3570147ea0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f3560009790 tx=0x7f3560006eb0).stop 2021-02-12T17:16:13.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.571+0000 7f3574ae8700 1 -- 172.21.2.102:0/4038205340 reap_dead start 2021-02-12T17:16:13.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.571+0000 7f357654b700 1 -- 172.21.2.102:0/4038205340 shutdown_connections 2021-02-12T17:16:13.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.571+0000 7f357654b700 1 -- 172.21.2.102:0/4038205340 >> 172.21.2.102:0/4038205340 conn(0x7f35700bc480 msgr2=0x7f35700b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:13.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.571+0000 7f357654b700 1 -- 172.21.2.102:0/4038205340 shutdown_connections 2021-02-12T17:16:13.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.571+0000 7f357654b700 1 -- 172.21.2.102:0/4038205340 wait complete. 2021-02-12T17:16:13.580 INFO:teuthology.orchestra.run.gibba002.stdout:55834574854 2021-02-12T17:16:13.580 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-02-12T17:16:13.671 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.669+0000 7fb4f3d89700 1 Processor -- start 2021-02-12T17:16:13.671 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.669+0000 7fb4f3d89700 1 -- start start 2021-02-12T17:16:13.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.670+0000 7fb4f3d89700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fb4ec14e530 0x7fb4ec068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.670+0000 7fb4f3d89700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4ec062740 0x7fb4ec062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.670+0000 7fb4f3d89700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ec0b7960 con 0x7fb4ec0b8d20 2021-02-12T17:16:13.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.670+0000 7fb4f3d89700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ec068d20 con 0x7fb4ec14e530 2021-02-12T17:16:13.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.670+0000 7fb4f3d89700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0622a0 con 0x7fb4ec062740 2021-02-12T17:16:13.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.670+0000 7fb4f1b25700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fb4ec0b8d20 0x7fb4ec0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53448/0 (socket says 172.21.2.102:53448) 2021-02-12T17:16:13.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.670+0000 7fb4f1b25700 1 -- 172.21.2.102:0/1027692008 learned_addr learned my addr 172.21.2.102:0/1027692008 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:13.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.670+0000 7fb4f0b23700 1 -- 172.21.2.102:0/1027692008 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896468976 0 0) 0x7fb4ec0b7960 con 0x7fb4ec0b8d20 2021-02-12T17:16:13.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.670+0000 7fb4f0b23700 1 -- 172.21.2.102:0/1027692008 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4d4003230 con 0x7fb4ec0b8d20 2021-02-12T17:16:13.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f1324700 1 --2- 172.21.2.102:0/1027692008 >> v2:172.21.2.104:3300/0 conn(0x7fb4ec14e530 0x7fb4ec068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f2326700 1 --2- 172.21.2.102:0/1027692008 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4ec062740 0x7fb4ec062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 -- 172.21.2.102:0/1027692008 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1295549579 0 0) 0x7fb4d4003230 con 0x7fb4ec0b8d20 2021-02-12T17:16:13.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 -- 172.21.2.102:0/1027692008 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4ec062740 msgr2=0x7fb4ec062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:13.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 --2- 172.21.2.102:0/1027692008 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4ec062740 0x7fb4ec062bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 -- 172.21.2.102:0/1027692008 >> v2:172.21.2.104:3300/0 conn(0x7fb4ec14e530 msgr2=0x7fb4ec068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:13.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 --2- 172.21.2.102:0/1027692008 >> v2:172.21.2.104:3300/0 conn(0x7fb4ec14e530 0x7fb4ec068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 -- 172.21.2.102:0/1027692008 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec14ea10 con 0x7fb4ec0b8d20 2021-02-12T17:16:13.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 -- 172.21.2.102:0/1027692008 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fb4e80014e0 con 0x7fb4ec0b8d20 2021-02-12T17:16:13.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 -- 172.21.2.102:0/1027692008 >> v1:172.21.2.102:6789/0 conn(0x7fb4ec0b8d20 legacy=0x7fb4ec0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 --2- 172.21.2.102:0/1027692008 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4d40037a0 0x7fb4d4003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 --2- 172.21.2.102:0/1027692008 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb4d40044d0 0x7fb4d4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 --2- 172.21.2.102:0/1027692008 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4ec062740 0x7fb4d4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 -- 172.21.2.102:0/1027692008 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec068d20 con 0x7fb4d40037a0 2021-02-12T17:16:13.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 -- 172.21.2.102:0/1027692008 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0622a0 con 0x7fb4d40044d0 2021-02-12T17:16:13.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 -- 172.21.2.102:0/1027692008 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d4005330 con 0x7fb4ec062740 2021-02-12T17:16:13.677 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f1b25700 1 --2- 172.21.2.102:0/1027692008 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4d40037a0 0x7fb4d4003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.677 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f2326700 1 --2- 172.21.2.102:0/1027692008 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4ec062740 0x7fb4d4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.677 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f1324700 1 --2- 172.21.2.102:0/1027692008 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb4d40044d0 0x7fb4d4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.677 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f1b25700 1 -- 172.21.2.102:0/1027692008 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4ec062740 msgr2=0x7fb4d4004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:13.677 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f1b25700 1 --2- 172.21.2.102:0/1027692008 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4ec062740 0x7fb4d4004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.677 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f1b25700 1 -- 172.21.2.102:0/1027692008 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb4d40044d0 msgr2=0x7fb4d4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:13.677 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f1b25700 1 --2- 172.21.2.102:0/1027692008 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb4d40044d0 0x7fb4d4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.677 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f1b25700 1 -- 172.21.2.102:0/1027692008 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d4003230 con 0x7fb4d40037a0 2021-02-12T17:16:13.677 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f1b25700 1 --2- 172.21.2.102:0/1027692008 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4d40037a0 0x7fb4d4003bc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fb4e800c210 tx=0x7fb4ec14eba0).ready entity=mon.0 client_cookie=58d820564706fe3c server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 -- 172.21.2.102:0/1027692008 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e80076e0 con 0x7fb4d40037a0 2021-02-12T17:16:13.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 -- 172.21.2.102:0/1027692008 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e80070d0 con 0x7fb4d40037a0 2021-02-12T17:16:13.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.671+0000 7fb4f0b23700 1 -- 172.21.2.102:0/1027692008 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8007490 con 0x7fb4d40037a0 2021-02-12T17:16:13.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.672+0000 7fb4f3d89700 1 -- 172.21.2.102:0/1027692008 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4d40037a0 msgr2=0x7fb4d4003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.672+0000 7fb4f3d89700 1 --2- 172.21.2.102:0/1027692008 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4d40037a0 0x7fb4d4003bc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fb4e800c210 tx=0x7fb4ec14eba0).stop 2021-02-12T17:16:13.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.672+0000 7fb4f2326700 1 -- 172.21.2.102:0/1027692008 reap_dead start 2021-02-12T17:16:13.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.672+0000 7fb4f3d89700 1 -- 172.21.2.102:0/1027692008 shutdown_connections 2021-02-12T17:16:13.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.672+0000 7fb4f3d89700 1 -- 172.21.2.102:0/1027692008 >> 172.21.2.102:0/1027692008 conn(0x7fb4ec0bc480 msgr2=0x7fb4ec0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:13.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.672+0000 7fb4f3d89700 1 -- 172.21.2.102:0/1027692008 shutdown_connections 2021-02-12T17:16:13.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.672+0000 7fb4f3d89700 1 -- 172.21.2.102:0/1027692008 wait complete. 2021-02-12T17:16:13.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.672+0000 7fb4f3d89700 1 Processor -- start 2021-02-12T17:16:13.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f3d89700 1 -- start start 2021-02-12T17:16:13.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f3d89700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4ec0b0170 0x7fb4ec0b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f3d89700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb4ec0acf10 0x7fb4ec0b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f3d89700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4ec0b1910 0x7fb4ec15da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f3d89700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec15d5d0 con 0x7fb4ec0b0170 2021-02-12T17:16:13.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f3d89700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec1508c0 con 0x7fb4ec0acf10 2021-02-12T17:16:13.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f3d89700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0b50e0 con 0x7fb4ec0b1910 2021-02-12T17:16:13.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f1b25700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4ec0b0170 0x7fb4ec0b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f1b25700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4ec0b0170 0x7fb4ec0b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44816/0 (socket says 172.21.2.102:44816) 2021-02-12T17:16:13.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f1b25700 1 -- 172.21.2.102:0/2718816182 learned_addr learned my addr 172.21.2.102:0/2718816182 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:13.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f1b25700 1 -- 172.21.2.102:0/2718816182 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4ec0b1910 msgr2=0x7fb4ec15da30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:13.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f1b25700 1 --2- 172.21.2.102:0/2718816182 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb4ec0b1910 0x7fb4ec15da30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:13.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f1b25700 1 -- 172.21.2.102:0/2718816182 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb4ec0acf10 msgr2=0x7fb4ec0b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f1b25700 1 --2- 172.21.2.102:0/2718816182 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb4ec0acf10 0x7fb4ec0b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:13.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f1b25700 1 -- 172.21.2.102:0/2718816182 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec0b5380 con 0x7fb4ec0b0170 2021-02-12T17:16:13.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.673+0000 7fb4f1b25700 1 --2- 172.21.2.102:0/2718816182 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4ec0b0170 0x7fb4ec0b0550 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fb4d4004350 tx=0x7fb4e8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.674+0000 7fb4ddffb700 1 -- 172.21.2.102:0/2718816182 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8006b10 con 0x7fb4ec0b0170 2021-02-12T17:16:13.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.674+0000 7fb4ddffb700 1 -- 172.21.2.102:0/2718816182 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e8006c70 con 0x7fb4ec0b0170 2021-02-12T17:16:13.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.674+0000 7fb4f3d89700 1 -- 172.21.2.102:0/2718816182 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ec0b5620 con 0x7fb4ec0b0170 2021-02-12T17:16:13.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.674+0000 7fb4ddffb700 1 -- 172.21.2.102:0/2718816182 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8013450 con 0x7fb4ec0b0170 2021-02-12T17:16:13.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.674+0000 7fb4f3d89700 1 -- 172.21.2.102:0/2718816182 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ec0b58c0 con 0x7fb4ec0b0170 2021-02-12T17:16:13.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.674+0000 7fb4f3d89700 1 -- 172.21.2.102:0/2718816182 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb4ec15d530 con 0x7fb4ec0b0170 2021-02-12T17:16:13.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.674+0000 7fb4ddffb700 1 -- 172.21.2.102:0/2718816182 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fb4e8026020 con 0x7fb4ec0b0170 2021-02-12T17:16:13.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.675+0000 7fb4ddffb700 1 --2- 172.21.2.102:0/2718816182 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb4cc059d30 0x7fb4cc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.675+0000 7fb4ddffb700 1 -- 172.21.2.102:0/2718816182 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fb4e8075080 con 0x7fb4ec0b0170 2021-02-12T17:16:13.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.675+0000 7fb4ddffb700 1 --2- 172.21.2.102:0/2718816182 >> [v2:172.21.2.102:6801/37581,v1:172.21.2.102:6802/37581] conn(0x7fb4cc062050 0x7fb4cc0644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.675+0000 7fb4ddffb700 1 -- 172.21.2.102:0/2718816182 --> [v2:172.21.2.102:6801/37581,v1:172.21.2.102:6802/37581] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb4cc064b30 con 0x7fb4cc062050 2021-02-12T17:16:13.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.675+0000 7fb4ddffb700 1 -- 172.21.2.102:0/2718816182 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4e80776f0 con 0x7fb4ec0b0170 2021-02-12T17:16:13.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.675+0000 7fb4f1324700 1 --2- 172.21.2.102:0/2718816182 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb4cc059d30 0x7fb4cc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.675+0000 7fb4f2326700 1 --2- 172.21.2.102:0/2718816182 >> [v2:172.21.2.102:6801/37581,v1:172.21.2.102:6802/37581] conn(0x7fb4cc062050 0x7fb4cc0644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.675+0000 7fb4f1324700 1 --2- 172.21.2.102:0/2718816182 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb4cc059d30 0x7fb4cc05c1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb4e000d830 tx=0x7fb4e0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.675+0000 7fb4f2326700 1 --2- 172.21.2.102:0/2718816182 >> [v2:172.21.2.102:6801/37581,v1:172.21.2.102:6802/37581] conn(0x7fb4cc062050 0x7fb4cc0644b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.676+0000 7fb4ddffb700 1 -- 172.21.2.102:0/2718816182 <== osd.1 v2:172.21.2.102:6801/37581 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7fb4cc064b30 con 0x7fb4cc062050 2021-02-12T17:16:13.689 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.688+0000 7fb4f3d89700 1 -- 172.21.2.102:0/2718816182 --> [v2:172.21.2.102:6801/37581,v1:172.21.2.102:6802/37581] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb4ec045460 con 0x7fb4cc062050 2021-02-12T17:16:13.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.689+0000 7fb4ddffb700 1 -- 172.21.2.102:0/2718816182 <== osd.1 v2:172.21.2.102:6801/37581 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb4ec045460 con 0x7fb4cc062050 2021-02-12T17:16:13.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.689+0000 7fb4f3d89700 1 -- 172.21.2.102:0/2718816182 >> [v2:172.21.2.102:6801/37581,v1:172.21.2.102:6802/37581] conn(0x7fb4cc062050 msgr2=0x7fb4cc0644b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.689+0000 7fb4f3d89700 1 --2- 172.21.2.102:0/2718816182 >> [v2:172.21.2.102:6801/37581,v1:172.21.2.102:6802/37581] conn(0x7fb4cc062050 0x7fb4cc0644b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.689+0000 7fb4f3d89700 1 -- 172.21.2.102:0/2718816182 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb4cc059d30 msgr2=0x7fb4cc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.689+0000 7fb4f3d89700 1 --2- 172.21.2.102:0/2718816182 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb4cc059d30 0x7fb4cc05c1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb4e000d830 tx=0x7fb4e0008040).stop 2021-02-12T17:16:13.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.689+0000 7fb4f3d89700 1 -- 172.21.2.102:0/2718816182 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4ec0b0170 msgr2=0x7fb4ec0b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.689+0000 7fb4f3d89700 1 --2- 172.21.2.102:0/2718816182 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb4ec0b0170 0x7fb4ec0b0550 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fb4d4004350 tx=0x7fb4e8015000).stop 2021-02-12T17:16:13.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.689+0000 7fb4f2326700 1 -- 172.21.2.102:0/2718816182 reap_dead start 2021-02-12T17:16:13.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.689+0000 7fb4f3d89700 1 -- 172.21.2.102:0/2718816182 shutdown_connections 2021-02-12T17:16:13.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.689+0000 7fb4f3d89700 1 -- 172.21.2.102:0/2718816182 >> 172.21.2.102:0/2718816182 conn(0x7fb4ec0bc480 msgr2=0x7fb4ec0b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:13.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.689+0000 7fb4f3d89700 1 -- 172.21.2.102:0/2718816182 shutdown_connections 2021-02-12T17:16:13.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.689+0000 7fb4f3d89700 1 -- 172.21.2.102:0/2718816182 wait complete. 2021-02-12T17:16:13.698 INFO:teuthology.orchestra.run.gibba002.stdout:55834574854 2021-02-12T17:16:13.699 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-02-12T17:16:13.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.787+0000 7f6383bf8700 1 Processor -- start 2021-02-12T17:16:13.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.787+0000 7f6383bf8700 1 -- start start 2021-02-12T17:16:13.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.787+0000 7f6383bf8700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f637c0b8d20 0x7f637c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6383bf8700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f637c14e530 0x7f637c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6383bf8700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637c0622a0 con 0x7f637c062740 2021-02-12T17:16:13.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6383bf8700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637c068d20 con 0x7f637c0b8d20 2021-02-12T17:16:13.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6383bf8700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c14ea10 con 0x7f637c14e530 2021-02-12T17:16:13.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6382195700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f637c062740 0x7f637c062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53472/0 (socket says 172.21.2.102:53472) 2021-02-12T17:16:13.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6382195700 1 -- 172.21.2.102:0/778268793 learned_addr learned my addr 172.21.2.102:0/778268793 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:13.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6381994700 1 --2- 172.21.2.102:0/778268793 >> v2:172.21.2.102:3300/0 conn(0x7f637c0b8d20 0x7f637c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6381994700 1 -- 172.21.2.102:0/778268793 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f637c14e530 msgr2=0x7f637c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:13.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6381994700 1 --2- 172.21.2.102:0/778268793 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f637c14e530 0x7f637c0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:13.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6381994700 1 -- 172.21.2.102:0/778268793 >> v1:172.21.2.102:6789/0 conn(0x7f637c062740 legacy=0x7f637c062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6381994700 1 -- 172.21.2.102:0/778268793 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c0b63f0 con 0x7f637c0b8d20 2021-02-12T17:16:13.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6381994700 1 --2- 172.21.2.102:0/778268793 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f637c0b8d20 0x7f637c068830 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f636c00b980 tx=0x7f636c006de0).ready entity=mon.0 client_cookie=de4d2f8741a5882f server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6380992700 1 -- 172.21.2.102:0/778268793 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c0097e0 con 0x7f637c0b8d20 2021-02-12T17:16:13.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6380992700 1 -- 172.21.2.102:0/778268793 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636c009940 con 0x7f637c0b8d20 2021-02-12T17:16:13.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.788+0000 7f6380992700 1 -- 172.21.2.102:0/778268793 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c009cc0 con 0x7f637c0b8d20 2021-02-12T17:16:13.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.789+0000 7f6383bf8700 1 -- 172.21.2.102:0/778268793 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f637c0b8d20 msgr2=0x7f637c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.789+0000 7f6383bf8700 1 --2- 172.21.2.102:0/778268793 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f637c0b8d20 0x7f637c068830 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f636c00b980 tx=0x7f636c006de0).stop 2021-02-12T17:16:13.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.789+0000 7f6383bf8700 1 -- 172.21.2.102:0/778268793 shutdown_connections 2021-02-12T17:16:13.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.789+0000 7f6383bf8700 1 --2- 172.21.2.102:0/778268793 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f637c0b8d20 0x7f637c068830 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.789+0000 7f6383bf8700 1 --2- 172.21.2.102:0/778268793 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f637c14e530 0x7f637c0b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:13.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.789+0000 7f6383bf8700 1 -- 172.21.2.102:0/778268793 >> 172.21.2.102:0/778268793 conn(0x7f637c0bc480 msgr2=0x7f637c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:13.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.789+0000 7f6383bf8700 1 -- 172.21.2.102:0/778268793 shutdown_connections 2021-02-12T17:16:13.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.789+0000 7f6383bf8700 1 -- 172.21.2.102:0/778268793 wait complete. 2021-02-12T17:16:13.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6383bf8700 1 Processor -- start 2021-02-12T17:16:13.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6383bf8700 1 -- start start 2021-02-12T17:16:13.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6383bf8700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f637c062740 0x7f637c15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6383bf8700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f637c0b8d20 0x7f637c0acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6383bf8700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f637c14e530 0x7f637c151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6383bf8700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c0ad400 con 0x7f637c0b8d20 2021-02-12T17:16:13.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6383bf8700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c0ad690 con 0x7f637c062740 2021-02-12T17:16:13.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6383bf8700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c15d9e0 con 0x7f637c14e530 2021-02-12T17:16:13.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6381193700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f637c0b8d20 0x7f637c0acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6381193700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f637c0b8d20 0x7f637c0acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44832/0 (socket says 172.21.2.102:44832) 2021-02-12T17:16:13.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6381193700 1 -- 172.21.2.102:0/3292202814 learned_addr learned my addr 172.21.2.102:0/3292202814 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:13.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6381193700 1 -- 172.21.2.102:0/3292202814 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f637c14e530 msgr2=0x7f637c151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6381193700 1 --2- 172.21.2.102:0/3292202814 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f637c14e530 0x7f637c151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:13.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6381193700 1 -- 172.21.2.102:0/3292202814 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f637c062740 msgr2=0x7f637c15e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6381193700 1 --2- 172.21.2.102:0/3292202814 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f637c062740 0x7f637c15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:13.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.790+0000 7f6381193700 1 -- 172.21.2.102:0/3292202814 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c15dc80 con 0x7f637c0b8d20 2021-02-12T17:16:13.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.791+0000 7f6381193700 1 --2- 172.21.2.102:0/3292202814 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f637c0b8d20 0x7f637c0acf10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f63780096e0 tx=0x7f6378006e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.791+0000 7f6369ffb700 1 -- 172.21.2.102:0/3292202814 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637800d500 con 0x7f637c0b8d20 2021-02-12T17:16:13.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.791+0000 7f6369ffb700 1 -- 172.21.2.102:0/3292202814 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6378000e90 con 0x7f637c0b8d20 2021-02-12T17:16:13.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.791+0000 7f6383bf8700 1 -- 172.21.2.102:0/3292202814 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637c15df20 con 0x7f637c0b8d20 2021-02-12T17:16:13.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.791+0000 7f6369ffb700 1 -- 172.21.2.102:0/3292202814 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637800d8b0 con 0x7f637c0b8d20 2021-02-12T17:16:13.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.791+0000 7f6383bf8700 1 -- 172.21.2.102:0/3292202814 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c151e30 con 0x7f637c0b8d20 2021-02-12T17:16:13.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.791+0000 7f6383bf8700 1 -- 172.21.2.102:0/3292202814 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f637c15d820 con 0x7f637c0b8d20 2021-02-12T17:16:13.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.792+0000 7f6369ffb700 1 -- 172.21.2.102:0/3292202814 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f637800dc20 con 0x7f637c0b8d20 2021-02-12T17:16:13.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.792+0000 7f6369ffb700 1 --2- 172.21.2.102:0/3292202814 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f635c059db0 0x7f635c05c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.792+0000 7f6369ffb700 1 -- 172.21.2.102:0/3292202814 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f6378073b50 con 0x7f637c0b8d20 2021-02-12T17:16:13.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.792+0000 7f6369ffb700 1 --2- 172.21.2.102:0/3292202814 >> [v2:172.21.2.102:6816/37582,v1:172.21.2.102:6818/37582] conn(0x7f635c0621d0 0x7f635c064630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.792+0000 7f6369ffb700 1 -- 172.21.2.102:0/3292202814 --> [v2:172.21.2.102:6816/37582,v1:172.21.2.102:6818/37582] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f635c064cb0 con 0x7f635c0621d0 2021-02-12T17:16:13.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.792+0000 7f6369ffb700 1 -- 172.21.2.102:0/3292202814 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6378078220 con 0x7f637c0b8d20 2021-02-12T17:16:13.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.792+0000 7f6381994700 1 --2- 172.21.2.102:0/3292202814 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f635c059db0 0x7f635c05c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.792+0000 7f6382195700 1 --2- 172.21.2.102:0/3292202814 >> [v2:172.21.2.102:6816/37582,v1:172.21.2.102:6818/37582] conn(0x7f635c0621d0 0x7f635c064630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.792+0000 7f6381994700 1 --2- 172.21.2.102:0/3292202814 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f635c059db0 0x7f635c05c270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f636c007fd0 tx=0x7f636c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.793+0000 7f6382195700 1 --2- 172.21.2.102:0/3292202814 >> [v2:172.21.2.102:6816/37582,v1:172.21.2.102:6818/37582] conn(0x7f635c0621d0 0x7f635c064630 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.799 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.793+0000 7f6369ffb700 1 -- 172.21.2.102:0/3292202814 <== osd.2 v2:172.21.2.102:6816/37582 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f635c064cb0 con 0x7f635c0621d0 2021-02-12T17:16:13.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.806+0000 7f6383bf8700 1 -- 172.21.2.102:0/3292202814 --> [v2:172.21.2.102:6816/37582,v1:172.21.2.102:6818/37582] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f637c14f1a0 con 0x7f635c0621d0 2021-02-12T17:16:13.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.806+0000 7f6369ffb700 1 -- 172.21.2.102:0/3292202814 <== osd.2 v2:172.21.2.102:6816/37582 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f637c14f1a0 con 0x7f635c0621d0 2021-02-12T17:16:13.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.807+0000 7f6383bf8700 1 -- 172.21.2.102:0/3292202814 >> [v2:172.21.2.102:6816/37582,v1:172.21.2.102:6818/37582] conn(0x7f635c0621d0 msgr2=0x7f635c064630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.807+0000 7f6383bf8700 1 --2- 172.21.2.102:0/3292202814 >> [v2:172.21.2.102:6816/37582,v1:172.21.2.102:6818/37582] conn(0x7f635c0621d0 0x7f635c064630 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.807+0000 7f6383bf8700 1 -- 172.21.2.102:0/3292202814 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f635c059db0 msgr2=0x7f635c05c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.807+0000 7f6383bf8700 1 --2- 172.21.2.102:0/3292202814 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f635c059db0 0x7f635c05c270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f636c007fd0 tx=0x7f636c016000).stop 2021-02-12T17:16:13.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.807+0000 7f6383bf8700 1 -- 172.21.2.102:0/3292202814 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f637c0b8d20 msgr2=0x7f637c0acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.807+0000 7f6383bf8700 1 --2- 172.21.2.102:0/3292202814 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f637c0b8d20 0x7f637c0acf10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f63780096e0 tx=0x7f6378006e10).stop 2021-02-12T17:16:13.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.807+0000 7f6382195700 1 -- 172.21.2.102:0/3292202814 reap_dead start 2021-02-12T17:16:13.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.807+0000 7f6383bf8700 1 -- 172.21.2.102:0/3292202814 shutdown_connections 2021-02-12T17:16:13.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.807+0000 7f6383bf8700 1 -- 172.21.2.102:0/3292202814 >> 172.21.2.102:0/3292202814 conn(0x7f637c0bc480 msgr2=0x7f637c0b7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:13.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.807+0000 7f6383bf8700 1 -- 172.21.2.102:0/3292202814 shutdown_connections 2021-02-12T17:16:13.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.807+0000 7f6383bf8700 1 -- 172.21.2.102:0/3292202814 wait complete. 2021-02-12T17:16:13.817 INFO:teuthology.orchestra.run.gibba002.stdout:55834574854 2021-02-12T17:16:13.817 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-02-12T17:16:13.906 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.904+0000 7fd50f906700 1 Processor -- start 2021-02-12T17:16:13.906 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.905+0000 7fd50f906700 1 -- start start 2021-02-12T17:16:13.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.905+0000 7fd50f906700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fd5080b8d20 0x7fd508068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.905+0000 7fd50f906700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fd50814e530 0x7fd5080b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.905+0000 7fd50f906700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5080622a0 con 0x7fd508062740 2021-02-12T17:16:13.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.905+0000 7fd50f906700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd508068d20 con 0x7fd5080b8d20 2021-02-12T17:16:13.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.905+0000 7fd50f906700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50814ea10 con 0x7fd50814e530 2021-02-12T17:16:13.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.905+0000 7fd50d6a2700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fd5080b8d20 0x7fd508068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.905+0000 7fd50d6a2700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fd5080b8d20 0x7fd508068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44840/0 (socket says 172.21.2.102:44840) 2021-02-12T17:16:13.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.905+0000 7fd50d6a2700 1 -- 172.21.2.102:0/779607193 learned_addr learned my addr 172.21.2.102:0/779607193 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:13.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.905+0000 7fd50d6a2700 1 -- 172.21.2.102:0/779607193 >> v2:172.21.2.104:3300/0 conn(0x7fd50814e530 msgr2=0x7fd5080b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:13.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.905+0000 7fd50d6a2700 1 --2- 172.21.2.102:0/779607193 >> v2:172.21.2.104:3300/0 conn(0x7fd50814e530 0x7fd5080b7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:13.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.905+0000 7fd50d6a2700 1 -- 172.21.2.102:0/779607193 >> v1:172.21.2.104:6789/0 conn(0x7fd508062740 legacy=0x7fd508062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:13.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.905+0000 7fd50d6a2700 1 -- 172.21.2.102:0/779607193 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5080b63f0 con 0x7fd5080b8d20 2021-02-12T17:16:13.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.906+0000 7fd50d6a2700 1 --2- 172.21.2.102:0/779607193 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd5080b8d20 0x7fd508068830 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd5080654b0 tx=0x7fd504006ea0).ready entity=mon.0 client_cookie=aa8211d458bba104 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.906+0000 7fd4f7fff700 1 -- 172.21.2.102:0/779607193 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504009800 con 0x7fd5080b8d20 2021-02-12T17:16:13.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.906+0000 7fd4f7fff700 1 -- 172.21.2.102:0/779607193 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd504009960 con 0x7fd5080b8d20 2021-02-12T17:16:13.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.906+0000 7fd4f7fff700 1 -- 172.21.2.102:0/779607193 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504009ce0 con 0x7fd5080b8d20 2021-02-12T17:16:13.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.906+0000 7fd50f906700 1 -- 172.21.2.102:0/779607193 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd5080b8d20 msgr2=0x7fd508068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.906+0000 7fd50f906700 1 --2- 172.21.2.102:0/779607193 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd5080b8d20 0x7fd508068830 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd5080654b0 tx=0x7fd504006ea0).stop 2021-02-12T17:16:13.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.906+0000 7fd50f906700 1 -- 172.21.2.102:0/779607193 shutdown_connections 2021-02-12T17:16:13.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.906+0000 7fd50f906700 1 --2- 172.21.2.102:0/779607193 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd5080b8d20 0x7fd508068830 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.906+0000 7fd50f906700 1 --2- 172.21.2.102:0/779607193 >> v2:172.21.2.104:3300/0 conn(0x7fd50814e530 0x7fd5080b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:13.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.906+0000 7fd50f906700 1 -- 172.21.2.102:0/779607193 >> 172.21.2.102:0/779607193 conn(0x7fd5080bc480 msgr2=0x7fd5080b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:13.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.906+0000 7fd50f906700 1 -- 172.21.2.102:0/779607193 shutdown_connections 2021-02-12T17:16:13.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.906+0000 7fd50f906700 1 -- 172.21.2.102:0/779607193 wait complete. 2021-02-12T17:16:13.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.907+0000 7fd50f906700 1 Processor -- start 2021-02-12T17:16:13.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.907+0000 7fd50f906700 1 -- start start 2021-02-12T17:16:13.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50f906700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd508062740 0x7fd50811d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50f906700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd5080b8d20 0x7fd50811dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50f906700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd50814e530 0x7fd50814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50f906700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50815e860 con 0x7fd508062740 2021-02-12T17:16:13.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50f906700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50815dbe0 con 0x7fd5080b8d20 2021-02-12T17:16:13.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50f906700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50815de80 con 0x7fd50814e530 2021-02-12T17:16:13.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50d6a2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd508062740 0x7fd50811d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50d6a2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd508062740 0x7fd50811d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44846/0 (socket says 172.21.2.102:44846) 2021-02-12T17:16:13.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50d6a2700 1 -- 172.21.2.102:0/1447094630 learned_addr learned my addr 172.21.2.102:0/1447094630 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:13.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50d6a2700 1 -- 172.21.2.102:0/1447094630 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd50814e530 msgr2=0x7fd50814ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:13.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50d6a2700 1 --2- 172.21.2.102:0/1447094630 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd50814e530 0x7fd50814ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:13.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50d6a2700 1 -- 172.21.2.102:0/1447094630 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd5080b8d20 msgr2=0x7fd50811dd00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:13.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50d6a2700 1 --2- 172.21.2.102:0/1447094630 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd5080b8d20 0x7fd50811dd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:13.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50d6a2700 1 -- 172.21.2.102:0/1447094630 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50815e120 con 0x7fd508062740 2021-02-12T17:16:13.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50d6a2700 1 --2- 172.21.2.102:0/1447094630 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd508062740 0x7fd50811d810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fd5080653c0 tx=0x7fd504016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd4f57fa700 1 -- 172.21.2.102:0/1447094630 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50401c420 con 0x7fd508062740 2021-02-12T17:16:13.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd4f57fa700 1 -- 172.21.2.102:0/1447094630 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50401c580 con 0x7fd508062740 2021-02-12T17:16:13.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50f906700 1 -- 172.21.2.102:0/1447094630 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50815e3c0 con 0x7fd508062740 2021-02-12T17:16:13.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd4f57fa700 1 -- 172.21.2.102:0/1447094630 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50401c940 con 0x7fd508062740 2021-02-12T17:16:13.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.908+0000 7fd50f906700 1 -- 172.21.2.102:0/1447094630 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50815d910 con 0x7fd508062740 2021-02-12T17:16:13.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.909+0000 7fd50f906700 1 -- 172.21.2.102:0/1447094630 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd508045460 con 0x7fd508062740 2021-02-12T17:16:13.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.909+0000 7fd4f57fa700 1 -- 172.21.2.102:0/1447094630 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fd50400f070 con 0x7fd508062740 2021-02-12T17:16:13.919 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.909+0000 7fd4f57fa700 1 --2- 172.21.2.102:0/1447094630 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd4e8059d30 0x7fd4e805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.919 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.910+0000 7fd4f57fa700 1 -- 172.21.2.102:0/1447094630 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fd5040753e0 con 0x7fd508062740 2021-02-12T17:16:13.919 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.910+0000 7fd50cea1700 1 --2- 172.21.2.102:0/1447094630 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd4e8059d30 0x7fd4e805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.919 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.910+0000 7fd4f57fa700 1 --2- 172.21.2.102:0/1447094630 >> [v2:172.21.2.102:6817/37583,v1:172.21.2.102:6819/37583] conn(0x7fd4e8062050 0x7fd4e80644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:13.919 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.910+0000 7fd4f57fa700 1 -- 172.21.2.102:0/1447094630 --> [v2:172.21.2.102:6817/37583,v1:172.21.2.102:6819/37583] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4e8064b30 con 0x7fd4e8062050 2021-02-12T17:16:13.920 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.910+0000 7fd4f57fa700 1 -- 172.21.2.102:0/1447094630 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd504077a50 con 0x7fd508062740 2021-02-12T17:16:13.920 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.910+0000 7fd50dea3700 1 --2- 172.21.2.102:0/1447094630 >> [v2:172.21.2.102:6817/37583,v1:172.21.2.102:6819/37583] conn(0x7fd4e8062050 0x7fd4e80644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:13.921 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.910+0000 7fd50cea1700 1 --2- 172.21.2.102:0/1447094630 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd4e8059d30 0x7fd4e805c1f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fd5080b7820 tx=0x7fd4f8006880).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.921 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.910+0000 7fd50dea3700 1 --2- 172.21.2.102:0/1447094630 >> [v2:172.21.2.102:6817/37583,v1:172.21.2.102:6819/37583] conn(0x7fd4e8062050 0x7fd4e80644b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:13.921 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.911+0000 7fd4f57fa700 1 -- 172.21.2.102:0/1447094630 <== osd.3 v2:172.21.2.102:6817/37583 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7fd4e8064b30 con 0x7fd4e8062050 2021-02-12T17:16:13.924 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.923+0000 7fd50f906700 1 -- 172.21.2.102:0/1447094630 --> [v2:172.21.2.102:6817/37583,v1:172.21.2.102:6819/37583] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd50815e550 con 0x7fd4e8062050 2021-02-12T17:16:13.926 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.924+0000 7fd4f57fa700 1 -- 172.21.2.102:0/1447094630 <== osd.3 v2:172.21.2.102:6817/37583 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd50815e550 con 0x7fd4e8062050 2021-02-12T17:16:13.927 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.924+0000 7fd50f906700 1 -- 172.21.2.102:0/1447094630 >> [v2:172.21.2.102:6817/37583,v1:172.21.2.102:6819/37583] conn(0x7fd4e8062050 msgr2=0x7fd4e80644b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.927 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.924+0000 7fd50f906700 1 --2- 172.21.2.102:0/1447094630 >> [v2:172.21.2.102:6817/37583,v1:172.21.2.102:6819/37583] conn(0x7fd4e8062050 0x7fd4e80644b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:13.927 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.924+0000 7fd50f906700 1 -- 172.21.2.102:0/1447094630 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd4e8059d30 msgr2=0x7fd4e805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.927 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.924+0000 7fd50f906700 1 --2- 172.21.2.102:0/1447094630 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd4e8059d30 0x7fd4e805c1f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fd5080b7820 tx=0x7fd4f8006880).stop 2021-02-12T17:16:13.927 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.924+0000 7fd50f906700 1 -- 172.21.2.102:0/1447094630 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd508062740 msgr2=0x7fd50811d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:13.927 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.924+0000 7fd50f906700 1 --2- 172.21.2.102:0/1447094630 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd508062740 0x7fd50811d810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fd5080653c0 tx=0x7fd504016000).stop 2021-02-12T17:16:13.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.924+0000 7fd50dea3700 1 -- 172.21.2.102:0/1447094630 reap_dead start 2021-02-12T17:16:13.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.924+0000 7fd50f906700 1 -- 172.21.2.102:0/1447094630 shutdown_connections 2021-02-12T17:16:13.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.924+0000 7fd50f906700 1 -- 172.21.2.102:0/1447094630 >> 172.21.2.102:0/1447094630 conn(0x7fd5080bc480 msgr2=0x7fd50814fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:13.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.924+0000 7fd50f906700 1 -- 172.21.2.102:0/1447094630 shutdown_connections 2021-02-12T17:16:13.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:13.924+0000 7fd50f906700 1 -- 172.21.2.102:0/1447094630 wait complete. 2021-02-12T17:16:13.934 INFO:teuthology.orchestra.run.gibba002.stdout:55834574855 2021-02-12T17:16:13.935 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-02-12T17:16:14.025 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.024+0000 7fb19bee5700 1 Processor -- start 2021-02-12T17:16:14.025 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.024+0000 7fb19bee5700 1 -- start start 2021-02-12T17:16:14.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.024+0000 7fb19bee5700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb19414e530 0x7fb194068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.024+0000 7fb19bee5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb194062740 0x7fb194062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.024+0000 7fb19bee5700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1940b7960 con 0x7fb1940b8d20 2021-02-12T17:16:14.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.024+0000 7fb19bee5700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb194068d20 con 0x7fb19414e530 2021-02-12T17:16:14.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.024+0000 7fb19bee5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940622a0 con 0x7fb194062740 2021-02-12T17:16:14.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.024+0000 7fb199c81700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fb1940b8d20 0x7fb1940b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53498/0 (socket says 172.21.2.102:53498) 2021-02-12T17:16:14.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.024+0000 7fb199c81700 1 -- 172.21.2.102:0/2308536024 learned_addr learned my addr 172.21.2.102:0/2308536024 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:14.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.024+0000 7fb199480700 1 --2- 172.21.2.102:0/2308536024 >> v2:172.21.2.102:3300/0 conn(0x7fb19414e530 0x7fb194068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.025+0000 7fb198c7f700 1 -- 172.21.2.102:0/2308536024 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066762023 0 0) 0x7fb1940b7960 con 0x7fb1940b8d20 2021-02-12T17:16:14.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.025+0000 7fb198c7f700 1 -- 172.21.2.102:0/2308536024 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb17c003230 con 0x7fb1940b8d20 2021-02-12T17:16:14.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.025+0000 7fb199480700 1 -- 172.21.2.102:0/2308536024 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb194062740 msgr2=0x7fb194062bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:14.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.025+0000 7fb199480700 1 --2- 172.21.2.102:0/2308536024 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb194062740 0x7fb194062bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:14.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.025+0000 7fb199480700 1 -- 172.21.2.102:0/2308536024 >> v1:172.21.2.102:6789/0 conn(0x7fb1940b8d20 legacy=0x7fb1940b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.025+0000 7fb199480700 1 -- 172.21.2.102:0/2308536024 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19414ea10 con 0x7fb19414e530 2021-02-12T17:16:14.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.025+0000 7fb199480700 1 --2- 172.21.2.102:0/2308536024 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb19414e530 0x7fb194068830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fb18400b980 tx=0x7fb184006de0).ready entity=mon.0 client_cookie=d1c1dea4d6fc3258 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.025+0000 7fb198c7f700 1 -- 172.21.2.102:0/2308536024 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18400be70 con 0x7fb19414e530 2021-02-12T17:16:14.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.025+0000 7fb198c7f700 1 -- 172.21.2.102:0/2308536024 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1840097e0 con 0x7fb19414e530 2021-02-12T17:16:14.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.025+0000 7fb198c7f700 1 -- 172.21.2.102:0/2308536024 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184009b60 con 0x7fb19414e530 2021-02-12T17:16:14.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.025+0000 7fb19bee5700 1 -- 172.21.2.102:0/2308536024 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb19414e530 msgr2=0x7fb194068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.025+0000 7fb19bee5700 1 --2- 172.21.2.102:0/2308536024 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb19414e530 0x7fb194068830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fb18400b980 tx=0x7fb184006de0).stop 2021-02-12T17:16:14.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.026+0000 7fb19bee5700 1 -- 172.21.2.102:0/2308536024 shutdown_connections 2021-02-12T17:16:14.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.026+0000 7fb19bee5700 1 --2- 172.21.2.102:0/2308536024 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb194062740 0x7fb194062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:14.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.026+0000 7fb19bee5700 1 --2- 172.21.2.102:0/2308536024 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb19414e530 0x7fb194068830 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.026+0000 7fb19bee5700 1 -- 172.21.2.102:0/2308536024 >> 172.21.2.102:0/2308536024 conn(0x7fb1940bc480 msgr2=0x7fb1940b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:14.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.026+0000 7fb19bee5700 1 -- 172.21.2.102:0/2308536024 shutdown_connections 2021-02-12T17:16:14.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.026+0000 7fb19bee5700 1 -- 172.21.2.102:0/2308536024 wait complete. 2021-02-12T17:16:14.031 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.026+0000 7fb19bee5700 1 Processor -- start 2021-02-12T17:16:14.031 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.026+0000 7fb19bee5700 1 -- start start 2021-02-12T17:16:14.031 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb19bee5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb194062740 0x7fb1940ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.031 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb19bee5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb1940b8d20 0x7fb1940b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.031 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb19bee5700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb19414e530 0x7fb1940b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.031 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb19bee5700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940b1fb0 con 0x7fb194062740 2021-02-12T17:16:14.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb19bee5700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19415dbc0 con 0x7fb19414e530 2021-02-12T17:16:14.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb19bee5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19415de60 con 0x7fb1940b8d20 2021-02-12T17:16:14.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb199c81700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb194062740 0x7fb1940ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb199c81700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb194062740 0x7fb1940ada50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44860/0 (socket says 172.21.2.102:44860) 2021-02-12T17:16:14.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb199c81700 1 -- 172.21.2.102:0/1984540552 learned_addr learned my addr 172.21.2.102:0/1984540552 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:14.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb199c81700 1 -- 172.21.2.102:0/1984540552 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb1940b8d20 msgr2=0x7fb1940b49b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:14.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb199c81700 1 --2- 172.21.2.102:0/1984540552 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb1940b8d20 0x7fb1940b49b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:14.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb199c81700 1 -- 172.21.2.102:0/1984540552 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb19414e530 msgr2=0x7fb1940b3c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:14.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb199c81700 1 --2- 172.21.2.102:0/1984540552 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb19414e530 0x7fb1940b3c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:14.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb199c81700 1 -- 172.21.2.102:0/1984540552 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1940b21a0 con 0x7fb194062740 2021-02-12T17:16:14.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb199c81700 1 --2- 172.21.2.102:0/1984540552 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb194062740 0x7fb1940ada50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb19000c6d0 tx=0x7fb190007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.027+0000 7fb181ffb700 1 -- 172.21.2.102:0/1984540552 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190007320 con 0x7fb194062740 2021-02-12T17:16:14.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.028+0000 7fb181ffb700 1 -- 172.21.2.102:0/1984540552 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb190007480 con 0x7fb194062740 2021-02-12T17:16:14.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.028+0000 7fb19bee5700 1 -- 172.21.2.102:0/1984540552 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1940b2440 con 0x7fb194062740 2021-02-12T17:16:14.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.028+0000 7fb181ffb700 1 -- 172.21.2.102:0/1984540552 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1900057f0 con 0x7fb194062740 2021-02-12T17:16:14.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.028+0000 7fb19bee5700 1 -- 172.21.2.102:0/1984540552 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1940b5060 con 0x7fb194062740 2021-02-12T17:16:14.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.028+0000 7fb19bee5700 1 -- 172.21.2.102:0/1984540552 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb19415e020 con 0x7fb194062740 2021-02-12T17:16:14.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.028+0000 7fb181ffb700 1 -- 172.21.2.102:0/1984540552 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fb190010030 con 0x7fb194062740 2021-02-12T17:16:14.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.029+0000 7fb181ffb700 1 --2- 172.21.2.102:0/1984540552 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb174059d30 0x7fb17405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.029+0000 7fb181ffb700 1 -- 172.21.2.102:0/1984540552 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fb190073a70 con 0x7fb194062740 2021-02-12T17:16:14.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.029+0000 7fb199480700 1 --2- 172.21.2.102:0/1984540552 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb174059d30 0x7fb17405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.029+0000 7fb181ffb700 1 --2- 172.21.2.102:0/1984540552 >> [v2:172.21.2.104:6801/37835,v1:172.21.2.104:6803/37835] conn(0x7fb1740620d0 0x7fb174064530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.029+0000 7fb181ffb700 1 -- 172.21.2.102:0/1984540552 --> [v2:172.21.2.104:6801/37835,v1:172.21.2.104:6803/37835] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb174064bb0 con 0x7fb1740620d0 2021-02-12T17:16:14.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.029+0000 7fb181ffb700 1 -- 172.21.2.102:0/1984540552 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb190078220 con 0x7fb194062740 2021-02-12T17:16:14.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.029+0000 7fb199480700 1 --2- 172.21.2.102:0/1984540552 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb174059d30 0x7fb17405c1f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb194066c90 tx=0x7fb184016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.029+0000 7fb19a482700 1 --2- 172.21.2.102:0/1984540552 >> [v2:172.21.2.104:6801/37835,v1:172.21.2.104:6803/37835] conn(0x7fb1740620d0 0x7fb174064530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.030+0000 7fb19a482700 1 --2- 172.21.2.102:0/1984540552 >> [v2:172.21.2.104:6801/37835,v1:172.21.2.104:6803/37835] conn(0x7fb1740620d0 0x7fb174064530 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.031+0000 7fb181ffb700 1 -- 172.21.2.102:0/1984540552 <== osd.4 v2:172.21.2.104:6801/37835 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7fb174064bb0 con 0x7fb1740620d0 2021-02-12T17:16:14.045 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.043+0000 7fb19bee5700 1 -- 172.21.2.102:0/1984540552 --> [v2:172.21.2.104:6801/37835,v1:172.21.2.104:6803/37835] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb194045460 con 0x7fb1740620d0 2021-02-12T17:16:14.047 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.044+0000 7fb181ffb700 1 -- 172.21.2.102:0/1984540552 <== osd.4 v2:172.21.2.104:6801/37835 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb194045460 con 0x7fb1740620d0 2021-02-12T17:16:14.047 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.045+0000 7fb19bee5700 1 -- 172.21.2.102:0/1984540552 >> [v2:172.21.2.104:6801/37835,v1:172.21.2.104:6803/37835] conn(0x7fb1740620d0 msgr2=0x7fb174064530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.047 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.045+0000 7fb19bee5700 1 --2- 172.21.2.102:0/1984540552 >> [v2:172.21.2.104:6801/37835,v1:172.21.2.104:6803/37835] conn(0x7fb1740620d0 0x7fb174064530 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.047 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.045+0000 7fb19bee5700 1 -- 172.21.2.102:0/1984540552 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb174059d30 msgr2=0x7fb17405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.045+0000 7fb19bee5700 1 --2- 172.21.2.102:0/1984540552 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb174059d30 0x7fb17405c1f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb194066c90 tx=0x7fb184016000).stop 2021-02-12T17:16:14.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.045+0000 7fb19bee5700 1 -- 172.21.2.102:0/1984540552 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb194062740 msgr2=0x7fb1940ada50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.045+0000 7fb19bee5700 1 --2- 172.21.2.102:0/1984540552 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb194062740 0x7fb1940ada50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb19000c6d0 tx=0x7fb190007ac0).stop 2021-02-12T17:16:14.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.045+0000 7fb19a482700 1 -- 172.21.2.102:0/1984540552 reap_dead start 2021-02-12T17:16:14.049 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.045+0000 7fb19bee5700 1 -- 172.21.2.102:0/1984540552 shutdown_connections 2021-02-12T17:16:14.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.045+0000 7fb19bee5700 1 -- 172.21.2.102:0/1984540552 >> 172.21.2.102:0/1984540552 conn(0x7fb1940bc480 msgr2=0x7fb19414cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:14.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.045+0000 7fb19bee5700 1 -- 172.21.2.102:0/1984540552 shutdown_connections 2021-02-12T17:16:14.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.045+0000 7fb19bee5700 1 -- 172.21.2.102:0/1984540552 wait complete. 2021-02-12T17:16:14.054 INFO:teuthology.orchestra.run.gibba002.stdout:55834574855 2021-02-12T17:16:14.054 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-02-12T17:16:14.144 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.142+0000 7fafadb5e700 1 Processor -- start 2021-02-12T17:16:14.144 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.142+0000 7fafadb5e700 1 -- start start 2021-02-12T17:16:14.145 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.142+0000 7fafadb5e700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fafa8062e50 0x7fafa8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.145 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.142+0000 7fafadb5e700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa80b7960 con 0x7fafa814e530 2021-02-12T17:16:14.145 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.142+0000 7fafadb5e700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa80622a0 con 0x7fafa80b8d20 2021-02-12T17:16:14.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.142+0000 7fafadb5e700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa8068d20 con 0x7fafa8062e50 2021-02-12T17:16:14.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.143+0000 7fafa7fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fafa8062e50 0x7fafa8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.143+0000 7fafa7fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fafa8062e50 0x7fafa8068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44872/0 (socket says 172.21.2.102:44872) 2021-02-12T17:16:14.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.143+0000 7fafa7fff700 1 -- 172.21.2.102:0/1592476986 learned_addr learned my addr 172.21.2.102:0/1592476986 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:14.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.143+0000 7fafa6ffd700 1 --1- 172.21.2.102:0/1592476986 >> v1:172.21.2.102:6789/0 conn(0x7fafa814e530 0x7fafa8062740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53514/0 (socket says 172.21.2.102:53514) 2021-02-12T17:16:14.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.143+0000 7fafa67fc700 1 -- 172.21.2.102:0/1592476986 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5727174 0 0) 0x7fafa80b7960 con 0x7fafa814e530 2021-02-12T17:16:14.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.143+0000 7fafa7fff700 1 -- 172.21.2.102:0/1592476986 >> v1:172.21.2.104:6789/0 conn(0x7fafa80b8d20 legacy=0x7fafa80b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:14.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.143+0000 7fafa7fff700 1 -- 172.21.2.102:0/1592476986 >> v1:172.21.2.102:6789/0 conn(0x7fafa814e530 legacy=0x7fafa8062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.143+0000 7fafa7fff700 1 -- 172.21.2.102:0/1592476986 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa814ea10 con 0x7fafa8062e50 2021-02-12T17:16:14.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.143+0000 7fafa7fff700 1 --2- 172.21.2.102:0/1592476986 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fafa8062e50 0x7fafa8068830 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fafa0009d50 tx=0x7fafa0009290).ready entity=mon.0 client_cookie=70e147c068d7fb2d server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.143+0000 7fafa67fc700 1 -- 172.21.2.102:0/1592476986 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa000bbb0 con 0x7fafa8062e50 2021-02-12T17:16:14.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.143+0000 7fafa67fc700 1 -- 172.21.2.102:0/1592476986 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa000bd10 con 0x7fafa8062e50 2021-02-12T17:16:14.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.143+0000 7fafa67fc700 1 -- 172.21.2.102:0/1592476986 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0011610 con 0x7fafa8062e50 2021-02-12T17:16:14.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.144+0000 7fafadb5e700 1 -- 172.21.2.102:0/1592476986 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fafa8062e50 msgr2=0x7fafa8068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.144+0000 7fafadb5e700 1 --2- 172.21.2.102:0/1592476986 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fafa8062e50 0x7fafa8068830 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fafa0009d50 tx=0x7fafa0009290).stop 2021-02-12T17:16:14.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.144+0000 7fafadb5e700 1 -- 172.21.2.102:0/1592476986 shutdown_connections 2021-02-12T17:16:14.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.144+0000 7fafadb5e700 1 --2- 172.21.2.102:0/1592476986 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fafa8062e50 0x7fafa8068830 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.144+0000 7fafadb5e700 1 -- 172.21.2.102:0/1592476986 >> 172.21.2.102:0/1592476986 conn(0x7fafa80bc480 msgr2=0x7fafa80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:14.148 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.144+0000 7fafadb5e700 1 -- 172.21.2.102:0/1592476986 shutdown_connections 2021-02-12T17:16:14.148 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.144+0000 7fafadb5e700 1 -- 172.21.2.102:0/1592476986 wait complete. 2021-02-12T17:16:14.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafadb5e700 1 Processor -- start 2021-02-12T17:16:14.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafadb5e700 1 -- start start 2021-02-12T17:16:14.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafadb5e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fafa8062e50 0x7fafa815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafadb5e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fafa80b8d20 0x7fafa814dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafadb5e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fafa814e530 0x7fafa80b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.152 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafadb5e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa815d180 con 0x7fafa814e530 2021-02-12T17:16:14.152 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafadb5e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa80b4910 con 0x7fafa8062e50 2021-02-12T17:16:14.152 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafadb5e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa815d370 con 0x7fafa80b8d20 2021-02-12T17:16:14.153 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafa7fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fafa814e530 0x7fafa80b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.153 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafa7fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fafa814e530 0x7fafa80b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44878/0 (socket says 172.21.2.102:44878) 2021-02-12T17:16:14.153 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafa7fff700 1 -- 172.21.2.102:0/1633431015 learned_addr learned my addr 172.21.2.102:0/1633431015 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:14.153 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafa6ffd700 1 --2- 172.21.2.102:0/1633431015 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fafa80b8d20 0x7fafa814dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.153 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafa77fe700 1 --2- 172.21.2.102:0/1633431015 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fafa8062e50 0x7fafa815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.153 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafa7fff700 1 -- 172.21.2.102:0/1633431015 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fafa80b8d20 msgr2=0x7fafa814dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.153 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafa7fff700 1 --2- 172.21.2.102:0/1633431015 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fafa80b8d20 0x7fafa814dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.153 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafa7fff700 1 -- 172.21.2.102:0/1633431015 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fafa8062e50 msgr2=0x7fafa815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.153 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.145+0000 7fafa7fff700 1 --2- 172.21.2.102:0/1633431015 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fafa8062e50 0x7fafa815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.153 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.146+0000 7fafa7fff700 1 -- 172.21.2.102:0/1633431015 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa815d610 con 0x7fafa814e530 2021-02-12T17:16:14.153 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.146+0000 7fafa7fff700 1 --2- 172.21.2.102:0/1633431015 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fafa814e530 0x7fafa80b2ad0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fafa80653c0 tx=0x7fafa0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.153 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.146+0000 7faf9f7fe700 1 -- 172.21.2.102:0/1633431015 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa000be80 con 0x7fafa814e530 2021-02-12T17:16:14.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.146+0000 7faf9f7fe700 1 -- 172.21.2.102:0/1633431015 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa0011e30 con 0x7fafa814e530 2021-02-12T17:16:14.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.146+0000 7fafadb5e700 1 -- 172.21.2.102:0/1633431015 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa815d8b0 con 0x7fafa814e530 2021-02-12T17:16:14.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.146+0000 7fafadb5e700 1 -- 172.21.2.102:0/1633431015 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa80bb120 con 0x7fafa814e530 2021-02-12T17:16:14.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.146+0000 7faf9f7fe700 1 -- 172.21.2.102:0/1633431015 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0010df0 con 0x7fafa814e530 2021-02-12T17:16:14.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.146+0000 7fafadb5e700 1 -- 172.21.2.102:0/1633431015 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fafa8045460 con 0x7fafa814e530 2021-02-12T17:16:14.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.147+0000 7faf9f7fe700 1 -- 172.21.2.102:0/1633431015 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fafa000f070 con 0x7fafa814e530 2021-02-12T17:16:14.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.147+0000 7faf9f7fe700 1 --2- 172.21.2.102:0/1633431015 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7faf8c059d30 0x7faf8c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.147+0000 7faf9f7fe700 1 -- 172.21.2.102:0/1633431015 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fafa0076580 con 0x7fafa814e530 2021-02-12T17:16:14.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.147+0000 7faf9f7fe700 1 --2- 172.21.2.102:0/1633431015 >> [v2:172.21.2.104:6800/37836,v1:172.21.2.104:6802/37836] conn(0x7faf8c0620d0 0x7faf8c064530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.147+0000 7faf9f7fe700 1 -- 172.21.2.102:0/1633431015 --> [v2:172.21.2.104:6800/37836,v1:172.21.2.104:6802/37836] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf8c064bb0 con 0x7faf8c0620d0 2021-02-12T17:16:14.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.147+0000 7faf9f7fe700 1 -- 172.21.2.102:0/1633431015 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafa00768b0 con 0x7fafa814e530 2021-02-12T17:16:14.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.147+0000 7fafa77fe700 1 --2- 172.21.2.102:0/1633431015 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7faf8c059d30 0x7faf8c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.147+0000 7fafa77fe700 1 --2- 172.21.2.102:0/1633431015 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7faf8c059d30 0x7faf8c05c1f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7faf9000b6c0 tx=0x7faf90008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.148+0000 7fafa6ffd700 1 --2- 172.21.2.102:0/1633431015 >> [v2:172.21.2.104:6800/37836,v1:172.21.2.104:6802/37836] conn(0x7faf8c0620d0 0x7faf8c064530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.148+0000 7fafa6ffd700 1 --2- 172.21.2.102:0/1633431015 >> [v2:172.21.2.104:6800/37836,v1:172.21.2.104:6802/37836] conn(0x7faf8c0620d0 0x7faf8c064530 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.149+0000 7faf9f7fe700 1 -- 172.21.2.102:0/1633431015 <== osd.5 v2:172.21.2.104:6800/37836 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7faf8c064bb0 con 0x7faf8c0620d0 2021-02-12T17:16:14.163 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.161+0000 7fafadb5e700 1 -- 172.21.2.102:0/1633431015 --> [v2:172.21.2.104:6800/37836,v1:172.21.2.104:6802/37836] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fafa8063670 con 0x7faf8c0620d0 2021-02-12T17:16:14.164 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.162+0000 7faf9f7fe700 1 -- 172.21.2.102:0/1633431015 <== osd.5 v2:172.21.2.104:6800/37836 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fafa8063670 con 0x7faf8c0620d0 2021-02-12T17:16:14.165 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.163+0000 7fafadb5e700 1 -- 172.21.2.102:0/1633431015 >> [v2:172.21.2.104:6800/37836,v1:172.21.2.104:6802/37836] conn(0x7faf8c0620d0 msgr2=0x7faf8c064530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.165 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.163+0000 7fafadb5e700 1 --2- 172.21.2.102:0/1633431015 >> [v2:172.21.2.104:6800/37836,v1:172.21.2.104:6802/37836] conn(0x7faf8c0620d0 0x7faf8c064530 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.165 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.163+0000 7fafadb5e700 1 -- 172.21.2.102:0/1633431015 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7faf8c059d30 msgr2=0x7faf8c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.165 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.163+0000 7fafadb5e700 1 --2- 172.21.2.102:0/1633431015 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7faf8c059d30 0x7faf8c05c1f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7faf9000b6c0 tx=0x7faf90008040).stop 2021-02-12T17:16:14.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.163+0000 7fafadb5e700 1 -- 172.21.2.102:0/1633431015 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fafa814e530 msgr2=0x7fafa80b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.163+0000 7fafadb5e700 1 --2- 172.21.2.102:0/1633431015 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fafa814e530 0x7fafa80b2ad0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fafa80653c0 tx=0x7fafa0017000).stop 2021-02-12T17:16:14.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.163+0000 7fafa7fff700 1 -- 172.21.2.102:0/1633431015 reap_dead start 2021-02-12T17:16:14.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.163+0000 7fafadb5e700 1 -- 172.21.2.102:0/1633431015 shutdown_connections 2021-02-12T17:16:14.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.163+0000 7fafadb5e700 1 -- 172.21.2.102:0/1633431015 >> 172.21.2.102:0/1633431015 conn(0x7fafa80bc480 msgr2=0x7fafa80b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:14.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.163+0000 7fafadb5e700 1 -- 172.21.2.102:0/1633431015 shutdown_connections 2021-02-12T17:16:14.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.163+0000 7fafadb5e700 1 -- 172.21.2.102:0/1633431015 wait complete. 2021-02-12T17:16:14.173 INFO:teuthology.orchestra.run.gibba002.stdout:55834574853 2021-02-12T17:16:14.173 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2021-02-12T17:16:14.262 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.261+0000 7f40b579f700 1 Processor -- start 2021-02-12T17:16:14.262 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.261+0000 7f40b579f700 1 -- start start 2021-02-12T17:16:14.263 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.261+0000 7f40b579f700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f40b00b8d20 0x7f40b0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.263 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.261+0000 7f40b579f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40b0062740 0x7f40b0062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.263 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.261+0000 7f40b579f700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b00b7960 con 0x7f40b014e530 2021-02-12T17:16:14.263 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.261+0000 7f40b579f700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b0068d20 con 0x7f40b00b8d20 2021-02-12T17:16:14.263 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.261+0000 7f40b579f700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00622a0 con 0x7f40b0062740 2021-02-12T17:16:14.264 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.262+0000 7f40aeffd700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f40b00b8d20 0x7f40b0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.264 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.262+0000 7f40af7fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40b0062740 0x7f40b0062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.264 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.262+0000 7f40aeffd700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f40b00b8d20 0x7f40b0068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:43248/0 (socket says 172.21.2.102:43248) 2021-02-12T17:16:14.264 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.262+0000 7f40aeffd700 1 -- 172.21.2.102:0/3839710294 learned_addr learned my addr 172.21.2.102:0/3839710294 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:14.264 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.263+0000 7f40af7fe700 1 -- 172.21.2.102:0/3839710294 >> v2:172.21.2.104:3300/0 conn(0x7f40b00b8d20 msgr2=0x7f40b0068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:14.264 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.263+0000 7f40af7fe700 1 --2- 172.21.2.102:0/3839710294 >> v2:172.21.2.104:3300/0 conn(0x7f40b00b8d20 0x7f40b0068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.264 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.263+0000 7f40af7fe700 1 -- 172.21.2.102:0/3839710294 >> v1:172.21.2.104:6789/0 conn(0x7f40b014e530 legacy=0x7f40b00b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.265 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.263+0000 7f40af7fe700 1 -- 172.21.2.102:0/3839710294 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b014ea10 con 0x7f40b0062740 2021-02-12T17:16:14.265 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.263+0000 7f40aeffd700 1 --2- 172.21.2.102:0/3839710294 >> v2:172.21.2.104:3300/0 conn(0x7f40b00b8d20 0x7f40b0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:16:14.265 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.263+0000 7f40af7fe700 1 --2- 172.21.2.102:0/3839710294 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40b0062740 0x7f40b0062bc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f40a8009c90 tx=0x7f40a80091d0).ready entity=mon.2 client_cookie=f53dd434877a025e server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.265 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.263+0000 7f40adffb700 1 -- 172.21.2.102:0/3839710294 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a800b9e0 con 0x7f40b0062740 2021-02-12T17:16:14.265 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.264+0000 7f40adffb700 1 -- 172.21.2.102:0/3839710294 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a800bb40 con 0x7f40b0062740 2021-02-12T17:16:14.266 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.264+0000 7f40adffb700 1 -- 172.21.2.102:0/3839710294 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8011400 con 0x7f40b0062740 2021-02-12T17:16:14.266 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.264+0000 7f40b579f700 1 -- 172.21.2.102:0/3839710294 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40b0062740 msgr2=0x7f40b0062bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.266 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.264+0000 7f40b579f700 1 --2- 172.21.2.102:0/3839710294 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40b0062740 0x7f40b0062bc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f40a8009c90 tx=0x7f40a80091d0).stop 2021-02-12T17:16:14.266 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.264+0000 7f40b579f700 1 -- 172.21.2.102:0/3839710294 shutdown_connections 2021-02-12T17:16:14.266 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.264+0000 7f40b579f700 1 --2- 172.21.2.102:0/3839710294 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40b0062740 0x7f40b0062bc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.266 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.264+0000 7f40b579f700 1 --2- 172.21.2.102:0/3839710294 >> v2:172.21.2.104:3300/0 conn(0x7f40b00b8d20 0x7f40b0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.266 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.264+0000 7f40b579f700 1 -- 172.21.2.102:0/3839710294 >> 172.21.2.102:0/3839710294 conn(0x7f40b00bc480 msgr2=0x7f40b00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:14.266 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.264+0000 7f40b579f700 1 -- 172.21.2.102:0/3839710294 shutdown_connections 2021-02-12T17:16:14.266 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.264+0000 7f40b579f700 1 -- 172.21.2.102:0/3839710294 wait complete. 2021-02-12T17:16:14.267 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.265+0000 7f40b579f700 1 Processor -- start 2021-02-12T17:16:14.267 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.265+0000 7f40b579f700 1 -- start start 2021-02-12T17:16:14.267 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.265+0000 7f40b579f700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40b0062740 0x7f40b00ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.265+0000 7f40b579f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40b00b8d20 0x7f40b0160d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.265+0000 7f40b579f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40b014e530 0x7f40b0161240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.265+0000 7f40b579f700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00b58b0 con 0x7f40b014e530 2021-02-12T17:16:14.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.265+0000 7f40b579f700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00b0260 con 0x7f40b0062740 2021-02-12T17:16:14.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.265+0000 7f40b579f700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00b0500 con 0x7f40b00b8d20 2021-02-12T17:16:14.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40af7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40b014e530 0x7f40b0161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40af7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40b014e530 0x7f40b0161240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44896/0 (socket says 172.21.2.102:44896) 2021-02-12T17:16:14.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40af7fe700 1 -- 172.21.2.102:0/1216849689 learned_addr learned my addr 172.21.2.102:0/1216849689 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:14.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40ae7fc700 1 --2- 172.21.2.102:0/1216849689 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40b00b8d20 0x7f40b0160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40aeffd700 1 --2- 172.21.2.102:0/1216849689 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40b0062740 0x7f40b00ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40af7fe700 1 -- 172.21.2.102:0/1216849689 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40b00b8d20 msgr2=0x7f40b0160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40af7fe700 1 --2- 172.21.2.102:0/1216849689 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f40b00b8d20 0x7f40b0160d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40af7fe700 1 -- 172.21.2.102:0/1216849689 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40b0062740 msgr2=0x7f40b00ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.269 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40af7fe700 1 --2- 172.21.2.102:0/1216849689 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f40b0062740 0x7f40b00ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.269 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40af7fe700 1 -- 172.21.2.102:0/1216849689 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b00b07a0 con 0x7f40b014e530 2021-02-12T17:16:14.269 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40af7fe700 1 --2- 172.21.2.102:0/1216849689 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40b014e530 0x7f40b0161240 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f40b00623e0 tx=0x7f40a8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.269 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40a6ffd700 1 -- 172.21.2.102:0/1216849689 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a801c630 con 0x7f40b014e530 2021-02-12T17:16:14.269 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40a6ffd700 1 -- 172.21.2.102:0/1216849689 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a801c790 con 0x7f40b014e530 2021-02-12T17:16:14.269 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40b579f700 1 -- 172.21.2.102:0/1216849689 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b01608b0 con 0x7f40b014e530 2021-02-12T17:16:14.269 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40a6ffd700 1 -- 172.21.2.102:0/1216849689 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a801cb30 con 0x7f40b014e530 2021-02-12T17:16:14.269 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.266+0000 7f40b579f700 1 -- 172.21.2.102:0/1216849689 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b00afe70 con 0x7f40b014e530 2021-02-12T17:16:14.270 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.267+0000 7f40b579f700 1 -- 172.21.2.102:0/1216849689 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f40b00b09a0 con 0x7f40b014e530 2021-02-12T17:16:14.270 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.267+0000 7f40a6ffd700 1 -- 172.21.2.102:0/1216849689 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f40a8022030 con 0x7f40b014e530 2021-02-12T17:16:14.271 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.267+0000 7f40a6ffd700 1 --2- 172.21.2.102:0/1216849689 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4094059db0 0x7f409405c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.271 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.267+0000 7f40a6ffd700 1 -- 172.21.2.102:0/1216849689 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f40a8075fa0 con 0x7f40b014e530 2021-02-12T17:16:14.271 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.267+0000 7f40aeffd700 1 --2- 172.21.2.102:0/1216849689 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4094059db0 0x7f409405c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.271 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.267+0000 7f40a6ffd700 1 --2- 172.21.2.102:0/1216849689 >> [v2:172.21.2.104:6816/37837,v1:172.21.2.104:6817/37837] conn(0x7f4094062150 0x7f40940645b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.271 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.267+0000 7f40a6ffd700 1 -- 172.21.2.102:0/1216849689 --> [v2:172.21.2.104:6816/37837,v1:172.21.2.104:6817/37837] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4094064c30 con 0x7f4094062150 2021-02-12T17:16:14.271 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.267+0000 7f40a6ffd700 1 -- 172.21.2.102:0/1216849689 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40a8078610 con 0x7f40b014e530 2021-02-12T17:16:14.271 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.268+0000 7f40ae7fc700 1 --2- 172.21.2.102:0/1216849689 >> [v2:172.21.2.104:6816/37837,v1:172.21.2.104:6817/37837] conn(0x7f4094062150 0x7f40940645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.271 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.268+0000 7f40aeffd700 1 --2- 172.21.2.102:0/1216849689 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4094059db0 0x7f409405c270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f4098006a00 tx=0x7f4098008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.272 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.268+0000 7f40ae7fc700 1 --2- 172.21.2.102:0/1216849689 >> [v2:172.21.2.104:6816/37837,v1:172.21.2.104:6817/37837] conn(0x7f4094062150 0x7f40940645b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.272 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.269+0000 7f40a6ffd700 1 -- 172.21.2.102:0/1216849689 <== osd.6 v2:172.21.2.104:6816/37837 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f4094064c30 con 0x7f4094062150 2021-02-12T17:16:14.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.281+0000 7f40b579f700 1 -- 172.21.2.102:0/1216849689 --> [v2:172.21.2.104:6816/37837,v1:172.21.2.104:6817/37837] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f40b00ad1d0 con 0x7f4094062150 2021-02-12T17:16:14.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.282+0000 7f40a6ffd700 1 -- 172.21.2.102:0/1216849689 <== osd.6 v2:172.21.2.104:6816/37837 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f40b00ad1d0 con 0x7f4094062150 2021-02-12T17:16:14.284 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.282+0000 7f40b579f700 1 -- 172.21.2.102:0/1216849689 >> [v2:172.21.2.104:6816/37837,v1:172.21.2.104:6817/37837] conn(0x7f4094062150 msgr2=0x7f40940645b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.284 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.282+0000 7f40b579f700 1 --2- 172.21.2.102:0/1216849689 >> [v2:172.21.2.104:6816/37837,v1:172.21.2.104:6817/37837] conn(0x7f4094062150 0x7f40940645b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.284 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.282+0000 7f40b579f700 1 -- 172.21.2.102:0/1216849689 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4094059db0 msgr2=0x7f409405c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.284 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.282+0000 7f40b579f700 1 --2- 172.21.2.102:0/1216849689 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4094059db0 0x7f409405c270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f4098006a00 tx=0x7f4098008040).stop 2021-02-12T17:16:14.284 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.282+0000 7f40b579f700 1 -- 172.21.2.102:0/1216849689 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40b014e530 msgr2=0x7f40b0161240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.282+0000 7f40b579f700 1 --2- 172.21.2.102:0/1216849689 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f40b014e530 0x7f40b0161240 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f40b00623e0 tx=0x7f40a8017000).stop 2021-02-12T17:16:14.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.282+0000 7f40af7fe700 1 -- 172.21.2.102:0/1216849689 reap_dead start 2021-02-12T17:16:14.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.282+0000 7f40b579f700 1 -- 172.21.2.102:0/1216849689 shutdown_connections 2021-02-12T17:16:14.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.282+0000 7f40b579f700 1 -- 172.21.2.102:0/1216849689 >> 172.21.2.102:0/1216849689 conn(0x7f40b00bc480 msgr2=0x7f40b01519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:14.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.283+0000 7f40b579f700 1 -- 172.21.2.102:0/1216849689 shutdown_connections 2021-02-12T17:16:14.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.283+0000 7f40b579f700 1 -- 172.21.2.102:0/1216849689 wait complete. 2021-02-12T17:16:14.292 INFO:teuthology.orchestra.run.gibba002.stdout:55834574854 2021-02-12T17:16:14.293 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2021-02-12T17:16:14.381 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.379+0000 7f838e58c700 1 Processor -- start 2021-02-12T17:16:14.381 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.380+0000 7f838e58c700 1 -- start start 2021-02-12T17:16:14.382 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.380+0000 7f838e58c700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f83880b8d20 0x7f83880681b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.382 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.380+0000 7f838e58c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8388146400 0x7f8388066aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.382 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.380+0000 7f838e58c700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8388067290 con 0x7f83881477f0 2021-02-12T17:16:14.382 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.380+0000 7f838e58c700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83880686a0 con 0x7f83880b8d20 2021-02-12T17:16:14.382 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.380+0000 7f838e58c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8388067530 con 0x7f8388146400 2021-02-12T17:16:14.382 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.380+0000 7f83877fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8388146400 0x7f8388066aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.382 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.380+0000 7f8387fff700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f83880b8d20 0x7f83880681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.382 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.380+0000 7f8387fff700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f83880b8d20 0x7f83880681b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:43264/0 (socket says 172.21.2.102:43264) 2021-02-12T17:16:14.382 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.380+0000 7f8387fff700 1 -- 172.21.2.102:0/2816300453 learned_addr learned my addr 172.21.2.102:0/2816300453 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:14.383 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.381+0000 7f83877fe700 1 -- 172.21.2.102:0/2816300453 >> v2:172.21.2.104:3300/0 conn(0x7f83880b8d20 msgr2=0x7f83880681b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:14.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.381+0000 7f83877fe700 1 --2- 172.21.2.102:0/2816300453 >> v2:172.21.2.104:3300/0 conn(0x7f83880b8d20 0x7f83880681b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.381+0000 7f83877fe700 1 -- 172.21.2.102:0/2816300453 >> v1:172.21.2.104:6789/0 conn(0x7f83881477f0 legacy=0x7f83881498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.381+0000 7f83877fe700 1 -- 172.21.2.102:0/2816300453 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880677d0 con 0x7f8388146400 2021-02-12T17:16:14.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.381+0000 7f83877fe700 1 --2- 172.21.2.102:0/2816300453 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8388146400 0x7f8388066aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f837c00b980 tx=0x7f837c006de0).ready entity=mon.2 client_cookie=d427ff55cb3c3af8 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.381+0000 7f8386ffd700 1 -- 172.21.2.102:0/2816300453 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c00be70 con 0x7f8388146400 2021-02-12T17:16:14.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.381+0000 7f8386ffd700 1 -- 172.21.2.102:0/2816300453 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c009870 con 0x7f8388146400 2021-02-12T17:16:14.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.381+0000 7f8386ffd700 1 -- 172.21.2.102:0/2816300453 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c009bf0 con 0x7f8388146400 2021-02-12T17:16:14.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.381+0000 7f838e58c700 1 -- 172.21.2.102:0/2816300453 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8388146400 msgr2=0x7f8388066aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.381+0000 7f838e58c700 1 --2- 172.21.2.102:0/2816300453 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8388146400 0x7f8388066aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f837c00b980 tx=0x7f837c006de0).stop 2021-02-12T17:16:14.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.382+0000 7f838e58c700 1 -- 172.21.2.102:0/2816300453 shutdown_connections 2021-02-12T17:16:14.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.382+0000 7f838e58c700 1 --2- 172.21.2.102:0/2816300453 >> v2:172.21.2.104:3300/0 conn(0x7f83880b8d20 0x7f83880681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.382+0000 7f838e58c700 1 --2- 172.21.2.102:0/2816300453 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8388146400 0x7f8388066aa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.382+0000 7f838e58c700 1 -- 172.21.2.102:0/2816300453 >> 172.21.2.102:0/2816300453 conn(0x7f83880bc480 msgr2=0x7f83880b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:14.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.382+0000 7f838e58c700 1 -- 172.21.2.102:0/2816300453 shutdown_connections 2021-02-12T17:16:14.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.382+0000 7f838e58c700 1 -- 172.21.2.102:0/2816300453 wait complete. 2021-02-12T17:16:14.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.382+0000 7f838e58c700 1 Processor -- start 2021-02-12T17:16:14.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f838e58c700 1 -- start start 2021-02-12T17:16:14.386 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f838e58c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83880b8d20 0x7f8388134880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f838e58c700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8388146400 0x7f8388139a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f838e58c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f83881477f0 0x7f8388139f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f838e58c700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83880b84f0 con 0x7f83880b8d20 2021-02-12T17:16:14.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f838e58c700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838813a430 con 0x7f8388146400 2021-02-12T17:16:14.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f838e58c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8388130bc0 con 0x7f83881477f0 2021-02-12T17:16:14.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f83877fe700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8388146400 0x7f8388139a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f8387fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83880b8d20 0x7f8388134880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f838cb29700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f83881477f0 0x7f8388139f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f83877fe700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8388146400 0x7f8388139a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:43268/0 (socket says 172.21.2.102:43268) 2021-02-12T17:16:14.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f8387fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83880b8d20 0x7f8388134880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44908/0 (socket says 172.21.2.102:44908) 2021-02-12T17:16:14.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f83877fe700 1 -- 172.21.2.102:0/3979294076 learned_addr learned my addr 172.21.2.102:0/3979294076 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:14.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f838cb29700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f83881477f0 0x7f8388139f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.102:47062/0 (socket says 172.21.2.102:47062) 2021-02-12T17:16:14.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.383+0000 7f8387fff700 1 -- 172.21.2.102:0/3979294076 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f83881477f0 msgr2=0x7f8388139f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.384+0000 7f8387fff700 1 --2- 172.21.2.102:0/3979294076 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f83881477f0 0x7f8388139f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.384+0000 7f8387fff700 1 -- 172.21.2.102:0/3979294076 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8388146400 msgr2=0x7f8388139a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.384+0000 7f8387fff700 1 --2- 172.21.2.102:0/3979294076 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8388146400 0x7f8388139a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.384+0000 7f8387fff700 1 -- 172.21.2.102:0/3979294076 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8388130e60 con 0x7f83880b8d20 2021-02-12T17:16:14.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.384+0000 7f8387fff700 1 --2- 172.21.2.102:0/3979294076 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83880b8d20 0x7f8388134880 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f837800eba0 tx=0x7f8378006ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.384+0000 7f836ffff700 1 -- 172.21.2.102:0/3979294076 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837800be20 con 0x7f83880b8d20 2021-02-12T17:16:14.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.384+0000 7f836ffff700 1 -- 172.21.2.102:0/3979294076 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837800c850 con 0x7f83880b8d20 2021-02-12T17:16:14.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.384+0000 7f838e58c700 1 -- 172.21.2.102:0/3979294076 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83880b9650 con 0x7f83880b8d20 2021-02-12T17:16:14.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.384+0000 7f838e58c700 1 -- 172.21.2.102:0/3979294076 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83880b9b90 con 0x7f83880b8d20 2021-02-12T17:16:14.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.384+0000 7f836ffff700 1 -- 172.21.2.102:0/3979294076 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837800cbd0 con 0x7f83880b8d20 2021-02-12T17:16:14.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.384+0000 7f838e58c700 1 -- 172.21.2.102:0/3979294076 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8360000f80 con 0x7f83880b8d20 2021-02-12T17:16:14.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.385+0000 7f836ffff700 1 -- 172.21.2.102:0/3979294076 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f8378022070 con 0x7f83880b8d20 2021-02-12T17:16:14.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.385+0000 7f836ffff700 1 --2- 172.21.2.102:0/3979294076 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8368059d30 0x7f836805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.385+0000 7f836ffff700 1 -- 172.21.2.102:0/3979294076 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f8378073e90 con 0x7f83880b8d20 2021-02-12T17:16:14.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.385+0000 7f83877fe700 1 --2- 172.21.2.102:0/3979294076 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8368059d30 0x7f836805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.385+0000 7f836ffff700 1 --2- 172.21.2.102:0/3979294076 >> [v2:172.21.2.104:6824/37838,v1:172.21.2.104:6825/37838] conn(0x7f8368061fd0 0x7f8368064430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.385+0000 7f836ffff700 1 -- 172.21.2.102:0/3979294076 --> [v2:172.21.2.104:6824/37838,v1:172.21.2.104:6825/37838] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8368064ab0 con 0x7f8368061fd0 2021-02-12T17:16:14.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.385+0000 7f836ffff700 1 -- 172.21.2.102:0/3979294076 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8378076500 con 0x7f83880b8d20 2021-02-12T17:16:14.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.385+0000 7f83877fe700 1 --2- 172.21.2.102:0/3979294076 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8368059d30 0x7f836805c1f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f83880bb5e0 tx=0x7f837c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.385+0000 7f838cb29700 1 --2- 172.21.2.102:0/3979294076 >> [v2:172.21.2.104:6824/37838,v1:172.21.2.104:6825/37838] conn(0x7f8368061fd0 0x7f8368064430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.386+0000 7f838cb29700 1 --2- 172.21.2.102:0/3979294076 >> [v2:172.21.2.104:6824/37838,v1:172.21.2.104:6825/37838] conn(0x7f8368061fd0 0x7f8368064430 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.386+0000 7f836ffff700 1 -- 172.21.2.102:0/3979294076 <== osd.7 v2:172.21.2.104:6824/37838 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f8368064ab0 con 0x7f8368061fd0 2021-02-12T17:16:14.400 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.399+0000 7f838e58c700 1 -- 172.21.2.102:0/3979294076 --> [v2:172.21.2.104:6824/37838,v1:172.21.2.104:6825/37838] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8360002990 con 0x7f8368061fd0 2021-02-12T17:16:14.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.400+0000 7f836ffff700 1 -- 172.21.2.102:0/3979294076 <== osd.7 v2:172.21.2.104:6824/37838 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8360002990 con 0x7f8368061fd0 2021-02-12T17:16:14.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.400+0000 7f838e58c700 1 -- 172.21.2.102:0/3979294076 >> [v2:172.21.2.104:6824/37838,v1:172.21.2.104:6825/37838] conn(0x7f8368061fd0 msgr2=0x7f8368064430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.400+0000 7f838e58c700 1 --2- 172.21.2.102:0/3979294076 >> [v2:172.21.2.104:6824/37838,v1:172.21.2.104:6825/37838] conn(0x7f8368061fd0 0x7f8368064430 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.400+0000 7f838e58c700 1 -- 172.21.2.102:0/3979294076 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8368059d30 msgr2=0x7f836805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.400+0000 7f838e58c700 1 --2- 172.21.2.102:0/3979294076 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8368059d30 0x7f836805c1f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f83880bb5e0 tx=0x7f837c016000).stop 2021-02-12T17:16:14.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.400+0000 7f838e58c700 1 -- 172.21.2.102:0/3979294076 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83880b8d20 msgr2=0x7f8388134880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.400+0000 7f838e58c700 1 --2- 172.21.2.102:0/3979294076 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83880b8d20 0x7f8388134880 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f837800eba0 tx=0x7f8378006ea0).stop 2021-02-12T17:16:14.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.400+0000 7f838cb29700 1 -- 172.21.2.102:0/3979294076 reap_dead start 2021-02-12T17:16:14.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.400+0000 7f838e58c700 1 -- 172.21.2.102:0/3979294076 shutdown_connections 2021-02-12T17:16:14.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.400+0000 7f838e58c700 1 -- 172.21.2.102:0/3979294076 >> 172.21.2.102:0/3979294076 conn(0x7f83880bc480 msgr2=0x7f8388066850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:14.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.400+0000 7f838e58c700 1 -- 172.21.2.102:0/3979294076 shutdown_connections 2021-02-12T17:16:14.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.400+0000 7f838e58c700 1 -- 172.21.2.102:0/3979294076 wait complete. 2021-02-12T17:16:14.409 INFO:teuthology.orchestra.run.gibba002.stdout:55834574853 2021-02-12T17:16:14.410 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-02-12T17:16:14.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.496+0000 7feeeb995700 1 Processor -- start 2021-02-12T17:16:14.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.496+0000 7feeeb995700 1 -- start start 2021-02-12T17:16:14.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feeeb995700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feee414e530 0x7feee4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feeeb995700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7feee4062740 0x7feee4062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feeeb995700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee40b7960 con 0x7feee40b8d20 2021-02-12T17:16:14.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feeeb995700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee4068d20 con 0x7feee4062740 2021-02-12T17:16:14.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feeeb995700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee40622a0 con 0x7feee414e530 2021-02-12T17:16:14.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feee9f32700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7feee4062740 0x7feee4062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feee9731700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7feee40b8d20 0x7feee40b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53562/0 (socket says 172.21.2.102:53562) 2021-02-12T17:16:14.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feee9731700 1 -- 172.21.2.102:0/2903575145 learned_addr learned my addr 172.21.2.102:0/2903575145 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:14.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feee3fff700 1 -- 172.21.2.102:0/2903575145 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894430206 0 0) 0x7feee40b7960 con 0x7feee40b8d20 2021-02-12T17:16:14.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feee8f30700 1 --2- 172.21.2.102:0/2903575145 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feee414e530 0x7feee4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feee9f32700 1 -- 172.21.2.102:0/2903575145 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feee414e530 msgr2=0x7feee4068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:14.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feee9f32700 1 --2- 172.21.2.102:0/2903575145 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feee414e530 0x7feee4068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feee9f32700 1 -- 172.21.2.102:0/2903575145 >> v1:172.21.2.102:6789/0 conn(0x7feee40b8d20 legacy=0x7feee40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feee9f32700 1 -- 172.21.2.102:0/2903575145 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee414ea10 con 0x7feee4062740 2021-02-12T17:16:14.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feee8f30700 1 --2- 172.21.2.102:0/2903575145 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feee414e530 0x7feee4068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:14.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.497+0000 7feee9f32700 1 --2- 172.21.2.102:0/2903575145 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feee4062740 0x7feee4062bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7feedc009c90 tx=0x7feedc0091d0).ready entity=mon.0 client_cookie=f25a5ea24c904d34 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.498+0000 7feee3fff700 1 -- 172.21.2.102:0/2903575145 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc009ea0 con 0x7feee4062740 2021-02-12T17:16:14.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.498+0000 7feee3fff700 1 -- 172.21.2.102:0/2903575145 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feedc00bbf0 con 0x7feee4062740 2021-02-12T17:16:14.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.498+0000 7feee3fff700 1 -- 172.21.2.102:0/2903575145 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc011400 con 0x7feee4062740 2021-02-12T17:16:14.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.498+0000 7feeeb995700 1 -- 172.21.2.102:0/2903575145 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feee4062740 msgr2=0x7feee4062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.498+0000 7feeeb995700 1 --2- 172.21.2.102:0/2903575145 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feee4062740 0x7feee4062bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7feedc009c90 tx=0x7feedc0091d0).stop 2021-02-12T17:16:14.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.498+0000 7feeeb995700 1 -- 172.21.2.102:0/2903575145 shutdown_connections 2021-02-12T17:16:14.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.498+0000 7feeeb995700 1 --2- 172.21.2.102:0/2903575145 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feee4062740 0x7feee4062bf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.498+0000 7feeeb995700 1 --2- 172.21.2.102:0/2903575145 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feee414e530 0x7feee4068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.498+0000 7feeeb995700 1 -- 172.21.2.102:0/2903575145 >> 172.21.2.102:0/2903575145 conn(0x7feee40bc480 msgr2=0x7feee40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:14.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.498+0000 7feeeb995700 1 -- 172.21.2.102:0/2903575145 shutdown_connections 2021-02-12T17:16:14.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.498+0000 7feeeb995700 1 -- 172.21.2.102:0/2903575145 wait complete. 2021-02-12T17:16:14.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.499+0000 7feeeb995700 1 Processor -- start 2021-02-12T17:16:14.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.499+0000 7feeeb995700 1 -- start start 2021-02-12T17:16:14.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.499+0000 7feeeb995700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feee4062740 0x7feee40ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.499+0000 7feeeb995700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7feee40b8d20 0x7feee40ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.499+0000 7feeeb995700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feee414e530 0x7feee415cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.499+0000 7feeeb995700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40ae240 con 0x7feee4062740 2021-02-12T17:16:14.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.499+0000 7feeeb995700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40b1380 con 0x7feee40b8d20 2021-02-12T17:16:14.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.499+0000 7feeeb995700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee40b1620 con 0x7feee414e530 2021-02-12T17:16:14.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feee9731700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feee4062740 0x7feee40ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feee9731700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feee4062740 0x7feee40ada50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44924/0 (socket says 172.21.2.102:44924) 2021-02-12T17:16:14.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feee9731700 1 -- 172.21.2.102:0/3481361958 learned_addr learned my addr 172.21.2.102:0/3481361958 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:14.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feee9f32700 1 --2- 172.21.2.102:0/3481361958 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feee414e530 0x7feee415cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feee8f30700 1 --2- 172.21.2.102:0/3481361958 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7feee40b8d20 0x7feee40ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feee9731700 1 -- 172.21.2.102:0/3481361958 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feee414e530 msgr2=0x7feee415cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feee9731700 1 --2- 172.21.2.102:0/3481361958 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feee414e530 0x7feee415cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feee9731700 1 -- 172.21.2.102:0/3481361958 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7feee40b8d20 msgr2=0x7feee40ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feee9731700 1 --2- 172.21.2.102:0/3481361958 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7feee40b8d20 0x7feee40ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feee9731700 1 -- 172.21.2.102:0/3481361958 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee40b18c0 con 0x7feee4062740 2021-02-12T17:16:14.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feee9731700 1 --2- 172.21.2.102:0/3481361958 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feee4062740 0x7feee40ada50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7feed400c760 tx=0x7feed4007a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feee17fa700 1 -- 172.21.2.102:0/3481361958 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed4007320 con 0x7feee4062740 2021-02-12T17:16:14.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feee17fa700 1 -- 172.21.2.102:0/3481361958 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed4007480 con 0x7feee4062740 2021-02-12T17:16:14.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feeeb995700 1 -- 172.21.2.102:0/3481361958 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee40adf40 con 0x7feee4062740 2021-02-12T17:16:14.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feeeb995700 1 -- 172.21.2.102:0/3481361958 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee40b1d60 con 0x7feee4062740 2021-02-12T17:16:14.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.500+0000 7feee17fa700 1 -- 172.21.2.102:0/3481361958 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed4005810 con 0x7feee4062740 2021-02-12T17:16:14.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.501+0000 7feeeb995700 1 -- 172.21.2.102:0/3481361958 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee40b11e0 con 0x7feee4062740 2021-02-12T17:16:14.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.501+0000 7feee17fa700 1 -- 172.21.2.102:0/3481361958 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7feed4010030 con 0x7feee4062740 2021-02-12T17:16:14.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.501+0000 7feee17fa700 1 --2- 172.21.2.102:0/3481361958 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7feec8059d80 0x7feec805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.501+0000 7feee17fa700 1 -- 172.21.2.102:0/3481361958 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7feed4073a10 con 0x7feee4062740 2021-02-12T17:16:14.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.501+0000 7feee8f30700 1 --2- 172.21.2.102:0/3481361958 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7feec8059d80 0x7feec805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.502+0000 7feee8f30700 1 --2- 172.21.2.102:0/3481361958 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7feec8059d80 0x7feec805c240 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7feee4064490 tx=0x7feecc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.504+0000 7feee17fa700 1 -- 172.21.2.102:0/3481361958 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7feee40b11e0 con 0x7feee4062740 2021-02-12T17:16:14.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.636+0000 7feeeb995700 1 -- 172.21.2.102:0/3481361958 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feee40b11e0 con 0x7feee4062740 2021-02-12T17:16:14.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.636+0000 7feee17fa700 1 -- 172.21.2.102:0/3481361958 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feee40b11e0 con 0x7feee4062740 2021-02-12T17:16:14.638 INFO:teuthology.orchestra.run.gibba002.stdout:55834574854 2021-02-12T17:16:14.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.637+0000 7feeeb995700 1 -- 172.21.2.102:0/3481361958 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7feec8059d80 msgr2=0x7feec805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.637+0000 7feeeb995700 1 --2- 172.21.2.102:0/3481361958 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7feec8059d80 0x7feec805c240 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7feee4064490 tx=0x7feecc008040).stop 2021-02-12T17:16:14.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.637+0000 7feeeb995700 1 -- 172.21.2.102:0/3481361958 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feee4062740 msgr2=0x7feee40ada50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.637+0000 7feeeb995700 1 --2- 172.21.2.102:0/3481361958 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feee4062740 0x7feee40ada50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7feed400c760 tx=0x7feed4007a50).stop 2021-02-12T17:16:14.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.637+0000 7feeeb995700 1 -- 172.21.2.102:0/3481361958 shutdown_connections 2021-02-12T17:16:14.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.637+0000 7feeeb995700 1 --2- 172.21.2.102:0/3481361958 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feee414e530 0x7feee415cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.637+0000 7feeeb995700 1 --2- 172.21.2.102:0/3481361958 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7feec8059d80 0x7feec805c240 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.637+0000 7feeeb995700 1 --2- 172.21.2.102:0/3481361958 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feee4062740 0x7feee40ada50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.637+0000 7feeeb995700 1 --2- 172.21.2.102:0/3481361958 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7feee40b8d20 0x7feee40ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.637+0000 7feeeb995700 1 -- 172.21.2.102:0/3481361958 >> 172.21.2.102:0/3481361958 conn(0x7feee40bc480 msgr2=0x7feee41517a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:14.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.637+0000 7feeeb995700 1 -- 172.21.2.102:0/3481361958 shutdown_connections 2021-02-12T17:16:14.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.637+0000 7feeeb995700 1 -- 172.21.2.102:0/3481361958 wait complete. 2021-02-12T17:16:14.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2021-02-12T17:16:14.647 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-02-12T17:16:14.735 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.734+0000 7fe5abce6700 1 Processor -- start 2021-02-12T17:16:14.736 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.734+0000 7fe5abce6700 1 -- start start 2021-02-12T17:16:14.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.735+0000 7fe5abce6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe5a40b8d20 0x7fe5a4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.735+0000 7fe5abce6700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe5a414e530 0x7fe5a40b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.735+0000 7fe5abce6700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a40622a0 con 0x7fe5a4062740 2021-02-12T17:16:14.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.735+0000 7fe5abce6700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a4068d20 con 0x7fe5a414e530 2021-02-12T17:16:14.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.735+0000 7fe5abce6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a414ea10 con 0x7fe5a40b8d20 2021-02-12T17:16:14.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.735+0000 7fe5a9281700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe5a414e530 0x7fe5a40b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.735+0000 7fe5a9281700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe5a414e530 0x7fe5a40b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44936/0 (socket says 172.21.2.102:44936) 2021-02-12T17:16:14.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.735+0000 7fe5a9281700 1 -- 172.21.2.102:0/259077581 learned_addr learned my addr 172.21.2.102:0/259077581 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:14.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.735+0000 7fe5a9281700 1 -- 172.21.2.102:0/259077581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe5a40b8d20 msgr2=0x7fe5a4068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:14.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.735+0000 7fe5a9281700 1 --2- 172.21.2.102:0/259077581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe5a40b8d20 0x7fe5a4068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:14.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.735+0000 7fe5a9281700 1 -- 172.21.2.102:0/259077581 >> v1:172.21.2.104:6789/0 conn(0x7fe5a4062740 legacy=0x7fe5a4062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:14.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.735+0000 7fe5a9281700 1 -- 172.21.2.102:0/259077581 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a40b63f0 con 0x7fe5a414e530 2021-02-12T17:16:14.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.735+0000 7fe5a9281700 1 --2- 172.21.2.102:0/259077581 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5a414e530 0x7fe5a40b7250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fe59800b9e0 tx=0x7fe598006ea0).ready entity=mon.0 client_cookie=d0b9beba624df800 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.735+0000 7fe5a8a80700 1 -- 172.21.2.102:0/259077581 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598009800 con 0x7fe5a414e530 2021-02-12T17:16:14.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.736+0000 7fe5a8a80700 1 -- 172.21.2.102:0/259077581 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe598009960 con 0x7fe5a414e530 2021-02-12T17:16:14.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.736+0000 7fe5a8a80700 1 -- 172.21.2.102:0/259077581 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598009ce0 con 0x7fe5a414e530 2021-02-12T17:16:14.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.736+0000 7fe5abce6700 1 -- 172.21.2.102:0/259077581 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5a414e530 msgr2=0x7fe5a40b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.736+0000 7fe5abce6700 1 --2- 172.21.2.102:0/259077581 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5a414e530 0x7fe5a40b7250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fe59800b9e0 tx=0x7fe598006ea0).stop 2021-02-12T17:16:14.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.736+0000 7fe5abce6700 1 -- 172.21.2.102:0/259077581 shutdown_connections 2021-02-12T17:16:14.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.736+0000 7fe5abce6700 1 --2- 172.21.2.102:0/259077581 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe5a40b8d20 0x7fe5a4068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:14.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.736+0000 7fe5abce6700 1 --2- 172.21.2.102:0/259077581 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5a414e530 0x7fe5a40b7250 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.736+0000 7fe5abce6700 1 -- 172.21.2.102:0/259077581 >> 172.21.2.102:0/259077581 conn(0x7fe5a40bc480 msgr2=0x7fe5a40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:14.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.736+0000 7fe5abce6700 1 -- 172.21.2.102:0/259077581 shutdown_connections 2021-02-12T17:16:14.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.736+0000 7fe5abce6700 1 -- 172.21.2.102:0/259077581 wait complete. 2021-02-12T17:16:14.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.737+0000 7fe5abce6700 1 Processor -- start 2021-02-12T17:16:14.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.737+0000 7fe5abce6700 1 -- start start 2021-02-12T17:16:14.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.737+0000 7fe5abce6700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5a4062740 0x7fe5a40b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.737+0000 7fe5abce6700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe5a40b8d20 0x7fe5a40b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.737+0000 7fe5abce6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe5a414e530 0x7fe5a40afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.737+0000 7fe5abce6700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40af730 con 0x7fe5a4062740 2021-02-12T17:16:14.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.737+0000 7fe5abce6700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a415e3e0 con 0x7fe5a40b8d20 2021-02-12T17:16:14.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.737+0000 7fe5abce6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40b20a0 con 0x7fe5a414e530 2021-02-12T17:16:14.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.737+0000 7fe5a9a82700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5a4062740 0x7fe5a40b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.737+0000 7fe5a9a82700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5a4062740 0x7fe5a40b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44940/0 (socket says 172.21.2.102:44940) 2021-02-12T17:16:14.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.737+0000 7fe5a9a82700 1 -- 172.21.2.102:0/616302484 learned_addr learned my addr 172.21.2.102:0/616302484 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:14.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.738+0000 7fe5a9a82700 1 -- 172.21.2.102:0/616302484 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe5a414e530 msgr2=0x7fe5a40afee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:14.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.738+0000 7fe5a9a82700 1 --2- 172.21.2.102:0/616302484 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe5a414e530 0x7fe5a40afee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:14.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.738+0000 7fe5a9a82700 1 -- 172.21.2.102:0/616302484 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe5a40b8d20 msgr2=0x7fe5a40b16f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:14.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.738+0000 7fe5a9a82700 1 --2- 172.21.2.102:0/616302484 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe5a40b8d20 0x7fe5a40b16f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:14.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.738+0000 7fe5a9a82700 1 -- 172.21.2.102:0/616302484 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a40b1be0 con 0x7fe5a4062740 2021-02-12T17:16:14.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.738+0000 7fe5a9a82700 1 --2- 172.21.2.102:0/616302484 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5a4062740 0x7fe5a40b1200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fe5a00096b0 tx=0x7fe5a0006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.738+0000 7fe595ffb700 1 -- 172.21.2.102:0/616302484 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000d500 con 0x7fe5a4062740 2021-02-12T17:16:14.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.738+0000 7fe595ffb700 1 -- 172.21.2.102:0/616302484 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a000d680 con 0x7fe5a4062740 2021-02-12T17:16:14.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.738+0000 7fe5abce6700 1 -- 172.21.2.102:0/616302484 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a40b2360 con 0x7fe5a4062740 2021-02-12T17:16:14.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.738+0000 7fe595ffb700 1 -- 172.21.2.102:0/616302484 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000da40 con 0x7fe5a4062740 2021-02-12T17:16:14.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.738+0000 7fe5abce6700 1 -- 172.21.2.102:0/616302484 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a40b0d60 con 0x7fe5a4062740 2021-02-12T17:16:14.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.739+0000 7fe5abce6700 1 -- 172.21.2.102:0/616302484 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a4045460 con 0x7fe5a4062740 2021-02-12T17:16:14.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.739+0000 7fe595ffb700 1 -- 172.21.2.102:0/616302484 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fe5a0012420 con 0x7fe5a4062740 2021-02-12T17:16:14.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.739+0000 7fe595ffb700 1 --2- 172.21.2.102:0/616302484 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe584059d80 0x7fe58405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:14.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.739+0000 7fe595ffb700 1 -- 172.21.2.102:0/616302484 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fe5a0073af0 con 0x7fe5a4062740 2021-02-12T17:16:14.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.739+0000 7fe5a9281700 1 --2- 172.21.2.102:0/616302484 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe584059d80 0x7fe58405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:14.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.740+0000 7fe5a9281700 1 --2- 172.21.2.102:0/616302484 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe584059d80 0x7fe58405c240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fe59800b9e0 tx=0x7fe598016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:14.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.742+0000 7fe595ffb700 1 -- 172.21.2.102:0/616302484 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fe5a0047230 con 0x7fe5a4062740 2021-02-12T17:16:14.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.869+0000 7fe5abce6700 1 -- 172.21.2.102:0/616302484 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe5a4063670 con 0x7fe5a4062740 2021-02-12T17:16:14.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.869+0000 7fe595ffb700 1 -- 172.21.2.102:0/616302484 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5a000ddb0 con 0x7fe5a4062740 2021-02-12T17:16:14.871 INFO:teuthology.orchestra.run.gibba002.stdout:55834574853 2021-02-12T17:16:14.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.870+0000 7fe5abce6700 1 -- 172.21.2.102:0/616302484 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe584059d80 msgr2=0x7fe58405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.870+0000 7fe5abce6700 1 --2- 172.21.2.102:0/616302484 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe584059d80 0x7fe58405c240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fe59800b9e0 tx=0x7fe598016000).stop 2021-02-12T17:16:14.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.870+0000 7fe5abce6700 1 -- 172.21.2.102:0/616302484 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5a4062740 msgr2=0x7fe5a40b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:14.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.870+0000 7fe5abce6700 1 --2- 172.21.2.102:0/616302484 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5a4062740 0x7fe5a40b1200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fe5a00096b0 tx=0x7fe5a0006de0).stop 2021-02-12T17:16:14.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.871+0000 7fe5abce6700 1 -- 172.21.2.102:0/616302484 shutdown_connections 2021-02-12T17:16:14.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.871+0000 7fe5abce6700 1 --2- 172.21.2.102:0/616302484 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe5a414e530 0x7fe5a40afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:14.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.871+0000 7fe5abce6700 1 --2- 172.21.2.102:0/616302484 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe584059d80 0x7fe58405c240 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.871+0000 7fe5abce6700 1 --2- 172.21.2.102:0/616302484 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5a4062740 0x7fe5a40b1200 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:14.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.871+0000 7fe5abce6700 1 --2- 172.21.2.102:0/616302484 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe5a40b8d20 0x7fe5a40b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:14.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.871+0000 7fe5abce6700 1 -- 172.21.2.102:0/616302484 >> 172.21.2.102:0/616302484 conn(0x7fe5a40bc480 msgr2=0x7fe5a414cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:14.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.871+0000 7fe5abce6700 1 -- 172.21.2.102:0/616302484 shutdown_connections 2021-02-12T17:16:14.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:14.871+0000 7fe5abce6700 1 -- 172.21.2.102:0/616302484 wait complete. 2021-02-12T17:16:14.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2021-02-12T17:16:15.881 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-02-12T17:16:15.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.969+0000 7f616d7cf700 1 Processor -- start 2021-02-12T17:16:15.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.969+0000 7f616d7cf700 1 -- start start 2021-02-12T17:16:15.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.970+0000 7f616d7cf700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f61680b8d20 0x7f6168068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:15.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.970+0000 7f616d7cf700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61680b7960 con 0x7f6168062740 2021-02-12T17:16:15.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.970+0000 7f616d7cf700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61680622a0 con 0x7f616814e530 2021-02-12T17:16:15.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.970+0000 7f616d7cf700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6168068d20 con 0x7f61680b8d20 2021-02-12T17:16:15.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.970+0000 7f61677fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f6168062740 0x7f6168062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53594/0 (socket says 172.21.2.102:53594) 2021-02-12T17:16:15.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.970+0000 7f61677fe700 1 -- 172.21.2.102:0/3353332209 learned_addr learned my addr 172.21.2.102:0/3353332209 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:15.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.970+0000 7f6166ffd700 1 --2- 172.21.2.102:0/3353332209 >> v2:172.21.2.104:3300/0 conn(0x7f61680b8d20 0x7f6168068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:15.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.970+0000 7f6165ffb700 1 -- 172.21.2.102:0/3353332209 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074818905 0 0) 0x7f61680b7960 con 0x7f6168062740 2021-02-12T17:16:15.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 -- 172.21.2.102:0/3353332209 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6148003230 con 0x7f6168062740 2021-02-12T17:16:15.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 -- 172.21.2.102:0/3353332209 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3595758056 0 0) 0x7f6148003230 con 0x7f6168062740 2021-02-12T17:16:15.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 -- 172.21.2.102:0/3353332209 >> v2:172.21.2.104:3300/0 conn(0x7f61680b8d20 msgr2=0x7f6168068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:15.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 --2- 172.21.2.102:0/3353332209 >> v2:172.21.2.104:3300/0 conn(0x7f61680b8d20 0x7f6168068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:15.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 -- 172.21.2.102:0/3353332209 >> v1:172.21.2.104:6789/0 conn(0x7f616814e530 legacy=0x7f61680b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:15.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 -- 172.21.2.102:0/3353332209 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616814ea10 con 0x7f6168062740 2021-02-12T17:16:15.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 -- 172.21.2.102:0/3353332209 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f6160001860 con 0x7f6168062740 2021-02-12T17:16:15.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 -- 172.21.2.102:0/3353332209 >> v1:172.21.2.102:6789/0 conn(0x7f6168062740 legacy=0x7f6168062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:15.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 --2- 172.21.2.102:0/3353332209 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6148003770 0x7f6148003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:15.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 --2- 172.21.2.102:0/3353332209 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f61480044d0 0x7f6148004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:15.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 --2- 172.21.2.102:0/3353332209 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6148004e40 0x7f614800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:15.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 -- 172.21.2.102:0/3353332209 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6168068d20 con 0x7f6148004e40 2021-02-12T17:16:15.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 -- 172.21.2.102:0/3353332209 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6148005320 con 0x7f6148003770 2021-02-12T17:16:15.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 -- 172.21.2.102:0/3353332209 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614800bc10 con 0x7f61480044d0 2021-02-12T17:16:15.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f61677fe700 1 --2- 172.21.2.102:0/3353332209 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6148004e40 0x7f614800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:15.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6166ffd700 1 --2- 172.21.2.102:0/3353332209 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6148003770 0x7f6148003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:15.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f61667fc700 1 --2- 172.21.2.102:0/3353332209 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f61480044d0 0x7f6148004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:15.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f61677fe700 1 -- 172.21.2.102:0/3353332209 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f61480044d0 msgr2=0x7f6148004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:15.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f61677fe700 1 --2- 172.21.2.102:0/3353332209 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f61480044d0 0x7f6148004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:15.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f61677fe700 1 -- 172.21.2.102:0/3353332209 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6148003770 msgr2=0x7f6148003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:15.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f61677fe700 1 --2- 172.21.2.102:0/3353332209 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6148003770 0x7f6148003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:15.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f61677fe700 1 -- 172.21.2.102:0/3353332209 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6148003230 con 0x7f6148004e40 2021-02-12T17:16:15.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f61667fc700 1 --2- 172.21.2.102:0/3353332209 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f61480044d0 0x7f6148004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:15.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6166ffd700 1 --2- 172.21.2.102:0/3353332209 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6148003770 0x7f6148003b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:15.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f61677fe700 1 -- 172.21.2.102:0/3353332209 reap_dead start 2021-02-12T17:16:15.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f61677fe700 1 --2- 172.21.2.102:0/3353332209 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6148004e40 0x7f614800b720 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f616000c600 tx=0x7f616814eba0).ready entity=mon.0 client_cookie=4dcbd7594c2062c5 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:15.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 -- 172.21.2.102:0/3353332209 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160005b70 con 0x7f6148004e40 2021-02-12T17:16:15.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 -- 172.21.2.102:0/3353332209 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6160005cd0 con 0x7f6148004e40 2021-02-12T17:16:15.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.971+0000 7f6165ffb700 1 -- 172.21.2.102:0/3353332209 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160007320 con 0x7f6148004e40 2021-02-12T17:16:15.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.972+0000 7f616d7cf700 1 -- 172.21.2.102:0/3353332209 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6148004e40 msgr2=0x7f614800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:15.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.972+0000 7f616d7cf700 1 --2- 172.21.2.102:0/3353332209 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6148004e40 0x7f614800b720 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f616000c600 tx=0x7f616814eba0).stop 2021-02-12T17:16:15.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.972+0000 7f616d7cf700 1 -- 172.21.2.102:0/3353332209 shutdown_connections 2021-02-12T17:16:15.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.972+0000 7f616d7cf700 1 --2- 172.21.2.102:0/3353332209 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6148004e40 0x7f614800b720 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:15.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.972+0000 7f616d7cf700 1 -- 172.21.2.102:0/3353332209 >> 172.21.2.102:0/3353332209 conn(0x7f61680bc480 msgr2=0x7f61680b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:15.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.972+0000 7f616d7cf700 1 -- 172.21.2.102:0/3353332209 shutdown_connections 2021-02-12T17:16:15.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.972+0000 7f616d7cf700 1 -- 172.21.2.102:0/3353332209 wait complete. 2021-02-12T17:16:15.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.973+0000 7f616d7cf700 1 Processor -- start 2021-02-12T17:16:15.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.973+0000 7f616d7cf700 1 -- start start 2021-02-12T17:16:15.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.973+0000 7f616d7cf700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6148004e40 0x7f61680b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:15.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.973+0000 7f616d7cf700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f616815d130 0x7f61680ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:15.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.973+0000 7f616d7cf700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f61680ae2f0 0x7f616815d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:15.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.973+0000 7f616d7cf700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61680af540 con 0x7f61680ae2f0 2021-02-12T17:16:15.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.973+0000 7f616d7cf700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61680b05d0 con 0x7f616815d130 2021-02-12T17:16:15.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.973+0000 7f616d7cf700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61680afb50 con 0x7f6148004e40 2021-02-12T17:16:15.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f61677fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f61680ae2f0 0x7f616815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:15.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f61677fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f61680ae2f0 0x7f616815d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44962/0 (socket says 172.21.2.102:44962) 2021-02-12T17:16:15.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f61677fe700 1 -- 172.21.2.102:0/4169579021 learned_addr learned my addr 172.21.2.102:0/4169579021 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:15.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f61667fc700 1 --2- 172.21.2.102:0/4169579021 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f616815d130 0x7f61680ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:15.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f6166ffd700 1 --2- 172.21.2.102:0/4169579021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6148004e40 0x7f61680b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:15.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f61677fe700 1 -- 172.21.2.102:0/4169579021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6148004e40 msgr2=0x7f61680b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:15.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f61677fe700 1 --2- 172.21.2.102:0/4169579021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6148004e40 0x7f61680b9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:15.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f61677fe700 1 -- 172.21.2.102:0/4169579021 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f616815d130 msgr2=0x7f61680ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:15.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f61677fe700 1 --2- 172.21.2.102:0/4169579021 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f616815d130 0x7f61680ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:15.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f61677fe700 1 -- 172.21.2.102:0/4169579021 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61680afdf0 con 0x7f61680ae2f0 2021-02-12T17:16:15.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f61677fe700 1 --2- 172.21.2.102:0/4169579021 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f61680ae2f0 0x7f616815d810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f6168067bb0 tx=0x7f6160010000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:15.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f615effd700 1 -- 172.21.2.102:0/4169579021 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616000c2f0 con 0x7f61680ae2f0 2021-02-12T17:16:15.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f615effd700 1 -- 172.21.2.102:0/4169579021 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61600148c0 con 0x7f61680ae2f0 2021-02-12T17:16:15.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f616d7cf700 1 -- 172.21.2.102:0/4169579021 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61680b0090 con 0x7f61680ae2f0 2021-02-12T17:16:15.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f615effd700 1 -- 172.21.2.102:0/4169579021 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160014c60 con 0x7f61680ae2f0 2021-02-12T17:16:15.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.974+0000 7f616d7cf700 1 -- 172.21.2.102:0/4169579021 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6168152eb0 con 0x7f61680ae2f0 2021-02-12T17:16:15.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.975+0000 7f616d7cf700 1 -- 172.21.2.102:0/4169579021 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6168045460 con 0x7f61680ae2f0 2021-02-12T17:16:15.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.975+0000 7f615effd700 1 -- 172.21.2.102:0/4169579021 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f6160027070 con 0x7f61680ae2f0 2021-02-12T17:16:15.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.976+0000 7f615effd700 1 --2- 172.21.2.102:0/4169579021 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f614c059d30 0x7f614c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:15.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.976+0000 7f615effd700 1 -- 172.21.2.102:0/4169579021 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f6160074870 con 0x7f61680ae2f0 2021-02-12T17:16:15.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.976+0000 7f6166ffd700 1 --2- 172.21.2.102:0/4169579021 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f614c059d30 0x7f614c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:15.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.976+0000 7f6166ffd700 1 --2- 172.21.2.102:0/4169579021 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f614c059d30 0x7f614c05c1f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6150006db0 tx=0x7f6150008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:15.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:15.979+0000 7f615effd700 1 -- 172.21.2.102:0/4169579021 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f6160048120 con 0x7f61680ae2f0 2021-02-12T17:16:16.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:16.107+0000 7f616d7cf700 1 -- 172.21.2.102:0/4169579021 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6168063670 con 0x7f61680ae2f0 2021-02-12T17:16:16.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:16.107+0000 7f615effd700 1 -- 172.21.2.102:0/4169579021 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f616004b740 con 0x7f61680ae2f0 2021-02-12T17:16:16.109 INFO:teuthology.orchestra.run.gibba002.stdout:55834574853 2021-02-12T17:16:16.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:16.108+0000 7f616d7cf700 1 -- 172.21.2.102:0/4169579021 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f614c059d30 msgr2=0x7f614c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:16.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:16.108+0000 7f616d7cf700 1 --2- 172.21.2.102:0/4169579021 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f614c059d30 0x7f614c05c1f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6150006db0 tx=0x7f6150008040).stop 2021-02-12T17:16:16.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:16.108+0000 7f616d7cf700 1 -- 172.21.2.102:0/4169579021 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f61680ae2f0 msgr2=0x7f616815d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:16.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:16.108+0000 7f616d7cf700 1 --2- 172.21.2.102:0/4169579021 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f61680ae2f0 0x7f616815d810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f6168067bb0 tx=0x7f6160010000).stop 2021-02-12T17:16:16.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:16.109+0000 7f616d7cf700 1 -- 172.21.2.102:0/4169579021 shutdown_connections 2021-02-12T17:16:16.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:16.109+0000 7f616d7cf700 1 --2- 172.21.2.102:0/4169579021 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f614c059d30 0x7f614c05c1f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:16.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:16.109+0000 7f616d7cf700 1 --2- 172.21.2.102:0/4169579021 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f61680ae2f0 0x7f616815d810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:16.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:16.109+0000 7f616d7cf700 1 --2- 172.21.2.102:0/4169579021 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6148004e40 0x7f61680b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:16.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:16.109+0000 7f616d7cf700 1 --2- 172.21.2.102:0/4169579021 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f616815d130 0x7f61680ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:16.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:16.109+0000 7f616d7cf700 1 -- 172.21.2.102:0/4169579021 >> 172.21.2.102:0/4169579021 conn(0x7f61680bc480 msgr2=0x7f61680b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:16.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:16.109+0000 7f616d7cf700 1 -- 172.21.2.102:0/4169579021 shutdown_connections 2021-02-12T17:16:16.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:16.109+0000 7f616d7cf700 1 -- 172.21.2.102:0/4169579021 wait complete. 2021-02-12T17:16:16.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2021-02-12T17:16:17.124 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-02-12T17:16:17.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.212+0000 7f5fed461700 1 Processor -- start 2021-02-12T17:16:17.214 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.212+0000 7f5fed461700 1 -- start start 2021-02-12T17:16:17.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.212+0000 7f5fed461700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5fe80b8d20 0x7f5fe8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.212+0000 7f5fed461700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe80b7960 con 0x7f5fe814e530 2021-02-12T17:16:17.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.212+0000 7f5fed461700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe80622a0 con 0x7f5fe8062740 2021-02-12T17:16:17.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.212+0000 7f5fed461700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8068d20 con 0x7f5fe80b8d20 2021-02-12T17:16:17.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.213+0000 7f5fe67fc700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f5fe814e530 0x7f5fe80b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53610/0 (socket says 172.21.2.102:53610) 2021-02-12T17:16:17.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.213+0000 7f5fe67fc700 1 -- 172.21.2.102:0/3671055023 learned_addr learned my addr 172.21.2.102:0/3671055023 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:17.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.213+0000 7f5fe5ffb700 1 -- 172.21.2.102:0/3671055023 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028314189 0 0) 0x7f5fe80b7960 con 0x7f5fe814e530 2021-02-12T17:16:17.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.213+0000 7f5fe5ffb700 1 -- 172.21.2.102:0/3671055023 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc8003230 con 0x7f5fe814e530 2021-02-12T17:16:17.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.213+0000 7f5fe6ffd700 1 --2- 172.21.2.102:0/3671055023 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5fe80b8d20 0x7f5fe8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.213+0000 7f5fe5ffb700 1 -- 172.21.2.102:0/3671055023 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3070432702 0 0) 0x7f5fc8003230 con 0x7f5fe814e530 2021-02-12T17:16:17.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.213+0000 7f5fe5ffb700 1 -- 172.21.2.102:0/3671055023 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5fe80b8d20 msgr2=0x7f5fe8068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:17.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.213+0000 7f5fe5ffb700 1 --2- 172.21.2.102:0/3671055023 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5fe80b8d20 0x7f5fe8068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.213+0000 7f5fe5ffb700 1 -- 172.21.2.102:0/3671055023 >> v1:172.21.2.104:6789/0 conn(0x7f5fe8062740 legacy=0x7f5fe8062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:17.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.213+0000 7f5fe5ffb700 1 -- 172.21.2.102:0/3671055023 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe814ea10 con 0x7f5fe814e530 2021-02-12T17:16:17.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.213+0000 7f5fe5ffb700 1 -- 172.21.2.102:0/3671055023 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f5fd00014e0 con 0x7f5fe814e530 2021-02-12T17:16:17.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.213+0000 7f5fe5ffb700 1 -- 172.21.2.102:0/3671055023 >> v1:172.21.2.102:6789/0 conn(0x7f5fe814e530 legacy=0x7f5fe80b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe5ffb700 1 --2- 172.21.2.102:0/3671055023 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5fe80b8d20 0x7f5fc8003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe5ffb700 1 --2- 172.21.2.102:0/3671055023 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5fc8003c40 0x7f5fc80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe5ffb700 1 --2- 172.21.2.102:0/3671055023 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5fc80049c0 0x7f5fc8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe5ffb700 1 -- 172.21.2.102:0/3671055023 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8068d20 con 0x7f5fc8003c40 2021-02-12T17:16:17.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe5ffb700 1 -- 172.21.2.102:0/3671055023 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80041d0 con 0x7f5fc80049c0 2021-02-12T17:16:17.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe5ffb700 1 -- 172.21.2.102:0/3671055023 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc800b720 con 0x7f5fe80b8d20 2021-02-12T17:16:17.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe67fc700 1 --2- 172.21.2.102:0/3671055023 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5fc8003c40 0x7f5fc80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe6ffd700 1 --2- 172.21.2.102:0/3671055023 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5fe80b8d20 0x7f5fc8003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe77fe700 1 --2- 172.21.2.102:0/3671055023 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5fc80049c0 0x7f5fc8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe67fc700 1 -- 172.21.2.102:0/3671055023 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5fe80b8d20 msgr2=0x7f5fc8003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:17.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe67fc700 1 --2- 172.21.2.102:0/3671055023 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5fe80b8d20 0x7f5fc8003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe67fc700 1 -- 172.21.2.102:0/3671055023 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5fc80049c0 msgr2=0x7f5fc8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:17.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe67fc700 1 --2- 172.21.2.102:0/3671055023 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5fc80049c0 0x7f5fc8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe67fc700 1 -- 172.21.2.102:0/3671055023 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc8003230 con 0x7f5fc8003c40 2021-02-12T17:16:17.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe67fc700 1 --2- 172.21.2.102:0/3671055023 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5fc8003c40 0x7f5fc80044d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f5fe806ac60 tx=0x7f5fe814eba0).ready entity=mon.0 client_cookie=bd6d60e23a34b878 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:17.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe5ffb700 1 -- 172.21.2.102:0/3671055023 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00070d0 con 0x7f5fc8003c40 2021-02-12T17:16:17.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe5ffb700 1 -- 172.21.2.102:0/3671055023 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0007230 con 0x7f5fc8003c40 2021-02-12T17:16:17.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.214+0000 7f5fe5ffb700 1 -- 172.21.2.102:0/3671055023 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00055e0 con 0x7f5fc8003c40 2021-02-12T17:16:17.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.215+0000 7f5fed461700 1 -- 172.21.2.102:0/3671055023 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5fc8003c40 msgr2=0x7f5fc80044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.215+0000 7f5fed461700 1 --2- 172.21.2.102:0/3671055023 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5fc8003c40 0x7f5fc80044d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f5fe806ac60 tx=0x7f5fe814eba0).stop 2021-02-12T17:16:17.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.215+0000 7f5fe77fe700 1 -- 172.21.2.102:0/3671055023 reap_dead start 2021-02-12T17:16:17.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.215+0000 7f5fed461700 1 -- 172.21.2.102:0/3671055023 shutdown_connections 2021-02-12T17:16:17.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.215+0000 7f5fed461700 1 -- 172.21.2.102:0/3671055023 >> 172.21.2.102:0/3671055023 conn(0x7f5fe80bc480 msgr2=0x7f5fe80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:17.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.215+0000 7f5fed461700 1 -- 172.21.2.102:0/3671055023 shutdown_connections 2021-02-12T17:16:17.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.215+0000 7f5fed461700 1 -- 172.21.2.102:0/3671055023 wait complete. 2021-02-12T17:16:17.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fed461700 1 Processor -- start 2021-02-12T17:16:17.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fed461700 1 -- start start 2021-02-12T17:16:17.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fed461700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5fe80b70c0 0x7f5fe8152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fed461700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5fe815dbe0 0x7f5fe80b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fed461700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5fe815c5b0 0x7f5fe815ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fed461700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe815e060 con 0x7f5fe815dbe0 2021-02-12T17:16:17.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fed461700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe80b4a90 con 0x7f5fe815c5b0 2021-02-12T17:16:17.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fed461700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe80b4d30 con 0x7f5fe80b70c0 2021-02-12T17:16:17.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fe67fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5fe815dbe0 0x7f5fe80b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fe67fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5fe815dbe0 0x7f5fe80b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44980/0 (socket says 172.21.2.102:44980) 2021-02-12T17:16:17.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fe67fc700 1 -- 172.21.2.102:0/601469765 learned_addr learned my addr 172.21.2.102:0/601469765 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:17.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fe67fc700 1 -- 172.21.2.102:0/601469765 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5fe80b70c0 msgr2=0x7f5fe8152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fe67fc700 1 --2- 172.21.2.102:0/601469765 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5fe80b70c0 0x7f5fe8152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:17.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fe67fc700 1 -- 172.21.2.102:0/601469765 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5fe815c5b0 msgr2=0x7f5fe815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fe67fc700 1 --2- 172.21.2.102:0/601469765 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5fe815c5b0 0x7f5fe815ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:17.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.216+0000 7f5fe67fc700 1 -- 172.21.2.102:0/601469765 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe80b4fd0 con 0x7f5fe815dbe0 2021-02-12T17:16:17.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.217+0000 7f5fe67fc700 1 --2- 172.21.2.102:0/601469765 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5fe815dbe0 0x7f5fe80b0690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f5fe80b6e00 tx=0x7f5fd0013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:17.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.217+0000 7f5fdeffd700 1 -- 172.21.2.102:0/601469765 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd000c140 con 0x7f5fe815dbe0 2021-02-12T17:16:17.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.217+0000 7f5fdeffd700 1 -- 172.21.2.102:0/601469765 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0018070 con 0x7f5fe815dbe0 2021-02-12T17:16:17.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.217+0000 7f5fed461700 1 -- 172.21.2.102:0/601469765 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe815d200 con 0x7f5fe815dbe0 2021-02-12T17:16:17.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.217+0000 7f5fdeffd700 1 -- 172.21.2.102:0/601469765 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0013870 con 0x7f5fe815dbe0 2021-02-12T17:16:17.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.217+0000 7f5fed461700 1 -- 172.21.2.102:0/601469765 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe815d740 con 0x7f5fe815dbe0 2021-02-12T17:16:17.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.218+0000 7f5fed461700 1 -- 172.21.2.102:0/601469765 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe8045460 con 0x7f5fe815dbe0 2021-02-12T17:16:17.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.218+0000 7f5fdeffd700 1 -- 172.21.2.102:0/601469765 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f5fd0010070 con 0x7f5fe815dbe0 2021-02-12T17:16:17.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.218+0000 7f5fdeffd700 1 --2- 172.21.2.102:0/601469765 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5fcc059d30 0x7f5fcc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.218+0000 7f5fdeffd700 1 -- 172.21.2.102:0/601469765 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f5fd0074d80 con 0x7f5fe815dbe0 2021-02-12T17:16:17.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.218+0000 7f5fe6ffd700 1 --2- 172.21.2.102:0/601469765 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5fcc059d30 0x7f5fcc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.218+0000 7f5fe6ffd700 1 --2- 172.21.2.102:0/601469765 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5fcc059d30 0x7f5fcc05c1f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5fe80af6e0 tx=0x7f5fd8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:17.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.221+0000 7f5fdeffd700 1 -- 172.21.2.102:0/601469765 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f5fd00485b0 con 0x7f5fe815dbe0 2021-02-12T17:16:17.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.351+0000 7f5fed461700 1 -- 172.21.2.102:0/601469765 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5fe8063670 con 0x7f5fe815dbe0 2021-02-12T17:16:17.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.351+0000 7f5fdeffd700 1 -- 172.21.2.102:0/601469765 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5fd0076030 con 0x7f5fe815dbe0 2021-02-12T17:16:17.353 INFO:teuthology.orchestra.run.gibba002.stdout:55834574854 2021-02-12T17:16:17.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.352+0000 7f5fed461700 1 -- 172.21.2.102:0/601469765 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5fcc059d30 msgr2=0x7f5fcc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.352+0000 7f5fed461700 1 --2- 172.21.2.102:0/601469765 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5fcc059d30 0x7f5fcc05c1f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5fe80af6e0 tx=0x7f5fd8008040).stop 2021-02-12T17:16:17.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.352+0000 7f5fed461700 1 -- 172.21.2.102:0/601469765 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5fe815dbe0 msgr2=0x7f5fe80b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.352+0000 7f5fed461700 1 --2- 172.21.2.102:0/601469765 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5fe815dbe0 0x7f5fe80b0690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f5fe80b6e00 tx=0x7f5fd0013000).stop 2021-02-12T17:16:17.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.352+0000 7f5fed461700 1 -- 172.21.2.102:0/601469765 shutdown_connections 2021-02-12T17:16:17.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.352+0000 7f5fed461700 1 --2- 172.21.2.102:0/601469765 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5fe815c5b0 0x7f5fe815ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:17.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.352+0000 7f5fed461700 1 --2- 172.21.2.102:0/601469765 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5fe80b70c0 0x7f5fe8152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:17.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.352+0000 7f5fed461700 1 --2- 172.21.2.102:0/601469765 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5fcc059d30 0x7f5fcc05c1f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.352+0000 7f5fed461700 1 --2- 172.21.2.102:0/601469765 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5fe815dbe0 0x7f5fe80b0690 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.352+0000 7f5fed461700 1 -- 172.21.2.102:0/601469765 >> 172.21.2.102:0/601469765 conn(0x7f5fe80bc480 msgr2=0x7f5fe80b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:17.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.352+0000 7f5fed461700 1 -- 172.21.2.102:0/601469765 shutdown_connections 2021-02-12T17:16:17.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.352+0000 7f5fed461700 1 -- 172.21.2.102:0/601469765 wait complete. 2021-02-12T17:16:17.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2021-02-12T17:16:17.362 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-02-12T17:16:17.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.450+0000 7feda1421700 1 Processor -- start 2021-02-12T17:16:17.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.450+0000 7feda1421700 1 -- start start 2021-02-12T17:16:17.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.450+0000 7feda1421700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fed9c0b8d20 0x7fed9c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.450+0000 7feda1421700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fed9c14e530 0x7fed9c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.450+0000 7feda1421700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fed9c062740 0x7fed9c062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.450+0000 7feda1421700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c068d20 con 0x7fed9c14e530 2021-02-12T17:16:17.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.450+0000 7feda1421700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c0622a0 con 0x7fed9c0b8d20 2021-02-12T17:16:17.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.450+0000 7feda1421700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c14ea10 con 0x7fed9c062740 2021-02-12T17:16:17.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.451+0000 7fed9a7fc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fed9c14e530 0x7fed9c0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.451+0000 7fed9a7fc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fed9c14e530 0x7fed9c0b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44984/0 (socket says 172.21.2.102:44984) 2021-02-12T17:16:17.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.451+0000 7fed9a7fc700 1 -- 172.21.2.102:0/2847760492 learned_addr learned my addr 172.21.2.102:0/2847760492 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:17.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.451+0000 7fed9affd700 1 --2- 172.21.2.102:0/2847760492 >> v2:172.21.2.104:3300/0 conn(0x7fed9c0b8d20 0x7fed9c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.451+0000 7fed9b7fe700 1 --2- 172.21.2.102:0/2847760492 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fed9c062740 0x7fed9c062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.451+0000 7fed9a7fc700 1 -- 172.21.2.102:0/2847760492 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fed9c062740 msgr2=0x7fed9c062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:17.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.451+0000 7fed9a7fc700 1 --2- 172.21.2.102:0/2847760492 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fed9c062740 0x7fed9c062bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.451+0000 7fed9a7fc700 1 -- 172.21.2.102:0/2847760492 >> v2:172.21.2.104:3300/0 conn(0x7fed9c0b8d20 msgr2=0x7fed9c068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:17.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.451+0000 7fed9a7fc700 1 --2- 172.21.2.102:0/2847760492 >> v2:172.21.2.104:3300/0 conn(0x7fed9c0b8d20 0x7fed9c068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.451+0000 7fed9a7fc700 1 -- 172.21.2.102:0/2847760492 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c0b63f0 con 0x7fed9c14e530 2021-02-12T17:16:17.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.451+0000 7fed9a7fc700 1 --2- 172.21.2.102:0/2847760492 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fed9c14e530 0x7fed9c0b7250 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fed9c06abc0 tx=0x7fed84006ea0).ready entity=mon.0 client_cookie=a0011699cee3c62f server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:17.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.451+0000 7fed99ffb700 1 -- 172.21.2.102:0/2847760492 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84009840 con 0x7fed9c14e530 2021-02-12T17:16:17.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.451+0000 7fed99ffb700 1 -- 172.21.2.102:0/2847760492 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed840099a0 con 0x7fed9c14e530 2021-02-12T17:16:17.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.452+0000 7fed99ffb700 1 -- 172.21.2.102:0/2847760492 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84009d20 con 0x7fed9c14e530 2021-02-12T17:16:17.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.452+0000 7feda1421700 1 -- 172.21.2.102:0/2847760492 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fed9c14e530 msgr2=0x7fed9c0b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.452+0000 7feda1421700 1 --2- 172.21.2.102:0/2847760492 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fed9c14e530 0x7fed9c0b7250 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fed9c06abc0 tx=0x7fed84006ea0).stop 2021-02-12T17:16:17.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.452+0000 7feda1421700 1 -- 172.21.2.102:0/2847760492 shutdown_connections 2021-02-12T17:16:17.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.452+0000 7feda1421700 1 --2- 172.21.2.102:0/2847760492 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fed9c062740 0x7fed9c062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.452+0000 7feda1421700 1 --2- 172.21.2.102:0/2847760492 >> v2:172.21.2.104:3300/0 conn(0x7fed9c0b8d20 0x7fed9c068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.452+0000 7feda1421700 1 --2- 172.21.2.102:0/2847760492 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fed9c14e530 0x7fed9c0b7250 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.452+0000 7feda1421700 1 -- 172.21.2.102:0/2847760492 >> 172.21.2.102:0/2847760492 conn(0x7fed9c0bc480 msgr2=0x7fed9c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:17.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.452+0000 7feda1421700 1 -- 172.21.2.102:0/2847760492 shutdown_connections 2021-02-12T17:16:17.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.452+0000 7feda1421700 1 -- 172.21.2.102:0/2847760492 wait complete. 2021-02-12T17:16:17.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.453+0000 7feda1421700 1 Processor -- start 2021-02-12T17:16:17.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.453+0000 7feda1421700 1 -- start start 2021-02-12T17:16:17.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.453+0000 7feda1421700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fed9c062740 0x7fed9c0b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.453+0000 7feda1421700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fed9c0b8d20 0x7fed9c0b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.453+0000 7feda1421700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fed9c14e530 0x7fed9c15d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.453+0000 7feda1421700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c11d3b0 con 0x7fed9c0b8d20 2021-02-12T17:16:17.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.453+0000 7feda1421700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0ae4f0 con 0x7fed9c14e530 2021-02-12T17:16:17.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.453+0000 7feda1421700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c11d5a0 con 0x7fed9c062740 2021-02-12T17:16:17.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed9a7fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fed9c0b8d20 0x7fed9c0b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed9a7fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fed9c0b8d20 0x7fed9c0b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:44992/0 (socket says 172.21.2.102:44992) 2021-02-12T17:16:17.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed9a7fc700 1 -- 172.21.2.102:0/3394604078 learned_addr learned my addr 172.21.2.102:0/3394604078 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:17.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed9b7fe700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fed9c14e530 0x7fed9c15d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed9affd700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fed9c062740 0x7fed9c0b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed9a7fc700 1 -- 172.21.2.102:0/3394604078 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fed9c062740 msgr2=0x7fed9c0b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed9a7fc700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fed9c062740 0x7fed9c0b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed9a7fc700 1 -- 172.21.2.102:0/3394604078 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fed9c14e530 msgr2=0x7fed9c15d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed9a7fc700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fed9c14e530 0x7fed9c15d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed9a7fc700 1 -- 172.21.2.102:0/3394604078 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c11d840 con 0x7fed9c0b8d20 2021-02-12T17:16:17.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed9affd700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fed9c062740 0x7fed9c0b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:17.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed9a7fc700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fed9c0b8d20 0x7fed9c0b4cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fed840093a0 tx=0x7fed84016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:17.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed92ffd700 1 -- 172.21.2.102:0/3394604078 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84006880 con 0x7fed9c0b8d20 2021-02-12T17:16:17.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed92ffd700 1 -- 172.21.2.102:0/3394604078 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed84012e70 con 0x7fed9c0b8d20 2021-02-12T17:16:17.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7feda1421700 1 -- 172.21.2.102:0/3394604078 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c0ae720 con 0x7fed9c0b8d20 2021-02-12T17:16:17.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7fed92ffd700 1 -- 172.21.2.102:0/3394604078 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8401c630 con 0x7fed9c0b8d20 2021-02-12T17:16:17.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.454+0000 7feda1421700 1 -- 172.21.2.102:0/3394604078 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c13fda0 con 0x7fed9c0b8d20 2021-02-12T17:16:17.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.455+0000 7feda1421700 1 -- 172.21.2.102:0/3394604078 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c0aeb80 con 0x7fed9c0b8d20 2021-02-12T17:16:17.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.455+0000 7fed92ffd700 1 -- 172.21.2.102:0/3394604078 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fed8400f070 con 0x7fed9c0b8d20 2021-02-12T17:16:17.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.455+0000 7fed92ffd700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fed80059d30 0x7fed8005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.456+0000 7fed92ffd700 1 -- 172.21.2.102:0/3394604078 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fed840753e0 con 0x7fed9c0b8d20 2021-02-12T17:16:17.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.456+0000 7fed9affd700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fed80059d30 0x7fed8005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.456+0000 7fed9affd700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fed80059d30 0x7fed8005c1f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fed8c006fd0 tx=0x7fed8c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:17.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.458+0000 7fed92ffd700 1 -- 172.21.2.102:0/3394604078 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fed84048b00 con 0x7fed9c0b8d20 2021-02-12T17:16:17.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.587+0000 7feda1421700 1 -- 172.21.2.102:0/3394604078 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fed9c045460 con 0x7fed9c0b8d20 2021-02-12T17:16:17.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.587+0000 7fed92ffd700 1 -- 172.21.2.102:0/3394604078 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed8401c9e0 con 0x7fed9c0b8d20 2021-02-12T17:16:17.589 INFO:teuthology.orchestra.run.gibba002.stdout:55834574854 2021-02-12T17:16:17.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.589+0000 7feda1421700 1 -- 172.21.2.102:0/3394604078 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fed80059d30 msgr2=0x7fed8005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.589+0000 7feda1421700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fed80059d30 0x7fed8005c1f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fed8c006fd0 tx=0x7fed8c008040).stop 2021-02-12T17:16:17.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.589+0000 7feda1421700 1 -- 172.21.2.102:0/3394604078 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fed9c0b8d20 msgr2=0x7fed9c0b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.589+0000 7feda1421700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fed9c0b8d20 0x7fed9c0b4cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fed840093a0 tx=0x7fed84016000).stop 2021-02-12T17:16:17.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.589+0000 7feda1421700 1 -- 172.21.2.102:0/3394604078 shutdown_connections 2021-02-12T17:16:17.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.589+0000 7feda1421700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fed9c14e530 0x7fed9c15d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.589+0000 7feda1421700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fed9c062740 0x7fed9c0b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.589+0000 7feda1421700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fed80059d30 0x7fed8005c1f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.589+0000 7feda1421700 1 --2- 172.21.2.102:0/3394604078 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fed9c0b8d20 0x7fed9c0b4cd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.589+0000 7feda1421700 1 -- 172.21.2.102:0/3394604078 >> 172.21.2.102:0/3394604078 conn(0x7fed9c0bc480 msgr2=0x7fed9c0b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:17.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.589+0000 7feda1421700 1 -- 172.21.2.102:0/3394604078 shutdown_connections 2021-02-12T17:16:17.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.589+0000 7feda1421700 1 -- 172.21.2.102:0/3394604078 wait complete. 2021-02-12T17:16:17.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2021-02-12T17:16:17.599 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-02-12T17:16:17.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.686+0000 7f378fb84700 1 Processor -- start 2021-02-12T17:16:17.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.686+0000 7f378fb84700 1 -- start start 2021-02-12T17:16:17.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.686+0000 7f378fb84700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f378814e530 0x7f3788068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.686+0000 7f378fb84700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37880b7960 con 0x7f3788062740 2021-02-12T17:16:17.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378fb84700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37880622a0 con 0x7f37880b8d20 2021-02-12T17:16:17.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378fb84700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3788068d20 con 0x7f378814e530 2021-02-12T17:16:17.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378e121700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f3788062740 0x7f3788062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53644/0 (socket says 172.21.2.102:53644) 2021-02-12T17:16:17.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378e121700 1 -- 172.21.2.102:0/2220696052 learned_addr learned my addr 172.21.2.102:0/2220696052 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:17.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378d11f700 1 --2- 172.21.2.102:0/2220696052 >> v2:172.21.2.104:3300/0 conn(0x7f378814e530 0x7f3788068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 -- 172.21.2.102:0/2220696052 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247943821 0 0) 0x7f37880b7960 con 0x7f3788062740 2021-02-12T17:16:17.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 -- 172.21.2.102:0/2220696052 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3770003230 con 0x7f3788062740 2021-02-12T17:16:17.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 -- 172.21.2.102:0/2220696052 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 269033640 0 0) 0x7f3770003230 con 0x7f3788062740 2021-02-12T17:16:17.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 -- 172.21.2.102:0/2220696052 >> v2:172.21.2.104:3300/0 conn(0x7f378814e530 msgr2=0x7f3788068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:17.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 --2- 172.21.2.102:0/2220696052 >> v2:172.21.2.104:3300/0 conn(0x7f378814e530 0x7f3788068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 -- 172.21.2.102:0/2220696052 >> v1:172.21.2.104:6789/0 conn(0x7f37880b8d20 legacy=0x7f37880b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 -- 172.21.2.102:0/2220696052 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378814ea10 con 0x7f3788062740 2021-02-12T17:16:17.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 -- 172.21.2.102:0/2220696052 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f3780001860 con 0x7f3788062740 2021-02-12T17:16:17.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 -- 172.21.2.102:0/2220696052 >> v1:172.21.2.102:6789/0 conn(0x7f3788062740 legacy=0x7f3788062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 --2- 172.21.2.102:0/2220696052 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3770003770 0x7f3770003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 --2- 172.21.2.102:0/2220696052 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f37700044d0 0x7f3770004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 --2- 172.21.2.102:0/2220696052 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3770004e40 0x7f377000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 -- 172.21.2.102:0/2220696052 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3788068d20 con 0x7f3770004e40 2021-02-12T17:16:17.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 -- 172.21.2.102:0/2220696052 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3770005320 con 0x7f37700044d0 2021-02-12T17:16:17.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378c91e700 1 -- 172.21.2.102:0/2220696052 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377000bc10 con 0x7f3770003770 2021-02-12T17:16:17.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.687+0000 7f378e121700 1 --2- 172.21.2.102:0/2220696052 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3770004e40 0x7f377000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378e121700 1 -- 172.21.2.102:0/2220696052 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3770003770 msgr2=0x7f3770003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:17.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378e121700 1 --2- 172.21.2.102:0/2220696052 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3770003770 0x7f3770003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:17.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378e121700 1 -- 172.21.2.102:0/2220696052 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f37700044d0 msgr2=0x7f3770004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:17.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378e121700 1 --2- 172.21.2.102:0/2220696052 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f37700044d0 0x7f3770004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:17.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378e121700 1 -- 172.21.2.102:0/2220696052 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3770003230 con 0x7f3770004e40 2021-02-12T17:16:17.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378e121700 1 -- 172.21.2.102:0/2220696052 reap_dead start 2021-02-12T17:16:17.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378e121700 1 --2- 172.21.2.102:0/2220696052 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3770004e40 0x7f377000b720 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f378000c600 tx=0x7f378814eba0).ready entity=mon.0 client_cookie=7813b25f49fa3185 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:17.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378c91e700 1 -- 172.21.2.102:0/2220696052 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3780005b70 con 0x7f3770004e40 2021-02-12T17:16:17.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378c91e700 1 -- 172.21.2.102:0/2220696052 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3780005cd0 con 0x7f3770004e40 2021-02-12T17:16:17.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378c91e700 1 -- 172.21.2.102:0/2220696052 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37800072e0 con 0x7f3770004e40 2021-02-12T17:16:17.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378fb84700 1 -- 172.21.2.102:0/2220696052 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3770004e40 msgr2=0x7f377000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378fb84700 1 --2- 172.21.2.102:0/2220696052 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3770004e40 0x7f377000b720 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f378000c600 tx=0x7f378814eba0).stop 2021-02-12T17:16:17.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378fb84700 1 -- 172.21.2.102:0/2220696052 shutdown_connections 2021-02-12T17:16:17.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378fb84700 1 --2- 172.21.2.102:0/2220696052 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3770004e40 0x7f377000b720 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378fb84700 1 -- 172.21.2.102:0/2220696052 >> 172.21.2.102:0/2220696052 conn(0x7f37880bc480 msgr2=0x7f37880b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:17.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378fb84700 1 -- 172.21.2.102:0/2220696052 shutdown_connections 2021-02-12T17:16:17.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.688+0000 7f378fb84700 1 -- 172.21.2.102:0/2220696052 wait complete. 2021-02-12T17:16:17.695 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.689+0000 7f378fb84700 1 Processor -- start 2021-02-12T17:16:17.695 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.689+0000 7f378fb84700 1 -- start start 2021-02-12T17:16:17.695 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378fb84700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3770004e40 0x7f3788161400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.695 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378fb84700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f37880b2260 0x7f37881524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.695 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378fb84700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f37880b4c00 0x7f378815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.695 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378fb84700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37880b5330 con 0x7f37880b2260 2021-02-12T17:16:17.695 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378fb84700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3788160a20 con 0x7f3770004e40 2021-02-12T17:16:17.695 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378fb84700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3788160cc0 con 0x7f37880b4c00 2021-02-12T17:16:17.695 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378e121700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f37880b4c00 0x7f378815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378e121700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f37880b4c00 0x7f378815d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.102:47158/0 (socket says 172.21.2.102:47158) 2021-02-12T17:16:17.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378e121700 1 -- 172.21.2.102:0/3391866689 learned_addr learned my addr 172.21.2.102:0/3391866689 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:17.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378d11f700 1 --2- 172.21.2.102:0/3391866689 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f37880b2260 0x7f37881524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378d920700 1 --2- 172.21.2.102:0/3391866689 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3770004e40 0x7f3788161400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378d11f700 1 -- 172.21.2.102:0/3391866689 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f37880b4c00 msgr2=0x7f378815d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378d11f700 1 --2- 172.21.2.102:0/3391866689 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f37880b4c00 0x7f378815d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378d11f700 1 -- 172.21.2.102:0/3391866689 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3770004e40 msgr2=0x7f3788161400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378d11f700 1 --2- 172.21.2.102:0/3391866689 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3770004e40 0x7f3788161400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378d11f700 1 -- 172.21.2.102:0/3391866689 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3788160f60 con 0x7f37880b2260 2021-02-12T17:16:17.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378d11f700 1 --2- 172.21.2.102:0/3391866689 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f37880b2260 0x7f37881524b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f378400e850 tx=0x7f3784006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:17.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f3775ffb700 1 -- 172.21.2.102:0/3391866689 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784010590 con 0x7f37880b2260 2021-02-12T17:16:17.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f3775ffb700 1 -- 172.21.2.102:0/3391866689 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37840106f0 con 0x7f37880b2260 2021-02-12T17:16:17.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378fb84700 1 -- 172.21.2.102:0/3391866689 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37880b0b80 con 0x7f37880b2260 2021-02-12T17:16:17.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f3775ffb700 1 -- 172.21.2.102:0/3391866689 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784010a70 con 0x7f37880b2260 2021-02-12T17:16:17.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.690+0000 7f378fb84700 1 -- 172.21.2.102:0/3391866689 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37881529a0 con 0x7f37880b2260 2021-02-12T17:16:17.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.691+0000 7f378fb84700 1 -- 172.21.2.102:0/3391866689 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37881610f0 con 0x7f37880b2260 2021-02-12T17:16:17.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.691+0000 7f3775ffb700 1 -- 172.21.2.102:0/3391866689 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f378401b400 con 0x7f37880b2260 2021-02-12T17:16:17.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.691+0000 7f3775ffb700 1 --2- 172.21.2.102:0/3391866689 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3768059d30 0x7f376805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.691+0000 7f3775ffb700 1 -- 172.21.2.102:0/3391866689 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f3784073b60 con 0x7f37880b2260 2021-02-12T17:16:17.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.692+0000 7f378d920700 1 --2- 172.21.2.102:0/3391866689 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3768059d30 0x7f376805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.692+0000 7f378d920700 1 --2- 172.21.2.102:0/3391866689 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3768059d30 0x7f376805c1f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f3778000f20 tx=0x7f3778009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:17.698 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.694+0000 7f3775ffb700 1 -- 172.21.2.102:0/3391866689 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f37840473e0 con 0x7f37880b2260 2021-02-12T17:16:17.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.824+0000 7f378fb84700 1 -- 172.21.2.102:0/3391866689 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3788045460 con 0x7f37880b2260 2021-02-12T17:16:17.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.824+0000 7f3775ffb700 1 -- 172.21.2.102:0/3391866689 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f378404aa00 con 0x7f37880b2260 2021-02-12T17:16:17.826 INFO:teuthology.orchestra.run.gibba002.stdout:55834574855 2021-02-12T17:16:17.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.826+0000 7f378fb84700 1 -- 172.21.2.102:0/3391866689 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3768059d30 msgr2=0x7f376805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.826+0000 7f378fb84700 1 --2- 172.21.2.102:0/3391866689 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3768059d30 0x7f376805c1f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f3778000f20 tx=0x7f3778009040).stop 2021-02-12T17:16:17.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.826+0000 7f378fb84700 1 -- 172.21.2.102:0/3391866689 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f37880b2260 msgr2=0x7f37881524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.826+0000 7f378fb84700 1 --2- 172.21.2.102:0/3391866689 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f37880b2260 0x7f37881524b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f378400e850 tx=0x7f3784006de0).stop 2021-02-12T17:16:17.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.826+0000 7f378fb84700 1 -- 172.21.2.102:0/3391866689 shutdown_connections 2021-02-12T17:16:17.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.826+0000 7f378fb84700 1 --2- 172.21.2.102:0/3391866689 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f37880b4c00 0x7f378815d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.826+0000 7f378fb84700 1 --2- 172.21.2.102:0/3391866689 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3770004e40 0x7f3788161400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.826+0000 7f378fb84700 1 --2- 172.21.2.102:0/3391866689 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3768059d30 0x7f376805c1f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.826+0000 7f378fb84700 1 --2- 172.21.2.102:0/3391866689 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f37880b2260 0x7f37881524b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.826+0000 7f378fb84700 1 -- 172.21.2.102:0/3391866689 >> 172.21.2.102:0/3391866689 conn(0x7f37880bc480 msgr2=0x7f378814cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:17.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.826+0000 7f378fb84700 1 -- 172.21.2.102:0/3391866689 shutdown_connections 2021-02-12T17:16:17.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.826+0000 7f378fb84700 1 -- 172.21.2.102:0/3391866689 wait complete. 2021-02-12T17:16:17.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2021-02-12T17:16:17.836 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-02-12T17:16:17.924 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.922+0000 7f17b13a6700 1 Processor -- start 2021-02-12T17:16:17.924 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.922+0000 7f17b13a6700 1 -- start start 2021-02-12T17:16:17.925 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.923+0000 7f17b13a6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f17ac0b6350 0x7f17ac1463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.925 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.923+0000 7f17b13a6700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac0b2930 con 0x7f17ac144ea0 2021-02-12T17:16:17.925 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.923+0000 7f17b13a6700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac0b67b0 con 0x7f17ac067720 2021-02-12T17:16:17.925 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.923+0000 7f17b13a6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac068980 con 0x7f17ac0b6350 2021-02-12T17:16:17.925 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.923+0000 7f17ab7fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f17ac144ea0 0x7f17ac145330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53662/0 (socket says 172.21.2.102:53662) 2021-02-12T17:16:17.925 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.923+0000 7f17ab7fe700 1 -- 172.21.2.102:0/2697919002 learned_addr learned my addr 172.21.2.102:0/2697919002 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:17.925 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.923+0000 7f17a9ffb700 1 -- 172.21.2.102:0/2697919002 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539656799 0 0) 0x7f17a4001450 con 0x7f17ac144ea0 2021-02-12T17:16:17.925 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 -- 172.21.2.102:0/2697919002 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1798003230 con 0x7f17ac144ea0 2021-02-12T17:16:17.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17aa7fc700 1 --2- 172.21.2.102:0/2697919002 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f17ac0b6350 0x7f17ac1463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 -- 172.21.2.102:0/2697919002 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2945128885 0 0) 0x7f1798003230 con 0x7f17ac144ea0 2021-02-12T17:16:17.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 -- 172.21.2.102:0/2697919002 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f17ac0b6350 msgr2=0x7f17ac1463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:17.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 --2- 172.21.2.102:0/2697919002 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f17ac0b6350 0x7f17ac1463a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 -- 172.21.2.102:0/2697919002 >> v1:172.21.2.104:6789/0 conn(0x7f17ac067720 legacy=0x7f17ac062580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:17.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 -- 172.21.2.102:0/2697919002 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac066db0 con 0x7f17ac144ea0 2021-02-12T17:16:17.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 -- 172.21.2.102:0/2697919002 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f17a40019f0 con 0x7f17ac144ea0 2021-02-12T17:16:17.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 -- 172.21.2.102:0/2697919002 >> v1:172.21.2.102:6789/0 conn(0x7f17ac144ea0 legacy=0x7f17ac145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 --2- 172.21.2.102:0/2697919002 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f17980037d0 0x7f1798003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 --2- 172.21.2.102:0/2697919002 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f17980044d0 0x7f1798004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 --2- 172.21.2.102:0/2697919002 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f17ac0b6350 0x7f1798004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 -- 172.21.2.102:0/2697919002 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac068980 con 0x7f17980037d0 2021-02-12T17:16:17.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 -- 172.21.2.102:0/2697919002 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1798005330 con 0x7f17980044d0 2021-02-12T17:16:17.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 -- 172.21.2.102:0/2697919002 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1798007700 con 0x7f17ac0b6350 2021-02-12T17:16:17.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17aaffd700 1 --2- 172.21.2.102:0/2697919002 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f17980037d0 0x7f1798003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17aa7fc700 1 --2- 172.21.2.102:0/2697919002 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f17980044d0 0x7f1798004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17ab7fe700 1 --2- 172.21.2.102:0/2697919002 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f17ac0b6350 0x7f1798004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.930 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17aaffd700 1 -- 172.21.2.102:0/2697919002 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f17ac0b6350 msgr2=0x7f1798004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:17.930 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17aaffd700 1 --2- 172.21.2.102:0/2697919002 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f17ac0b6350 0x7f1798004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.930 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17aaffd700 1 -- 172.21.2.102:0/2697919002 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f17980044d0 msgr2=0x7f1798004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:17.930 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17aaffd700 1 --2- 172.21.2.102:0/2697919002 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f17980044d0 0x7f1798004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:17.930 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17aaffd700 1 -- 172.21.2.102:0/2697919002 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1798003230 con 0x7f17980037d0 2021-02-12T17:16:17.930 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17aaffd700 1 --2- 172.21.2.102:0/2697919002 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f17980037d0 0x7f1798003bd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f179c002860 tx=0x7f179c007b80).ready entity=mon.0 client_cookie=3a183b25b14649e0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:17.930 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 -- 172.21.2.102:0/2697919002 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c007020 con 0x7f17980037d0 2021-02-12T17:16:17.930 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 -- 172.21.2.102:0/2697919002 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c0071c0 con 0x7f17980037d0 2021-02-12T17:16:17.930 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.924+0000 7f17a9ffb700 1 -- 172.21.2.102:0/2697919002 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c00cab0 con 0x7f17980037d0 2021-02-12T17:16:17.930 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.925+0000 7f17b13a6700 1 -- 172.21.2.102:0/2697919002 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f17980037d0 msgr2=0x7f1798003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.930 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.925+0000 7f17b13a6700 1 --2- 172.21.2.102:0/2697919002 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f17980037d0 0x7f1798003bd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f179c002860 tx=0x7f179c007b80).stop 2021-02-12T17:16:17.930 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.925+0000 7f17ab7fe700 1 -- 172.21.2.102:0/2697919002 reap_dead start 2021-02-12T17:16:17.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.925+0000 7f17b13a6700 1 -- 172.21.2.102:0/2697919002 shutdown_connections 2021-02-12T17:16:17.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.925+0000 7f17b13a6700 1 -- 172.21.2.102:0/2697919002 >> 172.21.2.102:0/2697919002 conn(0x7f17ac0bc480 msgr2=0x7f17ac0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:17.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.925+0000 7f17b13a6700 1 -- 172.21.2.102:0/2697919002 shutdown_connections 2021-02-12T17:16:17.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.925+0000 7f17b13a6700 1 -- 172.21.2.102:0/2697919002 wait complete. 2021-02-12T17:16:17.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.926+0000 7f17b13a6700 1 Processor -- start 2021-02-12T17:16:17.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.926+0000 7f17b13a6700 1 -- start start 2021-02-12T17:16:17.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.926+0000 7f17b13a6700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f17980037d0 0x7f17ac160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.926+0000 7f17b13a6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f17ac0b4890 0x7f17ac160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.926+0000 7f17b13a6700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f17ac0aee90 0x7f17ac0af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.926+0000 7f17b13a6700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac0b54c0 con 0x7f17980037d0 2021-02-12T17:16:17.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.926+0000 7f17b13a6700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac1610f0 con 0x7f17ac0aee90 2021-02-12T17:16:17.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.926+0000 7f17b13a6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac0b2e50 con 0x7f17ac0b4890 2021-02-12T17:16:17.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.927+0000 7f17aaffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f17980037d0 0x7f17ac160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.927+0000 7f17aaffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f17980037d0 0x7f17ac160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45028/0 (socket says 172.21.2.102:45028) 2021-02-12T17:16:17.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.927+0000 7f17aaffd700 1 -- 172.21.2.102:0/442938418 learned_addr learned my addr 172.21.2.102:0/442938418 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:17.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.927+0000 7f17aaffd700 1 -- 172.21.2.102:0/442938418 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f17ac0b4890 msgr2=0x7f17ac160c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:17.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.927+0000 7f17aaffd700 1 --2- 172.21.2.102:0/442938418 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f17ac0b4890 0x7f17ac160c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:17.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.927+0000 7f17aaffd700 1 -- 172.21.2.102:0/442938418 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f17ac0aee90 msgr2=0x7f17ac0af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:17.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.927+0000 7f17aaffd700 1 --2- 172.21.2.102:0/442938418 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f17ac0aee90 0x7f17ac0af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:17.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.927+0000 7f17aaffd700 1 -- 172.21.2.102:0/442938418 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac0b5710 con 0x7f17980037d0 2021-02-12T17:16:17.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.927+0000 7f17aaffd700 1 --2- 172.21.2.102:0/442938418 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f17980037d0 0x7f17ac160710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f179c00c3c0 tx=0x7f179c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:17.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.927+0000 7f1792ffd700 1 -- 172.21.2.102:0/442938418 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c013ad0 con 0x7f17980037d0 2021-02-12T17:16:17.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.927+0000 7f1792ffd700 1 -- 172.21.2.102:0/442938418 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c013c30 con 0x7f17980037d0 2021-02-12T17:16:17.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.927+0000 7f1792ffd700 1 -- 172.21.2.102:0/442938418 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c020440 con 0x7f17980037d0 2021-02-12T17:16:17.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.927+0000 7f17b13a6700 1 -- 172.21.2.102:0/442938418 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ac0b59b0 con 0x7f17980037d0 2021-02-12T17:16:17.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.927+0000 7f17b13a6700 1 -- 172.21.2.102:0/442938418 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ac0b40e0 con 0x7f17980037d0 2021-02-12T17:16:17.934 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.928+0000 7f17b13a6700 1 -- 172.21.2.102:0/442938418 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ac0b54c0 con 0x7f17980037d0 2021-02-12T17:16:17.934 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.928+0000 7f1792ffd700 1 -- 172.21.2.102:0/442938418 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f179c026020 con 0x7f17980037d0 2021-02-12T17:16:17.934 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.928+0000 7f1792ffd700 1 --2- 172.21.2.102:0/442938418 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f178c059d30 0x7f178c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:17.934 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.929+0000 7f1792ffd700 1 -- 172.21.2.102:0/442938418 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f179c075530 con 0x7f17980037d0 2021-02-12T17:16:17.934 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.929+0000 7f17aa7fc700 1 --2- 172.21.2.102:0/442938418 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f178c059d30 0x7f178c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:17.934 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.929+0000 7f17aa7fc700 1 --2- 172.21.2.102:0/442938418 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f178c059d30 0x7f178c05c1f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f17ac0b3a50 tx=0x7f17a0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:17.934 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:17.931+0000 7f1792ffd700 1 -- 172.21.2.102:0/442938418 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f179c048c50 con 0x7f17980037d0 2021-02-12T17:16:18.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.060+0000 7f17b13a6700 1 -- 172.21.2.102:0/442938418 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f17ac0b3e00 con 0x7f17980037d0 2021-02-12T17:16:18.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.060+0000 7f1792ffd700 1 -- 172.21.2.102:0/442938418 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f179c007710 con 0x7f17980037d0 2021-02-12T17:16:18.062 INFO:teuthology.orchestra.run.gibba002.stdout:55834574855 2021-02-12T17:16:18.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.061+0000 7f17b13a6700 1 -- 172.21.2.102:0/442938418 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f178c059d30 msgr2=0x7f178c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.061+0000 7f17b13a6700 1 --2- 172.21.2.102:0/442938418 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f178c059d30 0x7f178c05c1f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f17ac0b3a50 tx=0x7f17a0008040).stop 2021-02-12T17:16:18.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.061+0000 7f17b13a6700 1 -- 172.21.2.102:0/442938418 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f17980037d0 msgr2=0x7f17ac160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.061+0000 7f17b13a6700 1 --2- 172.21.2.102:0/442938418 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f17980037d0 0x7f17ac160710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f179c00c3c0 tx=0x7f179c015000).stop 2021-02-12T17:16:18.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.062+0000 7f17b13a6700 1 -- 172.21.2.102:0/442938418 shutdown_connections 2021-02-12T17:16:18.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.062+0000 7f17b13a6700 1 --2- 172.21.2.102:0/442938418 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f17ac0aee90 0x7f17ac0af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.062+0000 7f17b13a6700 1 --2- 172.21.2.102:0/442938418 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f178c059d30 0x7f178c05c1f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.062+0000 7f17b13a6700 1 --2- 172.21.2.102:0/442938418 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f17980037d0 0x7f17ac160710 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.062+0000 7f17b13a6700 1 --2- 172.21.2.102:0/442938418 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f17ac0b4890 0x7f17ac160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.062+0000 7f17b13a6700 1 -- 172.21.2.102:0/442938418 >> 172.21.2.102:0/442938418 conn(0x7f17ac0bc480 msgr2=0x7f17ac0b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:18.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.062+0000 7f17b13a6700 1 -- 172.21.2.102:0/442938418 shutdown_connections 2021-02-12T17:16:18.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.062+0000 7f17b13a6700 1 -- 172.21.2.102:0/442938418 wait complete. 2021-02-12T17:16:18.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2021-02-12T17:16:18.072 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-02-12T17:16:18.165 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.159+0000 7f3593d9c700 1 Processor -- start 2021-02-12T17:16:18.165 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.160+0000 7f3593d9c700 1 -- start start 2021-02-12T17:16:18.165 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.160+0000 7f3593d9c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f358c14e530 0x7f358c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.165 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.160+0000 7f3593d9c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f358c062740 0x7f358c062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.160+0000 7f3593d9c700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358c0b7960 con 0x7f358c0b8d20 2021-02-12T17:16:18.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.160+0000 7f3593d9c700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358c068d20 con 0x7f358c062740 2021-02-12T17:16:18.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.160+0000 7f3593d9c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0622a0 con 0x7f358c14e530 2021-02-12T17:16:18.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.160+0000 7f3592339700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f358c062740 0x7f358c062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:18.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.160+0000 7f3592339700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f358c062740 0x7f358c062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45036/0 (socket says 172.21.2.102:45036) 2021-02-12T17:16:18.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.160+0000 7f3592339700 1 -- 172.21.2.102:0/138126400 learned_addr learned my addr 172.21.2.102:0/138126400 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:18.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3592339700 1 -- 172.21.2.102:0/138126400 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f358c14e530 msgr2=0x7f358c068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:18.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3592339700 1 --2- 172.21.2.102:0/138126400 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f358c14e530 0x7f358c068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3592339700 1 -- 172.21.2.102:0/138126400 >> v1:172.21.2.102:6789/0 conn(0x7f358c0b8d20 legacy=0x7f358c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3592339700 1 -- 172.21.2.102:0/138126400 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c14ea10 con 0x7f358c062740 2021-02-12T17:16:18.166 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3592339700 1 --2- 172.21.2.102:0/138126400 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f358c062740 0x7f358c062bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f3584009d50 tx=0x7f3584009290).ready entity=mon.0 client_cookie=40d64cefe75214d5 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:18.167 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3590b36700 1 -- 172.21.2.102:0/138126400 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358400bbf0 con 0x7f358c062740 2021-02-12T17:16:18.167 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3590b36700 1 -- 172.21.2.102:0/138126400 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358400bd50 con 0x7f358c062740 2021-02-12T17:16:18.167 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3590b36700 1 -- 172.21.2.102:0/138126400 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584011610 con 0x7f358c062740 2021-02-12T17:16:18.167 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3593d9c700 1 -- 172.21.2.102:0/138126400 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f358c062740 msgr2=0x7f358c062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.167 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3593d9c700 1 --2- 172.21.2.102:0/138126400 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f358c062740 0x7f358c062bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f3584009d50 tx=0x7f3584009290).stop 2021-02-12T17:16:18.167 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3593d9c700 1 -- 172.21.2.102:0/138126400 shutdown_connections 2021-02-12T17:16:18.167 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3593d9c700 1 --2- 172.21.2.102:0/138126400 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f358c062740 0x7f358c062bf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.167 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3593d9c700 1 --2- 172.21.2.102:0/138126400 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f358c14e530 0x7f358c068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.167 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3593d9c700 1 -- 172.21.2.102:0/138126400 >> 172.21.2.102:0/138126400 conn(0x7f358c0bc480 msgr2=0x7f358c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:18.167 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3593d9c700 1 -- 172.21.2.102:0/138126400 shutdown_connections 2021-02-12T17:16:18.167 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.161+0000 7f3593d9c700 1 -- 172.21.2.102:0/138126400 wait complete. 2021-02-12T17:16:18.167 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.162+0000 7f3593d9c700 1 Processor -- start 2021-02-12T17:16:18.167 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.162+0000 7f3593d9c700 1 -- start start 2021-02-12T17:16:18.168 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3593d9c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f358c062740 0x7f358c0acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.168 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3593d9c700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f358c0b8d20 0x7f358c0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.168 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3593d9c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f358c14e530 0x7f358c0ba480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.168 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3593d9c700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0ad400 con 0x7f358c14e530 2021-02-12T17:16:18.168 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3593d9c700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0b2690 con 0x7f358c0b8d20 2021-02-12T17:16:18.168 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3593d9c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0b1eb0 con 0x7f358c062740 2021-02-12T17:16:18.168 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3592339700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f358c14e530 0x7f358c0ba480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:18.168 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3592339700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f358c14e530 0x7f358c0ba480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45044/0 (socket says 172.21.2.102:45044) 2021-02-12T17:16:18.168 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3592339700 1 -- 172.21.2.102:0/3144838185 learned_addr learned my addr 172.21.2.102:0/3144838185 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:18.168 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3591b38700 1 --2- 172.21.2.102:0/3144838185 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f358c062740 0x7f358c0acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:18.168 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3592339700 1 -- 172.21.2.102:0/3144838185 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f358c062740 msgr2=0x7f358c0acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.168 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3592339700 1 --2- 172.21.2.102:0/3144838185 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f358c062740 0x7f358c0acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.168 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3592339700 1 -- 172.21.2.102:0/3144838185 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f358c0b8d20 msgr2=0x7f358c0b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.169 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3592339700 1 --2- 172.21.2.102:0/3144838185 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f358c0b8d20 0x7f358c0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.169 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3592339700 1 -- 172.21.2.102:0/3144838185 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c0b2150 con 0x7f358c14e530 2021-02-12T17:16:18.169 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3591b38700 1 --2- 172.21.2.102:0/3144838185 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f358c062740 0x7f358c0acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:18.169 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3592339700 1 --2- 172.21.2.102:0/3144838185 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f358c14e530 0x7f358c0ba480 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f3584006fd0 tx=0x7f3584017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:18.169 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f357dffb700 1 -- 172.21.2.102:0/3144838185 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358400bec0 con 0x7f358c14e530 2021-02-12T17:16:18.169 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f357dffb700 1 -- 172.21.2.102:0/3144838185 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3584011e20 con 0x7f358c14e530 2021-02-12T17:16:18.169 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f3593d9c700 1 -- 172.21.2.102:0/3144838185 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c0b23f0 con 0x7f358c14e530 2021-02-12T17:16:18.169 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.163+0000 7f357dffb700 1 -- 172.21.2.102:0/3144838185 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584010dd0 con 0x7f358c14e530 2021-02-12T17:16:18.169 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.164+0000 7f3593d9c700 1 -- 172.21.2.102:0/3144838185 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c0b1690 con 0x7f358c14e530 2021-02-12T17:16:18.170 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.164+0000 7f3593d9c700 1 -- 172.21.2.102:0/3144838185 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358c062580 con 0x7f358c14e530 2021-02-12T17:16:18.170 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.165+0000 7f357dffb700 1 -- 172.21.2.102:0/3144838185 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f358402b070 con 0x7f358c14e530 2021-02-12T17:16:18.170 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.165+0000 7f357dffb700 1 --2- 172.21.2.102:0/3144838185 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f356c059d30 0x7f356c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.171 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.165+0000 7f357dffb700 1 -- 172.21.2.102:0/3144838185 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f3584075de0 con 0x7f358c14e530 2021-02-12T17:16:18.171 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.165+0000 7f3591b38700 1 --2- 172.21.2.102:0/3144838185 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f356c059d30 0x7f356c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:18.171 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.165+0000 7f3591b38700 1 --2- 172.21.2.102:0/3144838185 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f356c059d30 0x7f356c05c1f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f35800014b0 tx=0x7f3580009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:18.171 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.168+0000 7f357dffb700 1 -- 172.21.2.102:0/3144838185 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f3584049610 con 0x7f358c14e530 2021-02-12T17:16:18.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.299+0000 7f3593d9c700 1 -- 172.21.2.102:0/3144838185 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f358c0b0ec0 con 0x7f358c14e530 2021-02-12T17:16:18.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.299+0000 7f357dffb700 1 -- 172.21.2.102:0/3144838185 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f358404cc30 con 0x7f358c14e530 2021-02-12T17:16:18.301 INFO:teuthology.orchestra.run.gibba002.stdout:55834574854 2021-02-12T17:16:18.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.300+0000 7f3593d9c700 1 -- 172.21.2.102:0/3144838185 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f356c059d30 msgr2=0x7f356c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.300+0000 7f3593d9c700 1 --2- 172.21.2.102:0/3144838185 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f356c059d30 0x7f356c05c1f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f35800014b0 tx=0x7f3580009040).stop 2021-02-12T17:16:18.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.300+0000 7f3593d9c700 1 -- 172.21.2.102:0/3144838185 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f358c14e530 msgr2=0x7f358c0ba480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.300+0000 7f3593d9c700 1 --2- 172.21.2.102:0/3144838185 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f358c14e530 0x7f358c0ba480 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f3584006fd0 tx=0x7f3584017000).stop 2021-02-12T17:16:18.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.300+0000 7f3593d9c700 1 -- 172.21.2.102:0/3144838185 shutdown_connections 2021-02-12T17:16:18.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.300+0000 7f3593d9c700 1 --2- 172.21.2.102:0/3144838185 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f356c059d30 0x7f356c05c1f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.300+0000 7f3593d9c700 1 --2- 172.21.2.102:0/3144838185 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f358c14e530 0x7f358c0ba480 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.300+0000 7f3593d9c700 1 --2- 172.21.2.102:0/3144838185 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f358c062740 0x7f358c0acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.300+0000 7f3593d9c700 1 --2- 172.21.2.102:0/3144838185 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f358c0b8d20 0x7f358c0b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.300+0000 7f3593d9c700 1 -- 172.21.2.102:0/3144838185 >> 172.21.2.102:0/3144838185 conn(0x7f358c0bc480 msgr2=0x7f358c151930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:18.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.301+0000 7f3593d9c700 1 -- 172.21.2.102:0/3144838185 shutdown_connections 2021-02-12T17:16:18.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.301+0000 7f3593d9c700 1 -- 172.21.2.102:0/3144838185 wait complete. 2021-02-12T17:16:18.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2021-02-12T17:16:18.311 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2021-02-12T17:16:18.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.399+0000 7f1bc7e30700 1 Processor -- start 2021-02-12T17:16:18.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.400+0000 7f1bc7e30700 1 -- start start 2021-02-12T17:16:18.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.400+0000 7f1bc7e30700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f1bc00b8d20 0x7f1bc0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.400+0000 7f1bc7e30700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f1bc014e530 0x7f1bc00b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.400+0000 7f1bc7e30700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc00622a0 con 0x7f1bc0062740 2021-02-12T17:16:18.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.400+0000 7f1bc7e30700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc0068d20 con 0x7f1bc00b8d20 2021-02-12T17:16:18.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.400+0000 7f1bc7e30700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc014ea10 con 0x7f1bc014e530 2021-02-12T17:16:18.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.400+0000 7f1bc5bcc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f1bc00b8d20 0x7f1bc0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:18.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.400+0000 7f1bc5bcc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f1bc00b8d20 0x7f1bc0068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45048/0 (socket says 172.21.2.102:45048) 2021-02-12T17:16:18.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.400+0000 7f1bc5bcc700 1 -- 172.21.2.102:0/1801588805 learned_addr learned my addr 172.21.2.102:0/1801588805 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:18.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc5bcc700 1 -- 172.21.2.102:0/1801588805 >> v2:172.21.2.104:3300/0 conn(0x7f1bc014e530 msgr2=0x7f1bc00b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:18.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc5bcc700 1 --2- 172.21.2.102:0/1801588805 >> v2:172.21.2.104:3300/0 conn(0x7f1bc014e530 0x7f1bc00b7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc5bcc700 1 -- 172.21.2.102:0/1801588805 >> v1:172.21.2.104:6789/0 conn(0x7f1bc0062740 legacy=0x7f1bc0062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:18.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc5bcc700 1 -- 172.21.2.102:0/1801588805 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc00b63f0 con 0x7f1bc00b8d20 2021-02-12T17:16:18.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc5bcc700 1 --2- 172.21.2.102:0/1801588805 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1bc00b8d20 0x7f1bc0068830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f1bc00654b0 tx=0x7f1bb0006ea0).ready entity=mon.0 client_cookie=3bc37750cc8fb104 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:18.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc4bca700 1 -- 172.21.2.102:0/1801588805 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0009800 con 0x7f1bc00b8d20 2021-02-12T17:16:18.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc4bca700 1 -- 172.21.2.102:0/1801588805 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb0009960 con 0x7f1bc00b8d20 2021-02-12T17:16:18.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc4bca700 1 -- 172.21.2.102:0/1801588805 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0009ce0 con 0x7f1bc00b8d20 2021-02-12T17:16:18.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1801588805 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1bc00b8d20 msgr2=0x7f1bc0068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc7e30700 1 --2- 172.21.2.102:0/1801588805 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1bc00b8d20 0x7f1bc0068830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f1bc00654b0 tx=0x7f1bb0006ea0).stop 2021-02-12T17:16:18.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1801588805 shutdown_connections 2021-02-12T17:16:18.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc7e30700 1 --2- 172.21.2.102:0/1801588805 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1bc00b8d20 0x7f1bc0068830 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc7e30700 1 --2- 172.21.2.102:0/1801588805 >> v2:172.21.2.104:3300/0 conn(0x7f1bc014e530 0x7f1bc00b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1801588805 >> 172.21.2.102:0/1801588805 conn(0x7f1bc00bc480 msgr2=0x7f1bc00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:18.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1801588805 shutdown_connections 2021-02-12T17:16:18.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.401+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1801588805 wait complete. 2021-02-12T17:16:18.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.402+0000 7f1bc7e30700 1 Processor -- start 2021-02-12T17:16:18.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.402+0000 7f1bc7e30700 1 -- start start 2021-02-12T17:16:18.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc7e30700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1bc0062740 0x7f1bc011d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc7e30700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1bc00b8d20 0x7f1bc011dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc7e30700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1bc014e530 0x7f1bc014ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc7e30700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc015e860 con 0x7f1bc00b8d20 2021-02-12T17:16:18.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc7e30700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc015dbe0 con 0x7f1bc0062740 2021-02-12T17:16:18.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc7e30700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc015de80 con 0x7f1bc014e530 2021-02-12T17:16:18.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc53cb700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1bc00b8d20 0x7f1bc011dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:18.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc53cb700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1bc00b8d20 0x7f1bc011dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45054/0 (socket says 172.21.2.102:45054) 2021-02-12T17:16:18.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc53cb700 1 -- 172.21.2.102:0/1290707848 learned_addr learned my addr 172.21.2.102:0/1290707848 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:18.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc53cb700 1 -- 172.21.2.102:0/1290707848 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1bc014e530 msgr2=0x7f1bc014ade0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:18.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc53cb700 1 --2- 172.21.2.102:0/1290707848 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1bc014e530 0x7f1bc014ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc53cb700 1 -- 172.21.2.102:0/1290707848 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1bc0062740 msgr2=0x7f1bc011d810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:18.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc53cb700 1 --2- 172.21.2.102:0/1290707848 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1bc0062740 0x7f1bc011d810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc53cb700 1 -- 172.21.2.102:0/1290707848 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc015e120 con 0x7f1bc00b8d20 2021-02-12T17:16:18.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc53cb700 1 --2- 172.21.2.102:0/1290707848 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1bc00b8d20 0x7f1bc011dd00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f1bbc0096e0 tx=0x7f1bbc006d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:18.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1badffb700 1 -- 172.21.2.102:0/1290707848 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc00d500 con 0x7f1bc00b8d20 2021-02-12T17:16:18.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1badffb700 1 -- 172.21.2.102:0/1290707848 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc000e90 con 0x7f1bc00b8d20 2021-02-12T17:16:18.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1badffb700 1 -- 172.21.2.102:0/1290707848 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc00d8d0 con 0x7f1bc00b8d20 2021-02-12T17:16:18.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1290707848 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc015e3c0 con 0x7f1bc00b8d20 2021-02-12T17:16:18.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.403+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1290707848 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc015d910 con 0x7f1bc00b8d20 2021-02-12T17:16:18.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.404+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1290707848 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc015e550 con 0x7f1bc00b8d20 2021-02-12T17:16:18.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.404+0000 7f1badffb700 1 -- 172.21.2.102:0/1290707848 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f1bbc00dc40 con 0x7f1bc00b8d20 2021-02-12T17:16:18.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.404+0000 7f1badffb700 1 --2- 172.21.2.102:0/1290707848 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1ba0059d30 0x7f1ba005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.405+0000 7f1badffb700 1 -- 172.21.2.102:0/1290707848 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f1bbc0734f0 con 0x7f1bc00b8d20 2021-02-12T17:16:18.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.405+0000 7f1bc5bcc700 1 --2- 172.21.2.102:0/1290707848 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1ba0059d30 0x7f1ba005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:18.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.405+0000 7f1bc5bcc700 1 --2- 172.21.2.102:0/1290707848 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1ba0059d30 0x7f1ba005c1f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1bc00b2620 tx=0x7f1bb0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:18.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.407+0000 7f1badffb700 1 -- 172.21.2.102:0/1290707848 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f1bbc046bb0 con 0x7f1bc00b8d20 2021-02-12T17:16:18.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.538+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1290707848 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1bc0045460 con 0x7f1bc00b8d20 2021-02-12T17:16:18.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.538+0000 7f1badffb700 1 -- 172.21.2.102:0/1290707848 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1bbc04a1d0 con 0x7f1bc00b8d20 2021-02-12T17:16:18.539 INFO:teuthology.orchestra.run.gibba002.stdout:55834574855 2021-02-12T17:16:18.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.539+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1290707848 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1ba0059d30 msgr2=0x7f1ba005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.539+0000 7f1bc7e30700 1 --2- 172.21.2.102:0/1290707848 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1ba0059d30 0x7f1ba005c1f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1bc00b2620 tx=0x7f1bb0016000).stop 2021-02-12T17:16:18.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.539+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1290707848 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1bc00b8d20 msgr2=0x7f1bc011dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.539+0000 7f1bc7e30700 1 --2- 172.21.2.102:0/1290707848 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1bc00b8d20 0x7f1bc011dd00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f1bbc0096e0 tx=0x7f1bbc006d40).stop 2021-02-12T17:16:18.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.539+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1290707848 shutdown_connections 2021-02-12T17:16:18.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.539+0000 7f1bc7e30700 1 --2- 172.21.2.102:0/1290707848 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1bc014e530 0x7f1bc014ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.539+0000 7f1bc7e30700 1 --2- 172.21.2.102:0/1290707848 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1bc0062740 0x7f1bc011d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.539+0000 7f1bc7e30700 1 --2- 172.21.2.102:0/1290707848 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1ba0059d30 0x7f1ba005c1f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.539+0000 7f1bc7e30700 1 --2- 172.21.2.102:0/1290707848 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1bc00b8d20 0x7f1bc011dd00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.539+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1290707848 >> 172.21.2.102:0/1290707848 conn(0x7f1bc00bc480 msgr2=0x7f1bc014fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:18.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.539+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1290707848 shutdown_connections 2021-02-12T17:16:18.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.539+0000 7f1bc7e30700 1 -- 172.21.2.102:0/1290707848 wait complete. 2021-02-12T17:16:18.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2021-02-12T17:16:18.549 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2021-02-12T17:16:18.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.638+0000 7f15d5221700 1 Processor -- start 2021-02-12T17:16:18.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.638+0000 7f15d5221700 1 -- start start 2021-02-12T17:16:18.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.638+0000 7f15d5221700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f15d0149af0 0x7f15d0149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.638+0000 7f15d5221700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f15d0147f40 0x7f15d014a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.638+0000 7f15d5221700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d0068550 con 0x7f15d00b8bd0 2021-02-12T17:16:18.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.638+0000 7f15d5221700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d0067630 con 0x7f15d0149af0 2021-02-12T17:16:18.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.638+0000 7f15d5221700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00678d0 con 0x7f15d0147f40 2021-02-12T17:16:18.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.639+0000 7f15ce59c700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f15d00b8bd0 0x7f15d0147830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53708/0 (socket says 172.21.2.102:53708) 2021-02-12T17:16:18.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.639+0000 7f15ce59c700 1 -- 172.21.2.102:0/158255936 learned_addr learned my addr 172.21.2.102:0/158255936 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:18.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.639+0000 7f15ced9d700 1 --2- 172.21.2.102:0/158255936 >> v2:172.21.2.102:3300/0 conn(0x7f15d0149af0 0x7f15d0149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:18.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.639+0000 7f15ced9d700 1 -- 172.21.2.102:0/158255936 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f15d0147f40 msgr2=0x7f15d014a3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:18.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.639+0000 7f15ced9d700 1 --2- 172.21.2.102:0/158255936 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f15d0147f40 0x7f15d014a3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.639+0000 7f15ced9d700 1 -- 172.21.2.102:0/158255936 >> v1:172.21.2.102:6789/0 conn(0x7f15d00b8bd0 legacy=0x7f15d0147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.639+0000 7f15ced9d700 1 -- 172.21.2.102:0/158255936 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d0067b70 con 0x7f15d0149af0 2021-02-12T17:16:18.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.639+0000 7f15cdd9b700 1 -- 172.21.2.102:0/158255936 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177709640 0 0) 0x7f15d0068550 con 0x7f15d00b8bd0 2021-02-12T17:16:18.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.639+0000 7f15ced9d700 1 --2- 172.21.2.102:0/158255936 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f15d0149af0 0x7f15d0149ed0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f15c000b980 tx=0x7f15c0006de0).ready entity=mon.0 client_cookie=f5696d0a6349b267 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:18.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.639+0000 7f15cdd9b700 1 -- 172.21.2.102:0/158255936 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0009870 con 0x7f15d0149af0 2021-02-12T17:16:18.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.639+0000 7f15cdd9b700 1 -- 172.21.2.102:0/158255936 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c00099d0 con 0x7f15d0149af0 2021-02-12T17:16:18.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.639+0000 7f15cdd9b700 1 -- 172.21.2.102:0/158255936 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0009d50 con 0x7f15d0149af0 2021-02-12T17:16:18.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.640+0000 7f15d5221700 1 -- 172.21.2.102:0/158255936 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f15d0149af0 msgr2=0x7f15d0149ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.640+0000 7f15d5221700 1 --2- 172.21.2.102:0/158255936 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f15d0149af0 0x7f15d0149ed0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f15c000b980 tx=0x7f15c0006de0).stop 2021-02-12T17:16:18.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.640+0000 7f15d5221700 1 -- 172.21.2.102:0/158255936 shutdown_connections 2021-02-12T17:16:18.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.640+0000 7f15d5221700 1 --2- 172.21.2.102:0/158255936 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f15d0147f40 0x7f15d014a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.640+0000 7f15d5221700 1 --2- 172.21.2.102:0/158255936 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f15d0149af0 0x7f15d0149ed0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.640+0000 7f15d5221700 1 -- 172.21.2.102:0/158255936 >> 172.21.2.102:0/158255936 conn(0x7f15d00bc480 msgr2=0x7f15d00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:18.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.640+0000 7f15d5221700 1 -- 172.21.2.102:0/158255936 shutdown_connections 2021-02-12T17:16:18.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.640+0000 7f15d5221700 1 -- 172.21.2.102:0/158255936 wait complete. 2021-02-12T17:16:18.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.641+0000 7f15d5221700 1 Processor -- start 2021-02-12T17:16:18.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.641+0000 7f15d5221700 1 -- start start 2021-02-12T17:16:18.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.641+0000 7f15d5221700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f15d00b8bd0 0x7f15d00ba5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.641+0000 7f15d5221700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f15d0147f40 0x7f15d00aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.641+0000 7f15d5221700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f15d0149af0 0x7f15d00aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.641+0000 7f15d5221700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d015d2c0 con 0x7f15d00b8bd0 2021-02-12T17:16:18.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.641+0000 7f15d5221700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00b3b50 con 0x7f15d0147f40 2021-02-12T17:16:18.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.641+0000 7f15d5221700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00b1d00 con 0x7f15d0149af0 2021-02-12T17:16:18.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.641+0000 7f15ced9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f15d00b8bd0 0x7f15d00ba5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:18.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.641+0000 7f15ced9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f15d00b8bd0 0x7f15d00ba5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45072/0 (socket says 172.21.2.102:45072) 2021-02-12T17:16:18.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.641+0000 7f15ced9d700 1 -- 172.21.2.102:0/1476797387 learned_addr learned my addr 172.21.2.102:0/1476797387 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:18.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.642+0000 7f15ced9d700 1 -- 172.21.2.102:0/1476797387 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f15d0149af0 msgr2=0x7f15d00aef20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:18.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.642+0000 7f15ced9d700 1 --2- 172.21.2.102:0/1476797387 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f15d0149af0 0x7f15d00aef20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.642+0000 7f15ced9d700 1 -- 172.21.2.102:0/1476797387 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f15d0147f40 msgr2=0x7f15d00aea30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:18.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.642+0000 7f15ced9d700 1 --2- 172.21.2.102:0/1476797387 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f15d0147f40 0x7f15d00aea30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.642+0000 7f15ced9d700 1 -- 172.21.2.102:0/1476797387 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d00b3610 con 0x7f15d00b8bd0 2021-02-12T17:16:18.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.642+0000 7f15ced9d700 1 --2- 172.21.2.102:0/1476797387 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f15d00b8bd0 0x7f15d00ba5d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f15c0009340 tx=0x7f15c0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:18.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.642+0000 7f15c6ffd700 1 -- 172.21.2.102:0/1476797387 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c001c420 con 0x7f15d00b8bd0 2021-02-12T17:16:18.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.642+0000 7f15c6ffd700 1 -- 172.21.2.102:0/1476797387 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c001c5a0 con 0x7f15d00b8bd0 2021-02-12T17:16:18.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.642+0000 7f15d5221700 1 -- 172.21.2.102:0/1476797387 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d00b38b0 con 0x7f15d00b8bd0 2021-02-12T17:16:18.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.642+0000 7f15d5221700 1 -- 172.21.2.102:0/1476797387 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d0142bb0 con 0x7f15d00b8bd0 2021-02-12T17:16:18.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.642+0000 7f15c6ffd700 1 -- 172.21.2.102:0/1476797387 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c001c960 con 0x7f15d00b8bd0 2021-02-12T17:16:18.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.643+0000 7f15d5221700 1 -- 172.21.2.102:0/1476797387 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d0045460 con 0x7f15d00b8bd0 2021-02-12T17:16:18.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.643+0000 7f15c6ffd700 1 -- 172.21.2.102:0/1476797387 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f15c000f070 con 0x7f15d00b8bd0 2021-02-12T17:16:18.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.643+0000 7f15c6ffd700 1 --2- 172.21.2.102:0/1476797387 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f15b4059db0 0x7f15b405c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.643+0000 7f15c6ffd700 1 -- 172.21.2.102:0/1476797387 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f15c0075530 con 0x7f15d00b8bd0 2021-02-12T17:16:18.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.643+0000 7f15ce59c700 1 --2- 172.21.2.102:0/1476797387 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f15b4059db0 0x7f15b405c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:18.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.643+0000 7f15ce59c700 1 --2- 172.21.2.102:0/1476797387 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f15b4059db0 0x7f15b405c270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f15d00b9010 tx=0x7f15b8007600).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:18.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.646+0000 7f15c6ffd700 1 -- 172.21.2.102:0/1476797387 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f15c0048cd0 con 0x7f15d00b8bd0 2021-02-12T17:16:18.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.775+0000 7f15d5221700 1 -- 172.21.2.102:0/1476797387 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f15d01496b0 con 0x7f15d00b8bd0 2021-02-12T17:16:18.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.776+0000 7f15c6ffd700 1 -- 172.21.2.102:0/1476797387 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f15c004c2f0 con 0x7f15d00b8bd0 2021-02-12T17:16:18.777 INFO:teuthology.orchestra.run.gibba002.stdout:55834574854 2021-02-12T17:16:18.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.777+0000 7f15d5221700 1 -- 172.21.2.102:0/1476797387 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f15b4059db0 msgr2=0x7f15b405c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.777+0000 7f15d5221700 1 --2- 172.21.2.102:0/1476797387 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f15b4059db0 0x7f15b405c270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f15d00b9010 tx=0x7f15b8007600).stop 2021-02-12T17:16:18.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.777+0000 7f15d5221700 1 -- 172.21.2.102:0/1476797387 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f15d00b8bd0 msgr2=0x7f15d00ba5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.777+0000 7f15d5221700 1 --2- 172.21.2.102:0/1476797387 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f15d00b8bd0 0x7f15d00ba5d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f15c0009340 tx=0x7f15c0016000).stop 2021-02-12T17:16:18.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.777+0000 7f15d5221700 1 -- 172.21.2.102:0/1476797387 shutdown_connections 2021-02-12T17:16:18.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.777+0000 7f15d5221700 1 --2- 172.21.2.102:0/1476797387 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f15d0149af0 0x7f15d00aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.777+0000 7f15d5221700 1 --2- 172.21.2.102:0/1476797387 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f15b4059db0 0x7f15b405c270 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.777+0000 7f15d5221700 1 --2- 172.21.2.102:0/1476797387 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f15d00b8bd0 0x7f15d00ba5d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.777+0000 7f15d5221700 1 --2- 172.21.2.102:0/1476797387 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f15d0147f40 0x7f15d00aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.777+0000 7f15d5221700 1 -- 172.21.2.102:0/1476797387 >> 172.21.2.102:0/1476797387 conn(0x7f15d00bc480 msgr2=0x7f15d0066d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:18.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.777+0000 7f15d5221700 1 -- 172.21.2.102:0/1476797387 shutdown_connections 2021-02-12T17:16:18.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.777+0000 7f15d5221700 1 -- 172.21.2.102:0/1476797387 wait complete. 2021-02-12T17:16:18.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2021-02-12T17:16:18.787 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-02-12T17:16:18.787 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-02-12T17:16:18.874 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.873+0000 7f7347f44700 1 Processor -- start 2021-02-12T17:16:18.874 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.873+0000 7f7347f44700 1 -- start start 2021-02-12T17:16:18.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.873+0000 7f7347f44700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f73400b8d20 0x7f7340068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.873+0000 7f7347f44700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f7340062740 0x7f7340062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.873+0000 7f7347f44700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73400b7960 con 0x7f734014e530 2021-02-12T17:16:18.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.873+0000 7f7347f44700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7340068d20 con 0x7f7340062740 2021-02-12T17:16:18.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.874+0000 7f7347f44700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73400622a0 con 0x7f73400b8d20 2021-02-12T17:16:18.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.874+0000 7f73464e1700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f7340062740 0x7f7340062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:18.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.874+0000 7f73464e1700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f7340062740 0x7f7340062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45078/0 (socket says 172.21.2.102:45078) 2021-02-12T17:16:18.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.874+0000 7f73464e1700 1 -- 172.21.2.102:0/3373915880 learned_addr learned my addr 172.21.2.102:0/3373915880 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:18.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.874+0000 7f73464e1700 1 -- 172.21.2.102:0/3373915880 >> v2:172.21.2.104:3300/0 conn(0x7f73400b8d20 msgr2=0x7f7340068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:18.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.874+0000 7f73464e1700 1 --2- 172.21.2.102:0/3373915880 >> v2:172.21.2.104:3300/0 conn(0x7f73400b8d20 0x7f7340068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.874+0000 7f73464e1700 1 -- 172.21.2.102:0/3373915880 >> v1:172.21.2.104:6789/0 conn(0x7f734014e530 legacy=0x7f73400b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:18.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.874+0000 7f73464e1700 1 -- 172.21.2.102:0/3373915880 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734014ea10 con 0x7f7340062740 2021-02-12T17:16:18.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.874+0000 7f73464e1700 1 --2- 172.21.2.102:0/3373915880 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7340062740 0x7f7340062bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f734006abc0 tx=0x7f7338009290).ready entity=mon.0 client_cookie=31082b17da6a7288 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:18.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.874+0000 7f7344cde700 1 -- 172.21.2.102:0/3373915880 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800bbb0 con 0x7f7340062740 2021-02-12T17:16:18.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.874+0000 7f7344cde700 1 -- 172.21.2.102:0/3373915880 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733800bd10 con 0x7f7340062740 2021-02-12T17:16:18.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.874+0000 7f7344cde700 1 -- 172.21.2.102:0/3373915880 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7338011610 con 0x7f7340062740 2021-02-12T17:16:18.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.875+0000 7f7347f44700 1 -- 172.21.2.102:0/3373915880 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7340062740 msgr2=0x7f7340062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.875+0000 7f7347f44700 1 --2- 172.21.2.102:0/3373915880 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7340062740 0x7f7340062bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f734006abc0 tx=0x7f7338009290).stop 2021-02-12T17:16:18.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.875+0000 7f7347f44700 1 -- 172.21.2.102:0/3373915880 shutdown_connections 2021-02-12T17:16:18.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.875+0000 7f7347f44700 1 --2- 172.21.2.102:0/3373915880 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7340062740 0x7f7340062bf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.875+0000 7f7347f44700 1 --2- 172.21.2.102:0/3373915880 >> v2:172.21.2.104:3300/0 conn(0x7f73400b8d20 0x7f7340068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.875+0000 7f7347f44700 1 -- 172.21.2.102:0/3373915880 >> 172.21.2.102:0/3373915880 conn(0x7f73400bc480 msgr2=0x7f73400b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:18.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.875+0000 7f7347f44700 1 -- 172.21.2.102:0/3373915880 shutdown_connections 2021-02-12T17:16:18.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.875+0000 7f7347f44700 1 -- 172.21.2.102:0/3373915880 wait complete. 2021-02-12T17:16:18.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.876+0000 7f7347f44700 1 Processor -- start 2021-02-12T17:16:18.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.876+0000 7f7347f44700 1 -- start start 2021-02-12T17:16:18.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.876+0000 7f7347f44700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7340062740 0x7f73400b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.876+0000 7f7347f44700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73400b8d20 0x7f7340151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.876+0000 7f7347f44700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f734014e530 0x7f734015d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.876+0000 7f7347f44700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734014d330 con 0x7f7340062740 2021-02-12T17:16:18.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.876+0000 7f7347f44700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400ad970 con 0x7f73400b8d20 2021-02-12T17:16:18.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.876+0000 7f7347f44700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73400adc10 con 0x7f734014e530 2021-02-12T17:16:18.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f7345ce0700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7340062740 0x7f73400b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:18.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f7345ce0700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7340062740 0x7f73400b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45082/0 (socket says 172.21.2.102:45082) 2021-02-12T17:16:18.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f7345ce0700 1 -- 172.21.2.102:0/498772911 learned_addr learned my addr 172.21.2.102:0/498772911 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:18.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f73464e1700 1 --2- 172.21.2.102:0/498772911 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f734014e530 0x7f734015d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:18.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f7345ce0700 1 -- 172.21.2.102:0/498772911 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f734014e530 msgr2=0x7f734015d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f7345ce0700 1 --2- 172.21.2.102:0/498772911 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f734014e530 0x7f734015d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:18.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f7345ce0700 1 -- 172.21.2.102:0/498772911 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73400b8d20 msgr2=0x7f7340151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:18.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f7345ce0700 1 --2- 172.21.2.102:0/498772911 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73400b8d20 0x7f7340151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:18.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f7345ce0700 1 -- 172.21.2.102:0/498772911 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73400adeb0 con 0x7f7340062740 2021-02-12T17:16:18.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f7345ce0700 1 --2- 172.21.2.102:0/498772911 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7340062740 0x7f73400b0590 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f733c0096b0 tx=0x7f733c006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:18.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f7331ffb700 1 -- 172.21.2.102:0/498772911 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c00d500 con 0x7f7340062740 2021-02-12T17:16:18.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f7331ffb700 1 -- 172.21.2.102:0/498772911 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c00d6a0 con 0x7f7340062740 2021-02-12T17:16:18.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f7347f44700 1 -- 172.21.2.102:0/498772911 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73400b00f0 con 0x7f7340062740 2021-02-12T17:16:18.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f7331ffb700 1 -- 172.21.2.102:0/498772911 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c00da60 con 0x7f7340062740 2021-02-12T17:16:18.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.877+0000 7f7347f44700 1 -- 172.21.2.102:0/498772911 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7340151c40 con 0x7f7340062740 2021-02-12T17:16:18.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.878+0000 7f7347f44700 1 -- 172.21.2.102:0/498772911 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73400b0280 con 0x7f7340062740 2021-02-12T17:16:18.882 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.878+0000 7f7331ffb700 1 -- 172.21.2.102:0/498772911 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f733c012420 con 0x7f7340062740 2021-02-12T17:16:18.882 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.878+0000 7f7331ffb700 1 --2- 172.21.2.102:0/498772911 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7320059d30 0x7f732005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:18.882 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.878+0000 7f7331ffb700 1 -- 172.21.2.102:0/498772911 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f733c073b40 con 0x7f7340062740 2021-02-12T17:16:18.882 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.879+0000 7f73454df700 1 --2- 172.21.2.102:0/498772911 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7320059d30 0x7f732005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:18.883 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.879+0000 7f73454df700 1 --2- 172.21.2.102:0/498772911 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7320059d30 0x7f732005c1f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f73400b0b10 tx=0x7f7334006900).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:18.883 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:18.881+0000 7f7331ffb700 1 -- 172.21.2.102:0/498772911 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f733c047310 con 0x7f7340062740 2021-02-12T17:16:19.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.006+0000 7f7347f44700 1 -- 172.21.2.102:0/498772911 --> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7340045460 con 0x7f7320059d30 2021-02-12T17:16:19.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.009+0000 7f7331ffb700 1 -- 172.21.2.102:0/498772911 <== mgr.4107 v2:172.21.2.102:6832/37352 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+120206 (secure 0 0 0) 0x7f7340045460 con 0x7f7320059d30 2021-02-12T17:16:19.012 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:19.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.011+0000 7f7347f44700 1 -- 172.21.2.102:0/498772911 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7320059d30 msgr2=0x7f732005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.011+0000 7f7347f44700 1 --2- 172.21.2.102:0/498772911 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7320059d30 0x7f732005c1f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f73400b0b10 tx=0x7f7334006900).stop 2021-02-12T17:16:19.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.011+0000 7f7347f44700 1 -- 172.21.2.102:0/498772911 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7340062740 msgr2=0x7f73400b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.011+0000 7f7347f44700 1 --2- 172.21.2.102:0/498772911 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7340062740 0x7f73400b0590 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f733c0096b0 tx=0x7f733c006de0).stop 2021-02-12T17:16:19.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.011+0000 7f7347f44700 1 -- 172.21.2.102:0/498772911 shutdown_connections 2021-02-12T17:16:19.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.011+0000 7f7347f44700 1 --2- 172.21.2.102:0/498772911 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f734014e530 0x7f734015d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.011+0000 7f7347f44700 1 --2- 172.21.2.102:0/498772911 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7320059d30 0x7f732005c1f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.011+0000 7f7347f44700 1 --2- 172.21.2.102:0/498772911 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7340062740 0x7f73400b0590 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.011+0000 7f7347f44700 1 --2- 172.21.2.102:0/498772911 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73400b8d20 0x7f7340151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.011+0000 7f7347f44700 1 -- 172.21.2.102:0/498772911 >> 172.21.2.102:0/498772911 conn(0x7f73400bc480 msgr2=0x7f734014cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:19.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.011+0000 7f7347f44700 1 -- 172.21.2.102:0/498772911 shutdown_connections 2021-02-12T17:16:19.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.011+0000 7f7347f44700 1 -- 172.21.2.102:0/498772911 wait complete. 2021-02-12T17:16:19.014 INFO:teuthology.orchestra.run.gibba002.stderr:dumped all 2021-02-12T17:16:19.021 INFO:teuthology.orchestra.run.gibba002.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2021-02-12T17:16:17.589345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4612,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41756,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":754932964,"statfs":{"total":773094113280,"available":773051355136,"internally_reserved":0,"allocated":2453504,"data_stored":971999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.057270"},"pg_stats":[{"pgid":"6.3","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537876+0000","last_change":"2021-02-12T17:16:08.536920+0000","last_active":"2021-02-12T17:16:08.537876+0000","last_peered":"2021-02-12T17:16:08.537876+0000","last_clean":"2021-02-12T17:16:08.537876+0000","last_became_active":"2021-02-12T17:16:08.536774+0000","last_became_peered":"2021-02-12T17:16:08.536774+0000","last_unstale":"2021-02-12T17:16:08.537876+0000","last_undegraded":"2021-02-12T17:16:08.537876+0000","last_fullsized":"2021-02-12T17:16:08.537876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"22'4","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534492+0000","last_change":"2021-02-12T17:16:01.721000+0000","last_active":"2021-02-12T17:16:08.534492+0000","last_peered":"2021-02-12T17:16:08.534492+0000","last_clean":"2021-02-12T17:16:08.534492+0000","last_became_active":"2021-02-12T17:16:01.720788+0000","last_became_peered":"2021-02-12T17:16:01.720788+0000","last_unstale":"2021-02-12T17:16:08.534492+0000","last_undegraded":"2021-02-12T17:16:08.534492+0000","last_fullsized":"2021-02-12T17:16:08.534492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534240+0000","last_change":"2021-02-12T17:15:58.624633+0000","last_active":"2021-02-12T17:16:08.534240+0000","last_peered":"2021-02-12T17:16:08.534240+0000","last_clean":"2021-02-12T17:16:08.534240+0000","last_became_active":"2021-02-12T17:15:58.624463+0000","last_became_peered":"2021-02-12T17:15:58.624463+0000","last_unstale":"2021-02-12T17:16:08.534240+0000","last_undegraded":"2021-02-12T17:16:08.534240+0000","last_fullsized":"2021-02-12T17:16:08.534240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535181+0000","last_change":"2021-02-12T17:16:02.000491+0000","last_active":"2021-02-12T17:16:08.535181+0000","last_peered":"2021-02-12T17:16:08.535181+0000","last_clean":"2021-02-12T17:16:08.535181+0000","last_became_active":"2021-02-12T17:16:02.000325+0000","last_became_peered":"2021-02-12T17:16:02.000325+0000","last_unstale":"2021-02-12T17:16:08.535181+0000","last_undegraded":"2021-02-12T17:16:08.535181+0000","last_fullsized":"2021-02-12T17:16:08.535181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'8","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539481+0000","last_change":"2021-02-12T17:16:08.266576+0000","last_active":"2021-02-12T17:16:08.539481+0000","last_peered":"2021-02-12T17:16:08.539481+0000","last_clean":"2021-02-12T17:16:08.539481+0000","last_became_active":"2021-02-12T17:16:08.266349+0000","last_became_peered":"2021-02-12T17:16:08.266349+0000","last_unstale":"2021-02-12T17:16:08.539481+0000","last_undegraded":"2021-02-12T17:16:08.539481+0000","last_fullsized":"2021-02-12T17:16:08.539481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534571+0000","last_change":"2021-02-12T17:15:58.624453+0000","last_active":"2021-02-12T17:16:08.534571+0000","last_peered":"2021-02-12T17:16:08.534571+0000","last_clean":"2021-02-12T17:16:08.534571+0000","last_became_active":"2021-02-12T17:15:58.624258+0000","last_became_peered":"2021-02-12T17:15:58.624258+0000","last_unstale":"2021-02-12T17:16:08.534571+0000","last_undegraded":"2021-02-12T17:16:08.534571+0000","last_fullsized":"2021-02-12T17:16:08.534571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'6","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533638+0000","last_change":"2021-02-12T17:16:01.721442+0000","last_active":"2021-02-12T17:16:08.533638+0000","last_peered":"2021-02-12T17:16:08.533638+0000","last_clean":"2021-02-12T17:16:08.533638+0000","last_became_active":"2021-02-12T17:16:01.721222+0000","last_became_peered":"2021-02-12T17:16:01.721222+0000","last_unstale":"2021-02-12T17:16:08.533638+0000","last_undegraded":"2021-02-12T17:16:08.533638+0000","last_fullsized":"2021-02-12T17:16:08.533638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":576,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533455+0000","last_change":"2021-02-12T17:16:02.001124+0000","last_active":"2021-02-12T17:16:08.533455+0000","last_peered":"2021-02-12T17:16:08.533455+0000","last_clean":"2021-02-12T17:16:08.533455+0000","last_became_active":"2021-02-12T17:16:02.000908+0000","last_became_peered":"2021-02-12T17:16:02.000908+0000","last_unstale":"2021-02-12T17:16:08.533455+0000","last_undegraded":"2021-02-12T17:16:08.533455+0000","last_fullsized":"2021-02-12T17:16:08.533455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"10","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535130+0000","last_change":"2021-02-12T17:16:08.267064+0000","last_active":"2021-02-12T17:16:08.535130+0000","last_peered":"2021-02-12T17:16:08.535130+0000","last_clean":"2021-02-12T17:16:08.535130+0000","last_became_active":"2021-02-12T17:16:08.266819+0000","last_became_peered":"2021-02-12T17:16:08.266819+0000","last_unstale":"2021-02-12T17:16:08.535130+0000","last_undegraded":"2021-02-12T17:16:08.535130+0000","last_fullsized":"2021-02-12T17:16:08.535130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539615+0000","last_change":"2021-02-12T17:16:08.539171+0000","last_active":"2021-02-12T17:16:08.539615+0000","last_peered":"2021-02-12T17:16:08.539615+0000","last_clean":"2021-02-12T17:16:08.539615+0000","last_became_active":"2021-02-12T17:16:08.538969+0000","last_became_peered":"2021-02-12T17:16:08.538969+0000","last_unstale":"2021-02-12T17:16:08.539615+0000","last_undegraded":"2021-02-12T17:16:08.539615+0000","last_fullsized":"2021-02-12T17:16:08.539615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"21'8","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534705+0000","last_change":"2021-02-12T17:16:01.722429+0000","last_active":"2021-02-12T17:16:08.534705+0000","last_peered":"2021-02-12T17:16:08.534705+0000","last_clean":"2021-02-12T17:16:08.534705+0000","last_became_active":"2021-02-12T17:16:01.722278+0000","last_became_peered":"2021-02-12T17:16:01.722278+0000","last_unstale":"2021-02-12T17:16:08.534705+0000","last_undegraded":"2021-02-12T17:16:08.534705+0000","last_fullsized":"2021-02-12T17:16:08.534705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534759+0000","last_change":"2021-02-12T17:15:59.564623+0000","last_active":"2021-02-12T17:16:08.534759+0000","last_peered":"2021-02-12T17:16:08.534759+0000","last_clean":"2021-02-12T17:16:08.534759+0000","last_became_active":"2021-02-12T17:15:59.564259+0000","last_became_peered":"2021-02-12T17:15:59.564259+0000","last_unstale":"2021-02-12T17:16:08.534759+0000","last_undegraded":"2021-02-12T17:16:08.534759+0000","last_fullsized":"2021-02-12T17:16:08.534759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534404+0000","last_change":"2021-02-12T17:16:01.998996+0000","last_active":"2021-02-12T17:16:08.534404+0000","last_peered":"2021-02-12T17:16:08.534404+0000","last_clean":"2021-02-12T17:16:08.534404+0000","last_became_active":"2021-02-12T17:16:01.998787+0000","last_became_peered":"2021-02-12T17:16:01.998787+0000","last_unstale":"2021-02-12T17:16:08.534404+0000","last_undegraded":"2021-02-12T17:16:08.534404+0000","last_fullsized":"2021-02-12T17:16:08.534404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"26'1","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537289+0000","last_change":"2021-02-12T17:16:08.266772+0000","last_active":"2021-02-12T17:16:08.537289+0000","last_peered":"2021-02-12T17:16:08.537289+0000","last_clean":"2021-02-12T17:16:08.537289+0000","last_became_active":"2021-02-12T17:16:08.266590+0000","last_became_peered":"2021-02-12T17:16:08.266590+0000","last_unstale":"2021-02-12T17:16:08.537289+0000","last_undegraded":"2021-02-12T17:16:08.537289+0000","last_fullsized":"2021-02-12T17:16:08.537289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538271+0000","last_change":"2021-02-12T17:16:08.537438+0000","last_active":"2021-02-12T17:16:08.538271+0000","last_peered":"2021-02-12T17:16:08.538271+0000","last_clean":"2021-02-12T17:16:08.538271+0000","last_became_active":"2021-02-12T17:16:08.537259+0000","last_became_peered":"2021-02-12T17:16:08.537259+0000","last_unstale":"2021-02-12T17:16:08.538271+0000","last_undegraded":"2021-02-12T17:16:08.538271+0000","last_fullsized":"2021-02-12T17:16:08.538271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537972+0000","last_change":"2021-02-12T17:16:08.536661+0000","last_active":"2021-02-12T17:16:08.537972+0000","last_peered":"2021-02-12T17:16:08.537972+0000","last_clean":"2021-02-12T17:16:08.537972+0000","last_became_active":"2021-02-12T17:16:08.536432+0000","last_became_peered":"2021-02-12T17:16:08.536432+0000","last_unstale":"2021-02-12T17:16:08.537972+0000","last_undegraded":"2021-02-12T17:16:08.537972+0000","last_fullsized":"2021-02-12T17:16:08.537972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534307+0000","last_change":"2021-02-12T17:16:01.721350+0000","last_active":"2021-02-12T17:16:08.534307+0000","last_peered":"2021-02-12T17:16:08.534307+0000","last_clean":"2021-02-12T17:16:08.534307+0000","last_became_active":"2021-02-12T17:16:01.721143+0000","last_became_peered":"2021-02-12T17:16:01.721143+0000","last_unstale":"2021-02-12T17:16:08.534307+0000","last_undegraded":"2021-02-12T17:16:08.534307+0000","last_fullsized":"2021-02-12T17:16:08.534307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534765+0000","last_change":"2021-02-12T17:15:58.623963+0000","last_active":"2021-02-12T17:16:08.534765+0000","last_peered":"2021-02-12T17:16:08.534765+0000","last_clean":"2021-02-12T17:16:08.534765+0000","last_became_active":"2021-02-12T17:15:58.623796+0000","last_became_peered":"2021-02-12T17:15:58.623796+0000","last_unstale":"2021-02-12T17:16:08.534765+0000","last_undegraded":"2021-02-12T17:16:08.534765+0000","last_fullsized":"2021-02-12T17:16:08.534765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534425+0000","last_change":"2021-02-12T17:16:02.001353+0000","last_active":"2021-02-12T17:16:08.534425+0000","last_peered":"2021-02-12T17:16:08.534425+0000","last_clean":"2021-02-12T17:16:08.534425+0000","last_became_active":"2021-02-12T17:16:02.001120+0000","last_became_peered":"2021-02-12T17:16:02.001120+0000","last_unstale":"2021-02-12T17:16:08.534425+0000","last_undegraded":"2021-02-12T17:16:08.534425+0000","last_fullsized":"2021-02-12T17:16:08.534425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"26'6","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538852+0000","last_change":"2021-02-12T17:16:08.266750+0000","last_active":"2021-02-12T17:16:08.538852+0000","last_peered":"2021-02-12T17:16:08.538852+0000","last_clean":"2021-02-12T17:16:08.538852+0000","last_became_active":"2021-02-12T17:16:08.266527+0000","last_became_peered":"2021-02-12T17:16:08.266527+0000","last_unstale":"2021-02-12T17:16:08.538852+0000","last_undegraded":"2021-02-12T17:16:08.538852+0000","last_fullsized":"2021-02-12T17:16:08.538852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":576,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538178+0000","last_change":"2021-02-12T17:16:08.537723+0000","last_active":"2021-02-12T17:16:08.538178+0000","last_peered":"2021-02-12T17:16:08.538178+0000","last_clean":"2021-02-12T17:16:08.538178+0000","last_became_active":"2021-02-12T17:16:08.537507+0000","last_became_peered":"2021-02-12T17:16:08.537507+0000","last_unstale":"2021-02-12T17:16:08.538178+0000","last_undegraded":"2021-02-12T17:16:08.538178+0000","last_fullsized":"2021-02-12T17:16:08.538178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533639+0000","last_change":"2021-02-12T17:16:01.721104+0000","last_active":"2021-02-12T17:16:08.533639+0000","last_peered":"2021-02-12T17:16:08.533639+0000","last_clean":"2021-02-12T17:16:08.533639+0000","last_became_active":"2021-02-12T17:16:01.720876+0000","last_became_peered":"2021-02-12T17:16:01.720876+0000","last_unstale":"2021-02-12T17:16:08.533639+0000","last_undegraded":"2021-02-12T17:16:08.533639+0000","last_fullsized":"2021-02-12T17:16:08.533639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534709+0000","last_change":"2021-02-12T17:15:57.566001+0000","last_active":"2021-02-12T17:16:08.534709+0000","last_peered":"2021-02-12T17:16:08.534709+0000","last_clean":"2021-02-12T17:16:08.534709+0000","last_became_active":"2021-02-12T17:15:57.565738+0000","last_became_peered":"2021-02-12T17:15:57.565738+0000","last_unstale":"2021-02-12T17:16:08.534709+0000","last_undegraded":"2021-02-12T17:16:08.534709+0000","last_fullsized":"2021-02-12T17:16:08.534709+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:55.600099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:55.600099+0000","last_clean_scrub_stamp":"2021-02-12T17:15:55.600099+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535046+0000","last_change":"2021-02-12T17:15:58.624830+0000","last_active":"2021-02-12T17:16:08.535046+0000","last_peered":"2021-02-12T17:16:08.535046+0000","last_clean":"2021-02-12T17:16:08.535046+0000","last_became_active":"2021-02-12T17:15:58.624647+0000","last_became_peered":"2021-02-12T17:15:58.624647+0000","last_unstale":"2021-02-12T17:16:08.535046+0000","last_undegraded":"2021-02-12T17:16:08.535046+0000","last_fullsized":"2021-02-12T17:16:08.535046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534228+0000","last_change":"2021-02-12T17:16:03.011987+0000","last_active":"2021-02-12T17:16:08.534228+0000","last_peered":"2021-02-12T17:16:08.534228+0000","last_clean":"2021-02-12T17:16:08.534228+0000","last_became_active":"2021-02-12T17:16:03.011668+0000","last_became_peered":"2021-02-12T17:16:03.011668+0000","last_unstale":"2021-02-12T17:16:08.534228+0000","last_undegraded":"2021-02-12T17:16:08.534228+0000","last_fullsized":"2021-02-12T17:16:08.534228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"26'8","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.642446+0000","last_change":"2021-02-12T17:16:08.267110+0000","last_active":"2021-02-12T17:16:08.642446+0000","last_peered":"2021-02-12T17:16:08.642446+0000","last_clean":"2021-02-12T17:16:08.642446+0000","last_became_active":"2021-02-12T17:16:08.266920+0000","last_became_peered":"2021-02-12T17:16:08.266920+0000","last_unstale":"2021-02-12T17:16:08.642446+0000","last_undegraded":"2021-02-12T17:16:08.642446+0000","last_fullsized":"2021-02-12T17:16:08.642446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537881+0000","last_change":"2021-02-12T17:16:08.536884+0000","last_active":"2021-02-12T17:16:08.537881+0000","last_peered":"2021-02-12T17:16:08.537881+0000","last_clean":"2021-02-12T17:16:08.537881+0000","last_became_active":"2021-02-12T17:16:08.536645+0000","last_became_peered":"2021-02-12T17:16:08.536645+0000","last_unstale":"2021-02-12T17:16:08.537881+0000","last_undegraded":"2021-02-12T17:16:08.537881+0000","last_fullsized":"2021-02-12T17:16:08.537881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"21'8","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534414+0000","last_change":"2021-02-12T17:16:01.722384+0000","last_active":"2021-02-12T17:16:08.534414+0000","last_peered":"2021-02-12T17:16:08.534414+0000","last_clean":"2021-02-12T17:16:08.534414+0000","last_became_active":"2021-02-12T17:16:01.722205+0000","last_became_peered":"2021-02-12T17:16:01.722205+0000","last_unstale":"2021-02-12T17:16:08.534414+0000","last_undegraded":"2021-02-12T17:16:08.534414+0000","last_fullsized":"2021-02-12T17:16:08.534414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533448+0000","last_change":"2021-02-12T17:15:59.594109+0000","last_active":"2021-02-12T17:16:08.533448+0000","last_peered":"2021-02-12T17:16:08.533448+0000","last_clean":"2021-02-12T17:16:08.533448+0000","last_became_active":"2021-02-12T17:15:59.593760+0000","last_became_peered":"2021-02-12T17:15:59.593760+0000","last_unstale":"2021-02-12T17:16:08.533448+0000","last_undegraded":"2021-02-12T17:16:08.533448+0000","last_fullsized":"2021-02-12T17:16:08.533448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534623+0000","last_change":"2021-02-12T17:16:01.999606+0000","last_active":"2021-02-12T17:16:08.534623+0000","last_peered":"2021-02-12T17:16:08.534623+0000","last_clean":"2021-02-12T17:16:08.534623+0000","last_became_active":"2021-02-12T17:16:01.999372+0000","last_became_peered":"2021-02-12T17:16:01.999372+0000","last_unstale":"2021-02-12T17:16:08.534623+0000","last_undegraded":"2021-02-12T17:16:08.534623+0000","last_fullsized":"2021-02-12T17:16:08.534623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'4","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2021-02-12T17:16:10.411461+0000","last_change":"2021-02-12T17:16:08.266989+0000","last_active":"2021-02-12T17:16:10.411461+0000","last_peered":"2021-02-12T17:16:10.411461+0000","last_clean":"2021-02-12T17:16:10.411461+0000","last_became_active":"2021-02-12T17:16:08.266748+0000","last_became_peered":"2021-02-12T17:16:08.266748+0000","last_unstale":"2021-02-12T17:16:10.411461+0000","last_undegraded":"2021-02-12T17:16:10.411461+0000","last_fullsized":"2021-02-12T17:16:10.411461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539087+0000","last_change":"2021-02-12T17:16:08.536725+0000","last_active":"2021-02-12T17:16:08.539087+0000","last_peered":"2021-02-12T17:16:08.539087+0000","last_clean":"2021-02-12T17:16:08.539087+0000","last_became_active":"2021-02-12T17:16:08.536504+0000","last_became_peered":"2021-02-12T17:16:08.536504+0000","last_unstale":"2021-02-12T17:16:08.539087+0000","last_undegraded":"2021-02-12T17:16:08.539087+0000","last_fullsized":"2021-02-12T17:16:08.539087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"21'5","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535179+0000","last_change":"2021-02-12T17:16:01.721973+0000","last_active":"2021-02-12T17:16:08.535179+0000","last_peered":"2021-02-12T17:16:08.535179+0000","last_clean":"2021-02-12T17:16:08.535179+0000","last_became_active":"2021-02-12T17:16:01.721814+0000","last_became_peered":"2021-02-12T17:16:01.721814+0000","last_unstale":"2021-02-12T17:16:08.535179+0000","last_undegraded":"2021-02-12T17:16:08.535179+0000","last_fullsized":"2021-02-12T17:16:08.535179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535007+0000","last_change":"2021-02-12T17:15:58.624836+0000","last_active":"2021-02-12T17:16:08.535007+0000","last_peered":"2021-02-12T17:16:08.535007+0000","last_clean":"2021-02-12T17:16:08.535007+0000","last_became_active":"2021-02-12T17:15:58.624621+0000","last_became_peered":"2021-02-12T17:15:58.624621+0000","last_unstale":"2021-02-12T17:16:08.535007+0000","last_undegraded":"2021-02-12T17:16:08.535007+0000","last_fullsized":"2021-02-12T17:16:08.535007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534638+0000","last_change":"2021-02-12T17:16:02.003453+0000","last_active":"2021-02-12T17:16:08.534638+0000","last_peered":"2021-02-12T17:16:08.534638+0000","last_clean":"2021-02-12T17:16:08.534638+0000","last_became_active":"2021-02-12T17:16:02.003266+0000","last_became_peered":"2021-02-12T17:16:02.003266+0000","last_unstale":"2021-02-12T17:16:08.534638+0000","last_undegraded":"2021-02-12T17:16:08.534638+0000","last_fullsized":"2021-02-12T17:16:08.534638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'6","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539389+0000","last_change":"2021-02-12T17:16:08.266987+0000","last_active":"2021-02-12T17:16:08.539389+0000","last_peered":"2021-02-12T17:16:08.539389+0000","last_clean":"2021-02-12T17:16:08.539389+0000","last_became_active":"2021-02-12T17:16:08.266792+0000","last_became_peered":"2021-02-12T17:16:08.266792+0000","last_unstale":"2021-02-12T17:16:08.539389+0000","last_undegraded":"2021-02-12T17:16:08.539389+0000","last_fullsized":"2021-02-12T17:16:08.539389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"21'6","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535024+0000","last_change":"2021-02-12T17:16:01.722204+0000","last_active":"2021-02-12T17:16:08.535024+0000","last_peered":"2021-02-12T17:16:08.535024+0000","last_clean":"2021-02-12T17:16:08.535024+0000","last_became_active":"2021-02-12T17:16:01.722060+0000","last_became_peered":"2021-02-12T17:16:01.722060+0000","last_unstale":"2021-02-12T17:16:08.535024+0000","last_undegraded":"2021-02-12T17:16:08.535024+0000","last_fullsized":"2021-02-12T17:16:08.535024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534569+0000","last_change":"2021-02-12T17:15:59.564122+0000","last_active":"2021-02-12T17:16:08.534569+0000","last_peered":"2021-02-12T17:16:08.534569+0000","last_clean":"2021-02-12T17:16:08.534569+0000","last_became_active":"2021-02-12T17:15:59.563695+0000","last_became_peered":"2021-02-12T17:15:59.563695+0000","last_unstale":"2021-02-12T17:16:08.534569+0000","last_undegraded":"2021-02-12T17:16:08.534569+0000","last_fullsized":"2021-02-12T17:16:08.534569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534411+0000","last_change":"2021-02-12T17:16:01.999102+0000","last_active":"2021-02-12T17:16:08.534411+0000","last_peered":"2021-02-12T17:16:08.534411+0000","last_clean":"2021-02-12T17:16:08.534411+0000","last_became_active":"2021-02-12T17:16:01.998815+0000","last_became_peered":"2021-02-12T17:16:01.998815+0000","last_unstale":"2021-02-12T17:16:08.534411+0000","last_undegraded":"2021-02-12T17:16:08.534411+0000","last_fullsized":"2021-02-12T17:16:08.534411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"26'5","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539870+0000","last_change":"2021-02-12T17:16:08.267434+0000","last_active":"2021-02-12T17:16:08.539870+0000","last_peered":"2021-02-12T17:16:08.539870+0000","last_clean":"2021-02-12T17:16:08.539870+0000","last_became_active":"2021-02-12T17:16:08.267218+0000","last_became_peered":"2021-02-12T17:16:08.267218+0000","last_unstale":"2021-02-12T17:16:08.539870+0000","last_undegraded":"2021-02-12T17:16:08.539870+0000","last_fullsized":"2021-02-12T17:16:08.539870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538696+0000","last_change":"2021-02-12T17:16:08.535970+0000","last_active":"2021-02-12T17:16:08.538696+0000","last_peered":"2021-02-12T17:16:08.538696+0000","last_clean":"2021-02-12T17:16:08.538696+0000","last_became_active":"2021-02-12T17:16:08.535744+0000","last_became_peered":"2021-02-12T17:16:08.535744+0000","last_unstale":"2021-02-12T17:16:08.538696+0000","last_undegraded":"2021-02-12T17:16:08.538696+0000","last_fullsized":"2021-02-12T17:16:08.538696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":120499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5312,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366528,"statfs":{"total":96636764160,"available":96631324672,"internally_reserved":0,"allocated":319488,"data_stored":122737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":120693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5180,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366660,"statfs":{"total":96636764160,"available":96631459840,"internally_reserved":0,"allocated":315392,"data_stored":123537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":120499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]}]}} 2021-02-12T17:16:19.023 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-02-12T17:16:19.112 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.111+0000 7f0d4705f700 1 Processor -- start 2021-02-12T17:16:19.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.111+0000 7f0d4705f700 1 -- start start 2021-02-12T17:16:19.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.111+0000 7f0d4705f700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0d400b8d20 0x7f0d40068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d4705f700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f0d4014e530 0x7f0d400b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d4705f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d40062740 0x7f0d40062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d4705f700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d40068d20 con 0x7f0d400b8d20 2021-02-12T17:16:19.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d4705f700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d400622a0 con 0x7f0d4014e530 2021-02-12T17:16:19.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d4705f700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4014ea10 con 0x7f0d40062740 2021-02-12T17:16:19.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d44dfb700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0d400b8d20 0x7f0d40068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d44dfb700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0d400b8d20 0x7f0d40068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45090/0 (socket says 172.21.2.102:45090) 2021-02-12T17:16:19.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d44dfb700 1 -- 172.21.2.102:0/3845866401 learned_addr learned my addr 172.21.2.102:0/3845866401 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:19.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d44dfb700 1 -- 172.21.2.102:0/3845866401 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d40062740 msgr2=0x7f0d40062bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:19.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d44dfb700 1 --2- 172.21.2.102:0/3845866401 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d40062740 0x7f0d40062bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d44dfb700 1 -- 172.21.2.102:0/3845866401 >> v2:172.21.2.104:3300/0 conn(0x7f0d4014e530 msgr2=0x7f0d400b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:19.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d44dfb700 1 --2- 172.21.2.102:0/3845866401 >> v2:172.21.2.104:3300/0 conn(0x7f0d4014e530 0x7f0d400b7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d44dfb700 1 -- 172.21.2.102:0/3845866401 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d400b63f0 con 0x7f0d400b8d20 2021-02-12T17:16:19.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d44dfb700 1 --2- 172.21.2.102:0/3845866401 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d400b8d20 0x7f0d40068830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f0d400654b0 tx=0x7f0d28006ea0).ready entity=mon.0 client_cookie=9b5424ae751a50d0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:19.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d3f7fe700 1 -- 172.21.2.102:0/3845866401 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28009840 con 0x7f0d400b8d20 2021-02-12T17:16:19.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d3f7fe700 1 -- 172.21.2.102:0/3845866401 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d280099a0 con 0x7f0d400b8d20 2021-02-12T17:16:19.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.112+0000 7f0d3f7fe700 1 -- 172.21.2.102:0/3845866401 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28009d20 con 0x7f0d400b8d20 2021-02-12T17:16:19.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.113+0000 7f0d4705f700 1 -- 172.21.2.102:0/3845866401 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d400b8d20 msgr2=0x7f0d40068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.113+0000 7f0d4705f700 1 --2- 172.21.2.102:0/3845866401 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d400b8d20 0x7f0d40068830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f0d400654b0 tx=0x7f0d28006ea0).stop 2021-02-12T17:16:19.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.113+0000 7f0d4705f700 1 -- 172.21.2.102:0/3845866401 shutdown_connections 2021-02-12T17:16:19.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.113+0000 7f0d4705f700 1 --2- 172.21.2.102:0/3845866401 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d40062740 0x7f0d40062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.113+0000 7f0d4705f700 1 --2- 172.21.2.102:0/3845866401 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d400b8d20 0x7f0d40068830 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.113+0000 7f0d4705f700 1 --2- 172.21.2.102:0/3845866401 >> v2:172.21.2.104:3300/0 conn(0x7f0d4014e530 0x7f0d400b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.113+0000 7f0d4705f700 1 -- 172.21.2.102:0/3845866401 >> 172.21.2.102:0/3845866401 conn(0x7f0d400bc480 msgr2=0x7f0d400b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:19.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.113+0000 7f0d4705f700 1 -- 172.21.2.102:0/3845866401 shutdown_connections 2021-02-12T17:16:19.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.113+0000 7f0d4705f700 1 -- 172.21.2.102:0/3845866401 wait complete. 2021-02-12T17:16:19.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.114+0000 7f0d4705f700 1 Processor -- start 2021-02-12T17:16:19.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.114+0000 7f0d4705f700 1 -- start start 2021-02-12T17:16:19.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.114+0000 7f0d4705f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d40062740 0x7f0d400b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.114+0000 7f0d4705f700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0d400b8d20 0x7f0d4014aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.114+0000 7f0d4705f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d4014e530 0x7f0d4014afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.114+0000 7f0d4705f700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d400aee30 con 0x7f0d40062740 2021-02-12T17:16:19.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.114+0000 7f0d4705f700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d400b4c20 con 0x7f0d400b8d20 2021-02-12T17:16:19.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.114+0000 7f0d4705f700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d400ad820 con 0x7f0d4014e530 2021-02-12T17:16:19.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.114+0000 7f0d44dfb700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d40062740 0x7f0d400b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.114+0000 7f0d44dfb700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d40062740 0x7f0d400b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45096/0 (socket says 172.21.2.102:45096) 2021-02-12T17:16:19.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.114+0000 7f0d44dfb700 1 -- 172.21.2.102:0/3898294 learned_addr learned my addr 172.21.2.102:0/3898294 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:19.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.115+0000 7f0d44dfb700 1 -- 172.21.2.102:0/3898294 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d4014e530 msgr2=0x7f0d4014afd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:19.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.115+0000 7f0d44dfb700 1 --2- 172.21.2.102:0/3898294 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d4014e530 0x7f0d4014afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.115+0000 7f0d44dfb700 1 -- 172.21.2.102:0/3898294 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0d400b8d20 msgr2=0x7f0d4014aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:19.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.115+0000 7f0d44dfb700 1 --2- 172.21.2.102:0/3898294 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0d400b8d20 0x7f0d4014aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.115+0000 7f0d44dfb700 1 -- 172.21.2.102:0/3898294 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d400adac0 con 0x7f0d40062740 2021-02-12T17:16:19.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.115+0000 7f0d44dfb700 1 --2- 172.21.2.102:0/3898294 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d40062740 0x7f0d400b7f70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f0d28006ee0 tx=0x7f0d28016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:19.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.115+0000 7f0d3cff9700 1 -- 172.21.2.102:0/3898294 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28020070 con 0x7f0d40062740 2021-02-12T17:16:19.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.115+0000 7f0d3cff9700 1 -- 172.21.2.102:0/3898294 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2801c420 con 0x7f0d40062740 2021-02-12T17:16:19.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.115+0000 7f0d4705f700 1 -- 172.21.2.102:0/3898294 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d400add60 con 0x7f0d40062740 2021-02-12T17:16:19.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.115+0000 7f0d4705f700 1 -- 172.21.2.102:0/3898294 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d400b1bd0 con 0x7f0d40062740 2021-02-12T17:16:19.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.115+0000 7f0d3cff9700 1 -- 172.21.2.102:0/3898294 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2801c7e0 con 0x7f0d40062740 2021-02-12T17:16:19.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.116+0000 7f0d4705f700 1 -- 172.21.2.102:0/3898294 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d18004f60 con 0x7f0d40062740 2021-02-12T17:16:19.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.116+0000 7f0d3cff9700 1 -- 172.21.2.102:0/3898294 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f0d2800f070 con 0x7f0d40062740 2021-02-12T17:16:19.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.116+0000 7f0d3cff9700 1 --2- 172.21.2.102:0/3898294 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0d24059d80 0x7f0d2405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.116+0000 7f0d3cff9700 1 -- 172.21.2.102:0/3898294 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f0d280751e0 con 0x7f0d40062740 2021-02-12T17:16:19.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.116+0000 7f0d3ffff700 1 --2- 172.21.2.102:0/3898294 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0d24059d80 0x7f0d2405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.117+0000 7f0d3ffff700 1 --2- 172.21.2.102:0/3898294 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0d24059d80 0x7f0d2405c240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f0d3000b420 tx=0x7f0d30006920).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:19.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.119+0000 7f0d3cff9700 1 -- 172.21.2.102:0/3898294 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f0d28048980 con 0x7f0d40062740 2021-02-12T17:16:19.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.249+0000 7f0d4705f700 1 -- 172.21.2.102:0/3898294 --> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d18000b80 con 0x7f0d24059d80 2021-02-12T17:16:19.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.251+0000 7f0d3cff9700 1 -- 172.21.2.102:0/3898294 <== mgr.4107 v2:172.21.2.102:6832/37352 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+120206 (secure 0 0 0) 0x7f0d18000b80 con 0x7f0d24059d80 2021-02-12T17:16:19.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.253+0000 7f0d4705f700 1 -- 172.21.2.102:0/3898294 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0d24059d80 msgr2=0x7f0d2405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.253+0000 7f0d4705f700 1 --2- 172.21.2.102:0/3898294 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0d24059d80 0x7f0d2405c240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f0d3000b420 tx=0x7f0d30006920).stop 2021-02-12T17:16:19.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.253+0000 7f0d4705f700 1 -- 172.21.2.102:0/3898294 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d40062740 msgr2=0x7f0d400b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.253+0000 7f0d4705f700 1 --2- 172.21.2.102:0/3898294 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d40062740 0x7f0d400b7f70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f0d28006ee0 tx=0x7f0d28016000).stop 2021-02-12T17:16:19.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.253+0000 7f0d4705f700 1 -- 172.21.2.102:0/3898294 shutdown_connections 2021-02-12T17:16:19.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.253+0000 7f0d4705f700 1 --2- 172.21.2.102:0/3898294 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d4014e530 0x7f0d4014afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.253+0000 7f0d4705f700 1 --2- 172.21.2.102:0/3898294 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0d24059d80 0x7f0d2405c240 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.253+0000 7f0d4705f700 1 --2- 172.21.2.102:0/3898294 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d40062740 0x7f0d400b7f70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.253+0000 7f0d4705f700 1 --2- 172.21.2.102:0/3898294 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0d400b8d20 0x7f0d4014aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.253+0000 7f0d4705f700 1 -- 172.21.2.102:0/3898294 >> 172.21.2.102:0/3898294 conn(0x7f0d400bc480 msgr2=0x7f0d4014bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:19.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.253+0000 7f0d4705f700 1 -- 172.21.2.102:0/3898294 shutdown_connections 2021-02-12T17:16:19.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.253+0000 7f0d4705f700 1 -- 172.21.2.102:0/3898294 wait complete. 2021-02-12T17:16:19.255 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:19.256 INFO:teuthology.orchestra.run.gibba002.stderr:dumped all 2021-02-12T17:16:19.263 INFO:teuthology.orchestra.run.gibba002.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2021-02-12T17:16:17.589345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4612,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41756,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":754932964,"statfs":{"total":773094113280,"available":773051355136,"internally_reserved":0,"allocated":2453504,"data_stored":971999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.057270"},"pg_stats":[{"pgid":"6.3","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537876+0000","last_change":"2021-02-12T17:16:08.536920+0000","last_active":"2021-02-12T17:16:08.537876+0000","last_peered":"2021-02-12T17:16:08.537876+0000","last_clean":"2021-02-12T17:16:08.537876+0000","last_became_active":"2021-02-12T17:16:08.536774+0000","last_became_peered":"2021-02-12T17:16:08.536774+0000","last_unstale":"2021-02-12T17:16:08.537876+0000","last_undegraded":"2021-02-12T17:16:08.537876+0000","last_fullsized":"2021-02-12T17:16:08.537876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"22'4","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534492+0000","last_change":"2021-02-12T17:16:01.721000+0000","last_active":"2021-02-12T17:16:08.534492+0000","last_peered":"2021-02-12T17:16:08.534492+0000","last_clean":"2021-02-12T17:16:08.534492+0000","last_became_active":"2021-02-12T17:16:01.720788+0000","last_became_peered":"2021-02-12T17:16:01.720788+0000","last_unstale":"2021-02-12T17:16:08.534492+0000","last_undegraded":"2021-02-12T17:16:08.534492+0000","last_fullsized":"2021-02-12T17:16:08.534492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534240+0000","last_change":"2021-02-12T17:15:58.624633+0000","last_active":"2021-02-12T17:16:08.534240+0000","last_peered":"2021-02-12T17:16:08.534240+0000","last_clean":"2021-02-12T17:16:08.534240+0000","last_became_active":"2021-02-12T17:15:58.624463+0000","last_became_peered":"2021-02-12T17:15:58.624463+0000","last_unstale":"2021-02-12T17:16:08.534240+0000","last_undegraded":"2021-02-12T17:16:08.534240+0000","last_fullsized":"2021-02-12T17:16:08.534240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535181+0000","last_change":"2021-02-12T17:16:02.000491+0000","last_active":"2021-02-12T17:16:08.535181+0000","last_peered":"2021-02-12T17:16:08.535181+0000","last_clean":"2021-02-12T17:16:08.535181+0000","last_became_active":"2021-02-12T17:16:02.000325+0000","last_became_peered":"2021-02-12T17:16:02.000325+0000","last_unstale":"2021-02-12T17:16:08.535181+0000","last_undegraded":"2021-02-12T17:16:08.535181+0000","last_fullsized":"2021-02-12T17:16:08.535181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'8","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539481+0000","last_change":"2021-02-12T17:16:08.266576+0000","last_active":"2021-02-12T17:16:08.539481+0000","last_peered":"2021-02-12T17:16:08.539481+0000","last_clean":"2021-02-12T17:16:08.539481+0000","last_became_active":"2021-02-12T17:16:08.266349+0000","last_became_peered":"2021-02-12T17:16:08.266349+0000","last_unstale":"2021-02-12T17:16:08.539481+0000","last_undegraded":"2021-02-12T17:16:08.539481+0000","last_fullsized":"2021-02-12T17:16:08.539481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534571+0000","last_change":"2021-02-12T17:15:58.624453+0000","last_active":"2021-02-12T17:16:08.534571+0000","last_peered":"2021-02-12T17:16:08.534571+0000","last_clean":"2021-02-12T17:16:08.534571+0000","last_became_active":"2021-02-12T17:15:58.624258+0000","last_became_peered":"2021-02-12T17:15:58.624258+0000","last_unstale":"2021-02-12T17:16:08.534571+0000","last_undegraded":"2021-02-12T17:16:08.534571+0000","last_fullsized":"2021-02-12T17:16:08.534571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'6","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533638+0000","last_change":"2021-02-12T17:16:01.721442+0000","last_active":"2021-02-12T17:16:08.533638+0000","last_peered":"2021-02-12T17:16:08.533638+0000","last_clean":"2021-02-12T17:16:08.533638+0000","last_became_active":"2021-02-12T17:16:01.721222+0000","last_became_peered":"2021-02-12T17:16:01.721222+0000","last_unstale":"2021-02-12T17:16:08.533638+0000","last_undegraded":"2021-02-12T17:16:08.533638+0000","last_fullsized":"2021-02-12T17:16:08.533638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":576,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533455+0000","last_change":"2021-02-12T17:16:02.001124+0000","last_active":"2021-02-12T17:16:08.533455+0000","last_peered":"2021-02-12T17:16:08.533455+0000","last_clean":"2021-02-12T17:16:08.533455+0000","last_became_active":"2021-02-12T17:16:02.000908+0000","last_became_peered":"2021-02-12T17:16:02.000908+0000","last_unstale":"2021-02-12T17:16:08.533455+0000","last_undegraded":"2021-02-12T17:16:08.533455+0000","last_fullsized":"2021-02-12T17:16:08.533455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"10","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535130+0000","last_change":"2021-02-12T17:16:08.267064+0000","last_active":"2021-02-12T17:16:08.535130+0000","last_peered":"2021-02-12T17:16:08.535130+0000","last_clean":"2021-02-12T17:16:08.535130+0000","last_became_active":"2021-02-12T17:16:08.266819+0000","last_became_peered":"2021-02-12T17:16:08.266819+0000","last_unstale":"2021-02-12T17:16:08.535130+0000","last_undegraded":"2021-02-12T17:16:08.535130+0000","last_fullsized":"2021-02-12T17:16:08.535130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539615+0000","last_change":"2021-02-12T17:16:08.539171+0000","last_active":"2021-02-12T17:16:08.539615+0000","last_peered":"2021-02-12T17:16:08.539615+0000","last_clean":"2021-02-12T17:16:08.539615+0000","last_became_active":"2021-02-12T17:16:08.538969+0000","last_became_peered":"2021-02-12T17:16:08.538969+0000","last_unstale":"2021-02-12T17:16:08.539615+0000","last_undegraded":"2021-02-12T17:16:08.539615+0000","last_fullsized":"2021-02-12T17:16:08.539615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"21'8","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534705+0000","last_change":"2021-02-12T17:16:01.722429+0000","last_active":"2021-02-12T17:16:08.534705+0000","last_peered":"2021-02-12T17:16:08.534705+0000","last_clean":"2021-02-12T17:16:08.534705+0000","last_became_active":"2021-02-12T17:16:01.722278+0000","last_became_peered":"2021-02-12T17:16:01.722278+0000","last_unstale":"2021-02-12T17:16:08.534705+0000","last_undegraded":"2021-02-12T17:16:08.534705+0000","last_fullsized":"2021-02-12T17:16:08.534705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534759+0000","last_change":"2021-02-12T17:15:59.564623+0000","last_active":"2021-02-12T17:16:08.534759+0000","last_peered":"2021-02-12T17:16:08.534759+0000","last_clean":"2021-02-12T17:16:08.534759+0000","last_became_active":"2021-02-12T17:15:59.564259+0000","last_became_peered":"2021-02-12T17:15:59.564259+0000","last_unstale":"2021-02-12T17:16:08.534759+0000","last_undegraded":"2021-02-12T17:16:08.534759+0000","last_fullsized":"2021-02-12T17:16:08.534759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534404+0000","last_change":"2021-02-12T17:16:01.998996+0000","last_active":"2021-02-12T17:16:08.534404+0000","last_peered":"2021-02-12T17:16:08.534404+0000","last_clean":"2021-02-12T17:16:08.534404+0000","last_became_active":"2021-02-12T17:16:01.998787+0000","last_became_peered":"2021-02-12T17:16:01.998787+0000","last_unstale":"2021-02-12T17:16:08.534404+0000","last_undegraded":"2021-02-12T17:16:08.534404+0000","last_fullsized":"2021-02-12T17:16:08.534404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"26'1","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537289+0000","last_change":"2021-02-12T17:16:08.266772+0000","last_active":"2021-02-12T17:16:08.537289+0000","last_peered":"2021-02-12T17:16:08.537289+0000","last_clean":"2021-02-12T17:16:08.537289+0000","last_became_active":"2021-02-12T17:16:08.266590+0000","last_became_peered":"2021-02-12T17:16:08.266590+0000","last_unstale":"2021-02-12T17:16:08.537289+0000","last_undegraded":"2021-02-12T17:16:08.537289+0000","last_fullsized":"2021-02-12T17:16:08.537289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538271+0000","last_change":"2021-02-12T17:16:08.537438+0000","last_active":"2021-02-12T17:16:08.538271+0000","last_peered":"2021-02-12T17:16:08.538271+0000","last_clean":"2021-02-12T17:16:08.538271+0000","last_became_active":"2021-02-12T17:16:08.537259+0000","last_became_peered":"2021-02-12T17:16:08.537259+0000","last_unstale":"2021-02-12T17:16:08.538271+0000","last_undegraded":"2021-02-12T17:16:08.538271+0000","last_fullsized":"2021-02-12T17:16:08.538271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537972+0000","last_change":"2021-02-12T17:16:08.536661+0000","last_active":"2021-02-12T17:16:08.537972+0000","last_peered":"2021-02-12T17:16:08.537972+0000","last_clean":"2021-02-12T17:16:08.537972+0000","last_became_active":"2021-02-12T17:16:08.536432+0000","last_became_peered":"2021-02-12T17:16:08.536432+0000","last_unstale":"2021-02-12T17:16:08.537972+0000","last_undegraded":"2021-02-12T17:16:08.537972+0000","last_fullsized":"2021-02-12T17:16:08.537972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534307+0000","last_change":"2021-02-12T17:16:01.721350+0000","last_active":"2021-02-12T17:16:08.534307+0000","last_peered":"2021-02-12T17:16:08.534307+0000","last_clean":"2021-02-12T17:16:08.534307+0000","last_became_active":"2021-02-12T17:16:01.721143+0000","last_became_peered":"2021-02-12T17:16:01.721143+0000","last_unstale":"2021-02-12T17:16:08.534307+0000","last_undegraded":"2021-02-12T17:16:08.534307+0000","last_fullsized":"2021-02-12T17:16:08.534307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534765+0000","last_change":"2021-02-12T17:15:58.623963+0000","last_active":"2021-02-12T17:16:08.534765+0000","last_peered":"2021-02-12T17:16:08.534765+0000","last_clean":"2021-02-12T17:16:08.534765+0000","last_became_active":"2021-02-12T17:15:58.623796+0000","last_became_peered":"2021-02-12T17:15:58.623796+0000","last_unstale":"2021-02-12T17:16:08.534765+0000","last_undegraded":"2021-02-12T17:16:08.534765+0000","last_fullsized":"2021-02-12T17:16:08.534765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534425+0000","last_change":"2021-02-12T17:16:02.001353+0000","last_active":"2021-02-12T17:16:08.534425+0000","last_peered":"2021-02-12T17:16:08.534425+0000","last_clean":"2021-02-12T17:16:08.534425+0000","last_became_active":"2021-02-12T17:16:02.001120+0000","last_became_peered":"2021-02-12T17:16:02.001120+0000","last_unstale":"2021-02-12T17:16:08.534425+0000","last_undegraded":"2021-02-12T17:16:08.534425+0000","last_fullsized":"2021-02-12T17:16:08.534425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"26'6","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538852+0000","last_change":"2021-02-12T17:16:08.266750+0000","last_active":"2021-02-12T17:16:08.538852+0000","last_peered":"2021-02-12T17:16:08.538852+0000","last_clean":"2021-02-12T17:16:08.538852+0000","last_became_active":"2021-02-12T17:16:08.266527+0000","last_became_peered":"2021-02-12T17:16:08.266527+0000","last_unstale":"2021-02-12T17:16:08.538852+0000","last_undegraded":"2021-02-12T17:16:08.538852+0000","last_fullsized":"2021-02-12T17:16:08.538852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":576,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538178+0000","last_change":"2021-02-12T17:16:08.537723+0000","last_active":"2021-02-12T17:16:08.538178+0000","last_peered":"2021-02-12T17:16:08.538178+0000","last_clean":"2021-02-12T17:16:08.538178+0000","last_became_active":"2021-02-12T17:16:08.537507+0000","last_became_peered":"2021-02-12T17:16:08.537507+0000","last_unstale":"2021-02-12T17:16:08.538178+0000","last_undegraded":"2021-02-12T17:16:08.538178+0000","last_fullsized":"2021-02-12T17:16:08.538178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533639+0000","last_change":"2021-02-12T17:16:01.721104+0000","last_active":"2021-02-12T17:16:08.533639+0000","last_peered":"2021-02-12T17:16:08.533639+0000","last_clean":"2021-02-12T17:16:08.533639+0000","last_became_active":"2021-02-12T17:16:01.720876+0000","last_became_peered":"2021-02-12T17:16:01.720876+0000","last_unstale":"2021-02-12T17:16:08.533639+0000","last_undegraded":"2021-02-12T17:16:08.533639+0000","last_fullsized":"2021-02-12T17:16:08.533639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534709+0000","last_change":"2021-02-12T17:15:57.566001+0000","last_active":"2021-02-12T17:16:08.534709+0000","last_peered":"2021-02-12T17:16:08.534709+0000","last_clean":"2021-02-12T17:16:08.534709+0000","last_became_active":"2021-02-12T17:15:57.565738+0000","last_became_peered":"2021-02-12T17:15:57.565738+0000","last_unstale":"2021-02-12T17:16:08.534709+0000","last_undegraded":"2021-02-12T17:16:08.534709+0000","last_fullsized":"2021-02-12T17:16:08.534709+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:55.600099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:55.600099+0000","last_clean_scrub_stamp":"2021-02-12T17:15:55.600099+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535046+0000","last_change":"2021-02-12T17:15:58.624830+0000","last_active":"2021-02-12T17:16:08.535046+0000","last_peered":"2021-02-12T17:16:08.535046+0000","last_clean":"2021-02-12T17:16:08.535046+0000","last_became_active":"2021-02-12T17:15:58.624647+0000","last_became_peered":"2021-02-12T17:15:58.624647+0000","last_unstale":"2021-02-12T17:16:08.535046+0000","last_undegraded":"2021-02-12T17:16:08.535046+0000","last_fullsized":"2021-02-12T17:16:08.535046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534228+0000","last_change":"2021-02-12T17:16:03.011987+0000","last_active":"2021-02-12T17:16:08.534228+0000","last_peered":"2021-02-12T17:16:08.534228+0000","last_clean":"2021-02-12T17:16:08.534228+0000","last_became_active":"2021-02-12T17:16:03.011668+0000","last_became_peered":"2021-02-12T17:16:03.011668+0000","last_unstale":"2021-02-12T17:16:08.534228+0000","last_undegraded":"2021-02-12T17:16:08.534228+0000","last_fullsized":"2021-02-12T17:16:08.534228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"26'8","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.642446+0000","last_change":"2021-02-12T17:16:08.267110+0000","last_active":"2021-02-12T17:16:08.642446+0000","last_peered":"2021-02-12T17:16:08.642446+0000","last_clean":"2021-02-12T17:16:08.642446+0000","last_became_active":"2021-02-12T17:16:08.266920+0000","last_became_peered":"2021-02-12T17:16:08.266920+0000","last_unstale":"2021-02-12T17:16:08.642446+0000","last_undegraded":"2021-02-12T17:16:08.642446+0000","last_fullsized":"2021-02-12T17:16:08.642446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537881+0000","last_change":"2021-02-12T17:16:08.536884+0000","last_active":"2021-02-12T17:16:08.537881+0000","last_peered":"2021-02-12T17:16:08.537881+0000","last_clean":"2021-02-12T17:16:08.537881+0000","last_became_active":"2021-02-12T17:16:08.536645+0000","last_became_peered":"2021-02-12T17:16:08.536645+0000","last_unstale":"2021-02-12T17:16:08.537881+0000","last_undegraded":"2021-02-12T17:16:08.537881+0000","last_fullsized":"2021-02-12T17:16:08.537881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"21'8","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534414+0000","last_change":"2021-02-12T17:16:01.722384+0000","last_active":"2021-02-12T17:16:08.534414+0000","last_peered":"2021-02-12T17:16:08.534414+0000","last_clean":"2021-02-12T17:16:08.534414+0000","last_became_active":"2021-02-12T17:16:01.722205+0000","last_became_peered":"2021-02-12T17:16:01.722205+0000","last_unstale":"2021-02-12T17:16:08.534414+0000","last_undegraded":"2021-02-12T17:16:08.534414+0000","last_fullsized":"2021-02-12T17:16:08.534414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533448+0000","last_change":"2021-02-12T17:15:59.594109+0000","last_active":"2021-02-12T17:16:08.533448+0000","last_peered":"2021-02-12T17:16:08.533448+0000","last_clean":"2021-02-12T17:16:08.533448+0000","last_became_active":"2021-02-12T17:15:59.593760+0000","last_became_peered":"2021-02-12T17:15:59.593760+0000","last_unstale":"2021-02-12T17:16:08.533448+0000","last_undegraded":"2021-02-12T17:16:08.533448+0000","last_fullsized":"2021-02-12T17:16:08.533448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534623+0000","last_change":"2021-02-12T17:16:01.999606+0000","last_active":"2021-02-12T17:16:08.534623+0000","last_peered":"2021-02-12T17:16:08.534623+0000","last_clean":"2021-02-12T17:16:08.534623+0000","last_became_active":"2021-02-12T17:16:01.999372+0000","last_became_peered":"2021-02-12T17:16:01.999372+0000","last_unstale":"2021-02-12T17:16:08.534623+0000","last_undegraded":"2021-02-12T17:16:08.534623+0000","last_fullsized":"2021-02-12T17:16:08.534623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'4","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2021-02-12T17:16:10.411461+0000","last_change":"2021-02-12T17:16:08.266989+0000","last_active":"2021-02-12T17:16:10.411461+0000","last_peered":"2021-02-12T17:16:10.411461+0000","last_clean":"2021-02-12T17:16:10.411461+0000","last_became_active":"2021-02-12T17:16:08.266748+0000","last_became_peered":"2021-02-12T17:16:08.266748+0000","last_unstale":"2021-02-12T17:16:10.411461+0000","last_undegraded":"2021-02-12T17:16:10.411461+0000","last_fullsized":"2021-02-12T17:16:10.411461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539087+0000","last_change":"2021-02-12T17:16:08.536725+0000","last_active":"2021-02-12T17:16:08.539087+0000","last_peered":"2021-02-12T17:16:08.539087+0000","last_clean":"2021-02-12T17:16:08.539087+0000","last_became_active":"2021-02-12T17:16:08.536504+0000","last_became_peered":"2021-02-12T17:16:08.536504+0000","last_unstale":"2021-02-12T17:16:08.539087+0000","last_undegraded":"2021-02-12T17:16:08.539087+0000","last_fullsized":"2021-02-12T17:16:08.539087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"21'5","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535179+0000","last_change":"2021-02-12T17:16:01.721973+0000","last_active":"2021-02-12T17:16:08.535179+0000","last_peered":"2021-02-12T17:16:08.535179+0000","last_clean":"2021-02-12T17:16:08.535179+0000","last_became_active":"2021-02-12T17:16:01.721814+0000","last_became_peered":"2021-02-12T17:16:01.721814+0000","last_unstale":"2021-02-12T17:16:08.535179+0000","last_undegraded":"2021-02-12T17:16:08.535179+0000","last_fullsized":"2021-02-12T17:16:08.535179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535007+0000","last_change":"2021-02-12T17:15:58.624836+0000","last_active":"2021-02-12T17:16:08.535007+0000","last_peered":"2021-02-12T17:16:08.535007+0000","last_clean":"2021-02-12T17:16:08.535007+0000","last_became_active":"2021-02-12T17:15:58.624621+0000","last_became_peered":"2021-02-12T17:15:58.624621+0000","last_unstale":"2021-02-12T17:16:08.535007+0000","last_undegraded":"2021-02-12T17:16:08.535007+0000","last_fullsized":"2021-02-12T17:16:08.535007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534638+0000","last_change":"2021-02-12T17:16:02.003453+0000","last_active":"2021-02-12T17:16:08.534638+0000","last_peered":"2021-02-12T17:16:08.534638+0000","last_clean":"2021-02-12T17:16:08.534638+0000","last_became_active":"2021-02-12T17:16:02.003266+0000","last_became_peered":"2021-02-12T17:16:02.003266+0000","last_unstale":"2021-02-12T17:16:08.534638+0000","last_undegraded":"2021-02-12T17:16:08.534638+0000","last_fullsized":"2021-02-12T17:16:08.534638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'6","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539389+0000","last_change":"2021-02-12T17:16:08.266987+0000","last_active":"2021-02-12T17:16:08.539389+0000","last_peered":"2021-02-12T17:16:08.539389+0000","last_clean":"2021-02-12T17:16:08.539389+0000","last_became_active":"2021-02-12T17:16:08.266792+0000","last_became_peered":"2021-02-12T17:16:08.266792+0000","last_unstale":"2021-02-12T17:16:08.539389+0000","last_undegraded":"2021-02-12T17:16:08.539389+0000","last_fullsized":"2021-02-12T17:16:08.539389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"21'6","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535024+0000","last_change":"2021-02-12T17:16:01.722204+0000","last_active":"2021-02-12T17:16:08.535024+0000","last_peered":"2021-02-12T17:16:08.535024+0000","last_clean":"2021-02-12T17:16:08.535024+0000","last_became_active":"2021-02-12T17:16:01.722060+0000","last_became_peered":"2021-02-12T17:16:01.722060+0000","last_unstale":"2021-02-12T17:16:08.535024+0000","last_undegraded":"2021-02-12T17:16:08.535024+0000","last_fullsized":"2021-02-12T17:16:08.535024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534569+0000","last_change":"2021-02-12T17:15:59.564122+0000","last_active":"2021-02-12T17:16:08.534569+0000","last_peered":"2021-02-12T17:16:08.534569+0000","last_clean":"2021-02-12T17:16:08.534569+0000","last_became_active":"2021-02-12T17:15:59.563695+0000","last_became_peered":"2021-02-12T17:15:59.563695+0000","last_unstale":"2021-02-12T17:16:08.534569+0000","last_undegraded":"2021-02-12T17:16:08.534569+0000","last_fullsized":"2021-02-12T17:16:08.534569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534411+0000","last_change":"2021-02-12T17:16:01.999102+0000","last_active":"2021-02-12T17:16:08.534411+0000","last_peered":"2021-02-12T17:16:08.534411+0000","last_clean":"2021-02-12T17:16:08.534411+0000","last_became_active":"2021-02-12T17:16:01.998815+0000","last_became_peered":"2021-02-12T17:16:01.998815+0000","last_unstale":"2021-02-12T17:16:08.534411+0000","last_undegraded":"2021-02-12T17:16:08.534411+0000","last_fullsized":"2021-02-12T17:16:08.534411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"26'5","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539870+0000","last_change":"2021-02-12T17:16:08.267434+0000","last_active":"2021-02-12T17:16:08.539870+0000","last_peered":"2021-02-12T17:16:08.539870+0000","last_clean":"2021-02-12T17:16:08.539870+0000","last_became_active":"2021-02-12T17:16:08.267218+0000","last_became_peered":"2021-02-12T17:16:08.267218+0000","last_unstale":"2021-02-12T17:16:08.539870+0000","last_undegraded":"2021-02-12T17:16:08.539870+0000","last_fullsized":"2021-02-12T17:16:08.539870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538696+0000","last_change":"2021-02-12T17:16:08.535970+0000","last_active":"2021-02-12T17:16:08.538696+0000","last_peered":"2021-02-12T17:16:08.538696+0000","last_clean":"2021-02-12T17:16:08.538696+0000","last_became_active":"2021-02-12T17:16:08.535744+0000","last_became_peered":"2021-02-12T17:16:08.535744+0000","last_unstale":"2021-02-12T17:16:08.538696+0000","last_undegraded":"2021-02-12T17:16:08.538696+0000","last_fullsized":"2021-02-12T17:16:08.538696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":120499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5312,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366528,"statfs":{"total":96636764160,"available":96631324672,"internally_reserved":0,"allocated":319488,"data_stored":122737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":120693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5180,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366660,"statfs":{"total":96636764160,"available":96631459840,"internally_reserved":0,"allocated":315392,"data_stored":123537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":120499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]}]}} 2021-02-12T17:16:19.265 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-02-12T17:16:19.265 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-02-12T17:16:19.265 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-02-12T17:16:19.265 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-12T17:16:19.353 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.352+0000 7f53d65c9700 1 Processor -- start 2021-02-12T17:16:19.353 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.352+0000 7f53d65c9700 1 -- start start 2021-02-12T17:16:19.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.352+0000 7f53d65c9700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f53d00b8d20 0x7f53d0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.352+0000 7f53d65c9700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53d014e530 0x7f53d00b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.352+0000 7f53d65c9700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f53d0062740 0x7f53d0062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.352+0000 7f53d65c9700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d0068d20 con 0x7f53d0062740 2021-02-12T17:16:19.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.352+0000 7f53d65c9700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d00622a0 con 0x7f53d00b8d20 2021-02-12T17:16:19.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.352+0000 7f53d65c9700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d014ea10 con 0x7f53d014e530 2021-02-12T17:16:19.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d4b66700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f53d0062740 0x7f53d0062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d4b66700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f53d0062740 0x7f53d0062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45104/0 (socket says 172.21.2.102:45104) 2021-02-12T17:16:19.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d4b66700 1 -- 172.21.2.102:0/4083986149 learned_addr learned my addr 172.21.2.102:0/4083986149 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:19.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d4b66700 1 -- 172.21.2.102:0/4083986149 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53d014e530 msgr2=0x7f53d00b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:19.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d4b66700 1 --2- 172.21.2.102:0/4083986149 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53d014e530 0x7f53d00b7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d4b66700 1 -- 172.21.2.102:0/4083986149 >> v2:172.21.2.104:3300/0 conn(0x7f53d00b8d20 msgr2=0x7f53d0068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:19.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d4b66700 1 --2- 172.21.2.102:0/4083986149 >> v2:172.21.2.104:3300/0 conn(0x7f53d00b8d20 0x7f53d0068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d4b66700 1 -- 172.21.2.102:0/4083986149 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d00b63f0 con 0x7f53d0062740 2021-02-12T17:16:19.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d4b66700 1 --2- 172.21.2.102:0/4083986149 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53d0062740 0x7f53d0062bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f53d006abc0 tx=0x7f53c8009290).ready entity=mon.0 client_cookie=448c9017be5efa34 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:19.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53ceffd700 1 -- 172.21.2.102:0/4083986149 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c800bbf0 con 0x7f53d0062740 2021-02-12T17:16:19.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53ceffd700 1 -- 172.21.2.102:0/4083986149 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c800bd50 con 0x7f53d0062740 2021-02-12T17:16:19.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53ceffd700 1 -- 172.21.2.102:0/4083986149 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8011610 con 0x7f53d0062740 2021-02-12T17:16:19.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d65c9700 1 -- 172.21.2.102:0/4083986149 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53d0062740 msgr2=0x7f53d0062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d65c9700 1 --2- 172.21.2.102:0/4083986149 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53d0062740 0x7f53d0062bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f53d006abc0 tx=0x7f53c8009290).stop 2021-02-12T17:16:19.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d65c9700 1 -- 172.21.2.102:0/4083986149 shutdown_connections 2021-02-12T17:16:19.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d65c9700 1 --2- 172.21.2.102:0/4083986149 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53d0062740 0x7f53d0062bf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d65c9700 1 --2- 172.21.2.102:0/4083986149 >> v2:172.21.2.104:3300/0 conn(0x7f53d00b8d20 0x7f53d0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d65c9700 1 --2- 172.21.2.102:0/4083986149 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53d014e530 0x7f53d00b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.353+0000 7f53d65c9700 1 -- 172.21.2.102:0/4083986149 >> 172.21.2.102:0/4083986149 conn(0x7f53d00bc480 msgr2=0x7f53d00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:19.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.354+0000 7f53d65c9700 1 -- 172.21.2.102:0/4083986149 shutdown_connections 2021-02-12T17:16:19.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.354+0000 7f53d65c9700 1 -- 172.21.2.102:0/4083986149 wait complete. 2021-02-12T17:16:19.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.354+0000 7f53d65c9700 1 Processor -- start 2021-02-12T17:16:19.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d65c9700 1 -- start start 2021-02-12T17:16:19.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d65c9700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f53d0062740 0x7f53d00ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d65c9700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53d00b8d20 0x7f53d015d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d65c9700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53d014e530 0x7f53d015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d65c9700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d015e0f0 con 0x7f53d014e530 2021-02-12T17:16:19.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d65c9700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00b20a0 con 0x7f53d0062740 2021-02-12T17:16:19.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d65c9700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00b2340 con 0x7f53d00b8d20 2021-02-12T17:16:19.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d4b66700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53d014e530 0x7f53d015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d4b66700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53d014e530 0x7f53d015dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45110/0 (socket says 172.21.2.102:45110) 2021-02-12T17:16:19.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d4b66700 1 -- 172.21.2.102:0/798550590 learned_addr learned my addr 172.21.2.102:0/798550590 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:19.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d4b66700 1 -- 172.21.2.102:0/798550590 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53d00b8d20 msgr2=0x7f53d015d710 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:19.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d4b66700 1 --2- 172.21.2.102:0/798550590 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53d00b8d20 0x7f53d015d710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d4b66700 1 -- 172.21.2.102:0/798550590 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f53d0062740 msgr2=0x7f53d00ae380 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:19.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d4b66700 1 --2- 172.21.2.102:0/798550590 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f53d0062740 0x7f53d00ae380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.355+0000 7f53d4b66700 1 -- 172.21.2.102:0/798550590 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d015d270 con 0x7f53d014e530 2021-02-12T17:16:19.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.356+0000 7f53d4b66700 1 --2- 172.21.2.102:0/798550590 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53d014e530 0x7f53d015dc00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f53d00653c0 tx=0x7f53c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:19.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.356+0000 7f53c7fff700 1 -- 172.21.2.102:0/798550590 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8009e60 con 0x7f53d014e530 2021-02-12T17:16:19.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.356+0000 7f53c7fff700 1 -- 172.21.2.102:0/798550590 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8011e30 con 0x7f53d014e530 2021-02-12T17:16:19.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.356+0000 7f53c7fff700 1 -- 172.21.2.102:0/798550590 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8010df0 con 0x7f53d014e530 2021-02-12T17:16:19.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.356+0000 7f53d65c9700 1 -- 172.21.2.102:0/798550590 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d00b25e0 con 0x7f53d014e530 2021-02-12T17:16:19.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.356+0000 7f53d65c9700 1 -- 172.21.2.102:0/798550590 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d00b0b50 con 0x7f53d014e530 2021-02-12T17:16:19.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.357+0000 7f53d65c9700 1 -- 172.21.2.102:0/798550590 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d015d400 con 0x7f53d014e530 2021-02-12T17:16:19.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.357+0000 7f53c7fff700 1 -- 172.21.2.102:0/798550590 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f53c800f070 con 0x7f53d014e530 2021-02-12T17:16:19.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.357+0000 7f53c7fff700 1 --2- 172.21.2.102:0/798550590 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f53b4059d30 0x7f53b405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.357+0000 7f53c7fff700 1 -- 172.21.2.102:0/798550590 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f53c8075ba0 con 0x7f53d014e530 2021-02-12T17:16:19.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.357+0000 7f53cffff700 1 --2- 172.21.2.102:0/798550590 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f53b4059d30 0x7f53b405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.357+0000 7f53cffff700 1 --2- 172.21.2.102:0/798550590 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f53b4059d30 0x7f53b405c1f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f53d014eec0 tx=0x7f53c0006920).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:19.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.360+0000 7f53c7fff700 1 -- 172.21.2.102:0/798550590 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f53c80492c0 con 0x7f53d014e530 2021-02-12T17:16:19.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.539+0000 7f53d65c9700 1 -- 172.21.2.102:0/798550590 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f53d0045460 con 0x7f53d014e530 2021-02-12T17:16:19.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.540+0000 7f53c7fff700 1 -- 172.21.2.102:0/798550590 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f53c804c8e0 con 0x7f53d014e530 2021-02-12T17:16:19.541 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:19.542 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.541+0000 7f53d65c9700 1 -- 172.21.2.102:0/798550590 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f53b4059d30 msgr2=0x7f53b405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.541+0000 7f53d65c9700 1 --2- 172.21.2.102:0/798550590 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f53b4059d30 0x7f53b405c1f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f53d014eec0 tx=0x7f53c0006920).stop 2021-02-12T17:16:19.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.541+0000 7f53d65c9700 1 -- 172.21.2.102:0/798550590 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53d014e530 msgr2=0x7f53d015dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.541+0000 7f53d65c9700 1 --2- 172.21.2.102:0/798550590 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53d014e530 0x7f53d015dc00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f53d00653c0 tx=0x7f53c8017000).stop 2021-02-12T17:16:19.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.541+0000 7f53d65c9700 1 -- 172.21.2.102:0/798550590 shutdown_connections 2021-02-12T17:16:19.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.541+0000 7f53d65c9700 1 --2- 172.21.2.102:0/798550590 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f53b4059d30 0x7f53b405c1f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.541+0000 7f53d65c9700 1 --2- 172.21.2.102:0/798550590 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f53d014e530 0x7f53d015dc00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.541+0000 7f53d65c9700 1 --2- 172.21.2.102:0/798550590 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f53d0062740 0x7f53d00ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.541+0000 7f53d65c9700 1 --2- 172.21.2.102:0/798550590 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53d00b8d20 0x7f53d015d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.541+0000 7f53d65c9700 1 -- 172.21.2.102:0/798550590 >> 172.21.2.102:0/798550590 conn(0x7f53d00bc480 msgr2=0x7f53d014cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:19.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.541+0000 7f53d65c9700 1 -- 172.21.2.102:0/798550590 shutdown_connections 2021-02-12T17:16:19.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.541+0000 7f53d65c9700 1 -- 172.21.2.102:0/798550590 wait complete. 2021-02-12T17:16:19.551 INFO:teuthology.orchestra.run.gibba002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-02-12T17:16:19.551 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-02-12T17:16:19.552 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:19.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.638+0000 7f39dafab700 1 Processor -- start 2021-02-12T17:16:19.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.638+0000 7f39dafab700 1 -- start start 2021-02-12T17:16:19.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.639+0000 7f39dafab700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f39d4062e50 0x7f39d4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.639+0000 7f39dafab700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d40b7960 con 0x7f39d40b8d20 2021-02-12T17:16:19.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.639+0000 7f39dafab700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d40622a0 con 0x7f39d414e530 2021-02-12T17:16:19.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.639+0000 7f39dafab700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d4068d20 con 0x7f39d4062e50 2021-02-12T17:16:19.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.639+0000 7f39d9548700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f39d4062e50 0x7f39d4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.639+0000 7f39d8d47700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f39d40b8d20 0x7f39d40b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53762/0 (socket says 172.21.2.102:53762) 2021-02-12T17:16:19.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.639+0000 7f39d8d47700 1 -- 172.21.2.102:0/1036560498 learned_addr learned my addr 172.21.2.102:0/1036560498 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:19.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.639+0000 7f39d9548700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f39d4062e50 0x7f39d4068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45118/0 (socket says 172.21.2.102:45118) 2021-02-12T17:16:19.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.639+0000 7f39d37fe700 1 -- 172.21.2.102:0/1036560498 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171043587 0 0) 0x7f39d40b7960 con 0x7f39d40b8d20 2021-02-12T17:16:19.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.639+0000 7f39d9548700 1 -- 172.21.2.102:0/1036560498 >> v1:172.21.2.104:6789/0 conn(0x7f39d414e530 legacy=0x7f39d4062740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:19.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.639+0000 7f39d9548700 1 -- 172.21.2.102:0/1036560498 >> v1:172.21.2.102:6789/0 conn(0x7f39d40b8d20 legacy=0x7f39d40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.639+0000 7f39d9548700 1 -- 172.21.2.102:0/1036560498 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d414ea10 con 0x7f39d4062e50 2021-02-12T17:16:19.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.639+0000 7f39d9548700 1 --2- 172.21.2.102:0/1036560498 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f39d4062e50 0x7f39d4068830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f39cc009c90 tx=0x7f39cc0091d0).ready entity=mon.0 client_cookie=f6d43f1475a588bf server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:19.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.640+0000 7f39d37fe700 1 -- 172.21.2.102:0/1036560498 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc009ea0 con 0x7f39d4062e50 2021-02-12T17:16:19.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.640+0000 7f39d37fe700 1 -- 172.21.2.102:0/1036560498 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39cc00bbb0 con 0x7f39d4062e50 2021-02-12T17:16:19.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.640+0000 7f39d37fe700 1 -- 172.21.2.102:0/1036560498 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc011400 con 0x7f39d4062e50 2021-02-12T17:16:19.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.640+0000 7f39dafab700 1 -- 172.21.2.102:0/1036560498 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f39d4062e50 msgr2=0x7f39d4068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.640+0000 7f39dafab700 1 --2- 172.21.2.102:0/1036560498 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f39d4062e50 0x7f39d4068830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f39cc009c90 tx=0x7f39cc0091d0).stop 2021-02-12T17:16:19.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.640+0000 7f39dafab700 1 -- 172.21.2.102:0/1036560498 shutdown_connections 2021-02-12T17:16:19.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.640+0000 7f39dafab700 1 --2- 172.21.2.102:0/1036560498 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f39d4062e50 0x7f39d4068830 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.640+0000 7f39dafab700 1 -- 172.21.2.102:0/1036560498 >> 172.21.2.102:0/1036560498 conn(0x7f39d40bc480 msgr2=0x7f39d40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:19.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.640+0000 7f39dafab700 1 -- 172.21.2.102:0/1036560498 shutdown_connections 2021-02-12T17:16:19.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.640+0000 7f39dafab700 1 -- 172.21.2.102:0/1036560498 wait complete. 2021-02-12T17:16:19.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.641+0000 7f39dafab700 1 Processor -- start 2021-02-12T17:16:19.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.641+0000 7f39dafab700 1 -- start start 2021-02-12T17:16:19.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39dafab700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f39d4062e50 0x7f39d40b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39dafab700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f39d40b8d20 0x7f39d40ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39dafab700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f39d414e530 0x7f39d40b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39dafab700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4153d70 con 0x7f39d4062e50 2021-02-12T17:16:19.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39dafab700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d40adc90 con 0x7f39d40b8d20 2021-02-12T17:16:19.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39dafab700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d40adec0 con 0x7f39d414e530 2021-02-12T17:16:19.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39d8d47700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f39d4062e50 0x7f39d40b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39d8d47700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f39d4062e50 0x7f39d40b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45124/0 (socket says 172.21.2.102:45124) 2021-02-12T17:16:19.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39d8d47700 1 -- 172.21.2.102:0/2765760264 learned_addr learned my addr 172.21.2.102:0/2765760264 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:19.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39d8d47700 1 -- 172.21.2.102:0/2765760264 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f39d414e530 msgr2=0x7f39d40b0e40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:19.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39d8d47700 1 --2- 172.21.2.102:0/2765760264 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f39d414e530 0x7f39d40b0e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39d8d47700 1 -- 172.21.2.102:0/2765760264 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f39d40b8d20 msgr2=0x7f39d40ae420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:19.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39d8d47700 1 --2- 172.21.2.102:0/2765760264 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f39d40b8d20 0x7f39d40ae420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39d8d47700 1 -- 172.21.2.102:0/2765760264 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d40b5af0 con 0x7f39d4062e50 2021-02-12T17:16:19.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39d8d47700 1 --2- 172.21.2.102:0/2765760264 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f39d4062e50 0x7f39d40b2350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f39bc00c760 tx=0x7f39bc007a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:19.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39d0ff9700 1 -- 172.21.2.102:0/2765760264 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc007320 con 0x7f39d4062e50 2021-02-12T17:16:19.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39d0ff9700 1 -- 172.21.2.102:0/2765760264 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc007480 con 0x7f39d4062e50 2021-02-12T17:16:19.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39dafab700 1 -- 172.21.2.102:0/2765760264 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d40b5d90 con 0x7f39d4062e50 2021-02-12T17:16:19.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.642+0000 7f39d0ff9700 1 -- 172.21.2.102:0/2765760264 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc005810 con 0x7f39d4062e50 2021-02-12T17:16:19.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.643+0000 7f39dafab700 1 -- 172.21.2.102:0/2765760264 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d4160b70 con 0x7f39d4062e50 2021-02-12T17:16:19.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.643+0000 7f39dafab700 1 -- 172.21.2.102:0/2765760264 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d4160d30 con 0x7f39d4062e50 2021-02-12T17:16:19.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.643+0000 7f39d0ff9700 1 -- 172.21.2.102:0/2765760264 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f39bc010030 con 0x7f39d4062e50 2021-02-12T17:16:19.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.644+0000 7f39d0ff9700 1 --2- 172.21.2.102:0/2765760264 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f39b8059d30 0x7f39b805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.644+0000 7f39d0ff9700 1 -- 172.21.2.102:0/2765760264 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f39bc073a80 con 0x7f39d4062e50 2021-02-12T17:16:19.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.644+0000 7f39d3fff700 1 --2- 172.21.2.102:0/2765760264 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f39b8059d30 0x7f39b805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.644+0000 7f39d3fff700 1 --2- 172.21.2.102:0/2765760264 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f39b8059d30 0x7f39b805c1f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f39d40b2840 tx=0x7f39c4006880).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:19.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.646+0000 7f39d0ff9700 1 -- 172.21.2.102:0/2765760264 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f39bc047140 con 0x7f39d4062e50 2021-02-12T17:16:19.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.775+0000 7f39dafab700 1 -- 172.21.2.102:0/2765760264 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39d4045460 con 0x7f39d4062e50 2021-02-12T17:16:19.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.776+0000 7f39d0ff9700 1 -- 172.21.2.102:0/2765760264 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19888 (secure 0 0 0) 0x7f39bc04a760 con 0x7f39d4062e50 2021-02-12T17:16:19.778 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:19.778 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":27,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:09.532002+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}},{"pool":5,"pool_name":"b_metadata","create_time":"2021-02-12T17:16:06.678651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}}},{"pool":6,"pool_name":"b_data","create_time":"2021-02-12T17:16:07.511756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"b"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:19.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.777+0000 7f39dafab700 1 -- 172.21.2.102:0/2765760264 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f39b8059d30 msgr2=0x7f39b805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.777+0000 7f39dafab700 1 --2- 172.21.2.102:0/2765760264 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f39b8059d30 0x7f39b805c1f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f39d40b2840 tx=0x7f39c4006880).stop 2021-02-12T17:16:19.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.777+0000 7f39dafab700 1 -- 172.21.2.102:0/2765760264 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f39d4062e50 msgr2=0x7f39d40b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.777+0000 7f39dafab700 1 --2- 172.21.2.102:0/2765760264 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f39d4062e50 0x7f39d40b2350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f39bc00c760 tx=0x7f39bc007a50).stop 2021-02-12T17:16:19.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.777+0000 7f39dafab700 1 -- 172.21.2.102:0/2765760264 shutdown_connections 2021-02-12T17:16:19.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.777+0000 7f39dafab700 1 --2- 172.21.2.102:0/2765760264 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f39d414e530 0x7f39d40b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.777+0000 7f39dafab700 1 --2- 172.21.2.102:0/2765760264 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f39b8059d30 0x7f39b805c1f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.777+0000 7f39dafab700 1 --2- 172.21.2.102:0/2765760264 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f39d4062e50 0x7f39d40b2350 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.777+0000 7f39dafab700 1 --2- 172.21.2.102:0/2765760264 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f39d40b8d20 0x7f39d40ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:19.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.777+0000 7f39dafab700 1 -- 172.21.2.102:0/2765760264 >> 172.21.2.102:0/2765760264 conn(0x7f39d40bc480 msgr2=0x7f39d4151810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:19.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.777+0000 7f39dafab700 1 -- 172.21.2.102:0/2765760264 shutdown_connections 2021-02-12T17:16:19.780 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.777+0000 7f39dafab700 1 -- 172.21.2.102:0/2765760264 wait complete. 2021-02-12T17:16:19.788 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-12T17:15:54.614238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-12T17:15:56.701902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'a_metadata', 'create_time': '2021-02-12T17:15:59.832660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}}, {'pool': 4, 'pool_name': 'a_data', 'create_time': '2021-02-12T17:16:00.965024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'a'}}}, {'pool': 5, 'pool_name': 'b_metadata', 'create_time': '2021-02-12T17:16:06.678651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}}, {'pool': 6, 'pool_name': 'b_data', 'create_time': '2021-02-12T17:16:07.511756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'b'}}}] 2021-02-12T17:16:19.788 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-02-12T17:16:19.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.876+0000 7fec66237700 1 Processor -- start 2021-02-12T17:16:19.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.876+0000 7fec66237700 1 -- start start 2021-02-12T17:16:19.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.876+0000 7fec66237700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fec600bc2b0 0x7fec60151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.876+0000 7fec66237700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fec60151d20 0x7fec6014e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.876+0000 7fec66237700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec60066b70 con 0x7fec600b0940 2021-02-12T17:16:19.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.876+0000 7fec66237700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec600b27d0 con 0x7fec60151d20 2021-02-12T17:16:19.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.876+0000 7fec66237700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec6014e550 con 0x7fec600bc2b0 2021-02-12T17:16:19.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.877+0000 7fec5ffff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fec60151d20 0x7fec6014e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.877+0000 7fec5ffff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fec60151d20 0x7fec6014e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45130/0 (socket says 172.21.2.102:45130) 2021-02-12T17:16:19.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.877+0000 7fec5ffff700 1 -- 172.21.2.102:0/3870107954 learned_addr learned my addr 172.21.2.102:0/3870107954 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:19.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.877+0000 7fec5f7fe700 1 --2- 172.21.2.102:0/3870107954 >> v2:172.21.2.104:3300/0 conn(0x7fec600bc2b0 0x7fec60151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.877+0000 7fec5ffff700 1 -- 172.21.2.102:0/3870107954 >> v2:172.21.2.104:3300/0 conn(0x7fec600bc2b0 msgr2=0x7fec60151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:19.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.877+0000 7fec5ffff700 1 --2- 172.21.2.102:0/3870107954 >> v2:172.21.2.104:3300/0 conn(0x7fec600bc2b0 0x7fec60151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.877+0000 7fec5ffff700 1 -- 172.21.2.102:0/3870107954 >> v1:172.21.2.104:6789/0 conn(0x7fec600b0940 legacy=0x7fec60151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:19.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.877+0000 7fec5ffff700 1 -- 172.21.2.102:0/3870107954 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec600685b0 con 0x7fec60151d20 2021-02-12T17:16:19.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.877+0000 7fec5ffff700 1 --2- 172.21.2.102:0/3870107954 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fec60151d20 0x7fec6014e060 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fec600b94d0 tx=0x7fec58009290).ready entity=mon.0 client_cookie=767bc5d11602e331 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:19.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.877+0000 7fec5e7fc700 1 -- 172.21.2.102:0/3870107954 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5800bc40 con 0x7fec60151d20 2021-02-12T17:16:19.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.877+0000 7fec5e7fc700 1 -- 172.21.2.102:0/3870107954 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5800bda0 con 0x7fec60151d20 2021-02-12T17:16:19.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.877+0000 7fec5e7fc700 1 -- 172.21.2.102:0/3870107954 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec58011610 con 0x7fec60151d20 2021-02-12T17:16:19.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.878+0000 7fec66237700 1 -- 172.21.2.102:0/3870107954 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fec60151d20 msgr2=0x7fec6014e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.878+0000 7fec66237700 1 --2- 172.21.2.102:0/3870107954 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fec60151d20 0x7fec6014e060 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fec600b94d0 tx=0x7fec58009290).stop 2021-02-12T17:16:19.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.878+0000 7fec66237700 1 -- 172.21.2.102:0/3870107954 shutdown_connections 2021-02-12T17:16:19.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.878+0000 7fec66237700 1 --2- 172.21.2.102:0/3870107954 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fec60151d20 0x7fec6014e060 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.878+0000 7fec66237700 1 --2- 172.21.2.102:0/3870107954 >> v2:172.21.2.104:3300/0 conn(0x7fec600bc2b0 0x7fec60151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.878+0000 7fec66237700 1 -- 172.21.2.102:0/3870107954 >> 172.21.2.102:0/3870107954 conn(0x7fec60061830 msgr2=0x7fec600bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:19.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.878+0000 7fec66237700 1 -- 172.21.2.102:0/3870107954 shutdown_connections 2021-02-12T17:16:19.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.878+0000 7fec66237700 1 -- 172.21.2.102:0/3870107954 wait complete. 2021-02-12T17:16:19.884 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.879+0000 7fec66237700 1 Processor -- start 2021-02-12T17:16:19.884 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.879+0000 7fec66237700 1 -- start start 2021-02-12T17:16:19.884 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec66237700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fec600b0940 0x7fec60091090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.884 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec66237700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fec600bc2b0 0x7fec60091580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.884 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec66237700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fec60151d20 0x7fec6014c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec66237700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec60161250 con 0x7fec600bc2b0 2021-02-12T17:16:19.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec66237700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec600b3410 con 0x7fec600b0940 2021-02-12T17:16:19.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec66237700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec60161480 con 0x7fec60151d20 2021-02-12T17:16:19.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec5effd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fec600bc2b0 0x7fec60091580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec5effd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fec600bc2b0 0x7fec60091580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45136/0 (socket says 172.21.2.102:45136) 2021-02-12T17:16:19.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec5effd700 1 -- 172.21.2.102:0/3101969194 learned_addr learned my addr 172.21.2.102:0/3101969194 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:19.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec5ffff700 1 --2- 172.21.2.102:0/3101969194 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fec60151d20 0x7fec6014c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec5f7fe700 1 --2- 172.21.2.102:0/3101969194 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fec600b0940 0x7fec60091090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec5effd700 1 -- 172.21.2.102:0/3101969194 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fec60151d20 msgr2=0x7fec6014c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec5effd700 1 --2- 172.21.2.102:0/3101969194 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fec60151d20 0x7fec6014c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec5effd700 1 -- 172.21.2.102:0/3101969194 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fec600b0940 msgr2=0x7fec60091090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:19.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec5effd700 1 --2- 172.21.2.102:0/3101969194 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fec600b0940 0x7fec60091090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:19.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec5effd700 1 -- 172.21.2.102:0/3101969194 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec600b3a30 con 0x7fec600bc2b0 2021-02-12T17:16:19.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.880+0000 7fec5effd700 1 --2- 172.21.2.102:0/3101969194 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fec600bc2b0 0x7fec60091580 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fec5000c760 tx=0x7fec50007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:19.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.881+0000 7fec477fe700 1 -- 172.21.2.102:0/3101969194 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50010510 con 0x7fec600bc2b0 2021-02-12T17:16:19.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.881+0000 7fec66237700 1 -- 172.21.2.102:0/3101969194 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec600b36b0 con 0x7fec600bc2b0 2021-02-12T17:16:19.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.881+0000 7fec66237700 1 -- 172.21.2.102:0/3101969194 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec600b3ee0 con 0x7fec600bc2b0 2021-02-12T17:16:19.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.881+0000 7fec477fe700 1 -- 172.21.2.102:0/3101969194 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec50010690 con 0x7fec600bc2b0 2021-02-12T17:16:19.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.881+0000 7fec477fe700 1 -- 172.21.2.102:0/3101969194 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50010a50 con 0x7fec600bc2b0 2021-02-12T17:16:19.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.881+0000 7fec66237700 1 -- 172.21.2.102:0/3101969194 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec60161640 con 0x7fec600bc2b0 2021-02-12T17:16:19.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.881+0000 7fec477fe700 1 -- 172.21.2.102:0/3101969194 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fec50010070 con 0x7fec600bc2b0 2021-02-12T17:16:19.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.882+0000 7fec477fe700 1 --2- 172.21.2.102:0/3101969194 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fec40059d30 0x7fec4005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:19.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.882+0000 7fec477fe700 1 -- 172.21.2.102:0/3101969194 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fec500737c0 con 0x7fec600bc2b0 2021-02-12T17:16:19.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.882+0000 7fec5f7fe700 1 --2- 172.21.2.102:0/3101969194 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fec40059d30 0x7fec4005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:19.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.882+0000 7fec5f7fe700 1 --2- 172.21.2.102:0/3101969194 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fec40059d30 0x7fec4005c1f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fec54006fd0 tx=0x7fec54008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:19.887 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:19.885+0000 7fec477fe700 1 -- 172.21.2.102:0/3101969194 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fec50046ff0 con 0x7fec600bc2b0 2021-02-12T17:16:20.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.012+0000 7fec66237700 1 -- 172.21.2.102:0/3101969194 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fec60045460 con 0x7fec600bc2b0 2021-02-12T17:16:20.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.012+0000 7fec477fe700 1 -- 172.21.2.102:0/3101969194 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v27) v1 ==== 110+0+10 (secure 0 0 0) 0x7fec50007d10 con 0x7fec600bc2b0 2021-02-12T17:16:20.014 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 1 2021-02-12T17:16:20.015 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.013+0000 7fec66237700 1 -- 172.21.2.102:0/3101969194 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fec40059d30 msgr2=0x7fec4005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.015 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.013+0000 7fec66237700 1 --2- 172.21.2.102:0/3101969194 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fec40059d30 0x7fec4005c1f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fec54006fd0 tx=0x7fec54008040).stop 2021-02-12T17:16:20.015 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.013+0000 7fec66237700 1 -- 172.21.2.102:0/3101969194 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fec600bc2b0 msgr2=0x7fec60091580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.015 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.013+0000 7fec66237700 1 --2- 172.21.2.102:0/3101969194 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fec600bc2b0 0x7fec60091580 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fec5000c760 tx=0x7fec50007bf0).stop 2021-02-12T17:16:20.015 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.013+0000 7fec66237700 1 -- 172.21.2.102:0/3101969194 shutdown_connections 2021-02-12T17:16:20.015 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.013+0000 7fec66237700 1 --2- 172.21.2.102:0/3101969194 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fec60151d20 0x7fec6014c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.015 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.013+0000 7fec66237700 1 --2- 172.21.2.102:0/3101969194 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fec600b0940 0x7fec60091090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.015 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.013+0000 7fec66237700 1 --2- 172.21.2.102:0/3101969194 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fec40059d30 0x7fec4005c1f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.013+0000 7fec66237700 1 --2- 172.21.2.102:0/3101969194 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fec600bc2b0 0x7fec60091580 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.013+0000 7fec66237700 1 -- 172.21.2.102:0/3101969194 >> 172.21.2.102:0/3101969194 conn(0x7fec60061830 msgr2=0x7fec6014d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:20.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.013+0000 7fec66237700 1 -- 172.21.2.102:0/3101969194 shutdown_connections 2021-02-12T17:16:20.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.014+0000 7fec66237700 1 -- 172.21.2.102:0/3101969194 wait complete. 2021-02-12T17:16:20.024 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-02-12T17:16:20.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.111+0000 7fb901ace700 1 Processor -- start 2021-02-12T17:16:20.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.111+0000 7fb901ace700 1 -- start start 2021-02-12T17:16:20.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.112+0000 7fb901ace700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb8fc0b0940 0x7fb8fc14e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.112+0000 7fb901ace700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8fc066b70 con 0x7fb8fc09ada0 2021-02-12T17:16:20.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.112+0000 7fb901ace700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8fc0685b0 con 0x7fb8fc0bc2b0 2021-02-12T17:16:20.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.112+0000 7fb901ace700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc0b27d0 con 0x7fb8fc0b0940 2021-02-12T17:16:20.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.112+0000 7fb8fbfff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fb8fc09ada0 0x7fb8fc151830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53788/0 (socket says 172.21.2.102:53788) 2021-02-12T17:16:20.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.112+0000 7fb8fbfff700 1 -- 172.21.2.102:0/3727120646 learned_addr learned my addr 172.21.2.102:0/3727120646 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:20.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.112+0000 7fb8fa7fc700 1 -- 172.21.2.102:0/3727120646 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46260868 0 0) 0x7fb8fc066b70 con 0x7fb8fc09ada0 2021-02-12T17:16:20.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.112+0000 7fb8fa7fc700 1 -- 172.21.2.102:0/3727120646 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8dc003230 con 0x7fb8fc09ada0 2021-02-12T17:16:20.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.112+0000 7fb8faffd700 1 --2- 172.21.2.102:0/3727120646 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb8fc0b0940 0x7fb8fc14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fa7fc700 1 -- 172.21.2.102:0/3727120646 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1444423448 0 0) 0x7fb8dc003230 con 0x7fb8fc09ada0 2021-02-12T17:16:20.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fa7fc700 1 -- 172.21.2.102:0/3727120646 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb8fc0b0940 msgr2=0x7fb8fc14e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:20.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fa7fc700 1 --2- 172.21.2.102:0/3727120646 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb8fc0b0940 0x7fb8fc14e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fa7fc700 1 -- 172.21.2.102:0/3727120646 >> v1:172.21.2.104:6789/0 conn(0x7fb8fc0bc2b0 legacy=0x7fb8fc151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fa7fc700 1 -- 172.21.2.102:0/3727120646 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc14e550 con 0x7fb8fc09ada0 2021-02-12T17:16:20.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fa7fc700 1 -- 172.21.2.102:0/3727120646 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fb8f4001860 con 0x7fb8fc09ada0 2021-02-12T17:16:20.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8faffd700 1 --2- 172.21.2.102:0/3727120646 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb8fc0b0940 0x7fb8fc14e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:20.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fa7fc700 1 -- 172.21.2.102:0/3727120646 >> v1:172.21.2.102:6789/0 conn(0x7fb8fc09ada0 legacy=0x7fb8fc151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fa7fc700 1 --2- 172.21.2.102:0/3727120646 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb8dc003750 0x7fb8dc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fa7fc700 1 --2- 172.21.2.102:0/3727120646 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb8dc0044d0 0x7fb8dc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fa7fc700 1 --2- 172.21.2.102:0/3727120646 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb8fc0b0940 0x7fb8dc004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fa7fc700 1 -- 172.21.2.102:0/3727120646 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc0b27d0 con 0x7fb8dc003750 2021-02-12T17:16:20.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fa7fc700 1 -- 172.21.2.102:0/3727120646 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc005380 con 0x7fb8dc0044d0 2021-02-12T17:16:20.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fa7fc700 1 -- 172.21.2.102:0/3727120646 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc004320 con 0x7fb8fc0b0940 2021-02-12T17:16:20.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fb7fe700 1 --2- 172.21.2.102:0/3727120646 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb8dc003750 0x7fb8dc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fbfff700 1 --2- 172.21.2.102:0/3727120646 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb8fc0b0940 0x7fb8dc004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8faffd700 1 --2- 172.21.2.102:0/3727120646 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb8dc0044d0 0x7fb8dc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fb7fe700 1 -- 172.21.2.102:0/3727120646 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb8fc0b0940 msgr2=0x7fb8dc004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:20.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fb7fe700 1 --2- 172.21.2.102:0/3727120646 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb8fc0b0940 0x7fb8dc004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fb7fe700 1 -- 172.21.2.102:0/3727120646 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb8dc0044d0 msgr2=0x7fb8dc004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:20.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fb7fe700 1 --2- 172.21.2.102:0/3727120646 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb8dc0044d0 0x7fb8dc004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fb7fe700 1 -- 172.21.2.102:0/3727120646 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc003230 con 0x7fb8dc003750 2021-02-12T17:16:20.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.113+0000 7fb8fb7fe700 1 --2- 172.21.2.102:0/3727120646 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb8dc003750 0x7fb8dc003b70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fb8ec001950 tx=0x7fb8ec007b80).ready entity=mon.0 client_cookie=b6aa5b2cf9e92a91 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:20.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.114+0000 7fb8fa7fc700 1 -- 172.21.2.102:0/3727120646 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec007020 con 0x7fb8dc003750 2021-02-12T17:16:20.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.114+0000 7fb8fa7fc700 1 -- 172.21.2.102:0/3727120646 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec007180 con 0x7fb8dc003750 2021-02-12T17:16:20.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.114+0000 7fb8fa7fc700 1 -- 172.21.2.102:0/3727120646 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00c860 con 0x7fb8dc003750 2021-02-12T17:16:20.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.114+0000 7fb901ace700 1 -- 172.21.2.102:0/3727120646 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb8dc003750 msgr2=0x7fb8dc003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.114+0000 7fb901ace700 1 --2- 172.21.2.102:0/3727120646 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb8dc003750 0x7fb8dc003b70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fb8ec001950 tx=0x7fb8ec007b80).stop 2021-02-12T17:16:20.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.114+0000 7fb8fbfff700 1 -- 172.21.2.102:0/3727120646 reap_dead start 2021-02-12T17:16:20.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.114+0000 7fb901ace700 1 -- 172.21.2.102:0/3727120646 shutdown_connections 2021-02-12T17:16:20.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.114+0000 7fb901ace700 1 -- 172.21.2.102:0/3727120646 >> 172.21.2.102:0/3727120646 conn(0x7fb8fc061830 msgr2=0x7fb8fc0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:20.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.114+0000 7fb901ace700 1 -- 172.21.2.102:0/3727120646 shutdown_connections 2021-02-12T17:16:20.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.114+0000 7fb901ace700 1 -- 172.21.2.102:0/3727120646 wait complete. 2021-02-12T17:16:20.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.115+0000 7fb901ace700 1 Processor -- start 2021-02-12T17:16:20.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.115+0000 7fb901ace700 1 -- start start 2021-02-12T17:16:20.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.115+0000 7fb901ace700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb8dc003750 0x7fb8fc063e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.115+0000 7fb901ace700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb8fc148980 0x7fb8fc1530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.115+0000 7fb901ace700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb8fc09e970 0x7fb8fc061df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.115+0000 7fb901ace700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc1481f0 con 0x7fb8fc148980 2021-02-12T17:16:20.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.115+0000 7fb901ace700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc147ca0 con 0x7fb8dc003750 2021-02-12T17:16:20.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.115+0000 7fb901ace700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc1496c0 con 0x7fb8fc09e970 2021-02-12T17:16:20.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb8faffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb8fc148980 0x7fb8fc1530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb8faffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb8fc148980 0x7fb8fc1530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45158/0 (socket says 172.21.2.102:45158) 2021-02-12T17:16:20.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb8faffd700 1 -- 172.21.2.102:0/2725010369 learned_addr learned my addr 172.21.2.102:0/2725010369 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:20.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb8fb7fe700 1 --2- 172.21.2.102:0/2725010369 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb8dc003750 0x7fb8fc063e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb8fbfff700 1 --2- 172.21.2.102:0/2725010369 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb8fc09e970 0x7fb8fc061df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb8faffd700 1 -- 172.21.2.102:0/2725010369 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb8fc09e970 msgr2=0x7fb8fc061df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb8faffd700 1 --2- 172.21.2.102:0/2725010369 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb8fc09e970 0x7fb8fc061df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb8faffd700 1 -- 172.21.2.102:0/2725010369 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb8dc003750 msgr2=0x7fb8fc063e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb8faffd700 1 --2- 172.21.2.102:0/2725010369 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb8dc003750 0x7fb8fc063e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb8faffd700 1 -- 172.21.2.102:0/2725010369 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc149960 con 0x7fb8fc148980 2021-02-12T17:16:20.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb8faffd700 1 --2- 172.21.2.102:0/2725010369 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb8fc148980 0x7fb8fc1530d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fb8e400f7e0 tx=0x7fb8e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:20.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb8f37fe700 1 -- 172.21.2.102:0/2725010369 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4013610 con 0x7fb8fc148980 2021-02-12T17:16:20.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb8f37fe700 1 -- 172.21.2.102:0/2725010369 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e4013770 con 0x7fb8fc148980 2021-02-12T17:16:20.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb8f37fe700 1 -- 172.21.2.102:0/2725010369 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4013af0 con 0x7fb8fc148980 2021-02-12T17:16:20.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb901ace700 1 -- 172.21.2.102:0/2725010369 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8fc152a60 con 0x7fb8fc148980 2021-02-12T17:16:20.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.116+0000 7fb901ace700 1 -- 172.21.2.102:0/2725010369 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8fc064340 con 0x7fb8fc148980 2021-02-12T17:16:20.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.117+0000 7fb901ace700 1 -- 172.21.2.102:0/2725010369 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8fc045460 con 0x7fb8fc148980 2021-02-12T17:16:20.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.117+0000 7fb8f37fe700 1 -- 172.21.2.102:0/2725010369 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fb8e4023070 con 0x7fb8fc148980 2021-02-12T17:16:20.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.117+0000 7fb8f37fe700 1 --2- 172.21.2.102:0/2725010369 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb8e0059d30 0x7fb8e005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.117+0000 7fb8f37fe700 1 -- 172.21.2.102:0/2725010369 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fb8e4073f20 con 0x7fb8fc148980 2021-02-12T17:16:20.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.118+0000 7fb8fb7fe700 1 --2- 172.21.2.102:0/2725010369 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb8e0059d30 0x7fb8e005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.118+0000 7fb8fb7fe700 1 --2- 172.21.2.102:0/2725010369 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb8e0059d30 0x7fb8e005c1f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb8ec001950 tx=0x7fb8ec015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:20.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.120+0000 7fb8f37fe700 1 -- 172.21.2.102:0/2725010369 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fb8e4047640 con 0x7fb8fc148980 2021-02-12T17:16:20.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.246+0000 7fb901ace700 1 -- 172.21.2.102:0/2725010369 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb8fc0b7650 con 0x7fb8fc148980 2021-02-12T17:16:20.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.247+0000 7fb8f37fe700 1 -- 172.21.2.102:0/2725010369 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb8e4013e60 con 0x7fb8fc148980 2021-02-12T17:16:20.249 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:20.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.248+0000 7fb901ace700 1 -- 172.21.2.102:0/2725010369 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb8e0059d30 msgr2=0x7fb8e005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.248+0000 7fb901ace700 1 --2- 172.21.2.102:0/2725010369 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb8e0059d30 0x7fb8e005c1f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb8ec001950 tx=0x7fb8ec015000).stop 2021-02-12T17:16:20.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.248+0000 7fb901ace700 1 -- 172.21.2.102:0/2725010369 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb8fc148980 msgr2=0x7fb8fc1530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.248+0000 7fb901ace700 1 --2- 172.21.2.102:0/2725010369 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb8fc148980 0x7fb8fc1530d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fb8e400f7e0 tx=0x7fb8e4008040).stop 2021-02-12T17:16:20.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.248+0000 7fb901ace700 1 -- 172.21.2.102:0/2725010369 shutdown_connections 2021-02-12T17:16:20.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.248+0000 7fb901ace700 1 --2- 172.21.2.102:0/2725010369 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb8fc09e970 0x7fb8fc061df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.248+0000 7fb901ace700 1 --2- 172.21.2.102:0/2725010369 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb8dc003750 0x7fb8fc063e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.248+0000 7fb901ace700 1 --2- 172.21.2.102:0/2725010369 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb8e0059d30 0x7fb8e005c1f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.248+0000 7fb901ace700 1 --2- 172.21.2.102:0/2725010369 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb8fc148980 0x7fb8fc1530d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.248+0000 7fb901ace700 1 -- 172.21.2.102:0/2725010369 >> 172.21.2.102:0/2725010369 conn(0x7fb8fc061830 msgr2=0x7fb8fc14c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:20.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.248+0000 7fb901ace700 1 -- 172.21.2.102:0/2725010369 shutdown_connections 2021-02-12T17:16:20.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.248+0000 7fb901ace700 1 -- 172.21.2.102:0/2725010369 wait complete. 2021-02-12T17:16:20.258 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2021-02-12T17:16:20.349 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.348+0000 7f70a63f1700 1 Processor -- start 2021-02-12T17:16:20.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.348+0000 7f70a63f1700 1 -- start start 2021-02-12T17:16:20.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.348+0000 7f70a63f1700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f70a00b0d60 0x7f70a0067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.348+0000 7f70a63f1700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f70a00b7c10 0x7f70a00b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.348+0000 7f70a63f1700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a0145ec0 con 0x7f70a0067530 2021-02-12T17:16:20.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.348+0000 7f70a63f1700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a0146160 con 0x7f70a00b7c10 2021-02-12T17:16:20.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.348+0000 7f70a63f1700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a0146400 con 0x7f70a00b0d60 2021-02-12T17:16:20.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.349+0000 7f709ffff700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f70a00b0d60 0x7f70a0067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.349+0000 7f70a498e700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f70a00b7c10 0x7f70a00b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.349+0000 7f709ffff700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f70a00b0d60 0x7f70a0067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.102:47314/0 (socket says 172.21.2.102:47314) 2021-02-12T17:16:20.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.349+0000 7f709ffff700 1 -- 172.21.2.102:0/2815331074 learned_addr learned my addr 172.21.2.102:0/2815331074 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:20.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.350+0000 7f709ffff700 1 -- 172.21.2.102:0/2815331074 >> v2:172.21.2.104:3300/0 conn(0x7f70a00b7c10 msgr2=0x7f70a00b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:20.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.350+0000 7f709ffff700 1 --2- 172.21.2.102:0/2815331074 >> v2:172.21.2.104:3300/0 conn(0x7f70a00b7c10 0x7f70a00b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.350+0000 7f709ffff700 1 -- 172.21.2.102:0/2815331074 >> v1:172.21.2.104:6789/0 conn(0x7f70a0067530 legacy=0x7f70a00b7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.350+0000 7f709ffff700 1 -- 172.21.2.102:0/2815331074 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a01466a0 con 0x7f70a00b0d60 2021-02-12T17:16:20.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.350+0000 7f709ffff700 1 --2- 172.21.2.102:0/2815331074 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f70a00b0d60 0x7f70a0067040 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f708800b9e0 tx=0x7f7088006ea0).ready entity=mon.2 client_cookie=4ada9c258119a6b8 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:20.353 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.350+0000 7f709effd700 1 -- 172.21.2.102:0/2815331074 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708800be70 con 0x7f70a00b0d60 2021-02-12T17:16:20.353 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.350+0000 7f709effd700 1 -- 172.21.2.102:0/2815331074 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70880098d0 con 0x7f70a00b0d60 2021-02-12T17:16:20.353 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.350+0000 7f709effd700 1 -- 172.21.2.102:0/2815331074 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7088009c50 con 0x7f70a00b0d60 2021-02-12T17:16:20.353 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.351+0000 7f70a63f1700 1 -- 172.21.2.102:0/2815331074 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f70a00b0d60 msgr2=0x7f70a0067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.353 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.351+0000 7f70a63f1700 1 --2- 172.21.2.102:0/2815331074 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f70a00b0d60 0x7f70a0067040 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f708800b9e0 tx=0x7f7088006ea0).stop 2021-02-12T17:16:20.353 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.351+0000 7f70a63f1700 1 -- 172.21.2.102:0/2815331074 shutdown_connections 2021-02-12T17:16:20.353 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.351+0000 7f70a63f1700 1 --2- 172.21.2.102:0/2815331074 >> v2:172.21.2.104:3300/0 conn(0x7f70a00b7c10 0x7f70a00b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.353 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.351+0000 7f70a63f1700 1 --2- 172.21.2.102:0/2815331074 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f70a00b0d60 0x7f70a0067040 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.353 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.351+0000 7f70a63f1700 1 -- 172.21.2.102:0/2815331074 >> 172.21.2.102:0/2815331074 conn(0x7f70a0061830 msgr2=0x7f70a00bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:20.353 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.351+0000 7f70a63f1700 1 -- 172.21.2.102:0/2815331074 shutdown_connections 2021-02-12T17:16:20.353 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.351+0000 7f70a63f1700 1 -- 172.21.2.102:0/2815331074 wait complete. 2021-02-12T17:16:20.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.351+0000 7f70a63f1700 1 Processor -- start 2021-02-12T17:16:20.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.352+0000 7f70a63f1700 1 -- start start 2021-02-12T17:16:20.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.352+0000 7f70a63f1700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f70a0067530 0x7f70a01594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.352+0000 7f70a63f1700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f70a00b0d60 0x7f70a0147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.352+0000 7f70a63f1700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f70a00b7c10 0x7f70a00a1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.352+0000 7f70a63f1700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a00b3350 con 0x7f70a00b0d60 2021-02-12T17:16:20.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.352+0000 7f70a63f1700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a00b35f0 con 0x7f70a00b7c10 2021-02-12T17:16:20.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.352+0000 7f70a63f1700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a00b3ca0 con 0x7f70a0067530 2021-02-12T17:16:20.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.352+0000 7f70a498e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f70a00b7c10 0x7f70a00a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.352+0000 7f709ffff700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f70a0067530 0x7f70a01594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.352+0000 7f70a498e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f70a00b7c10 0x7f70a00a1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:43530/0 (socket says 172.21.2.102:43530) 2021-02-12T17:16:20.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.352+0000 7f70a498e700 1 -- 172.21.2.102:0/2123094617 learned_addr learned my addr 172.21.2.102:0/2123094617 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:20.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.352+0000 7f709f7fe700 1 --2- 172.21.2.102:0/2123094617 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f70a00b0d60 0x7f70a0147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.353+0000 7f709f7fe700 1 -- 172.21.2.102:0/2123094617 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f70a0067530 msgr2=0x7f70a01594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.353+0000 7f709f7fe700 1 --2- 172.21.2.102:0/2123094617 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f70a0067530 0x7f70a01594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.353+0000 7f709f7fe700 1 -- 172.21.2.102:0/2123094617 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f70a00b7c10 msgr2=0x7f70a00a1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.353+0000 7f709f7fe700 1 --2- 172.21.2.102:0/2123094617 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f70a00b7c10 0x7f70a00a1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.353+0000 7f709f7fe700 1 -- 172.21.2.102:0/2123094617 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a00b3f40 con 0x7f70a00b0d60 2021-02-12T17:16:20.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.353+0000 7f709f7fe700 1 --2- 172.21.2.102:0/2123094617 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f70a00b0d60 0x7f70a0147580 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f709000c6e0 tx=0x7f7090007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:20.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.353+0000 7f7097fff700 1 -- 172.21.2.102:0/2123094617 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090007020 con 0x7f70a00b0d60 2021-02-12T17:16:20.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.353+0000 7f7097fff700 1 -- 172.21.2.102:0/2123094617 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7090007180 con 0x7f70a00b0d60 2021-02-12T17:16:20.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.353+0000 7f70a63f1700 1 -- 172.21.2.102:0/2123094617 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a0147a70 con 0x7f70a00b0d60 2021-02-12T17:16:20.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.353+0000 7f7097fff700 1 -- 172.21.2.102:0/2123094617 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70900064e0 con 0x7f70a00b0d60 2021-02-12T17:16:20.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.353+0000 7f70a63f1700 1 -- 172.21.2.102:0/2123094617 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a00b43e0 con 0x7f70a00b0d60 2021-02-12T17:16:20.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.354+0000 7f70a63f1700 1 -- 172.21.2.102:0/2123094617 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a00b40d0 con 0x7f70a00b0d60 2021-02-12T17:16:20.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.354+0000 7f7097fff700 1 -- 172.21.2.102:0/2123094617 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f709001a060 con 0x7f70a00b0d60 2021-02-12T17:16:20.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.354+0000 7f7097fff700 1 --2- 172.21.2.102:0/2123094617 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7084059d30 0x7f708405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.354+0000 7f7097fff700 1 -- 172.21.2.102:0/2123094617 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f7090001e40 con 0x7f70a00b0d60 2021-02-12T17:16:20.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.354+0000 7f709ffff700 1 --2- 172.21.2.102:0/2123094617 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7084059d30 0x7f708405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.355+0000 7f709ffff700 1 --2- 172.21.2.102:0/2123094617 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7084059d30 0x7f708405c1f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7088006ee0 tx=0x7f7088018000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:20.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.357+0000 7f7097fff700 1 -- 172.21.2.102:0/2123094617 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f7090046cc0 con 0x7f70a00b0d60 2021-02-12T17:16:20.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.486+0000 7f70a63f1700 1 -- 172.21.2.102:0/2123094617 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70a0045460 con 0x7f70a00b0d60 2021-02-12T17:16:20.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.486+0000 7f7097fff700 1 -- 172.21.2.102:0/2123094617 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+10 (secure 0 0 0) 0x7f7090018070 con 0x7f70a00b0d60 2021-02-12T17:16:20.487 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:20.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.487+0000 7f70a63f1700 1 -- 172.21.2.102:0/2123094617 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7084059d30 msgr2=0x7f708405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.487+0000 7f70a63f1700 1 --2- 172.21.2.102:0/2123094617 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7084059d30 0x7f708405c1f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7088006ee0 tx=0x7f7088018000).stop 2021-02-12T17:16:20.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.487+0000 7f70a63f1700 1 -- 172.21.2.102:0/2123094617 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f70a00b0d60 msgr2=0x7f70a0147580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.487+0000 7f70a63f1700 1 --2- 172.21.2.102:0/2123094617 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f70a00b0d60 0x7f70a0147580 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f709000c6e0 tx=0x7f7090007b80).stop 2021-02-12T17:16:20.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.487+0000 7f70a63f1700 1 -- 172.21.2.102:0/2123094617 shutdown_connections 2021-02-12T17:16:20.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.487+0000 7f70a63f1700 1 --2- 172.21.2.102:0/2123094617 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f70a00b7c10 0x7f70a00a1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.487+0000 7f70a63f1700 1 --2- 172.21.2.102:0/2123094617 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f70a0067530 0x7f70a01594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.487+0000 7f70a63f1700 1 --2- 172.21.2.102:0/2123094617 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7084059d30 0x7f708405c1f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.487+0000 7f70a63f1700 1 --2- 172.21.2.102:0/2123094617 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f70a00b0d60 0x7f70a0147580 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.487+0000 7f70a63f1700 1 -- 172.21.2.102:0/2123094617 >> 172.21.2.102:0/2123094617 conn(0x7f70a0061830 msgr2=0x7f70a00baba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:20.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.487+0000 7f70a63f1700 1 -- 172.21.2.102:0/2123094617 shutdown_connections 2021-02-12T17:16:20.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.487+0000 7f70a63f1700 1 -- 172.21.2.102:0/2123094617 wait complete. 2021-02-12T17:16:20.498 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2021-02-12T17:16:20.588 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.587+0000 7fc125d3e700 1 Processor -- start 2021-02-12T17:16:20.588 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.587+0000 7fc125d3e700 1 -- start start 2021-02-12T17:16:20.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.587+0000 7fc125d3e700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fc1200b0940 0x7fc12014e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.587+0000 7fc125d3e700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc120066b70 con 0x7fc12009ada0 2021-02-12T17:16:20.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.587+0000 7fc125d3e700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1200685b0 con 0x7fc1200bc2b0 2021-02-12T17:16:20.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.587+0000 7fc125d3e700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1200b27d0 con 0x7fc1200b0940 2021-02-12T17:16:20.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.588+0000 7fc11effd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fc1200b0940 0x7fc12014e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.588+0000 7fc11ffff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fc12009ada0 0x7fc120151830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53824/0 (socket says 172.21.2.102:53824) 2021-02-12T17:16:20.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.588+0000 7fc11ffff700 1 -- 172.21.2.102:0/2374424078 learned_addr learned my addr 172.21.2.102:0/2374424078 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:20.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.588+0000 7fc11effd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fc1200b0940 0x7fc12014e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45176/0 (socket says 172.21.2.102:45176) 2021-02-12T17:16:20.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.588+0000 7fc11effd700 1 -- 172.21.2.102:0/2374424078 >> v1:172.21.2.104:6789/0 conn(0x7fc1200bc2b0 legacy=0x7fc120151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:20.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.588+0000 7fc11effd700 1 -- 172.21.2.102:0/2374424078 >> v1:172.21.2.102:6789/0 conn(0x7fc12009ada0 legacy=0x7fc120151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.588+0000 7fc11e7fc700 1 -- 172.21.2.102:0/2374424078 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555406164 0 0) 0x7fc120066b70 con 0x7fc12009ada0 2021-02-12T17:16:20.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.588+0000 7fc11effd700 1 -- 172.21.2.102:0/2374424078 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12014e550 con 0x7fc1200b0940 2021-02-12T17:16:20.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.588+0000 7fc11effd700 1 --2- 172.21.2.102:0/2374424078 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc1200b0940 0x7fc12014e060 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fc10800b980 tx=0x7fc108006de0).ready entity=mon.0 client_cookie=1f21e8e359fa1dd9 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:20.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.588+0000 7fc11e7fc700 1 -- 172.21.2.102:0/2374424078 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1080097a0 con 0x7fc1200b0940 2021-02-12T17:16:20.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.588+0000 7fc11e7fc700 1 -- 172.21.2.102:0/2374424078 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc108009900 con 0x7fc1200b0940 2021-02-12T17:16:20.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.588+0000 7fc11e7fc700 1 -- 172.21.2.102:0/2374424078 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108009c80 con 0x7fc1200b0940 2021-02-12T17:16:20.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.589+0000 7fc125d3e700 1 -- 172.21.2.102:0/2374424078 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc1200b0940 msgr2=0x7fc12014e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.589+0000 7fc125d3e700 1 --2- 172.21.2.102:0/2374424078 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc1200b0940 0x7fc12014e060 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fc10800b980 tx=0x7fc108006de0).stop 2021-02-12T17:16:20.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.589+0000 7fc125d3e700 1 -- 172.21.2.102:0/2374424078 shutdown_connections 2021-02-12T17:16:20.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.589+0000 7fc125d3e700 1 --2- 172.21.2.102:0/2374424078 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc1200b0940 0x7fc12014e060 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.589+0000 7fc125d3e700 1 -- 172.21.2.102:0/2374424078 >> 172.21.2.102:0/2374424078 conn(0x7fc120061830 msgr2=0x7fc1200bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:20.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.589+0000 7fc125d3e700 1 -- 172.21.2.102:0/2374424078 shutdown_connections 2021-02-12T17:16:20.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.589+0000 7fc125d3e700 1 -- 172.21.2.102:0/2374424078 wait complete. 2021-02-12T17:16:20.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.590+0000 7fc125d3e700 1 Processor -- start 2021-02-12T17:16:20.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.590+0000 7fc125d3e700 1 -- start start 2021-02-12T17:16:20.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.590+0000 7fc125d3e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc12009ada0 0x7fc1201512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.590+0000 7fc125d3e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc1200b0940 0x7fc120160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.590+0000 7fc125d3e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc1200bc2b0 0x7fc120160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.590+0000 7fc125d3e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1200b2dd0 con 0x7fc12009ada0 2021-02-12T17:16:20.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.590+0000 7fc125d3e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12009c6c0 con 0x7fc1200bc2b0 2021-02-12T17:16:20.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.590+0000 7fc125d3e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12009c960 con 0x7fc1200b0940 2021-02-12T17:16:20.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc11f7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc12009ada0 0x7fc1201512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc11f7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc12009ada0 0x7fc1201512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45182/0 (socket says 172.21.2.102:45182) 2021-02-12T17:16:20.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc11f7fe700 1 -- 172.21.2.102:0/2042692412 learned_addr learned my addr 172.21.2.102:0/2042692412 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:20.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc11f7fe700 1 -- 172.21.2.102:0/2042692412 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc1200b0940 msgr2=0x7fc120160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc11f7fe700 1 --2- 172.21.2.102:0/2042692412 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc1200b0940 0x7fc120160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:20.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc11f7fe700 1 -- 172.21.2.102:0/2042692412 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc1200bc2b0 msgr2=0x7fc120160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc11ffff700 1 --2- 172.21.2.102:0/2042692412 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc1200bc2b0 0x7fc120160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc11f7fe700 1 --2- 172.21.2.102:0/2042692412 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc1200bc2b0 0x7fc120160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc11f7fe700 1 -- 172.21.2.102:0/2042692412 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12009cc00 con 0x7fc12009ada0 2021-02-12T17:16:20.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc11ffff700 1 --2- 172.21.2.102:0/2042692412 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc1200bc2b0 0x7fc120160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:20.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc11f7fe700 1 --2- 172.21.2.102:0/2042692412 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc12009ada0 0x7fc1201512e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fc1100096e0 tx=0x7fc110006d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:20.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc1177fe700 1 -- 172.21.2.102:0/2042692412 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11000d500 con 0x7fc12009ada0 2021-02-12T17:16:20.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc1177fe700 1 -- 172.21.2.102:0/2042692412 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc110000e90 con 0x7fc12009ada0 2021-02-12T17:16:20.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc1177fe700 1 -- 172.21.2.102:0/2042692412 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11000d8b0 con 0x7fc12009ada0 2021-02-12T17:16:20.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc125d3e700 1 -- 172.21.2.102:0/2042692412 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1200b3000 con 0x7fc12009ada0 2021-02-12T17:16:20.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.591+0000 7fc125d3e700 1 -- 172.21.2.102:0/2042692412 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12009b870 con 0x7fc12009ada0 2021-02-12T17:16:20.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.592+0000 7fc125d3e700 1 -- 172.21.2.102:0/2042692412 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1200b3190 con 0x7fc12009ada0 2021-02-12T17:16:20.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.592+0000 7fc1177fe700 1 -- 172.21.2.102:0/2042692412 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fc11000dc20 con 0x7fc12009ada0 2021-02-12T17:16:20.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.593+0000 7fc1177fe700 1 --2- 172.21.2.102:0/2042692412 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc104059d30 0x7fc10405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.593+0000 7fc1177fe700 1 -- 172.21.2.102:0/2042692412 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fc110073530 con 0x7fc12009ada0 2021-02-12T17:16:20.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.593+0000 7fc11effd700 1 --2- 172.21.2.102:0/2042692412 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc104059d30 0x7fc10405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.593+0000 7fc11effd700 1 --2- 172.21.2.102:0/2042692412 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc104059d30 0x7fc10405c1f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc1200b0d40 tx=0x7fc108016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:20.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.596+0000 7fc1177fe700 1 -- 172.21.2.102:0/2042692412 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fc110046c50 con 0x7fc12009ada0 2021-02-12T17:16:20.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.724+0000 7fc125d3e700 1 -- 172.21.2.102:0/2042692412 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7fc120045460 con 0x7fc12009ada0 2021-02-12T17:16:20.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.724+0000 7fc1177fe700 1 -- 172.21.2.102:0/2042692412 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+10 (secure 0 0 0) 0x7fc11004a270 con 0x7fc12009ada0 2021-02-12T17:16:20.726 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:20.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.725+0000 7fc125d3e700 1 -- 172.21.2.102:0/2042692412 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc104059d30 msgr2=0x7fc10405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.725+0000 7fc125d3e700 1 --2- 172.21.2.102:0/2042692412 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc104059d30 0x7fc10405c1f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc1200b0d40 tx=0x7fc108016000).stop 2021-02-12T17:16:20.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.725+0000 7fc125d3e700 1 -- 172.21.2.102:0/2042692412 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc12009ada0 msgr2=0x7fc1201512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.725+0000 7fc125d3e700 1 --2- 172.21.2.102:0/2042692412 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc12009ada0 0x7fc1201512e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fc1100096e0 tx=0x7fc110006d60).stop 2021-02-12T17:16:20.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.725+0000 7fc125d3e700 1 -- 172.21.2.102:0/2042692412 shutdown_connections 2021-02-12T17:16:20.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.725+0000 7fc125d3e700 1 --2- 172.21.2.102:0/2042692412 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc1200bc2b0 0x7fc120160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.725+0000 7fc125d3e700 1 --2- 172.21.2.102:0/2042692412 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc104059d30 0x7fc10405c1f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.725+0000 7fc125d3e700 1 --2- 172.21.2.102:0/2042692412 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc12009ada0 0x7fc1201512e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.725+0000 7fc125d3e700 1 --2- 172.21.2.102:0/2042692412 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc1200b0940 0x7fc120160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:20.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.725+0000 7fc125d3e700 1 -- 172.21.2.102:0/2042692412 >> 172.21.2.102:0/2042692412 conn(0x7fc120061830 msgr2=0x7fc1200b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:20.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.725+0000 7fc125d3e700 1 -- 172.21.2.102:0/2042692412 shutdown_connections 2021-02-12T17:16:20.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.725+0000 7fc125d3e700 1 -- 172.21.2.102:0/2042692412 wait complete. 2021-02-12T17:16:20.735 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2021-02-12T17:16:20.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.824+0000 7f87e6ddd700 1 Processor -- start 2021-02-12T17:16:20.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.824+0000 7f87e6ddd700 1 -- start start 2021-02-12T17:16:20.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.824+0000 7f87e6ddd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f87e00b7d70 0x7f87e00bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.824+0000 7f87e6ddd700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e0149ea0 con 0x7f87e00bc0f0 2021-02-12T17:16:20.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.824+0000 7f87e6ddd700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e014a140 con 0x7f87e0149a00 2021-02-12T17:16:20.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.824+0000 7f87e6ddd700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e014a3e0 con 0x7f87e00b7d70 2021-02-12T17:16:20.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.825+0000 7f87e537a700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f87e00b7d70 0x7f87e00bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.825+0000 7f87e4b79700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f87e00bc0f0 0x7f87e00b0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53834/0 (socket says 172.21.2.102:53834) 2021-02-12T17:16:20.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.825+0000 7f87e4b79700 1 -- 172.21.2.102:0/1699600078 learned_addr learned my addr 172.21.2.102:0/1699600078 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:20.838 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.825+0000 7f87e537a700 1 -- 172.21.2.102:0/1699600078 >> v1:172.21.2.104:6789/0 conn(0x7f87e0149a00 legacy=0x7f87e00b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:20.839 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.825+0000 7f87e537a700 1 -- 172.21.2.102:0/1699600078 >> v1:172.21.2.102:6789/0 conn(0x7f87e00bc0f0 legacy=0x7f87e00b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.839 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.825+0000 7f87df7fe700 1 -- 172.21.2.102:0/1699600078 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227265777 0 0) 0x7f87e0149ea0 con 0x7f87e00bc0f0 2021-02-12T17:16:20.839 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.825+0000 7f87e537a700 1 -- 172.21.2.102:0/1699600078 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e014a680 con 0x7f87e00b7d70 2021-02-12T17:16:20.840 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.825+0000 7f87e537a700 1 --2- 172.21.2.102:0/1699600078 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87e00b7d70 0x7f87e00bc4d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f87d800bf20 tx=0x7f87d800b460).ready entity=mon.0 client_cookie=297c6dceaa29170b server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:20.841 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.825+0000 7f87df7fe700 1 -- 172.21.2.102:0/1699600078 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8010470 con 0x7f87e00b7d70 2021-02-12T17:16:20.841 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.825+0000 7f87df7fe700 1 -- 172.21.2.102:0/1699600078 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d80105d0 con 0x7f87e00b7d70 2021-02-12T17:16:20.842 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.825+0000 7f87df7fe700 1 -- 172.21.2.102:0/1699600078 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8010950 con 0x7f87e00b7d70 2021-02-12T17:16:20.843 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.826+0000 7f87e6ddd700 1 -- 172.21.2.102:0/1699600078 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87e00b7d70 msgr2=0x7f87e00bc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.826+0000 7f87e6ddd700 1 --2- 172.21.2.102:0/1699600078 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87e00b7d70 0x7f87e00bc4d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f87d800bf20 tx=0x7f87d800b460).stop 2021-02-12T17:16:20.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.826+0000 7f87e6ddd700 1 -- 172.21.2.102:0/1699600078 shutdown_connections 2021-02-12T17:16:20.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.826+0000 7f87e6ddd700 1 --2- 172.21.2.102:0/1699600078 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87e00b7d70 0x7f87e00bc4d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.826+0000 7f87e6ddd700 1 -- 172.21.2.102:0/1699600078 >> 172.21.2.102:0/1699600078 conn(0x7f87e0061830 msgr2=0x7f87e00bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:20.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.826+0000 7f87e6ddd700 1 -- 172.21.2.102:0/1699600078 shutdown_connections 2021-02-12T17:16:20.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.826+0000 7f87e6ddd700 1 -- 172.21.2.102:0/1699600078 wait complete. 2021-02-12T17:16:20.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.827+0000 7f87e6ddd700 1 Processor -- start 2021-02-12T17:16:20.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.827+0000 7f87e6ddd700 1 -- start start 2021-02-12T17:16:20.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e6ddd700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f87e00b7d70 0x7f87e00b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e6ddd700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f87e00bc0f0 0x7f87e0067080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e6ddd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87e0149a00 0x7f87e00b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e6ddd700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00a0b50 con 0x7f87e0149a00 2021-02-12T17:16:20.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e6ddd700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0090220 con 0x7f87e00bc0f0 2021-02-12T17:16:20.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e6ddd700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00904c0 con 0x7f87e00b7d70 2021-02-12T17:16:20.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e537a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87e0149a00 0x7f87e00b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e537a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87e0149a00 0x7f87e00b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45198/0 (socket says 172.21.2.102:45198) 2021-02-12T17:16:20.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e537a700 1 -- 172.21.2.102:0/2112781138 learned_addr learned my addr 172.21.2.102:0/2112781138 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:20.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e4b79700 1 --2- 172.21.2.102:0/2112781138 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f87e00b7d70 0x7f87e00b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87dffff700 1 --2- 172.21.2.102:0/2112781138 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f87e00bc0f0 0x7f87e0067080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e537a700 1 -- 172.21.2.102:0/2112781138 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f87e00b7d70 msgr2=0x7f87e00b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e537a700 1 --2- 172.21.2.102:0/2112781138 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f87e00b7d70 0x7f87e00b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e537a700 1 -- 172.21.2.102:0/2112781138 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f87e00bc0f0 msgr2=0x7f87e0067080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e537a700 1 --2- 172.21.2.102:0/2112781138 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f87e00bc0f0 0x7f87e0067080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e537a700 1 -- 172.21.2.102:0/2112781138 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e0090760 con 0x7f87e0149a00 2021-02-12T17:16:20.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e537a700 1 --2- 172.21.2.102:0/2112781138 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87e0149a00 0x7f87e00b4820 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f87e005d280 tx=0x7f87e014a2d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:20.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87dcff9700 1 -- 172.21.2.102:0/2112781138 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d801f070 con 0x7f87e0149a00 2021-02-12T17:16:20.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87dcff9700 1 -- 172.21.2.102:0/2112781138 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8019d10 con 0x7f87e0149a00 2021-02-12T17:16:20.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87e6ddd700 1 -- 172.21.2.102:0/2112781138 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e0090a00 con 0x7f87e0149a00 2021-02-12T17:16:20.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.828+0000 7f87dcff9700 1 -- 172.21.2.102:0/2112781138 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8023640 con 0x7f87e0149a00 2021-02-12T17:16:20.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.829+0000 7f87e6ddd700 1 -- 172.21.2.102:0/2112781138 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e008ff10 con 0x7f87e0149a00 2021-02-12T17:16:20.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.829+0000 7f87e6ddd700 1 -- 172.21.2.102:0/2112781138 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e0045460 con 0x7f87e0149a00 2021-02-12T17:16:20.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.829+0000 7f87dcff9700 1 -- 172.21.2.102:0/2112781138 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f87d802a030 con 0x7f87e0149a00 2021-02-12T17:16:20.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.830+0000 7f87dcff9700 1 --2- 172.21.2.102:0/2112781138 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f87c4059d60 0x7f87c405c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:20.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.830+0000 7f87dcff9700 1 -- 172.21.2.102:0/2112781138 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f87d8077fe0 con 0x7f87e0149a00 2021-02-12T17:16:20.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.830+0000 7f87e4b79700 1 --2- 172.21.2.102:0/2112781138 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f87c4059d60 0x7f87c405c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:20.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.830+0000 7f87e4b79700 1 --2- 172.21.2.102:0/2112781138 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f87c4059d60 0x7f87c405c220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f87c80011a0 tx=0x7f87c8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:20.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.833+0000 7f87dcff9700 1 -- 172.21.2.102:0/2112781138 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f87d804b740 con 0x7f87e0149a00 2021-02-12T17:16:20.965 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.963+0000 7f87e6ddd700 1 -- 172.21.2.102:0/2112781138 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87e006a450 con 0x7f87e0149a00 2021-02-12T17:16:20.965 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.963+0000 7f87dcff9700 1 -- 172.21.2.102:0/2112781138 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+10 (secure 0 0 0) 0x7f87d8028070 con 0x7f87e0149a00 2021-02-12T17:16:20.965 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:20.967 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.965+0000 7f87e6ddd700 1 -- 172.21.2.102:0/2112781138 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f87c4059d60 msgr2=0x7f87c405c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.967 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.965+0000 7f87e6ddd700 1 --2- 172.21.2.102:0/2112781138 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f87c4059d60 0x7f87c405c220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f87c80011a0 tx=0x7f87c8009040).stop 2021-02-12T17:16:20.967 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.965+0000 7f87e6ddd700 1 -- 172.21.2.102:0/2112781138 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87e0149a00 msgr2=0x7f87e00b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:20.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.965+0000 7f87e6ddd700 1 --2- 172.21.2.102:0/2112781138 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87e0149a00 0x7f87e00b4820 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f87e005d280 tx=0x7f87e014a2d0).stop 2021-02-12T17:16:20.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.965+0000 7f87e6ddd700 1 -- 172.21.2.102:0/2112781138 shutdown_connections 2021-02-12T17:16:20.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.965+0000 7f87e6ddd700 1 --2- 172.21.2.102:0/2112781138 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f87c4059d60 0x7f87c405c220 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.965+0000 7f87e6ddd700 1 --2- 172.21.2.102:0/2112781138 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87e0149a00 0x7f87e00b4820 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.965+0000 7f87e6ddd700 1 --2- 172.21.2.102:0/2112781138 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f87e00b7d70 0x7f87e00b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.965+0000 7f87e6ddd700 1 --2- 172.21.2.102:0/2112781138 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f87e00bc0f0 0x7f87e0067080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:20.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.965+0000 7f87e6ddd700 1 -- 172.21.2.102:0/2112781138 >> 172.21.2.102:0/2112781138 conn(0x7f87e0061830 msgr2=0x7f87e0146cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:20.969 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.965+0000 7f87e6ddd700 1 -- 172.21.2.102:0/2112781138 shutdown_connections 2021-02-12T17:16:20.969 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:20.965+0000 7f87e6ddd700 1 -- 172.21.2.102:0/2112781138 wait complete. 2021-02-12T17:16:20.975 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2021-02-12T17:16:21.066 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.064+0000 7fcdba32b700 1 Processor -- start 2021-02-12T17:16:21.066 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.064+0000 7fcdba32b700 1 -- start start 2021-02-12T17:16:21.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.065+0000 7fcdba32b700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fcdb40bc2b0 0x7fcdb4151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:21.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.065+0000 7fcdba32b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fcdb40b0940 0x7fcdb4151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:21.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.065+0000 7fcdba32b700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb4066b70 con 0x7fcdb409ada0 2021-02-12T17:16:21.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.065+0000 7fcdba32b700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb40b27d0 con 0x7fcdb40b0940 2021-02-12T17:16:21.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.065+0000 7fcdba32b700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb40b7110 con 0x7fcdb40bc2b0 2021-02-12T17:16:21.072 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.065+0000 7fcdb88c8700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fcdb409ada0 0x7fcdb414d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53850/0 (socket says 172.21.2.102:53850) 2021-02-12T17:16:21.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.065+0000 7fcdb88c8700 1 -- 172.21.2.102:0/2449058447 learned_addr learned my addr 172.21.2.102:0/2449058447 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:21.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.065+0000 7fcdb37fe700 1 --2- 172.21.2.102:0/2449058447 >> v2:172.21.2.102:3300/0 conn(0x7fcdb40b0940 0x7fcdb4151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:21.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.065+0000 7fcdb2ffd700 1 -- 172.21.2.102:0/2449058447 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790123312 0 0) 0x7fcdb4066b70 con 0x7fcdb409ada0 2021-02-12T17:16:21.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.065+0000 7fcdb2ffd700 1 -- 172.21.2.102:0/2449058447 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd94003230 con 0x7fcdb409ada0 2021-02-12T17:16:21.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdb37fe700 1 -- 172.21.2.102:0/2449058447 >> v2:172.21.2.104:3300/0 conn(0x7fcdb40bc2b0 msgr2=0x7fcdb4151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:21.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdb37fe700 1 --2- 172.21.2.102:0/2449058447 >> v2:172.21.2.104:3300/0 conn(0x7fcdb40bc2b0 0x7fcdb4151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:21.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdb37fe700 1 -- 172.21.2.102:0/2449058447 >> v1:172.21.2.102:6789/0 conn(0x7fcdb409ada0 legacy=0x7fcdb414d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:21.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdb37fe700 1 -- 172.21.2.102:0/2449058447 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb40685b0 con 0x7fcdb40b0940 2021-02-12T17:16:21.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdb37fe700 1 --2- 172.21.2.102:0/2449058447 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcdb40b0940 0x7fcdb4151610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fcdb40b94d0 tx=0x7fcda4006de0).ready entity=mon.0 client_cookie=b209e2d885f31fe5 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:21.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdb2ffd700 1 -- 172.21.2.102:0/2449058447 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4009630 con 0x7fcdb40b0940 2021-02-12T17:16:21.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdb2ffd700 1 -- 172.21.2.102:0/2449058447 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda4009790 con 0x7fcdb40b0940 2021-02-12T17:16:21.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdb2ffd700 1 -- 172.21.2.102:0/2449058447 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4009b10 con 0x7fcdb40b0940 2021-02-12T17:16:21.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdba32b700 1 -- 172.21.2.102:0/2449058447 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcdb40b0940 msgr2=0x7fcdb4151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:21.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdba32b700 1 --2- 172.21.2.102:0/2449058447 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcdb40b0940 0x7fcdb4151610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fcdb40b94d0 tx=0x7fcda4006de0).stop 2021-02-12T17:16:21.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdba32b700 1 -- 172.21.2.102:0/2449058447 shutdown_connections 2021-02-12T17:16:21.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdba32b700 1 --2- 172.21.2.102:0/2449058447 >> v2:172.21.2.104:3300/0 conn(0x7fcdb40bc2b0 0x7fcdb4151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:21.075 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdba32b700 1 --2- 172.21.2.102:0/2449058447 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcdb40b0940 0x7fcdb4151610 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:21.075 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdba32b700 1 -- 172.21.2.102:0/2449058447 >> 172.21.2.102:0/2449058447 conn(0x7fcdb4061830 msgr2=0x7fcdb40bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:21.075 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdba32b700 1 -- 172.21.2.102:0/2449058447 shutdown_connections 2021-02-12T17:16:21.075 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.066+0000 7fcdba32b700 1 -- 172.21.2.102:0/2449058447 wait complete. 2021-02-12T17:16:21.075 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.067+0000 7fcdba32b700 1 Processor -- start 2021-02-12T17:16:21.075 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.067+0000 7fcdba32b700 1 -- start start 2021-02-12T17:16:21.075 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdba32b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcdb409ada0 0x7fcdb409eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:21.075 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdba32b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcdb40b0940 0x7fcdb4149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:21.075 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdba32b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcdb40bc2b0 0x7fcdb4149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:21.075 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdba32b700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb40a0d40 con 0x7fcdb40b0940 2021-02-12T17:16:21.075 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdba32b700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb40a0fe0 con 0x7fcdb409ada0 2021-02-12T17:16:21.075 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdba32b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb40a1280 con 0x7fcdb40bc2b0 2021-02-12T17:16:21.075 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdb37fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcdb40b0940 0x7fcdb4149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:21.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdb37fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcdb40b0940 0x7fcdb4149810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45208/0 (socket says 172.21.2.102:45208) 2021-02-12T17:16:21.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdb37fe700 1 -- 172.21.2.102:0/2595637375 learned_addr learned my addr 172.21.2.102:0/2595637375 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:21.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdb37fe700 1 -- 172.21.2.102:0/2595637375 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcdb40bc2b0 msgr2=0x7fcdb4149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:21.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdb88c8700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcdb40bc2b0 0x7fcdb4149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:21.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdb3fff700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcdb409ada0 0x7fcdb409eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:21.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdb37fe700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcdb40bc2b0 0x7fcdb4149d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:21.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdb37fe700 1 -- 172.21.2.102:0/2595637375 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcdb409ada0 msgr2=0x7fcdb409eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:21.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdb37fe700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcdb409ada0 0x7fcdb409eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:21.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdb37fe700 1 -- 172.21.2.102:0/2595637375 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb40a1520 con 0x7fcdb40b0940 2021-02-12T17:16:21.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdb3fff700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcdb409ada0 0x7fcdb409eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:21.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.068+0000 7fcdb37fe700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcdb40b0940 0x7fcdb4149810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fcda4006e20 tx=0x7fcda4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:21.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.069+0000 7fcdabfff700 1 -- 172.21.2.102:0/2595637375 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda401c420 con 0x7fcdb40b0940 2021-02-12T17:16:21.076 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.069+0000 7fcdabfff700 1 -- 172.21.2.102:0/2595637375 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda401c580 con 0x7fcdb40b0940 2021-02-12T17:16:21.077 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.069+0000 7fcdabfff700 1 -- 172.21.2.102:0/2595637375 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda401c920 con 0x7fcdb40b0940 2021-02-12T17:16:21.077 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.069+0000 7fcdba32b700 1 -- 172.21.2.102:0/2595637375 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb4061ea0 con 0x7fcdb40b0940 2021-02-12T17:16:21.077 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.069+0000 7fcdba32b700 1 -- 172.21.2.102:0/2595637375 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb409f020 con 0x7fcdb40b0940 2021-02-12T17:16:21.077 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.069+0000 7fcdba32b700 1 -- 172.21.2.102:0/2595637375 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb4045460 con 0x7fcdb40b0940 2021-02-12T17:16:21.077 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.070+0000 7fcdabfff700 1 -- 172.21.2.102:0/2595637375 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fcda400f070 con 0x7fcdb40b0940 2021-02-12T17:16:21.077 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.070+0000 7fcdabfff700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcd98059d80 0x7fcd9805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:21.077 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.070+0000 7fcdabfff700 1 -- 172.21.2.102:0/2595637375 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fcda4075510 con 0x7fcdb40b0940 2021-02-12T17:16:21.077 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.070+0000 7fcdb3fff700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcd98059d80 0x7fcd9805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:21.077 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.070+0000 7fcdb3fff700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcd98059d80 0x7fcd9805c240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fcd9c00a7a0 tx=0x7fcd9c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:21.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.073+0000 7fcdabfff700 1 -- 172.21.2.102:0/2595637375 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fcda4048cb0 con 0x7fcdb40b0940 2021-02-12T17:16:21.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.201+0000 7fcdba32b700 1 -- 172.21.2.102:0/2595637375 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7fcdb40b7650 con 0x7fcdb40b0940 2021-02-12T17:16:21.203 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.202+0000 7fcdabfff700 1 -- 172.21.2.102:0/2595637375 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+10 (secure 0 0 0) 0x7fcda401a310 con 0x7fcdb40b0940 2021-02-12T17:16:21.203 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:21.204 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.203+0000 7fcdba32b700 1 -- 172.21.2.102:0/2595637375 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcd98059d80 msgr2=0x7fcd9805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:21.204 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.203+0000 7fcdba32b700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcd98059d80 0x7fcd9805c240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fcd9c00a7a0 tx=0x7fcd9c008040).stop 2021-02-12T17:16:21.204 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.203+0000 7fcdba32b700 1 -- 172.21.2.102:0/2595637375 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcdb40b0940 msgr2=0x7fcdb4149810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:21.204 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.203+0000 7fcdba32b700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcdb40b0940 0x7fcdb4149810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fcda4006e20 tx=0x7fcda4016000).stop 2021-02-12T17:16:21.205 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.203+0000 7fcdba32b700 1 -- 172.21.2.102:0/2595637375 shutdown_connections 2021-02-12T17:16:21.205 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.203+0000 7fcdba32b700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcdb40bc2b0 0x7fcdb4149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:21.205 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.203+0000 7fcdba32b700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcdb409ada0 0x7fcdb409eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:21.205 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.203+0000 7fcdba32b700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcd98059d80 0x7fcd9805c240 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:21.205 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.203+0000 7fcdba32b700 1 --2- 172.21.2.102:0/2595637375 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcdb40b0940 0x7fcdb4149810 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:21.205 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.203+0000 7fcdba32b700 1 -- 172.21.2.102:0/2595637375 >> 172.21.2.102:0/2595637375 conn(0x7fcdb4061830 msgr2=0x7fcdb40b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:21.205 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.203+0000 7fcdba32b700 1 -- 172.21.2.102:0/2595637375 shutdown_connections 2021-02-12T17:16:21.205 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.203+0000 7fcdba32b700 1 -- 172.21.2.102:0/2595637375 wait complete. 2021-02-12T17:16:21.214 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:16:21.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.302+0000 7fe5ebb34700 1 Processor -- start 2021-02-12T17:16:21.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.302+0000 7fe5ebb34700 1 -- start start 2021-02-12T17:16:21.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.303+0000 7fe5ebb34700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe5e41405c0 0x7fe5e4146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:21.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.303+0000 7fe5ebb34700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e40b7990 con 0x7fe5e40b88b0 2021-02-12T17:16:21.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.303+0000 7fe5ebb34700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e40b7c30 con 0x7fe5e40b7450 2021-02-12T17:16:21.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.303+0000 7fe5ebb34700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e40b7ed0 con 0x7fe5e41405c0 2021-02-12T17:16:21.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.303+0000 7fe5e98d0700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe5e41405c0 0x7fe5e4146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:21.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.303+0000 7fe5e90cf700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fe5e40b88b0 0x7fe5e40b9c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53862/0 (socket says 172.21.2.102:53862) 2021-02-12T17:16:21.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.303+0000 7fe5e90cf700 1 -- 172.21.2.102:0/3421646871 learned_addr learned my addr 172.21.2.102:0/3421646871 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:21.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.303+0000 7fe5e88ce700 1 -- 172.21.2.102:0/3421646871 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71210171 0 0) 0x7fe5e40b7990 con 0x7fe5e40b88b0 2021-02-12T17:16:21.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.303+0000 7fe5e98d0700 1 -- 172.21.2.102:0/3421646871 >> v1:172.21.2.104:6789/0 conn(0x7fe5e40b7450 legacy=0x7fe5e40b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:21.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.303+0000 7fe5e98d0700 1 -- 172.21.2.102:0/3421646871 >> v1:172.21.2.102:6789/0 conn(0x7fe5e40b88b0 legacy=0x7fe5e40b9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:21.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.303+0000 7fe5e98d0700 1 -- 172.21.2.102:0/3421646871 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e40b8170 con 0x7fe5e41405c0 2021-02-12T17:16:21.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.303+0000 7fe5e98d0700 1 --2- 172.21.2.102:0/3421646871 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5e41405c0 0x7fe5e4146fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fe5e000b980 tx=0x7fe5e0006de0).ready entity=mon.0 client_cookie=d9f4f0cf580d062 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:21.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.304+0000 7fe5e88ce700 1 -- 172.21.2.102:0/3421646871 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0009870 con 0x7fe5e41405c0 2021-02-12T17:16:21.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.304+0000 7fe5e88ce700 1 -- 172.21.2.102:0/3421646871 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e00099d0 con 0x7fe5e41405c0 2021-02-12T17:16:21.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.304+0000 7fe5e88ce700 1 -- 172.21.2.102:0/3421646871 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0009d50 con 0x7fe5e41405c0 2021-02-12T17:16:21.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.304+0000 7fe5ebb34700 1 -- 172.21.2.102:0/3421646871 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5e41405c0 msgr2=0x7fe5e4146fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:21.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.304+0000 7fe5ebb34700 1 --2- 172.21.2.102:0/3421646871 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5e41405c0 0x7fe5e4146fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fe5e000b980 tx=0x7fe5e0006de0).stop 2021-02-12T17:16:21.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.304+0000 7fe5ebb34700 1 -- 172.21.2.102:0/3421646871 shutdown_connections 2021-02-12T17:16:21.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.304+0000 7fe5ebb34700 1 --2- 172.21.2.102:0/3421646871 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5e41405c0 0x7fe5e4146fe0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:21.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.304+0000 7fe5ebb34700 1 -- 172.21.2.102:0/3421646871 >> 172.21.2.102:0/3421646871 conn(0x7fe5e40bd540 msgr2=0x7fe5e40b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:21.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.304+0000 7fe5ebb34700 1 -- 172.21.2.102:0/3421646871 shutdown_connections 2021-02-12T17:16:21.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.304+0000 7fe5ebb34700 1 -- 172.21.2.102:0/3421646871 wait complete. 2021-02-12T17:16:21.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.305+0000 7fe5ebb34700 1 Processor -- start 2021-02-12T17:16:21.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.305+0000 7fe5ebb34700 1 -- start start 2021-02-12T17:16:21.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ebb34700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe5e40b7450 0x7fe5e415a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:21.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ebb34700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe5e40b88b0 0x7fe5e4061a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:21.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ebb34700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5e41405c0 0x7fe5e40a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:21.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ebb34700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e415a650 con 0x7fe5e41405c0 2021-02-12T17:16:21.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ebb34700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40b40a0 con 0x7fe5e40b88b0 2021-02-12T17:16:21.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ebb34700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40b4340 con 0x7fe5e40b7450 2021-02-12T17:16:21.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ea0d1700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5e41405c0 0x7fe5e40a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:21.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ea0d1700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5e41405c0 0x7fe5e40a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45224/0 (socket says 172.21.2.102:45224) 2021-02-12T17:16:21.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ea0d1700 1 -- 172.21.2.102:0/2384447827 learned_addr learned my addr 172.21.2.102:0/2384447827 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:21.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5e98d0700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe5e40b7450 0x7fe5e415a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:21.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5e90cf700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe5e40b88b0 0x7fe5e4061a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:21.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ea0d1700 1 -- 172.21.2.102:0/2384447827 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe5e40b7450 msgr2=0x7fe5e415a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:21.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ea0d1700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe5e40b7450 0x7fe5e415a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:21.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ea0d1700 1 -- 172.21.2.102:0/2384447827 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe5e40b88b0 msgr2=0x7fe5e4061a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:21.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ea0d1700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe5e40b88b0 0x7fe5e4061a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:21.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ea0d1700 1 -- 172.21.2.102:0/2384447827 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e40b45e0 con 0x7fe5e41405c0 2021-02-12T17:16:21.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5e98d0700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe5e40b7450 0x7fe5e415a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:21.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ea0d1700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5e41405c0 0x7fe5e40a1c50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fe5dc00ca90 tx=0x7fe5dc007f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:21.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5d5ffb700 1 -- 172.21.2.102:0/2384447827 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc00a760 con 0x7fe5e41405c0 2021-02-12T17:16:21.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5d5ffb700 1 -- 172.21.2.102:0/2384447827 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc00a8c0 con 0x7fe5e41405c0 2021-02-12T17:16:21.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5ebb34700 1 -- 172.21.2.102:0/2384447827 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e40b4880 con 0x7fe5e41405c0 2021-02-12T17:16:21.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.306+0000 7fe5d5ffb700 1 -- 172.21.2.102:0/2384447827 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc00ac40 con 0x7fe5e41405c0 2021-02-12T17:16:21.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.307+0000 7fe5ebb34700 1 -- 172.21.2.102:0/2384447827 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e4061f70 con 0x7fe5e41405c0 2021-02-12T17:16:21.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.307+0000 7fe5ebb34700 1 -- 172.21.2.102:0/2384447827 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e4066ad0 con 0x7fe5e41405c0 2021-02-12T17:16:21.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.307+0000 7fe5d5ffb700 1 -- 172.21.2.102:0/2384447827 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fe5dc019030 con 0x7fe5e41405c0 2021-02-12T17:16:21.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.308+0000 7fe5d5ffb700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe5c4059d30 0x7fe5c405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:21.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.308+0000 7fe5d5ffb700 1 -- 172.21.2.102:0/2384447827 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fe5dc073390 con 0x7fe5e41405c0 2021-02-12T17:16:21.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.308+0000 7fe5e98d0700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe5c4059d30 0x7fe5c405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:21.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.308+0000 7fe5e98d0700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe5c4059d30 0x7fe5c405c1f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe5e0006e20 tx=0x7fe5e0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:21.313 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.311+0000 7fe5d5ffb700 1 -- 172.21.2.102:0/2384447827 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fe5dc045580 con 0x7fe5e41405c0 2021-02-12T17:16:21.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.471+0000 7fe5ebb34700 1 -- 172.21.2.102:0/2384447827 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5e40b8350 con 0x7fe5e41405c0 2021-02-12T17:16:21.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.471+0000 7fe5d5ffb700 1 -- 172.21.2.102:0/2384447827 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7fe5dc017070 con 0x7fe5e41405c0 2021-02-12T17:16:21.473 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:21.473 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:16:21.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.472+0000 7fe5ebb34700 1 -- 172.21.2.102:0/2384447827 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe5c4059d30 msgr2=0x7fe5c405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:21.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.472+0000 7fe5ebb34700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe5c4059d30 0x7fe5c405c1f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe5e0006e20 tx=0x7fe5e0016000).stop 2021-02-12T17:16:21.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.472+0000 7fe5ebb34700 1 -- 172.21.2.102:0/2384447827 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5e41405c0 msgr2=0x7fe5e40a1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:21.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.472+0000 7fe5ebb34700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5e41405c0 0x7fe5e40a1c50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fe5dc00ca90 tx=0x7fe5dc007f00).stop 2021-02-12T17:16:21.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.472+0000 7fe5ebb34700 1 -- 172.21.2.102:0/2384447827 shutdown_connections 2021-02-12T17:16:21.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.472+0000 7fe5ebb34700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe5c4059d30 0x7fe5c405c1f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:21.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.472+0000 7fe5ebb34700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe5e41405c0 0x7fe5e40a1c50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:21.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.472+0000 7fe5ebb34700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe5e40b7450 0x7fe5e415a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:21.475 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.472+0000 7fe5ebb34700 1 --2- 172.21.2.102:0/2384447827 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe5e40b88b0 0x7fe5e4061a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:21.475 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.472+0000 7fe5ebb34700 1 -- 172.21.2.102:0/2384447827 >> 172.21.2.102:0/2384447827 conn(0x7fe5e40bd540 msgr2=0x7fe5e409eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:21.475 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.472+0000 7fe5ebb34700 1 -- 172.21.2.102:0/2384447827 shutdown_connections 2021-02-12T17:16:21.475 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:21.472+0000 7fe5ebb34700 1 -- 172.21.2.102:0/2384447827 wait complete. 2021-02-12T17:16:21.475 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:16:21.886 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-12T17:16:01.991560+0000', 'modified': '2021-02-12T17:16:03.999381+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.2.102:6837/1917299206', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.102:6835', 'nonce': 1917299206}, {'type': 'v1', 'addr': '172.21.2.102:6837', 'nonce': 1917299206}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'a', 'balancer': '', 'standby_count_wanted': 0} 2021-02-12T17:16:21.886 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-12T17:16:21.886 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-02-12T17:16:21.990 INFO:teuthology.orchestra.run.gibba002.stdout:{"cluster_fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","whoami":0,"id":4272,"want_state":"up:active","state":"up:active","fs_name":"a","rank_uptime":19.988782136000001,"mdsmap_epoch":6,"osdmap_epoch":27,"osdmap_epoch_barrier":22,"uptime":23.289727121999999} 2021-02-12T17:16:21.990 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "84d6d175-2ea1-4991-ab6d-aa08bc640524", "fs_name": "a", "id": 4272, "mdsmap_epoch": 6, "osdmap_epoch": 27, "osdmap_epoch_barrier": 22, "rank_uptime": 19.988782136, "state": "up:active", "uptime": 23.289727122, "want_state": "up:active", "whoami": 0 } 2021-02-12T17:16:21.991 INFO:teuthology.run_tasks:Running task ceph-fuse... 2021-02-12T17:16:22.011 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2021-02-12T17:16:22.011 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2021-02-12T17:16:22.011 INFO:tasks.ceph_fuse:client.0 config is {'cephfs_name': 'a'} 2021-02-12T17:16:22.012 INFO:tasks.ceph_fuse:client.1 config is {'cephfs_name': 'b'} 2021-02-12T17:16:22.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:22.012 DEBUG:teuthology.orchestra.run.gibba002:> ip netns list 2021-02-12T17:16:22.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:22.024 DEBUG:teuthology.orchestra.run.gibba002:> sudo ip link delete ceph-brx 2021-02-12T17:16:22.085 INFO:teuthology.orchestra.run.gibba002.stderr:Cannot find device "ceph-brx" 2021-02-12T17:16:22.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-12T17:16:22.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:22.086 DEBUG:teuthology.orchestra.run.gibba004:> ip netns list 2021-02-12T17:16:22.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:22.099 DEBUG:teuthology.orchestra.run.gibba004:> sudo ip link delete ceph-brx 2021-02-12T17:16:22.160 INFO:teuthology.orchestra.run.gibba004.stderr:Cannot find device "ceph-brx" 2021-02-12T17:16:22.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-12T17:16:22.161 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2021-02-12T17:16:22.161 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-02-12T17:16:22.161 INFO:tasks.cephfs.mount:self.client_remote.hostname = gibba002.front.sepia.ceph.com 2021-02-12T17:16:22.162 INFO:tasks.cephfs.mount:self.client.name = client.0 2021-02-12T17:16:22.162 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2021-02-12T17:16:22.162 INFO:tasks.cephfs.mount:self.cephfs_name = a 2021-02-12T17:16:22.162 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2021-02-12T17:16:22.162 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-02-12T17:16:22.162 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2021-02-12T17:16:22.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:22.162 DEBUG:teuthology.orchestra.run.gibba002:> ip addr 2021-02-12T17:16:22.174 INFO:teuthology.orchestra.run.gibba002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-02-12T17:16:22.174 INFO:teuthology.orchestra.run.gibba002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-02-12T17:16:22.174 INFO:teuthology.orchestra.run.gibba002.stdout: inet 127.0.0.1/8 scope host lo 2021-02-12T17:16:22.175 INFO:teuthology.orchestra.run.gibba002.stdout: valid_lft forever preferred_lft forever 2021-02-12T17:16:22.175 INFO:teuthology.orchestra.run.gibba002.stdout: inet6 ::1/128 scope host 2021-02-12T17:16:22.175 INFO:teuthology.orchestra.run.gibba002.stdout: valid_lft forever preferred_lft forever 2021-02-12T17:16:22.175 INFO:teuthology.orchestra.run.gibba002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-02-12T17:16:22.175 INFO:teuthology.orchestra.run.gibba002.stdout: link/ether 00:25:90:bd:e3:22 brd ff:ff:ff:ff:ff:ff 2021-02-12T17:16:22.175 INFO:teuthology.orchestra.run.gibba002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-02-12T17:16:22.175 INFO:teuthology.orchestra.run.gibba002.stdout: link/ether 00:25:90:bd:e3:23 brd ff:ff:ff:ff:ff:ff 2021-02-12T17:16:22.175 INFO:teuthology.orchestra.run.gibba002.stdout:4: enp1s0f0: mtu 1500 qdisc mq state UP group default qlen 1000 2021-02-12T17:16:22.175 INFO:teuthology.orchestra.run.gibba002.stdout: link/ether 3c:ec:ef:3d:8f:b6 brd ff:ff:ff:ff:ff:ff 2021-02-12T17:16:22.175 INFO:teuthology.orchestra.run.gibba002.stdout: inet 172.21.2.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp1s0f0 2021-02-12T17:16:22.175 INFO:teuthology.orchestra.run.gibba002.stdout: valid_lft 42766sec preferred_lft 42766sec 2021-02-12T17:16:22.175 INFO:teuthology.orchestra.run.gibba002.stdout: inet6 fe80::3eec:efff:fe3d:8fb6/64 scope link 2021-02-12T17:16:22.175 INFO:teuthology.orchestra.run.gibba002.stdout: valid_lft forever preferred_lft forever 2021-02-12T17:16:22.176 INFO:teuthology.orchestra.run.gibba002.stdout:5: enp1s0f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-02-12T17:16:22.176 INFO:teuthology.orchestra.run.gibba002.stdout: link/ether 3c:ec:ef:3d:8f:b7 brd ff:ff:ff:ff:ff:ff 2021-02-12T17:16:22.176 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2021-02-12T17:16:22.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:22.176 DEBUG:teuthology.orchestra.run.gibba002:> (cd / && exec sudo bash -c ' 2021-02-12T17:16:22.176 DEBUG:teuthology.orchestra.run.gibba002:> set -e 2021-02-12T17:16:22.176 DEBUG:teuthology.orchestra.run.gibba002:> sudo ip link add name ceph-brx type bridge 2021-02-12T17:16:22.177 DEBUG:teuthology.orchestra.run.gibba002:> sudo ip addr flush dev ceph-brx 2021-02-12T17:16:22.177 DEBUG:teuthology.orchestra.run.gibba002:> sudo ip link set ceph-brx up 2021-02-12T17:16:22.177 DEBUG:teuthology.orchestra.run.gibba002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2021-02-12T17:16:22.177 DEBUG:teuthology.orchestra.run.gibba002:> ') 2021-02-12T17:16:22.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:22.304 DEBUG:teuthology.orchestra.run.gibba002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-02-12T17:16:22.323 INFO:teuthology.orchestra.run.gibba002.stdout:1 2021-02-12T17:16:22.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:22.324 DEBUG:teuthology.orchestra.run.gibba002:> route 2021-02-12T17:16:22.392 INFO:teuthology.orchestra.run.gibba002.stdout:Kernel IP routing table 2021-02-12T17:16:22.392 INFO:teuthology.orchestra.run.gibba002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-02-12T17:16:22.392 INFO:teuthology.orchestra.run.gibba002.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp1s0f0 2021-02-12T17:16:22.392 INFO:teuthology.orchestra.run.gibba002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp1s0f0 2021-02-12T17:16:22.392 INFO:teuthology.orchestra.run.gibba002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-02-12T17:16:22.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:22.393 DEBUG:teuthology.orchestra.run.gibba002:> (cd / && exec sudo bash -c ' 2021-02-12T17:16:22.393 DEBUG:teuthology.orchestra.run.gibba002:> set -e 2021-02-12T17:16:22.393 DEBUG:teuthology.orchestra.run.gibba002:> sudo iptables -A FORWARD -o enp1s0f0 -i ceph-brx -j ACCEPT 2021-02-12T17:16:22.393 DEBUG:teuthology.orchestra.run.gibba002:> sudo iptables -A FORWARD -i enp1s0f0 -o ceph-brx -j ACCEPT 2021-02-12T17:16:22.393 DEBUG:teuthology.orchestra.run.gibba002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp1s0f0 -j MASQUERADE 2021-02-12T17:16:22.393 DEBUG:teuthology.orchestra.run.gibba002:> ') 2021-02-12T17:16:22.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:22.616 DEBUG:teuthology.orchestra.run.gibba002:> ip netns list 2021-02-12T17:16:22.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:22.627 DEBUG:teuthology.orchestra.run.gibba002:> ip netns list-id 2021-02-12T17:16:22.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:22.679 DEBUG:teuthology.orchestra.run.gibba002:> (cd / && exec sudo bash -c ' 2021-02-12T17:16:22.679 DEBUG:teuthology.orchestra.run.gibba002:> set -e 2021-02-12T17:16:22.679 DEBUG:teuthology.orchestra.run.gibba002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2021-02-12T17:16:22.679 DEBUG:teuthology.orchestra.run.gibba002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2021-02-12T17:16:22.679 DEBUG:teuthology.orchestra.run.gibba002:> ') 2021-02-12T17:16:22.756 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2021-02-12T17:16:22.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:22.757 DEBUG:teuthology.orchestra.run.gibba002:> (cd / && exec sudo bash -c ' 2021-02-12T17:16:22.757 DEBUG:teuthology.orchestra.run.gibba002:> set -e 2021-02-12T17:16:22.757 DEBUG:teuthology.orchestra.run.gibba002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2021-02-12T17:16:22.757 DEBUG:teuthology.orchestra.run.gibba002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2021-02-12T17:16:22.757 DEBUG:teuthology.orchestra.run.gibba002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2021-02-12T17:16:22.757 DEBUG:teuthology.orchestra.run.gibba002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2021-02-12T17:16:22.757 DEBUG:teuthology.orchestra.run.gibba002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2021-02-12T17:16:22.757 DEBUG:teuthology.orchestra.run.gibba002:> ') 2021-02-12T17:16:22.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:22.951 DEBUG:teuthology.orchestra.run.gibba002:> (cd / && exec sudo bash -c ' 2021-02-12T17:16:22.951 DEBUG:teuthology.orchestra.run.gibba002:> set -e 2021-02-12T17:16:22.951 DEBUG:teuthology.orchestra.run.gibba002:> sudo ip link set brx.0 up 2021-02-12T17:16:22.951 DEBUG:teuthology.orchestra.run.gibba002:> sudo ip link set dev brx.0 master ceph-brx 2021-02-12T17:16:22.951 DEBUG:teuthology.orchestra.run.gibba002:> ') 2021-02-12T17:16:23.032 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'cephfs_name': 'a'} 2021-02-12T17:16:23.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-12T17:16:23.032 DEBUG:teuthology.orchestra.run.gibba002:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0) 2021-02-12T17:16:23.044 INFO:teuthology.orchestra.run.gibba002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2021-02-12T17:16:23.045 DEBUG:teuthology.orchestra.run.gibba002:> sudo modprobe fuse 2021-02-12T17:16:23.125 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-12T17:16:23.125 DEBUG:teuthology.orchestra.run.gibba002:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-12T17:16:23.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-12T17:16:23.185 DEBUG:teuthology.orchestra.run.gibba002:> ls /sys/fs/fuse/connections 2021-02-12T17:16:23.236 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-12T17:16:23.237 DEBUG:teuthology.orchestra.run.gibba002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 --client_fs=a /home/ubuntu/cephtest/mnt.0) 2021-02-12T17:16:23.280 DEBUG:teuthology.orchestra.run.gibba002:> sudo modprobe fuse 2021-02-12T17:16:23.299 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-12T17:16:23.299 DEBUG:teuthology.orchestra.run.gibba002:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-12T17:16:23.343 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba002.stderr:2021-02-12T17:16:23.342+0000 7fbb029b7200 -1 init, newargv = 0x565351193230 newargc=15 2021-02-12T17:16:23.343 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba002.stderr:ceph-fuse[44519]: starting ceph client 2021-02-12T17:16:23.348 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba002.stderr:ceph-fuse[44519]: starting fuse 2021-02-12T17:16:23.359 INFO:teuthology.orchestra.run.gibba002.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2021-02-12T17:16:23.360 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-12T17:16:23.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-12T17:16:23.360 DEBUG:teuthology.orchestra.run.gibba002:> ls /sys/fs/fuse/connections 2021-02-12T17:16:23.412 INFO:teuthology.orchestra.run.gibba002.stdout:47 2021-02-12T17:16:23.412 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2021-02-12T17:16:23.413 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-02-12T17:16:23.413 DEBUG:teuthology.orchestra.run.gibba002:> import glob 2021-02-12T17:16:23.413 DEBUG:teuthology.orchestra.run.gibba002:> import re 2021-02-12T17:16:23.413 DEBUG:teuthology.orchestra.run.gibba002:> import os 2021-02-12T17:16:23.413 DEBUG:teuthology.orchestra.run.gibba002:> import subprocess 2021-02-12T17:16:23.413 DEBUG:teuthology.orchestra.run.gibba002:> 2021-02-12T17:16:23.413 DEBUG:teuthology.orchestra.run.gibba002:> def _find_admin_socket(client_name): 2021-02-12T17:16:23.413 DEBUG:teuthology.orchestra.run.gibba002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-12T17:16:23.413 DEBUG:teuthology.orchestra.run.gibba002:> files = glob.glob(asok_path) 2021-02-12T17:16:23.413 DEBUG:teuthology.orchestra.run.gibba002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2021-02-12T17:16:23.413 DEBUG:teuthology.orchestra.run.gibba002:> 2021-02-12T17:16:23.413 DEBUG:teuthology.orchestra.run.gibba002:> # Given a non-glob path, it better be there 2021-02-12T17:16:23.413 DEBUG:teuthology.orchestra.run.gibba002:> if "*" not in asok_path: 2021-02-12T17:16:23.413 DEBUG:teuthology.orchestra.run.gibba002:> assert(len(files) == 1) 2021-02-12T17:16:23.414 DEBUG:teuthology.orchestra.run.gibba002:> return files[0] 2021-02-12T17:16:23.414 DEBUG:teuthology.orchestra.run.gibba002:> 2021-02-12T17:16:23.414 DEBUG:teuthology.orchestra.run.gibba002:> for f in files: 2021-02-12T17:16:23.414 DEBUG:teuthology.orchestra.run.gibba002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-12T17:16:23.414 DEBUG:teuthology.orchestra.run.gibba002:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-12T17:16:23.414 DEBUG:teuthology.orchestra.run.gibba002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2021-02-12T17:16:23.414 DEBUG:teuthology.orchestra.run.gibba002:> contents = proc_f.read() 2021-02-12T17:16:23.414 DEBUG:teuthology.orchestra.run.gibba002:> if mountpoint in contents: 2021-02-12T17:16:23.414 DEBUG:teuthology.orchestra.run.gibba002:> return f 2021-02-12T17:16:23.414 DEBUG:teuthology.orchestra.run.gibba002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-12T17:16:23.414 DEBUG:teuthology.orchestra.run.gibba002:> 2021-02-12T17:16:23.414 DEBUG:teuthology.orchestra.run.gibba002:> print(_find_admin_socket("client.0")) 2021-02-12T17:16:23.414 DEBUG:teuthology.orchestra.run.gibba002:> ' 2021-02-12T17:16:23.516 INFO:teuthology.orchestra.run.gibba002.stdout:/var/run/ceph/ceph-client.0.44519.asok 2021-02-12T17:16:23.702 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44519.asok 2021-02-12T17:16:23.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-12T17:16:23.702 DEBUG:teuthology.orchestra.run.gibba002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44519.asok status 2021-02-12T17:16:23.830 INFO:teuthology.orchestra.run.gibba002.stdout:{ 2021-02-12T17:16:23.830 INFO:teuthology.orchestra.run.gibba002.stdout: "metadata": { 2021-02-12T17:16:23.830 INFO:teuthology.orchestra.run.gibba002.stdout: "ceph_sha1": "4819f209edcf86cf21724c2e068d1a90ce8b9945", 2021-02-12T17:16:23.830 INFO:teuthology.orchestra.run.gibba002.stdout: "ceph_version": "ceph version 17.0.0-720-g4819f209 (4819f209edcf86cf21724c2e068d1a90ce8b9945) quincy (dev)", 2021-02-12T17:16:23.830 INFO:teuthology.orchestra.run.gibba002.stdout: "entity_id": "0", 2021-02-12T17:16:23.831 INFO:teuthology.orchestra.run.gibba002.stdout: "hostname": "gibba002", 2021-02-12T17:16:23.831 INFO:teuthology.orchestra.run.gibba002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-12T17:16:23.831 INFO:teuthology.orchestra.run.gibba002.stdout: "pid": "44519", 2021-02-12T17:16:23.831 INFO:teuthology.orchestra.run.gibba002.stdout: "root": "/" 2021-02-12T17:16:23.831 INFO:teuthology.orchestra.run.gibba002.stdout: }, 2021-02-12T17:16:23.831 INFO:teuthology.orchestra.run.gibba002.stdout: "dentry_count": 0, 2021-02-12T17:16:23.831 INFO:teuthology.orchestra.run.gibba002.stdout: "dentry_pinned_count": 0, 2021-02-12T17:16:23.831 INFO:teuthology.orchestra.run.gibba002.stdout: "id": 4722, 2021-02-12T17:16:23.831 INFO:teuthology.orchestra.run.gibba002.stdout: "inst": { 2021-02-12T17:16:23.831 INFO:teuthology.orchestra.run.gibba002.stdout: "name": { 2021-02-12T17:16:23.831 INFO:teuthology.orchestra.run.gibba002.stdout: "type": "client", 2021-02-12T17:16:23.831 INFO:teuthology.orchestra.run.gibba002.stdout: "num": 4722 2021-02-12T17:16:23.831 INFO:teuthology.orchestra.run.gibba002.stdout: }, 2021-02-12T17:16:23.832 INFO:teuthology.orchestra.run.gibba002.stdout: "addr": { 2021-02-12T17:16:23.832 INFO:teuthology.orchestra.run.gibba002.stdout: "type": "v1", 2021-02-12T17:16:23.832 INFO:teuthology.orchestra.run.gibba002.stdout: "addr": "192.168.0.1:0", 2021-02-12T17:16:23.832 INFO:teuthology.orchestra.run.gibba002.stdout: "nonce": 4086178760 2021-02-12T17:16:23.832 INFO:teuthology.orchestra.run.gibba002.stdout: } 2021-02-12T17:16:23.832 INFO:teuthology.orchestra.run.gibba002.stdout: }, 2021-02-12T17:16:23.832 INFO:teuthology.orchestra.run.gibba002.stdout: "addr": { 2021-02-12T17:16:23.832 INFO:teuthology.orchestra.run.gibba002.stdout: "type": "v1", 2021-02-12T17:16:23.832 INFO:teuthology.orchestra.run.gibba002.stdout: "addr": "192.168.0.1:0", 2021-02-12T17:16:23.832 INFO:teuthology.orchestra.run.gibba002.stdout: "nonce": 4086178760 2021-02-12T17:16:23.832 INFO:teuthology.orchestra.run.gibba002.stdout: }, 2021-02-12T17:16:23.832 INFO:teuthology.orchestra.run.gibba002.stdout: "inst_str": "client.4722 192.168.0.1:0/4086178760", 2021-02-12T17:16:23.832 INFO:teuthology.orchestra.run.gibba002.stdout: "addr_str": "192.168.0.1:0/4086178760", 2021-02-12T17:16:23.833 INFO:teuthology.orchestra.run.gibba002.stdout: "inode_count": 1, 2021-02-12T17:16:23.833 INFO:teuthology.orchestra.run.gibba002.stdout: "mds_epoch": 6, 2021-02-12T17:16:23.833 INFO:teuthology.orchestra.run.gibba002.stdout: "osd_epoch": 27, 2021-02-12T17:16:23.833 INFO:teuthology.orchestra.run.gibba002.stdout: "osd_epoch_barrier": 0, 2021-02-12T17:16:23.833 INFO:teuthology.orchestra.run.gibba002.stdout: "blocklisted": false, 2021-02-12T17:16:23.833 INFO:teuthology.orchestra.run.gibba002.stdout: "fs_name": "a" 2021-02-12T17:16:23.833 INFO:teuthology.orchestra.run.gibba002.stdout:} 2021-02-12T17:16:23.836 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-02-12T17:16:23.836 INFO:tasks.cephfs.mount:self.client_remote.hostname = gibba004.front.sepia.ceph.com 2021-02-12T17:16:23.836 INFO:tasks.cephfs.mount:self.client.name = client.1 2021-02-12T17:16:23.836 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2021-02-12T17:16:23.836 INFO:tasks.cephfs.mount:self.cephfs_name = b 2021-02-12T17:16:23.837 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2021-02-12T17:16:23.837 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-02-12T17:16:23.837 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2021-02-12T17:16:23.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:23.837 DEBUG:teuthology.orchestra.run.gibba004:> ip addr 2021-02-12T17:16:23.850 INFO:teuthology.orchestra.run.gibba004.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-02-12T17:16:23.850 INFO:teuthology.orchestra.run.gibba004.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-02-12T17:16:23.850 INFO:teuthology.orchestra.run.gibba004.stdout: inet 127.0.0.1/8 scope host lo 2021-02-12T17:16:23.850 INFO:teuthology.orchestra.run.gibba004.stdout: valid_lft forever preferred_lft forever 2021-02-12T17:16:23.850 INFO:teuthology.orchestra.run.gibba004.stdout: inet6 ::1/128 scope host 2021-02-12T17:16:23.850 INFO:teuthology.orchestra.run.gibba004.stdout: valid_lft forever preferred_lft forever 2021-02-12T17:16:23.850 INFO:teuthology.orchestra.run.gibba004.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-02-12T17:16:23.850 INFO:teuthology.orchestra.run.gibba004.stdout: link/ether 00:25:90:bd:e1:e8 brd ff:ff:ff:ff:ff:ff 2021-02-12T17:16:23.850 INFO:teuthology.orchestra.run.gibba004.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-02-12T17:16:23.851 INFO:teuthology.orchestra.run.gibba004.stdout: link/ether 00:25:90:bd:e1:e9 brd ff:ff:ff:ff:ff:ff 2021-02-12T17:16:23.851 INFO:teuthology.orchestra.run.gibba004.stdout:4: enp1s0f0: mtu 1500 qdisc mq state UP group default qlen 1000 2021-02-12T17:16:23.851 INFO:teuthology.orchestra.run.gibba004.stdout: link/ether 3c:ec:ef:3d:8b:fe brd ff:ff:ff:ff:ff:ff 2021-02-12T17:16:23.851 INFO:teuthology.orchestra.run.gibba004.stdout: inet 172.21.2.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp1s0f0 2021-02-12T17:16:23.851 INFO:teuthology.orchestra.run.gibba004.stdout: valid_lft 42771sec preferred_lft 42771sec 2021-02-12T17:16:23.851 INFO:teuthology.orchestra.run.gibba004.stdout: inet6 fe80::3eec:efff:fe3d:8bfe/64 scope link noprefixroute 2021-02-12T17:16:23.851 INFO:teuthology.orchestra.run.gibba004.stdout: valid_lft forever preferred_lft forever 2021-02-12T17:16:23.851 INFO:teuthology.orchestra.run.gibba004.stdout:5: enp1s0f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2021-02-12T17:16:23.851 INFO:teuthology.orchestra.run.gibba004.stdout: link/ether 3c:ec:ef:3d:8b:ff brd ff:ff:ff:ff:ff:ff 2021-02-12T17:16:23.852 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2021-02-12T17:16:23.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:23.852 DEBUG:teuthology.orchestra.run.gibba004:> (cd / && exec sudo bash -c ' 2021-02-12T17:16:23.852 DEBUG:teuthology.orchestra.run.gibba004:> set -e 2021-02-12T17:16:23.852 DEBUG:teuthology.orchestra.run.gibba004:> sudo ip link add name ceph-brx type bridge 2021-02-12T17:16:23.852 DEBUG:teuthology.orchestra.run.gibba004:> sudo ip addr flush dev ceph-brx 2021-02-12T17:16:23.852 DEBUG:teuthology.orchestra.run.gibba004:> sudo ip link set ceph-brx up 2021-02-12T17:16:23.852 DEBUG:teuthology.orchestra.run.gibba004:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2021-02-12T17:16:23.852 DEBUG:teuthology.orchestra.run.gibba004:> ') 2021-02-12T17:16:23.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:23.987 DEBUG:teuthology.orchestra.run.gibba004:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-02-12T17:16:24.006 INFO:teuthology.orchestra.run.gibba004.stdout:1 2021-02-12T17:16:24.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:24.007 DEBUG:teuthology.orchestra.run.gibba004:> route 2021-02-12T17:16:24.082 INFO:teuthology.orchestra.run.gibba004.stdout:Kernel IP routing table 2021-02-12T17:16:24.082 INFO:teuthology.orchestra.run.gibba004.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-02-12T17:16:24.082 INFO:teuthology.orchestra.run.gibba004.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp1s0f0 2021-02-12T17:16:24.082 INFO:teuthology.orchestra.run.gibba004.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp1s0f0 2021-02-12T17:16:24.083 INFO:teuthology.orchestra.run.gibba004.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-02-12T17:16:24.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:24.083 DEBUG:teuthology.orchestra.run.gibba004:> (cd / && exec sudo bash -c ' 2021-02-12T17:16:24.083 DEBUG:teuthology.orchestra.run.gibba004:> set -e 2021-02-12T17:16:24.083 DEBUG:teuthology.orchestra.run.gibba004:> sudo iptables -A FORWARD -o enp1s0f0 -i ceph-brx -j ACCEPT 2021-02-12T17:16:24.083 DEBUG:teuthology.orchestra.run.gibba004:> sudo iptables -A FORWARD -i enp1s0f0 -o ceph-brx -j ACCEPT 2021-02-12T17:16:24.083 DEBUG:teuthology.orchestra.run.gibba004:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp1s0f0 -j MASQUERADE 2021-02-12T17:16:24.083 DEBUG:teuthology.orchestra.run.gibba004:> ') 2021-02-12T17:16:24.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:24.309 DEBUG:teuthology.orchestra.run.gibba004:> ip netns list 2021-02-12T17:16:24.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:24.320 DEBUG:teuthology.orchestra.run.gibba004:> ip netns list-id 2021-02-12T17:16:24.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:24.372 DEBUG:teuthology.orchestra.run.gibba004:> (cd / && exec sudo bash -c ' 2021-02-12T17:16:24.372 DEBUG:teuthology.orchestra.run.gibba004:> set -e 2021-02-12T17:16:24.372 DEBUG:teuthology.orchestra.run.gibba004:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2021-02-12T17:16:24.372 DEBUG:teuthology.orchestra.run.gibba004:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2021-02-12T17:16:24.372 DEBUG:teuthology.orchestra.run.gibba004:> ') 2021-02-12T17:16:24.449 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2021-02-12T17:16:24.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:24.450 DEBUG:teuthology.orchestra.run.gibba004:> (cd / && exec sudo bash -c ' 2021-02-12T17:16:24.450 DEBUG:teuthology.orchestra.run.gibba004:> set -e 2021-02-12T17:16:24.450 DEBUG:teuthology.orchestra.run.gibba004:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2021-02-12T17:16:24.450 DEBUG:teuthology.orchestra.run.gibba004:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2021-02-12T17:16:24.450 DEBUG:teuthology.orchestra.run.gibba004:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2021-02-12T17:16:24.450 DEBUG:teuthology.orchestra.run.gibba004:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2021-02-12T17:16:24.450 DEBUG:teuthology.orchestra.run.gibba004:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2021-02-12T17:16:24.450 DEBUG:teuthology.orchestra.run.gibba004:> ') 2021-02-12T17:16:24.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-12T17:16:24.652 DEBUG:teuthology.orchestra.run.gibba004:> (cd / && exec sudo bash -c ' 2021-02-12T17:16:24.652 DEBUG:teuthology.orchestra.run.gibba004:> set -e 2021-02-12T17:16:24.652 DEBUG:teuthology.orchestra.run.gibba004:> sudo ip link set brx.0 up 2021-02-12T17:16:24.652 DEBUG:teuthology.orchestra.run.gibba004:> sudo ip link set dev brx.0 master ceph-brx 2021-02-12T17:16:24.652 DEBUG:teuthology.orchestra.run.gibba004:> ') 2021-02-12T17:16:24.732 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {'cephfs_name': 'b'} 2021-02-12T17:16:24.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-12T17:16:24.732 DEBUG:teuthology.orchestra.run.gibba004:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.1) 2021-02-12T17:16:24.744 INFO:teuthology.orchestra.run.gibba004.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2021-02-12T17:16:24.744 DEBUG:teuthology.orchestra.run.gibba004:> sudo modprobe fuse 2021-02-12T17:16:24.830 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-12T17:16:24.830 DEBUG:teuthology.orchestra.run.gibba004:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-12T17:16:24.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-12T17:16:24.851 DEBUG:teuthology.orchestra.run.gibba004:> ls /sys/fs/fuse/connections 2021-02-12T17:16:24.902 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-12T17:16:24.903 DEBUG:teuthology.orchestra.run.gibba004:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 1 --client_fs=b /home/ubuntu/cephtest/mnt.1) 2021-02-12T17:16:24.946 DEBUG:teuthology.orchestra.run.gibba004:> sudo modprobe fuse 2021-02-12T17:16:24.964 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-12T17:16:24.965 DEBUG:teuthology.orchestra.run.gibba004:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-12T17:16:25.008 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba004.stderr:2021-02-12T17:16:25.007+0000 7faef3326200 -1 init, newargv = 0x555bce8b4e50 newargc=15 2021-02-12T17:16:25.008 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba004.stderr:ceph-fuse[41655]: starting ceph client 2021-02-12T17:16:25.024 INFO:teuthology.orchestra.run.gibba004.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2021-02-12T17:16:25.025 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-12T17:16:25.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-12T17:16:25.025 DEBUG:teuthology.orchestra.run.gibba004:> ls /sys/fs/fuse/connections 2021-02-12T17:16:25.353 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba004.stderr:ceph-fuse[41655]: starting fuse 2021-02-12T17:16:26.179 DEBUG:teuthology.orchestra.run.gibba004:> sudo modprobe fuse 2021-02-12T17:16:26.200 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-12T17:16:26.201 DEBUG:teuthology.orchestra.run.gibba004:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-12T17:16:26.261 INFO:teuthology.orchestra.run.gibba004.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2021-02-12T17:16:26.261 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-12T17:16:26.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-12T17:16:26.262 DEBUG:teuthology.orchestra.run.gibba004:> ls /sys/fs/fuse/connections 2021-02-12T17:16:26.313 INFO:teuthology.orchestra.run.gibba004.stdout:47 2021-02-12T17:16:26.313 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2021-02-12T17:16:26.314 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-02-12T17:16:26.314 DEBUG:teuthology.orchestra.run.gibba004:> import glob 2021-02-12T17:16:26.314 DEBUG:teuthology.orchestra.run.gibba004:> import re 2021-02-12T17:16:26.314 DEBUG:teuthology.orchestra.run.gibba004:> import os 2021-02-12T17:16:26.314 DEBUG:teuthology.orchestra.run.gibba004:> import subprocess 2021-02-12T17:16:26.314 DEBUG:teuthology.orchestra.run.gibba004:> 2021-02-12T17:16:26.314 DEBUG:teuthology.orchestra.run.gibba004:> def _find_admin_socket(client_name): 2021-02-12T17:16:26.314 DEBUG:teuthology.orchestra.run.gibba004:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-02-12T17:16:26.314 DEBUG:teuthology.orchestra.run.gibba004:> files = glob.glob(asok_path) 2021-02-12T17:16:26.314 DEBUG:teuthology.orchestra.run.gibba004:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2021-02-12T17:16:26.314 DEBUG:teuthology.orchestra.run.gibba004:> 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> # Given a non-glob path, it better be there 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> if "*" not in asok_path: 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> assert(len(files) == 1) 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> return files[0] 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> for f in files: 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> contents = proc_f.read() 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> if mountpoint in contents: 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> return f 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> 2021-02-12T17:16:26.315 DEBUG:teuthology.orchestra.run.gibba004:> print(_find_admin_socket("client.1")) 2021-02-12T17:16:26.316 DEBUG:teuthology.orchestra.run.gibba004:> ' 2021-02-12T17:16:26.417 INFO:teuthology.orchestra.run.gibba004.stdout:/var/run/ceph/ceph-client.1.41655.asok 2021-02-12T17:16:26.603 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41655.asok 2021-02-12T17:16:26.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-12T17:16:26.604 DEBUG:teuthology.orchestra.run.gibba004:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41655.asok status 2021-02-12T17:16:26.731 INFO:teuthology.orchestra.run.gibba004.stdout:{ 2021-02-12T17:16:26.732 INFO:teuthology.orchestra.run.gibba004.stdout: "metadata": { 2021-02-12T17:16:26.732 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph_sha1": "4819f209edcf86cf21724c2e068d1a90ce8b9945", 2021-02-12T17:16:26.732 INFO:teuthology.orchestra.run.gibba004.stdout: "ceph_version": "ceph version 17.0.0-720-g4819f209 (4819f209edcf86cf21724c2e068d1a90ce8b9945) quincy (dev)", 2021-02-12T17:16:26.732 INFO:teuthology.orchestra.run.gibba004.stdout: "entity_id": "1", 2021-02-12T17:16:26.732 INFO:teuthology.orchestra.run.gibba004.stdout: "hostname": "gibba004", 2021-02-12T17:16:26.732 INFO:teuthology.orchestra.run.gibba004.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-02-12T17:16:26.732 INFO:teuthology.orchestra.run.gibba004.stdout: "pid": "41655", 2021-02-12T17:16:26.732 INFO:teuthology.orchestra.run.gibba004.stdout: "root": "/" 2021-02-12T17:16:26.732 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-02-12T17:16:26.732 INFO:teuthology.orchestra.run.gibba004.stdout: "dentry_count": 0, 2021-02-12T17:16:26.732 INFO:teuthology.orchestra.run.gibba004.stdout: "dentry_pinned_count": 0, 2021-02-12T17:16:26.732 INFO:teuthology.orchestra.run.gibba004.stdout: "id": 34307, 2021-02-12T17:16:26.733 INFO:teuthology.orchestra.run.gibba004.stdout: "inst": { 2021-02-12T17:16:26.733 INFO:teuthology.orchestra.run.gibba004.stdout: "name": { 2021-02-12T17:16:26.733 INFO:teuthology.orchestra.run.gibba004.stdout: "type": "client", 2021-02-12T17:16:26.733 INFO:teuthology.orchestra.run.gibba004.stdout: "num": 34307 2021-02-12T17:16:26.733 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-02-12T17:16:26.733 INFO:teuthology.orchestra.run.gibba004.stdout: "addr": { 2021-02-12T17:16:26.733 INFO:teuthology.orchestra.run.gibba004.stdout: "type": "v1", 2021-02-12T17:16:26.733 INFO:teuthology.orchestra.run.gibba004.stdout: "addr": "192.168.0.1:0", 2021-02-12T17:16:26.733 INFO:teuthology.orchestra.run.gibba004.stdout: "nonce": 1713122278 2021-02-12T17:16:26.733 INFO:teuthology.orchestra.run.gibba004.stdout: } 2021-02-12T17:16:26.733 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-02-12T17:16:26.733 INFO:teuthology.orchestra.run.gibba004.stdout: "addr": { 2021-02-12T17:16:26.733 INFO:teuthology.orchestra.run.gibba004.stdout: "type": "v1", 2021-02-12T17:16:26.733 INFO:teuthology.orchestra.run.gibba004.stdout: "addr": "192.168.0.1:0", 2021-02-12T17:16:26.734 INFO:teuthology.orchestra.run.gibba004.stdout: "nonce": 1713122278 2021-02-12T17:16:26.734 INFO:teuthology.orchestra.run.gibba004.stdout: }, 2021-02-12T17:16:26.734 INFO:teuthology.orchestra.run.gibba004.stdout: "inst_str": "client.34307 192.168.0.1:0/1713122278", 2021-02-12T17:16:26.734 INFO:teuthology.orchestra.run.gibba004.stdout: "addr_str": "192.168.0.1:0/1713122278", 2021-02-12T17:16:26.734 INFO:teuthology.orchestra.run.gibba004.stdout: "inode_count": 1, 2021-02-12T17:16:26.734 INFO:teuthology.orchestra.run.gibba004.stdout: "mds_epoch": 10, 2021-02-12T17:16:26.734 INFO:teuthology.orchestra.run.gibba004.stdout: "osd_epoch": 27, 2021-02-12T17:16:26.734 INFO:teuthology.orchestra.run.gibba004.stdout: "osd_epoch_barrier": 0, 2021-02-12T17:16:26.734 INFO:teuthology.orchestra.run.gibba004.stdout: "blocklisted": false, 2021-02-12T17:16:26.734 INFO:teuthology.orchestra.run.gibba004.stdout: "fs_name": "b" 2021-02-12T17:16:26.734 INFO:teuthology.orchestra.run.gibba004.stdout:} 2021-02-12T17:16:26.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-12T17:16:26.738 DEBUG:teuthology.orchestra.run.gibba002:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-12T17:16:26.738 DEBUG:teuthology.orchestra.run.gibba002:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-12T17:16:26.750 INFO:teuthology.orchestra.run.gibba002.stdout:fuseblk 2021-02-12T17:16:26.751 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-12T17:16:26.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-12T17:16:26.751 DEBUG:teuthology.orchestra.run.gibba002:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-12T17:16:26.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-12T17:16:26.812 DEBUG:teuthology.orchestra.run.gibba004:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-12T17:16:26.812 DEBUG:teuthology.orchestra.run.gibba004:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-12T17:16:26.825 INFO:teuthology.orchestra.run.gibba004.stdout:fuseblk 2021-02-12T17:16:26.825 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-12T17:16:26.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-12T17:16:26.825 DEBUG:teuthology.orchestra.run.gibba004:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-02-12T17:16:26.887 INFO:teuthology.run_tasks:Running task mds_thrash... 2021-02-12T17:16:26.900 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:26.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.986+0000 7f99927fe700 1 Processor -- start 2021-02-12T17:16:26.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.986+0000 7f99927fe700 1 -- start start 2021-02-12T17:16:26.989 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.987+0000 7f99927fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f998c062e50 0x7f998c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:26.989 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.987+0000 7f99927fe700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c0b7960 con 0x7f998c14e530 2021-02-12T17:16:26.989 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.987+0000 7f99927fe700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c0622a0 con 0x7f998c0b8d20 2021-02-12T17:16:26.989 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.987+0000 7f99927fe700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998c068d20 con 0x7f998c062e50 2021-02-12T17:16:26.990 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.987+0000 7f9990d9b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f998c062e50 0x7f998c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:26.990 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.987+0000 7f998b7fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f998c14e530 0x7f998c062740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53900/0 (socket says 172.21.2.102:53900) 2021-02-12T17:16:26.990 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.987+0000 7f998b7fe700 1 -- 172.21.2.102:0/192040328 learned_addr learned my addr 172.21.2.102:0/192040328 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:26.990 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.987+0000 7f9990d9b700 1 -- 172.21.2.102:0/192040328 >> v1:172.21.2.104:6789/0 conn(0x7f998c0b8d20 legacy=0x7f998c0b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:26.990 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.987+0000 7f9990d9b700 1 -- 172.21.2.102:0/192040328 >> v1:172.21.2.102:6789/0 conn(0x7f998c14e530 legacy=0x7f998c062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:26.990 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.987+0000 7f9990d9b700 1 -- 172.21.2.102:0/192040328 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c14ea10 con 0x7f998c062e50 2021-02-12T17:16:26.990 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.987+0000 7f9990d9b700 1 --2- 172.21.2.102:0/192040328 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f998c062e50 0x7f998c068830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f9984009c90 tx=0x7f99840091d0).ready entity=mon.0 client_cookie=fc0a47371d6dd136 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:26.990 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.987+0000 7f998affd700 1 -- 172.21.2.102:0/192040328 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9984009ea0 con 0x7f998c062e50 2021-02-12T17:16:26.990 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.987+0000 7f998affd700 1 -- 172.21.2.102:0/192040328 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998400bbb0 con 0x7f998c062e50 2021-02-12T17:16:26.990 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.987+0000 7f998affd700 1 -- 172.21.2.102:0/192040328 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9984011400 con 0x7f998c062e50 2021-02-12T17:16:26.990 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.988+0000 7f99927fe700 1 -- 172.21.2.102:0/192040328 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f998c062e50 msgr2=0x7f998c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:26.990 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.988+0000 7f99927fe700 1 --2- 172.21.2.102:0/192040328 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f998c062e50 0x7f998c068830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f9984009c90 tx=0x7f99840091d0).stop 2021-02-12T17:16:26.991 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.988+0000 7f99927fe700 1 -- 172.21.2.102:0/192040328 shutdown_connections 2021-02-12T17:16:26.991 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.988+0000 7f99927fe700 1 --2- 172.21.2.102:0/192040328 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f998c062e50 0x7f998c068830 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:26.991 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.988+0000 7f99927fe700 1 -- 172.21.2.102:0/192040328 >> 172.21.2.102:0/192040328 conn(0x7f998c0bc480 msgr2=0x7f998c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:26.991 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.988+0000 7f99927fe700 1 -- 172.21.2.102:0/192040328 shutdown_connections 2021-02-12T17:16:26.991 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.988+0000 7f99927fe700 1 -- 172.21.2.102:0/192040328 wait complete. 2021-02-12T17:16:26.993 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.989+0000 7f99927fe700 1 Processor -- start 2021-02-12T17:16:26.993 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.989+0000 7f99927fe700 1 -- start start 2021-02-12T17:16:26.993 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.989+0000 7f99927fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f998c062e50 0x7f998c0b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:26.993 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.989+0000 7f99927fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f998c0b8d20 0x7f998c0b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:26.993 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.989+0000 7f99927fe700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f998c14e530 0x7f998c141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:26.993 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.989+0000 7f99927fe700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c141540 con 0x7f998c0b8d20 2021-02-12T17:16:26.993 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.989+0000 7f99927fe700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0b3c50 con 0x7f998c14e530 2021-02-12T17:16:26.993 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.989+0000 7f99927fe700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0b3eb0 con 0x7f998c062e50 2021-02-12T17:16:26.993 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.989+0000 7f998b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f998c0b8d20 0x7f998c0b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:26.993 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.989+0000 7f998b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f998c0b8d20 0x7f998c0b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45260/0 (socket says 172.21.2.102:45260) 2021-02-12T17:16:26.993 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.989+0000 7f998b7fe700 1 -- 172.21.2.102:0/2865613670 learned_addr learned my addr 172.21.2.102:0/2865613670 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:26.994 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.990+0000 7f998b7fe700 1 -- 172.21.2.102:0/2865613670 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f998c062e50 msgr2=0x7f998c0b21a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:26.994 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.990+0000 7f998b7fe700 1 --2- 172.21.2.102:0/2865613670 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f998c062e50 0x7f998c0b21a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:26.994 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.990+0000 7f998b7fe700 1 -- 172.21.2.102:0/2865613670 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f998c14e530 msgr2=0x7f998c141050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:26.994 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.990+0000 7f998b7fe700 1 --2- 172.21.2.102:0/2865613670 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f998c14e530 0x7f998c141050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:26.994 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.990+0000 7f998b7fe700 1 -- 172.21.2.102:0/2865613670 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c0b4150 con 0x7f998c0b8d20 2021-02-12T17:16:26.994 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.990+0000 7f998b7fe700 1 --2- 172.21.2.102:0/2865613670 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f998c0b8d20 0x7f998c0b0000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f997c00c710 tx=0x7f997c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:26.994 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.990+0000 7f9983fff700 1 -- 172.21.2.102:0/2865613670 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c0072e0 con 0x7f998c0b8d20 2021-02-12T17:16:26.994 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.990+0000 7f9983fff700 1 -- 172.21.2.102:0/2865613670 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c007440 con 0x7f998c0b8d20 2021-02-12T17:16:26.994 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.990+0000 7f99927fe700 1 -- 172.21.2.102:0/2865613670 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998c0b43f0 con 0x7f998c0b8d20 2021-02-12T17:16:26.994 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.990+0000 7f99927fe700 1 -- 172.21.2.102:0/2865613670 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c0ba480 con 0x7f998c0b8d20 2021-02-12T17:16:26.994 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.990+0000 7f9983fff700 1 -- 172.21.2.102:0/2865613670 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c0057f0 con 0x7f998c0b8d20 2021-02-12T17:16:26.995 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.991+0000 7f99927fe700 1 -- 172.21.2.102:0/2865613670 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9964004f60 con 0x7f998c0b8d20 2021-02-12T17:16:26.995 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.991+0000 7f9983fff700 1 -- 172.21.2.102:0/2865613670 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f997c010070 con 0x7f998c0b8d20 2021-02-12T17:16:26.995 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.991+0000 7f9983fff700 1 --2- 172.21.2.102:0/2865613670 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9970059d30 0x7f997005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:26.995 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.991+0000 7f9983fff700 1 -- 172.21.2.102:0/2865613670 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f997c073350 con 0x7f998c0b8d20 2021-02-12T17:16:26.995 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.991+0000 7f998bfff700 1 --2- 172.21.2.102:0/2865613670 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9970059d30 0x7f997005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:26.995 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.991+0000 7f998bfff700 1 --2- 172.21.2.102:0/2865613670 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9970059d30 0x7f997005c1f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f998c0b5be0 tx=0x7f9974006920).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:26.995 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:26.994+0000 7f9983fff700 1 -- 172.21.2.102:0/2865613670 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f997c046a70 con 0x7f998c0b8d20 2021-02-12T17:16:27.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.124+0000 7f99927fe700 1 -- 172.21.2.102:0/2865613670 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9964005210 con 0x7f998c0b8d20 2021-02-12T17:16:27.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.125+0000 7f9983fff700 1 -- 172.21.2.102:0/2865613670 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19888 (secure 0 0 0) 0x7f997c04a090 con 0x7f998c0b8d20 2021-02-12T17:16:27.126 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:27.126 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":27,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:09.532002+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}},{"pool":5,"pool_name":"b_metadata","create_time":"2021-02-12T17:16:06.678651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}}},{"pool":6,"pool_name":"b_data","create_time":"2021-02-12T17:16:07.511756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"b"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:27.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.126+0000 7f99927fe700 1 -- 172.21.2.102:0/2865613670 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9970059d30 msgr2=0x7f997005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.126+0000 7f99927fe700 1 --2- 172.21.2.102:0/2865613670 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9970059d30 0x7f997005c1f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f998c0b5be0 tx=0x7f9974006920).stop 2021-02-12T17:16:27.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.126+0000 7f99927fe700 1 -- 172.21.2.102:0/2865613670 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f998c0b8d20 msgr2=0x7f998c0b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.126+0000 7f99927fe700 1 --2- 172.21.2.102:0/2865613670 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f998c0b8d20 0x7f998c0b0000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f997c00c710 tx=0x7f997c007c90).stop 2021-02-12T17:16:27.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.126+0000 7f99927fe700 1 -- 172.21.2.102:0/2865613670 shutdown_connections 2021-02-12T17:16:27.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.126+0000 7f99927fe700 1 --2- 172.21.2.102:0/2865613670 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f998c14e530 0x7f998c141050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:27.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.126+0000 7f99927fe700 1 --2- 172.21.2.102:0/2865613670 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f998c062e50 0x7f998c0b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:27.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.126+0000 7f99927fe700 1 --2- 172.21.2.102:0/2865613670 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9970059d30 0x7f997005c1f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.126+0000 7f99927fe700 1 --2- 172.21.2.102:0/2865613670 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f998c0b8d20 0x7f998c0b0000 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.126+0000 7f99927fe700 1 -- 172.21.2.102:0/2865613670 >> 172.21.2.102:0/2865613670 conn(0x7f998c0bc480 msgr2=0x7f998c152370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:27.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.126+0000 7f99927fe700 1 -- 172.21.2.102:0/2865613670 shutdown_connections 2021-02-12T17:16:27.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.126+0000 7f99927fe700 1 -- 172.21.2.102:0/2865613670 wait complete. 2021-02-12T17:16:27.136 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-12T17:15:54.614238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-12T17:15:56.701902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'a_metadata', 'create_time': '2021-02-12T17:15:59.832660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}}, {'pool': 4, 'pool_name': 'a_data', 'create_time': '2021-02-12T17:16:00.965024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'a'}}}, {'pool': 5, 'pool_name': 'b_metadata', 'create_time': '2021-02-12T17:16:06.678651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}}, {'pool': 6, 'pool_name': 'b_data', 'create_time': '2021-02-12T17:16:07.511756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'b'}}}] 2021-02-12T17:16:27.137 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-02-12T17:16:27.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.225+0000 7ff7a03a0700 1 Processor -- start 2021-02-12T17:16:27.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.225+0000 7ff7a03a0700 1 -- start start 2021-02-12T17:16:27.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.226+0000 7ff7a03a0700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7ff7980b0940 0x7ff79814e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.226+0000 7ff7a03a0700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff79809ada0 0x7ff798151830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.226+0000 7ff7a03a0700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff798066b70 con 0x7ff7980bc2b0 2021-02-12T17:16:27.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.226+0000 7ff7a03a0700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7980b27d0 con 0x7ff7980b0940 2021-02-12T17:16:27.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.226+0000 7ff7a03a0700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79814e550 con 0x7ff79809ada0 2021-02-12T17:16:27.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.227+0000 7ff79e13c700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7ff7980bc2b0 0x7ff798151120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:36282/0 (socket says 172.21.2.102:36282) 2021-02-12T17:16:27.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.227+0000 7ff79e13c700 1 -- 172.21.2.102:0/1393406226 learned_addr learned my addr 172.21.2.102:0/1393406226 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:27.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.227+0000 7ff79e93d700 1 --2- 172.21.2.102:0/1393406226 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff79809ada0 0x7ff798151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.227+0000 7ff79d93b700 1 --2- 172.21.2.102:0/1393406226 >> v2:172.21.2.104:3300/0 conn(0x7ff7980b0940 0x7ff79814e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.228+0000 7ff79d93b700 1 -- 172.21.2.102:0/1393406226 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff79809ada0 msgr2=0x7ff798151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:27.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.228+0000 7ff79d93b700 1 --2- 172.21.2.102:0/1393406226 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff79809ada0 0x7ff798151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.228+0000 7ff79d93b700 1 -- 172.21.2.102:0/1393406226 >> v1:172.21.2.104:6789/0 conn(0x7ff7980bc2b0 legacy=0x7ff798151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.228+0000 7ff79d93b700 1 -- 172.21.2.102:0/1393406226 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7980685b0 con 0x7ff7980b0940 2021-02-12T17:16:27.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.228+0000 7ff79d93b700 1 --2- 172.21.2.102:0/1393406226 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7980b0940 0x7ff79814e060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7ff79400b980 tx=0x7ff794006de0).ready entity=mon.1 client_cookie=9f302acca9d5b517 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:27.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.228+0000 7ff79d13a700 1 -- 172.21.2.102:0/1393406226 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79400be70 con 0x7ff7980b0940 2021-02-12T17:16:27.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.228+0000 7ff79d13a700 1 -- 172.21.2.102:0/1393406226 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff794009870 con 0x7ff7980b0940 2021-02-12T17:16:27.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.228+0000 7ff79d13a700 1 -- 172.21.2.102:0/1393406226 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794009bf0 con 0x7ff7980b0940 2021-02-12T17:16:27.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.228+0000 7ff7a03a0700 1 -- 172.21.2.102:0/1393406226 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7980b0940 msgr2=0x7ff79814e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.228+0000 7ff7a03a0700 1 --2- 172.21.2.102:0/1393406226 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7980b0940 0x7ff79814e060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7ff79400b980 tx=0x7ff794006de0).stop 2021-02-12T17:16:27.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.229+0000 7ff7a03a0700 1 -- 172.21.2.102:0/1393406226 shutdown_connections 2021-02-12T17:16:27.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.229+0000 7ff7a03a0700 1 --2- 172.21.2.102:0/1393406226 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff79809ada0 0x7ff798151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.229+0000 7ff7a03a0700 1 --2- 172.21.2.102:0/1393406226 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7980b0940 0x7ff79814e060 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.229+0000 7ff7a03a0700 1 -- 172.21.2.102:0/1393406226 >> 172.21.2.102:0/1393406226 conn(0x7ff798061830 msgr2=0x7ff7980bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:27.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.229+0000 7ff7a03a0700 1 -- 172.21.2.102:0/1393406226 shutdown_connections 2021-02-12T17:16:27.233 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.229+0000 7ff7a03a0700 1 -- 172.21.2.102:0/1393406226 wait complete. 2021-02-12T17:16:27.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.229+0000 7ff7a03a0700 1 Processor -- start 2021-02-12T17:16:27.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.229+0000 7ff7a03a0700 1 -- start start 2021-02-12T17:16:27.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff7a03a0700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff79809ada0 0x7ff798153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff7a03a0700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff7980b0940 0x7ff79815d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff7a03a0700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7980bc2b0 0x7ff79815db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff7a03a0700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980a1260 con 0x7ff79809ada0 2021-02-12T17:16:27.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff7a03a0700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff798152be0 con 0x7ff7980bc2b0 2021-02-12T17:16:27.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff7a03a0700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff798061df0 con 0x7ff7980b0940 2021-02-12T17:16:27.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff79e13c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff79809ada0 0x7ff798153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff79e13c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff79809ada0 0x7ff798153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45272/0 (socket says 172.21.2.102:45272) 2021-02-12T17:16:27.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff79e13c700 1 -- 172.21.2.102:0/3794218727 learned_addr learned my addr 172.21.2.102:0/3794218727 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:27.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff79e93d700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7980bc2b0 0x7ff79815db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff79e13c700 1 -- 172.21.2.102:0/3794218727 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff7980b0940 msgr2=0x7ff79815d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff79d93b700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff7980b0940 0x7ff79815d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff79e13c700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff7980b0940 0x7ff79815d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff79e13c700 1 -- 172.21.2.102:0/3794218727 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7980bc2b0 msgr2=0x7ff79815db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.230+0000 7ff79e13c700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7980bc2b0 0x7ff79815db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.231+0000 7ff79e13c700 1 -- 172.21.2.102:0/3794218727 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff798063e40 con 0x7ff79809ada0 2021-02-12T17:16:27.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.231+0000 7ff79e93d700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7980bc2b0 0x7ff79815db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:27.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.231+0000 7ff79e13c700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff79809ada0 0x7ff798153600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7ff78c00c710 tx=0x7ff78c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:27.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.231+0000 7ff78a7fc700 1 -- 172.21.2.102:0/3794218727 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c0072e0 con 0x7ff79809ada0 2021-02-12T17:16:27.238 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.231+0000 7ff78a7fc700 1 -- 172.21.2.102:0/3794218727 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c007440 con 0x7ff79809ada0 2021-02-12T17:16:27.238 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.231+0000 7ff7a03a0700 1 -- 172.21.2.102:0/3794218727 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7980a1450 con 0x7ff79809ada0 2021-02-12T17:16:27.238 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.231+0000 7ff7a03a0700 1 -- 172.21.2.102:0/3794218727 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79815e080 con 0x7ff79809ada0 2021-02-12T17:16:27.238 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.231+0000 7ff78a7fc700 1 -- 172.21.2.102:0/3794218727 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c0057f0 con 0x7ff79809ada0 2021-02-12T17:16:27.238 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.231+0000 7ff7a03a0700 1 -- 172.21.2.102:0/3794218727 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff798045460 con 0x7ff79809ada0 2021-02-12T17:16:27.238 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.232+0000 7ff78a7fc700 1 -- 172.21.2.102:0/3794218727 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7ff78c010070 con 0x7ff79809ada0 2021-02-12T17:16:27.238 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.232+0000 7ff78a7fc700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff778059d80 0x7ff77805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.238 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.232+0000 7ff78a7fc700 1 -- 172.21.2.102:0/3794218727 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7ff78c073280 con 0x7ff79809ada0 2021-02-12T17:16:27.238 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.232+0000 7ff79d93b700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff778059d80 0x7ff77805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.238 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.232+0000 7ff79d93b700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff778059d80 0x7ff77805c240 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff7980b0d40 tx=0x7ff794016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:27.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.235+0000 7ff78a7fc700 1 -- 172.21.2.102:0/3794218727 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7ff78c046b30 con 0x7ff79809ada0 2021-02-12T17:16:27.366 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.365+0000 7ff7a03a0700 1 -- 172.21.2.102:0/3794218727 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff7980008d0 con 0x7ff79809ada0 2021-02-12T17:16:27.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.366+0000 7ff78a7fc700 1 -- 172.21.2.102:0/3794218727 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v27) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff78c04a150 con 0x7ff79809ada0 2021-02-12T17:16:27.367 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 1 2021-02-12T17:16:27.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.367+0000 7ff7a03a0700 1 -- 172.21.2.102:0/3794218727 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff778059d80 msgr2=0x7ff77805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.367+0000 7ff7a03a0700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff778059d80 0x7ff77805c240 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff7980b0d40 tx=0x7ff794016000).stop 2021-02-12T17:16:27.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.367+0000 7ff7a03a0700 1 -- 172.21.2.102:0/3794218727 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff79809ada0 msgr2=0x7ff798153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.367+0000 7ff7a03a0700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff79809ada0 0x7ff798153600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7ff78c00c710 tx=0x7ff78c007c90).stop 2021-02-12T17:16:27.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.367+0000 7ff7a03a0700 1 -- 172.21.2.102:0/3794218727 shutdown_connections 2021-02-12T17:16:27.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.367+0000 7ff7a03a0700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7980bc2b0 0x7ff79815db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.367+0000 7ff7a03a0700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff778059d80 0x7ff77805c240 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.367+0000 7ff7a03a0700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff79809ada0 0x7ff798153600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.367+0000 7ff7a03a0700 1 --2- 172.21.2.102:0/3794218727 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff7980b0940 0x7ff79815d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.367+0000 7ff7a03a0700 1 -- 172.21.2.102:0/3794218727 >> 172.21.2.102:0/3794218727 conn(0x7ff798061830 msgr2=0x7ff7980b8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:27.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.367+0000 7ff7a03a0700 1 -- 172.21.2.102:0/3794218727 shutdown_connections 2021-02-12T17:16:27.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.367+0000 7ff7a03a0700 1 -- 172.21.2.102:0/3794218727 wait complete. 2021-02-12T17:16:27.377 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-02-12T17:16:27.466 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.464+0000 7fb04bc5b700 1 Processor -- start 2021-02-12T17:16:27.466 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.465+0000 7fb04bc5b700 1 -- start start 2021-02-12T17:16:27.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.465+0000 7fb04bc5b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb0440bc2b0 0x7fb044151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.465+0000 7fb04bc5b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb044151d20 0x7fb04414e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.465+0000 7fb04bc5b700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb044066b70 con 0x7fb0440b0940 2021-02-12T17:16:27.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.465+0000 7fb04bc5b700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0440b27d0 con 0x7fb044151d20 2021-02-12T17:16:27.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.465+0000 7fb04bc5b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04414e550 con 0x7fb0440bc2b0 2021-02-12T17:16:27.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.465+0000 7fb04a1f8700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb044151d20 0x7fb04414e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.465+0000 7fb04a1f8700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb044151d20 0x7fb04414e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45282/0 (socket says 172.21.2.102:45282) 2021-02-12T17:16:27.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.465+0000 7fb04a1f8700 1 -- 172.21.2.102:0/651126508 learned_addr learned my addr 172.21.2.102:0/651126508 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:27.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.466+0000 7fb0499f7700 1 --2- 172.21.2.102:0/651126508 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb0440bc2b0 0x7fb044151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.466+0000 7fb04a1f8700 1 -- 172.21.2.102:0/651126508 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb0440bc2b0 msgr2=0x7fb044151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:27.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.466+0000 7fb04a1f8700 1 --2- 172.21.2.102:0/651126508 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb0440bc2b0 0x7fb044151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.466+0000 7fb04a1f8700 1 -- 172.21.2.102:0/651126508 >> v1:172.21.2.104:6789/0 conn(0x7fb0440b0940 legacy=0x7fb044151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:27.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.466+0000 7fb04a1f8700 1 -- 172.21.2.102:0/651126508 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0440685b0 con 0x7fb044151d20 2021-02-12T17:16:27.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.466+0000 7fb04a1f8700 1 --2- 172.21.2.102:0/651126508 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb044151d20 0x7fb04414e060 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fb03c009d50 tx=0x7fb03c009290).ready entity=mon.0 client_cookie=722d6e7640aa4f1e server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:27.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.466+0000 7fb0489f5700 1 -- 172.21.2.102:0/651126508 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00bc40 con 0x7fb044151d20 2021-02-12T17:16:27.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.466+0000 7fb0489f5700 1 -- 172.21.2.102:0/651126508 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c00bda0 con 0x7fb044151d20 2021-02-12T17:16:27.469 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.466+0000 7fb0489f5700 1 -- 172.21.2.102:0/651126508 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c011610 con 0x7fb044151d20 2021-02-12T17:16:27.470 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.466+0000 7fb04bc5b700 1 -- 172.21.2.102:0/651126508 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb044151d20 msgr2=0x7fb04414e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.470 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.466+0000 7fb04bc5b700 1 --2- 172.21.2.102:0/651126508 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb044151d20 0x7fb04414e060 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fb03c009d50 tx=0x7fb03c009290).stop 2021-02-12T17:16:27.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.467+0000 7fb04bc5b700 1 -- 172.21.2.102:0/651126508 shutdown_connections 2021-02-12T17:16:27.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.467+0000 7fb04bc5b700 1 --2- 172.21.2.102:0/651126508 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb044151d20 0x7fb04414e060 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.467+0000 7fb04bc5b700 1 --2- 172.21.2.102:0/651126508 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb0440bc2b0 0x7fb044151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.467+0000 7fb04bc5b700 1 -- 172.21.2.102:0/651126508 >> 172.21.2.102:0/651126508 conn(0x7fb044061830 msgr2=0x7fb0440bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:27.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.467+0000 7fb04bc5b700 1 -- 172.21.2.102:0/651126508 shutdown_connections 2021-02-12T17:16:27.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.467+0000 7fb04bc5b700 1 -- 172.21.2.102:0/651126508 wait complete. 2021-02-12T17:16:27.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.467+0000 7fb04bc5b700 1 Processor -- start 2021-02-12T17:16:27.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.468+0000 7fb04bc5b700 1 -- start start 2021-02-12T17:16:27.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.468+0000 7fb04bc5b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb0440b0940 0x7fb04414c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.468+0000 7fb04bc5b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb0440bc2b0 0x7fb044160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.468+0000 7fb04bc5b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb044151d20 0x7fb044161380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.468+0000 7fb04bc5b700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440b5980 con 0x7fb044151d20 2021-02-12T17:16:27.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.468+0000 7fb04bc5b700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440b51a0 con 0x7fb0440b0940 2021-02-12T17:16:27.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.468+0000 7fb04bc5b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440b5440 con 0x7fb0440bc2b0 2021-02-12T17:16:27.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.468+0000 7fb04a1f8700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb044151d20 0x7fb044161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.468+0000 7fb04a1f8700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb044151d20 0x7fb044161380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45290/0 (socket says 172.21.2.102:45290) 2021-02-12T17:16:27.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.468+0000 7fb04a1f8700 1 -- 172.21.2.102:0/2911679109 learned_addr learned my addr 172.21.2.102:0/2911679109 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:27.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.469+0000 7fb04a1f8700 1 -- 172.21.2.102:0/2911679109 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb0440bc2b0 msgr2=0x7fb044160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.469+0000 7fb04a1f8700 1 --2- 172.21.2.102:0/2911679109 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb0440bc2b0 0x7fb044160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:27.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.469+0000 7fb04a1f8700 1 -- 172.21.2.102:0/2911679109 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb0440b0940 msgr2=0x7fb04414c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.469+0000 7fb04a1f8700 1 --2- 172.21.2.102:0/2911679109 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb0440b0940 0x7fb04414c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:27.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.469+0000 7fb04a1f8700 1 -- 172.21.2.102:0/2911679109 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0440b56e0 con 0x7fb044151d20 2021-02-12T17:16:27.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.469+0000 7fb04a1f8700 1 --2- 172.21.2.102:0/2911679109 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb044151d20 0x7fb044161380 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fb04405d280 tx=0x7fb03c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:27.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.469+0000 7fb035ffb700 1 -- 172.21.2.102:0/2911679109 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c011e20 con 0x7fb044151d20 2021-02-12T17:16:27.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.469+0000 7fb035ffb700 1 -- 172.21.2.102:0/2911679109 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c010bc0 con 0x7fb044151d20 2021-02-12T17:16:27.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.469+0000 7fb04bc5b700 1 -- 172.21.2.102:0/2911679109 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0441609f0 con 0x7fb044151d20 2021-02-12T17:16:27.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.469+0000 7fb035ffb700 1 -- 172.21.2.102:0/2911679109 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c01b410 con 0x7fb044151d20 2021-02-12T17:16:27.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.469+0000 7fb04bc5b700 1 -- 172.21.2.102:0/2911679109 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0440bc720 con 0x7fb044151d20 2021-02-12T17:16:27.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.470+0000 7fb04bc5b700 1 -- 172.21.2.102:0/2911679109 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb044160b80 con 0x7fb044151d20 2021-02-12T17:16:27.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.470+0000 7fb035ffb700 1 -- 172.21.2.102:0/2911679109 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fb03c023030 con 0x7fb044151d20 2021-02-12T17:16:27.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.470+0000 7fb035ffb700 1 --2- 172.21.2.102:0/2911679109 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb024059d80 0x7fb02405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.470+0000 7fb035ffb700 1 -- 172.21.2.102:0/2911679109 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fb03c075420 con 0x7fb044151d20 2021-02-12T17:16:27.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.471+0000 7fb0499f7700 1 --2- 172.21.2.102:0/2911679109 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb024059d80 0x7fb02405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.471+0000 7fb0499f7700 1 --2- 172.21.2.102:0/2911679109 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb024059d80 0x7fb02405c240 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb03800b740 tx=0x7fb038008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:27.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.473+0000 7fb035ffb700 1 -- 172.21.2.102:0/2911679109 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fb03c048bc0 con 0x7fb044151d20 2021-02-12T17:16:27.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.602+0000 7fb04bc5b700 1 -- 172.21.2.102:0/2911679109 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb044045460 con 0x7fb044151d20 2021-02-12T17:16:27.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.603+0000 7fb035ffb700 1 -- 172.21.2.102:0/2911679109 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb03c006cf0 con 0x7fb044151d20 2021-02-12T17:16:27.604 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:27.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.604+0000 7fb04bc5b700 1 -- 172.21.2.102:0/2911679109 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb024059d80 msgr2=0x7fb02405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.604+0000 7fb04bc5b700 1 --2- 172.21.2.102:0/2911679109 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb024059d80 0x7fb02405c240 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb03800b740 tx=0x7fb038008040).stop 2021-02-12T17:16:27.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.604+0000 7fb04bc5b700 1 -- 172.21.2.102:0/2911679109 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb044151d20 msgr2=0x7fb044161380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.604+0000 7fb04bc5b700 1 --2- 172.21.2.102:0/2911679109 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb044151d20 0x7fb044161380 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fb04405d280 tx=0x7fb03c017000).stop 2021-02-12T17:16:27.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.604+0000 7fb04bc5b700 1 -- 172.21.2.102:0/2911679109 shutdown_connections 2021-02-12T17:16:27.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.604+0000 7fb04bc5b700 1 --2- 172.21.2.102:0/2911679109 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb024059d80 0x7fb02405c240 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.604+0000 7fb04bc5b700 1 --2- 172.21.2.102:0/2911679109 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb044151d20 0x7fb044161380 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.604+0000 7fb04bc5b700 1 --2- 172.21.2.102:0/2911679109 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb0440b0940 0x7fb04414c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:27.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.604+0000 7fb04bc5b700 1 --2- 172.21.2.102:0/2911679109 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb0440bc2b0 0x7fb044160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:27.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.604+0000 7fb04bc5b700 1 -- 172.21.2.102:0/2911679109 >> 172.21.2.102:0/2911679109 conn(0x7fb044061830 msgr2=0x7fb0440b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:27.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.604+0000 7fb04bc5b700 1 -- 172.21.2.102:0/2911679109 shutdown_connections 2021-02-12T17:16:27.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.604+0000 7fb04bc5b700 1 -- 172.21.2.102:0/2911679109 wait complete. 2021-02-12T17:16:27.614 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2021-02-12T17:16:27.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.702+0000 7f57103da700 1 Processor -- start 2021-02-12T17:16:27.704 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.702+0000 7f57103da700 1 -- start start 2021-02-12T17:16:27.704 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.703+0000 7f57103da700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f57080b0940 0x7f570814e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.704 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.703+0000 7f57103da700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5708066b70 con 0x7f570809ada0 2021-02-12T17:16:27.704 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.703+0000 7f57103da700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57080685b0 con 0x7f57080bc2b0 2021-02-12T17:16:27.704 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.703+0000 7f57103da700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57080b27d0 con 0x7f57080b0940 2021-02-12T17:16:27.704 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.703+0000 7f570e977700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f570809ada0 0x7f5708151830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53942/0 (socket says 172.21.2.102:53942) 2021-02-12T17:16:27.705 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.703+0000 7f570e977700 1 -- 172.21.2.102:0/1320818236 learned_addr learned my addr 172.21.2.102:0/1320818236 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:27.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.703+0000 7f570d174700 1 -- 172.21.2.102:0/1320818236 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591537069 0 0) 0x7f5708066b70 con 0x7f570809ada0 2021-02-12T17:16:27.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.703+0000 7f570d174700 1 -- 172.21.2.102:0/1320818236 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56f0003230 con 0x7f570809ada0 2021-02-12T17:16:27.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 -- 172.21.2.102:0/1320818236 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1609329339 0 0) 0x7f56f0003230 con 0x7f570809ada0 2021-02-12T17:16:27.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 -- 172.21.2.102:0/1320818236 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f57080b0940 msgr2=0x7f570814e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:27.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 --2- 172.21.2.102:0/1320818236 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f57080b0940 0x7f570814e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:27.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 -- 172.21.2.102:0/1320818236 >> v1:172.21.2.104:6789/0 conn(0x7f57080bc2b0 legacy=0x7f5708151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:27.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 -- 172.21.2.102:0/1320818236 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570814e550 con 0x7f570809ada0 2021-02-12T17:16:27.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 -- 172.21.2.102:0/1320818236 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f5700001860 con 0x7f570809ada0 2021-02-12T17:16:27.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 -- 172.21.2.102:0/1320818236 >> v1:172.21.2.102:6789/0 conn(0x7f570809ada0 legacy=0x7f5708151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 --2- 172.21.2.102:0/1320818236 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f57080b0940 0x7f56f00037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 --2- 172.21.2.102:0/1320818236 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f56f0003cc0 0x7f56f00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 --2- 172.21.2.102:0/1320818236 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f56f00049c0 0x7f56f0004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 -- 172.21.2.102:0/1320818236 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57080b27d0 con 0x7f56f00049c0 2021-02-12T17:16:27.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 -- 172.21.2.102:0/1320818236 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f0004250 con 0x7f56f0003cc0 2021-02-12T17:16:27.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 -- 172.21.2.102:0/1320818236 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f000b720 con 0x7f57080b0940 2021-02-12T17:16:27.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570e977700 1 --2- 172.21.2.102:0/1320818236 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f56f00049c0 0x7f56f0004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570e977700 1 -- 172.21.2.102:0/1320818236 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f57080b0940 msgr2=0x7f56f00037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:27.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570e977700 1 --2- 172.21.2.102:0/1320818236 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f57080b0940 0x7f56f00037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:27.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570e977700 1 -- 172.21.2.102:0/1320818236 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f56f0003cc0 msgr2=0x7f56f00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:27.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570e977700 1 --2- 172.21.2.102:0/1320818236 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f56f0003cc0 0x7f56f00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:27.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570e977700 1 -- 172.21.2.102:0/1320818236 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f0003230 con 0x7f56f00049c0 2021-02-12T17:16:27.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570e977700 1 --2- 172.21.2.102:0/1320818236 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f56f00049c0 0x7f56f0004e40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f570000c5d0 tx=0x7f5700007ac0).ready entity=mon.0 client_cookie=37e8c90248271edf server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:27.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 -- 172.21.2.102:0/1320818236 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5700005b70 con 0x7f56f00049c0 2021-02-12T17:16:27.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 -- 172.21.2.102:0/1320818236 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5700005cd0 con 0x7f56f00049c0 2021-02-12T17:16:27.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.704+0000 7f570d174700 1 -- 172.21.2.102:0/1320818236 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57000072e0 con 0x7f56f00049c0 2021-02-12T17:16:27.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.705+0000 7f57103da700 1 -- 172.21.2.102:0/1320818236 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f56f00049c0 msgr2=0x7f56f0004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.705+0000 7f57103da700 1 --2- 172.21.2.102:0/1320818236 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f56f00049c0 0x7f56f0004e40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f570000c5d0 tx=0x7f5700007ac0).stop 2021-02-12T17:16:27.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.705+0000 7f570e977700 1 -- 172.21.2.102:0/1320818236 reap_dead start 2021-02-12T17:16:27.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.705+0000 7f57103da700 1 -- 172.21.2.102:0/1320818236 shutdown_connections 2021-02-12T17:16:27.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.705+0000 7f57103da700 1 -- 172.21.2.102:0/1320818236 >> 172.21.2.102:0/1320818236 conn(0x7f5708061830 msgr2=0x7f57080bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:27.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.705+0000 7f57103da700 1 -- 172.21.2.102:0/1320818236 shutdown_connections 2021-02-12T17:16:27.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.705+0000 7f57103da700 1 -- 172.21.2.102:0/1320818236 wait complete. 2021-02-12T17:16:27.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.706+0000 7f57103da700 1 Processor -- start 2021-02-12T17:16:27.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.706+0000 7f57103da700 1 -- start start 2021-02-12T17:16:27.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.706+0000 7f57103da700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f56f00049c0 0x7f5708063a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.706+0000 7f57103da700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f57080b58b0 0x7f570814a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.706+0000 7f57103da700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f570815dea0 0x7f570814a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.706+0000 7f57103da700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570815e420 con 0x7f57080b58b0 2021-02-12T17:16:27.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.706+0000 7f57103da700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57080ba4c0 con 0x7f56f00049c0 2021-02-12T17:16:27.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.706+0000 7f57103da700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57080ba760 con 0x7f570815dea0 2021-02-12T17:16:27.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.706+0000 7f570d975700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f57080b58b0 0x7f570814a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.706+0000 7f570d975700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f57080b58b0 0x7f570814a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45308/0 (socket says 172.21.2.102:45308) 2021-02-12T17:16:27.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.706+0000 7f570d975700 1 -- 172.21.2.102:0/564025404 learned_addr learned my addr 172.21.2.102:0/564025404 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:27.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.707+0000 7f570e176700 1 --2- 172.21.2.102:0/564025404 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f56f00049c0 0x7f5708063a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.707+0000 7f570d975700 1 -- 172.21.2.102:0/564025404 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f570815dea0 msgr2=0x7f570814a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.707+0000 7f570d975700 1 --2- 172.21.2.102:0/564025404 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f570815dea0 0x7f570814a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:27.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.707+0000 7f570d975700 1 -- 172.21.2.102:0/564025404 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f56f00049c0 msgr2=0x7f5708063a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.707+0000 7f570d975700 1 --2- 172.21.2.102:0/564025404 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f56f00049c0 0x7f5708063a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.707+0000 7f570d975700 1 -- 172.21.2.102:0/564025404 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57080baa00 con 0x7f57080b58b0 2021-02-12T17:16:27.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.707+0000 7f570d975700 1 --2- 172.21.2.102:0/564025404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f57080b58b0 0x7f570814a2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f56f80096b0 tx=0x7f56f8006e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:27.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.707+0000 7f56f67fc700 1 -- 172.21.2.102:0/564025404 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f800d500 con 0x7f57080b58b0 2021-02-12T17:16:27.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.707+0000 7f56f67fc700 1 -- 172.21.2.102:0/564025404 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f8000e90 con 0x7f57080b58b0 2021-02-12T17:16:27.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.707+0000 7f56f67fc700 1 -- 172.21.2.102:0/564025404 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f800d8d0 con 0x7f57080b58b0 2021-02-12T17:16:27.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.707+0000 7f57103da700 1 -- 172.21.2.102:0/564025404 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5708063f20 con 0x7f57080b58b0 2021-02-12T17:16:27.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.707+0000 7f57103da700 1 -- 172.21.2.102:0/564025404 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5708063310 con 0x7f57080b58b0 2021-02-12T17:16:27.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.708+0000 7f57103da700 1 -- 172.21.2.102:0/564025404 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f570814e910 con 0x7f57080b58b0 2021-02-12T17:16:27.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.708+0000 7f56f67fc700 1 -- 172.21.2.102:0/564025404 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f56f800dc40 con 0x7f57080b58b0 2021-02-12T17:16:27.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.708+0000 7f56f67fc700 1 --2- 172.21.2.102:0/564025404 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f56e8059d30 0x7f56e805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.708+0000 7f56f67fc700 1 -- 172.21.2.102:0/564025404 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f56f8073c30 con 0x7f57080b58b0 2021-02-12T17:16:27.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.708+0000 7f570e176700 1 --2- 172.21.2.102:0/564025404 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f56e8059d30 0x7f56e805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.708+0000 7f570e176700 1 --2- 172.21.2.102:0/564025404 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f56e8059d30 0x7f56e805c1f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f570400b6c0 tx=0x7f5704008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:27.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.711+0000 7f56f67fc700 1 -- 172.21.2.102:0/564025404 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f56f8047350 con 0x7f57080b58b0 2021-02-12T17:16:27.843 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.841+0000 7f57103da700 1 -- 172.21.2.102:0/564025404 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5708045460 con 0x7f57080b58b0 2021-02-12T17:16:27.843 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.841+0000 7f56f67fc700 1 -- 172.21.2.102:0/564025404 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+10 (secure 0 0 0) 0x7f56f804a970 con 0x7f57080b58b0 2021-02-12T17:16:27.843 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:27.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.842+0000 7f57103da700 1 -- 172.21.2.102:0/564025404 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f56e8059d30 msgr2=0x7f56e805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.842+0000 7f57103da700 1 --2- 172.21.2.102:0/564025404 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f56e8059d30 0x7f56e805c1f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f570400b6c0 tx=0x7f5704008040).stop 2021-02-12T17:16:27.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.842+0000 7f57103da700 1 -- 172.21.2.102:0/564025404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f57080b58b0 msgr2=0x7f570814a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.842+0000 7f57103da700 1 --2- 172.21.2.102:0/564025404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f57080b58b0 0x7f570814a2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f56f80096b0 tx=0x7f56f8006e30).stop 2021-02-12T17:16:27.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.843+0000 7f57103da700 1 -- 172.21.2.102:0/564025404 shutdown_connections 2021-02-12T17:16:27.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.843+0000 7f57103da700 1 --2- 172.21.2.102:0/564025404 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f570815dea0 0x7f570814a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:27.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.843+0000 7f57103da700 1 --2- 172.21.2.102:0/564025404 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f56f00049c0 0x7f5708063a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.843+0000 7f57103da700 1 --2- 172.21.2.102:0/564025404 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f56e8059d30 0x7f56e805c1f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.843+0000 7f57103da700 1 --2- 172.21.2.102:0/564025404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f57080b58b0 0x7f570814a2f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.843+0000 7f57103da700 1 -- 172.21.2.102:0/564025404 >> 172.21.2.102:0/564025404 conn(0x7f5708061830 msgr2=0x7f570814edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:27.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.843+0000 7f57103da700 1 -- 172.21.2.102:0/564025404 shutdown_connections 2021-02-12T17:16:27.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.843+0000 7f57103da700 1 -- 172.21.2.102:0/564025404 wait complete. 2021-02-12T17:16:27.853 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2021-02-12T17:16:27.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.941+0000 7f2f7dc23700 1 Processor -- start 2021-02-12T17:16:27.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.941+0000 7f2f7dc23700 1 -- start start 2021-02-12T17:16:27.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.941+0000 7f2f7dc23700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f2f780bc2b0 0x7f2f78151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.941+0000 7f2f7dc23700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f780b0940 0x7f2f78151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.941+0000 7f2f7dc23700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f78066b70 con 0x7f2f7809ada0 2021-02-12T17:16:27.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.941+0000 7f2f7dc23700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f780b27d0 con 0x7f2f780bc2b0 2021-02-12T17:16:27.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.941+0000 7f2f7dc23700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f780b7110 con 0x7f2f780b0940 2021-02-12T17:16:27.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.942+0000 7f2f77fff700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f2f7809ada0 0x7f2f7814d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:36328/0 (socket says 172.21.2.102:36328) 2021-02-12T17:16:27.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.942+0000 7f2f77fff700 1 -- 172.21.2.102:0/2680231161 learned_addr learned my addr 172.21.2.102:0/2680231161 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:27.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.942+0000 7f2f777fe700 1 --2- 172.21.2.102:0/2680231161 >> v2:172.21.2.102:3300/0 conn(0x7f2f780bc2b0 0x7f2f78151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.942+0000 7f2f76ffd700 1 --2- 172.21.2.102:0/2680231161 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f780b0940 0x7f2f78151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.942+0000 7f2f777fe700 1 -- 172.21.2.102:0/2680231161 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f780b0940 msgr2=0x7f2f78151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:27.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.942+0000 7f2f777fe700 1 --2- 172.21.2.102:0/2680231161 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f780b0940 0x7f2f78151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.942+0000 7f2f777fe700 1 -- 172.21.2.102:0/2680231161 >> v1:172.21.2.104:6789/0 conn(0x7f2f7809ada0 legacy=0x7f2f7814d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.942+0000 7f2f777fe700 1 -- 172.21.2.102:0/2680231161 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f780685b0 con 0x7f2f780bc2b0 2021-02-12T17:16:27.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.942+0000 7f2f777fe700 1 --2- 172.21.2.102:0/2680231161 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f780bc2b0 0x7f2f78151120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f2f6800b980 tx=0x7f2f68006de0).ready entity=mon.0 client_cookie=b5500ba0df1986b6 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:27.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.942+0000 7f2f767fc700 1 -- 172.21.2.102:0/2680231161 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68009870 con 0x7f2f780bc2b0 2021-02-12T17:16:27.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.942+0000 7f2f767fc700 1 -- 172.21.2.102:0/2680231161 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f680099d0 con 0x7f2f780bc2b0 2021-02-12T17:16:27.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.942+0000 7f2f767fc700 1 -- 172.21.2.102:0/2680231161 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68009d50 con 0x7f2f780bc2b0 2021-02-12T17:16:27.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.943+0000 7f2f7dc23700 1 -- 172.21.2.102:0/2680231161 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f780bc2b0 msgr2=0x7f2f78151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.943+0000 7f2f7dc23700 1 --2- 172.21.2.102:0/2680231161 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f780bc2b0 0x7f2f78151120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f2f6800b980 tx=0x7f2f68006de0).stop 2021-02-12T17:16:27.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.943+0000 7f2f7dc23700 1 -- 172.21.2.102:0/2680231161 shutdown_connections 2021-02-12T17:16:27.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.943+0000 7f2f7dc23700 1 --2- 172.21.2.102:0/2680231161 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f780bc2b0 0x7f2f78151120 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.943+0000 7f2f7dc23700 1 --2- 172.21.2.102:0/2680231161 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f780b0940 0x7f2f78151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.943+0000 7f2f7dc23700 1 -- 172.21.2.102:0/2680231161 >> 172.21.2.102:0/2680231161 conn(0x7f2f78061830 msgr2=0x7f2f780bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:27.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.943+0000 7f2f7dc23700 1 -- 172.21.2.102:0/2680231161 shutdown_connections 2021-02-12T17:16:27.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.943+0000 7f2f7dc23700 1 -- 172.21.2.102:0/2680231161 wait complete. 2021-02-12T17:16:27.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.944+0000 7f2f7dc23700 1 Processor -- start 2021-02-12T17:16:27.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.944+0000 7f2f7dc23700 1 -- start start 2021-02-12T17:16:27.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.944+0000 7f2f7dc23700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f7809ada0 0x7f2f780b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.944+0000 7f2f7dc23700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f780b0940 0x7f2f78161320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.944+0000 7f2f7dc23700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f780bc2b0 0x7f2f7814a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.944+0000 7f2f7dc23700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f780b4920 con 0x7f2f780b0940 2021-02-12T17:16:27.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.944+0000 7f2f7dc23700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f78161810 con 0x7f2f7809ada0 2021-02-12T17:16:27.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.944+0000 7f2f7dc23700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7809ea80 con 0x7f2f780bc2b0 2021-02-12T17:16:27.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f76ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f780b0940 0x7f2f78161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f76ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f780b0940 0x7f2f78161320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45324/0 (socket says 172.21.2.102:45324) 2021-02-12T17:16:27.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f76ffd700 1 -- 172.21.2.102:0/877289504 learned_addr learned my addr 172.21.2.102:0/877289504 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:27.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f777fe700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f7809ada0 0x7f2f780b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f77fff700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f780bc2b0 0x7f2f7814a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f76ffd700 1 -- 172.21.2.102:0/877289504 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f780bc2b0 msgr2=0x7f2f7814a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f76ffd700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f780bc2b0 0x7f2f7814a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f76ffd700 1 -- 172.21.2.102:0/877289504 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f7809ada0 msgr2=0x7f2f780b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:27.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f76ffd700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f7809ada0 0x7f2f780b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:27.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f76ffd700 1 -- 172.21.2.102:0/877289504 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7809ed20 con 0x7f2f780b0940 2021-02-12T17:16:27.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f77fff700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f780bc2b0 0x7f2f7814a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:27.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f76ffd700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f780b0940 0x7f2f78161320 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f2f6000db60 tx=0x7f2f60008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:27.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f6f7fe700 1 -- 172.21.2.102:0/877289504 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60009760 con 0x7f2f780b0940 2021-02-12T17:16:27.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f6f7fe700 1 -- 172.21.2.102:0/877289504 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f600098c0 con 0x7f2f780b0940 2021-02-12T17:16:27.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f7dc23700 1 -- 172.21.2.102:0/877289504 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7809efc0 con 0x7f2f780b0940 2021-02-12T17:16:27.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f6f7fe700 1 -- 172.21.2.102:0/877289504 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60009c40 con 0x7f2f780b0940 2021-02-12T17:16:27.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.945+0000 7f2f7dc23700 1 -- 172.21.2.102:0/877289504 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f780b2d30 con 0x7f2f780b0940 2021-02-12T17:16:27.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.946+0000 7f2f7dc23700 1 -- 172.21.2.102:0/877289504 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f78045460 con 0x7f2f780b0940 2021-02-12T17:16:27.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.946+0000 7f2f6f7fe700 1 -- 172.21.2.102:0/877289504 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f2f60013480 con 0x7f2f780b0940 2021-02-12T17:16:27.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.946+0000 7f2f6f7fe700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2f5c059d30 0x7f2f5c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:27.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.947+0000 7f2f6f7fe700 1 -- 172.21.2.102:0/877289504 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f2f60073f50 con 0x7f2f780b0940 2021-02-12T17:16:27.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.947+0000 7f2f777fe700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2f5c059d30 0x7f2f5c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:27.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.947+0000 7f2f777fe700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2f5c059d30 0x7f2f5c05c1f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f2f68006e20 tx=0x7f2f68016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:27.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:27.950+0000 7f2f6f7fe700 1 -- 172.21.2.102:0/877289504 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f2f60047720 con 0x7f2f780b0940 2021-02-12T17:16:28.080 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.078+0000 7f2f7dc23700 1 -- 172.21.2.102:0/877289504 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f2f7809ab80 con 0x7f2f780b0940 2021-02-12T17:16:28.080 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.079+0000 7f2f6f7fe700 1 -- 172.21.2.102:0/877289504 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+10 (secure 0 0 0) 0x7f2f6004ad40 con 0x7f2f780b0940 2021-02-12T17:16:28.080 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:28.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.080+0000 7f2f7dc23700 1 -- 172.21.2.102:0/877289504 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2f5c059d30 msgr2=0x7f2f5c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.080+0000 7f2f7dc23700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2f5c059d30 0x7f2f5c05c1f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f2f68006e20 tx=0x7f2f68016000).stop 2021-02-12T17:16:28.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.080+0000 7f2f7dc23700 1 -- 172.21.2.102:0/877289504 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f780b0940 msgr2=0x7f2f78161320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.080+0000 7f2f7dc23700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f780b0940 0x7f2f78161320 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f2f6000db60 tx=0x7f2f60008040).stop 2021-02-12T17:16:28.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.080+0000 7f2f7dc23700 1 -- 172.21.2.102:0/877289504 shutdown_connections 2021-02-12T17:16:28.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.080+0000 7f2f7dc23700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f780bc2b0 0x7f2f7814a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.080+0000 7f2f7dc23700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f7809ada0 0x7f2f780b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.080+0000 7f2f7dc23700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2f5c059d30 0x7f2f5c05c1f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.080+0000 7f2f7dc23700 1 --2- 172.21.2.102:0/877289504 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f780b0940 0x7f2f78161320 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.080+0000 7f2f7dc23700 1 -- 172.21.2.102:0/877289504 >> 172.21.2.102:0/877289504 conn(0x7f2f78061830 msgr2=0x7f2f7814cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:28.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.080+0000 7f2f7dc23700 1 -- 172.21.2.102:0/877289504 shutdown_connections 2021-02-12T17:16:28.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.080+0000 7f2f7dc23700 1 -- 172.21.2.102:0/877289504 wait complete. 2021-02-12T17:16:28.090 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2021-02-12T17:16:28.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.179+0000 7ff48e9cb700 1 Processor -- start 2021-02-12T17:16:28.181 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.179+0000 7ff48e9cb700 1 -- start start 2021-02-12T17:16:28.182 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.179+0000 7ff48e9cb700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7ff4880bc2b0 0x7ff488151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.182 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.179+0000 7ff48e9cb700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff488066b70 con 0x7ff4880b0940 2021-02-12T17:16:28.182 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.180+0000 7ff48e9cb700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4880685b0 con 0x7ff488151d20 2021-02-12T17:16:28.182 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.180+0000 7ff48e9cb700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4880b27d0 con 0x7ff4880bc2b0 2021-02-12T17:16:28.182 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.180+0000 7ff4877fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7ff4880b0940 0x7ff488151610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53976/0 (socket says 172.21.2.102:53976) 2021-02-12T17:16:28.182 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.180+0000 7ff4877fe700 1 -- 172.21.2.102:0/2520873023 learned_addr learned my addr 172.21.2.102:0/2520873023 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:28.182 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.180+0000 7ff487fff700 1 --2- 172.21.2.102:0/2520873023 >> v2:172.21.2.102:3300/0 conn(0x7ff4880bc2b0 0x7ff488151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.180+0000 7ff486ffd700 1 -- 172.21.2.102:0/2520873023 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625571097 0 0) 0x7ff488066b70 con 0x7ff4880b0940 2021-02-12T17:16:28.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.180+0000 7ff486ffd700 1 -- 172.21.2.102:0/2520873023 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff468003230 con 0x7ff4880b0940 2021-02-12T17:16:28.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.180+0000 7ff487fff700 1 -- 172.21.2.102:0/2520873023 >> v1:172.21.2.104:6789/0 conn(0x7ff488151d20 legacy=0x7ff4881584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:28.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.180+0000 7ff487fff700 1 -- 172.21.2.102:0/2520873023 >> v1:172.21.2.102:6789/0 conn(0x7ff4880b0940 legacy=0x7ff488151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.180+0000 7ff487fff700 1 -- 172.21.2.102:0/2520873023 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880b7110 con 0x7ff4880bc2b0 2021-02-12T17:16:28.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.180+0000 7ff487fff700 1 --2- 172.21.2.102:0/2520873023 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4880bc2b0 0x7ff488151120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7ff47000b980 tx=0x7ff470006de0).ready entity=mon.0 client_cookie=4d5fb101d53e868b server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:28.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.181+0000 7ff486ffd700 1 -- 172.21.2.102:0/2520873023 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47000be70 con 0x7ff4880bc2b0 2021-02-12T17:16:28.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.181+0000 7ff486ffd700 1 -- 172.21.2.102:0/2520873023 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff470009830 con 0x7ff4880bc2b0 2021-02-12T17:16:28.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.181+0000 7ff486ffd700 1 -- 172.21.2.102:0/2520873023 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470009bb0 con 0x7ff4880bc2b0 2021-02-12T17:16:28.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.181+0000 7ff48e9cb700 1 -- 172.21.2.102:0/2520873023 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4880bc2b0 msgr2=0x7ff488151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.181+0000 7ff48e9cb700 1 --2- 172.21.2.102:0/2520873023 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4880bc2b0 0x7ff488151120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7ff47000b980 tx=0x7ff470006de0).stop 2021-02-12T17:16:28.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.181+0000 7ff48e9cb700 1 -- 172.21.2.102:0/2520873023 shutdown_connections 2021-02-12T17:16:28.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.181+0000 7ff48e9cb700 1 --2- 172.21.2.102:0/2520873023 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4880bc2b0 0x7ff488151120 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.181+0000 7ff48e9cb700 1 -- 172.21.2.102:0/2520873023 >> 172.21.2.102:0/2520873023 conn(0x7ff488061830 msgr2=0x7ff4880bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:28.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.181+0000 7ff48e9cb700 1 -- 172.21.2.102:0/2520873023 shutdown_connections 2021-02-12T17:16:28.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.181+0000 7ff48e9cb700 1 -- 172.21.2.102:0/2520873023 wait complete. 2021-02-12T17:16:28.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.182+0000 7ff48e9cb700 1 Processor -- start 2021-02-12T17:16:28.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.182+0000 7ff48e9cb700 1 -- start start 2021-02-12T17:16:28.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48e9cb700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff4880b0940 0x7ff488161120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48e9cb700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff4880bc2b0 0x7ff48814d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48e9cb700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff488151d20 0x7ff4880b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48e9cb700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff488161610 con 0x7ff488151d20 2021-02-12T17:16:28.188 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48e9cb700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff488062170 con 0x7ff4880bc2b0 2021-02-12T17:16:28.188 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48e9cb700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff488062410 con 0x7ff4880b0940 2021-02-12T17:16:28.188 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48cf68700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff488151d20 0x7ff4880b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.188 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48cf68700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff488151d20 0x7ff4880b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45336/0 (socket says 172.21.2.102:45336) 2021-02-12T17:16:28.188 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48cf68700 1 -- 172.21.2.102:0/3676148052 learned_addr learned my addr 172.21.2.102:0/3676148052 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:28.188 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff4877fe700 1 --2- 172.21.2.102:0/3676148052 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff4880bc2b0 0x7ff48814d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.188 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48cf68700 1 -- 172.21.2.102:0/3676148052 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff4880b0940 msgr2=0x7ff488161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.188 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48cf68700 1 --2- 172.21.2.102:0/3676148052 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff4880b0940 0x7ff488161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.188 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48cf68700 1 -- 172.21.2.102:0/3676148052 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff4880bc2b0 msgr2=0x7ff48814d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.188 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48cf68700 1 --2- 172.21.2.102:0/3676148052 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff4880bc2b0 0x7ff48814d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.188 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48cf68700 1 -- 172.21.2.102:0/3676148052 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880626b0 con 0x7ff488151d20 2021-02-12T17:16:28.188 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.183+0000 7ff48cf68700 1 --2- 172.21.2.102:0/3676148052 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff488151d20 0x7ff4880b4930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7ff48000bae0 tx=0x7ff4800090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:28.188 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.184+0000 7ff47ffff700 1 -- 172.21.2.102:0/3676148052 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48000c740 con 0x7ff488151d20 2021-02-12T17:16:28.189 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.184+0000 7ff47ffff700 1 -- 172.21.2.102:0/3676148052 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48000c8c0 con 0x7ff488151d20 2021-02-12T17:16:28.189 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.184+0000 7ff47ffff700 1 -- 172.21.2.102:0/3676148052 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48000ca70 con 0x7ff488151d20 2021-02-12T17:16:28.189 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.184+0000 7ff48e9cb700 1 -- 172.21.2.102:0/3676148052 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff488062950 con 0x7ff488151d20 2021-02-12T17:16:28.189 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.184+0000 7ff48e9cb700 1 -- 172.21.2.102:0/3676148052 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48814d7e0 con 0x7ff488151d20 2021-02-12T17:16:28.189 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.184+0000 7ff48e9cb700 1 -- 172.21.2.102:0/3676148052 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff488062db0 con 0x7ff488151d20 2021-02-12T17:16:28.189 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.184+0000 7ff47ffff700 1 -- 172.21.2.102:0/3676148052 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7ff48001c070 con 0x7ff488151d20 2021-02-12T17:16:28.189 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.185+0000 7ff47ffff700 1 --2- 172.21.2.102:0/3676148052 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff46c059d60 0x7ff46c05c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.189 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.185+0000 7ff47ffff700 1 -- 172.21.2.102:0/3676148052 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7ff480073210 con 0x7ff488151d20 2021-02-12T17:16:28.189 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.185+0000 7ff487fff700 1 --2- 172.21.2.102:0/3676148052 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff46c059d60 0x7ff46c05c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.190 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.185+0000 7ff487fff700 1 --2- 172.21.2.102:0/3676148052 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff46c059d60 0x7ff46c05c220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7ff4880b20c0 tx=0x7ff470016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:28.190 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.188+0000 7ff47ffff700 1 -- 172.21.2.102:0/3676148052 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7ff480046a40 con 0x7ff488151d20 2021-02-12T17:16:28.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.317+0000 7ff48e9cb700 1 -- 172.21.2.102:0/3676148052 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff488045460 con 0x7ff488151d20 2021-02-12T17:16:28.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.317+0000 7ff47ffff700 1 -- 172.21.2.102:0/3676148052 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+10 (secure 0 0 0) 0x7ff48004a060 con 0x7ff488151d20 2021-02-12T17:16:28.319 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:28.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.318+0000 7ff48e9cb700 1 -- 172.21.2.102:0/3676148052 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff46c059d60 msgr2=0x7ff46c05c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.318+0000 7ff48e9cb700 1 --2- 172.21.2.102:0/3676148052 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff46c059d60 0x7ff46c05c220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7ff4880b20c0 tx=0x7ff470016000).stop 2021-02-12T17:16:28.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.319+0000 7ff48e9cb700 1 -- 172.21.2.102:0/3676148052 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff488151d20 msgr2=0x7ff4880b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.319+0000 7ff48e9cb700 1 --2- 172.21.2.102:0/3676148052 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff488151d20 0x7ff4880b4930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7ff48000bae0 tx=0x7ff4800090f0).stop 2021-02-12T17:16:28.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.319+0000 7ff48e9cb700 1 -- 172.21.2.102:0/3676148052 shutdown_connections 2021-02-12T17:16:28.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.319+0000 7ff48e9cb700 1 --2- 172.21.2.102:0/3676148052 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff46c059d60 0x7ff46c05c220 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.319+0000 7ff48e9cb700 1 --2- 172.21.2.102:0/3676148052 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff488151d20 0x7ff4880b4930 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.319+0000 7ff48e9cb700 1 --2- 172.21.2.102:0/3676148052 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff4880b0940 0x7ff488161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.319+0000 7ff48e9cb700 1 --2- 172.21.2.102:0/3676148052 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff4880bc2b0 0x7ff48814d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.319+0000 7ff48e9cb700 1 -- 172.21.2.102:0/3676148052 >> 172.21.2.102:0/3676148052 conn(0x7ff488061830 msgr2=0x7ff48814c250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:28.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.319+0000 7ff48e9cb700 1 -- 172.21.2.102:0/3676148052 shutdown_connections 2021-02-12T17:16:28.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.319+0000 7ff48e9cb700 1 -- 172.21.2.102:0/3676148052 wait complete. 2021-02-12T17:16:28.329 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2021-02-12T17:16:28.419 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.418+0000 7f340259f700 1 Processor -- start 2021-02-12T17:16:28.419 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.418+0000 7f340259f700 1 -- start start 2021-02-12T17:16:28.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.418+0000 7f340259f700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f33fc09ada0 0x7f33fc14e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.418+0000 7f340259f700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33fc066b70 con 0x7f33fc0bc2b0 2021-02-12T17:16:28.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.418+0000 7f340259f700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33fc0685b0 con 0x7f33fc0b0940 2021-02-12T17:16:28.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.418+0000 7f340259f700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33fc0b27d0 con 0x7f33fc09ada0 2021-02-12T17:16:28.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.418+0000 7f33fbfff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f33fc0bc2b0 0x7f33fc151120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:53986/0 (socket says 172.21.2.102:53986) 2021-02-12T17:16:28.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.418+0000 7f33fbfff700 1 -- 172.21.2.102:0/4174134519 learned_addr learned my addr 172.21.2.102:0/4174134519 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:28.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f3400b3c700 1 --2- 172.21.2.102:0/4174134519 >> v2:172.21.2.104:3300/0 conn(0x7f33fc09ada0 0x7f33fc14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 -- 172.21.2.102:0/4174134519 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093970096 0 0) 0x7f33fc066b70 con 0x7f33fc0bc2b0 2021-02-12T17:16:28.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 -- 172.21.2.102:0/4174134519 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33dc003230 con 0x7f33fc0bc2b0 2021-02-12T17:16:28.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 -- 172.21.2.102:0/4174134519 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3567829414 0 0) 0x7f33dc003230 con 0x7f33fc0bc2b0 2021-02-12T17:16:28.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 -- 172.21.2.102:0/4174134519 >> v2:172.21.2.104:3300/0 conn(0x7f33fc09ada0 msgr2=0x7f33fc14e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:28.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 --2- 172.21.2.102:0/4174134519 >> v2:172.21.2.104:3300/0 conn(0x7f33fc09ada0 0x7f33fc14e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 -- 172.21.2.102:0/4174134519 >> v1:172.21.2.104:6789/0 conn(0x7f33fc0b0940 legacy=0x7f33fc151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 -- 172.21.2.102:0/4174134519 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc14e550 con 0x7f33fc0bc2b0 2021-02-12T17:16:28.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 -- 172.21.2.102:0/4174134519 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f33e40014e0 con 0x7f33fc0bc2b0 2021-02-12T17:16:28.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 -- 172.21.2.102:0/4174134519 >> v1:172.21.2.102:6789/0 conn(0x7f33fc0bc2b0 legacy=0x7f33fc151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 --2- 172.21.2.102:0/4174134519 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f33dc003770 0x7f33dc003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 --2- 172.21.2.102:0/4174134519 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f33dc0044d0 0x7f33dc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 --2- 172.21.2.102:0/4174134519 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f33dc004e40 0x7f33dc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 -- 172.21.2.102:0/4174134519 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc0b27d0 con 0x7f33dc0044d0 2021-02-12T17:16:28.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 -- 172.21.2.102:0/4174134519 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc0052f0 con 0x7f33dc004e40 2021-02-12T17:16:28.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33faffd700 1 -- 172.21.2.102:0/4174134519 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc00bc10 con 0x7f33dc003770 2021-02-12T17:16:28.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f3400b3c700 1 --2- 172.21.2.102:0/4174134519 >> v2:172.21.2.104:3300/0 conn(0x7f33fc09ada0 0x7f33fc14e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:16:28.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.419+0000 7f33fb7fe700 1 --2- 172.21.2.102:0/4174134519 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f33dc0044d0 0x7f33dc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f3400b3c700 1 --2- 172.21.2.102:0/4174134519 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f33dc004e40 0x7f33dc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f33fbfff700 1 --2- 172.21.2.102:0/4174134519 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f33dc003770 0x7f33dc003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f33fb7fe700 1 -- 172.21.2.102:0/4174134519 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f33dc003770 msgr2=0x7f33dc003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:28.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f33fb7fe700 1 --2- 172.21.2.102:0/4174134519 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f33dc003770 0x7f33dc003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f33fb7fe700 1 -- 172.21.2.102:0/4174134519 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f33dc004e40 msgr2=0x7f33dc00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:28.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f33fb7fe700 1 --2- 172.21.2.102:0/4174134519 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f33dc004e40 0x7f33dc00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f3400b3c700 1 -- 172.21.2.102:0/4174134519 reap_dead start 2021-02-12T17:16:28.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f33fb7fe700 1 -- 172.21.2.102:0/4174134519 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc003230 con 0x7f33dc0044d0 2021-02-12T17:16:28.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f33fbfff700 1 --2- 172.21.2.102:0/4174134519 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f33dc003770 0x7f33dc003b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:28.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f33fb7fe700 1 --2- 172.21.2.102:0/4174134519 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f33dc0044d0 0x7f33dc004950 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f33ec0018f0 tx=0x7f33ec007b80).ready entity=mon.0 client_cookie=4fba5ccc695cd0fe server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:28.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f33faffd700 1 -- 172.21.2.102:0/4174134519 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec007020 con 0x7f33dc0044d0 2021-02-12T17:16:28.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f33faffd700 1 -- 172.21.2.102:0/4174134519 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec007180 con 0x7f33dc0044d0 2021-02-12T17:16:28.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f33faffd700 1 -- 172.21.2.102:0/4174134519 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00c650 con 0x7f33dc0044d0 2021-02-12T17:16:28.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f340259f700 1 -- 172.21.2.102:0/4174134519 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f33dc0044d0 msgr2=0x7f33dc004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f340259f700 1 --2- 172.21.2.102:0/4174134519 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f33dc0044d0 0x7f33dc004950 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f33ec0018f0 tx=0x7f33ec007b80).stop 2021-02-12T17:16:28.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f340259f700 1 -- 172.21.2.102:0/4174134519 shutdown_connections 2021-02-12T17:16:28.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f340259f700 1 --2- 172.21.2.102:0/4174134519 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f33dc0044d0 0x7f33dc004950 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f340259f700 1 -- 172.21.2.102:0/4174134519 >> 172.21.2.102:0/4174134519 conn(0x7f33fc061830 msgr2=0x7f33fc0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:28.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f340259f700 1 -- 172.21.2.102:0/4174134519 shutdown_connections 2021-02-12T17:16:28.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.420+0000 7f340259f700 1 -- 172.21.2.102:0/4174134519 wait complete. 2021-02-12T17:16:28.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.421+0000 7f340259f700 1 Processor -- start 2021-02-12T17:16:28.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.421+0000 7f340259f700 1 -- start start 2021-02-12T17:16:28.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f340259f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f33dc0044d0 0x7f33fc09f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f340259f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f33fc14ed20 0x7f33fc09cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f340259f700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f33fc14f1a0 0x7f33fc09d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f340259f700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc0a0140 con 0x7f33fc14ed20 2021-02-12T17:16:28.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f340259f700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc09fc00 con 0x7f33fc14f1a0 2021-02-12T17:16:28.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f340259f700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc09fea0 con 0x7f33dc0044d0 2021-02-12T17:16:28.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f33fb7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f33fc14ed20 0x7f33fc09cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f33fb7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f33fc14ed20 0x7f33fc09cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45350/0 (socket says 172.21.2.102:45350) 2021-02-12T17:16:28.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f33fb7fe700 1 -- 172.21.2.102:0/101234922 learned_addr learned my addr 172.21.2.102:0/101234922 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:28.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f3400b3c700 1 --2- 172.21.2.102:0/101234922 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f33fc14f1a0 0x7f33fc09d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f33fb7fe700 1 -- 172.21.2.102:0/101234922 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f33dc0044d0 msgr2=0x7f33fc09f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f33fb7fe700 1 --2- 172.21.2.102:0/101234922 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f33dc0044d0 0x7f33fc09f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f33fb7fe700 1 -- 172.21.2.102:0/101234922 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f33fc14f1a0 msgr2=0x7f33fc09d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f33fb7fe700 1 --2- 172.21.2.102:0/101234922 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f33fc14f1a0 0x7f33fc09d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f33fb7fe700 1 -- 172.21.2.102:0/101234922 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc09e040 con 0x7f33fc14ed20 2021-02-12T17:16:28.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f3400b3c700 1 --2- 172.21.2.102:0/101234922 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f33fc14f1a0 0x7f33fc09d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:28.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f33fb7fe700 1 --2- 172.21.2.102:0/101234922 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f33fc14ed20 0x7f33fc09cb40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f33dc0043c0 tx=0x7f33ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:28.429 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f33f3fff700 1 -- 172.21.2.102:0/101234922 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0067f0 con 0x7f33fc14ed20 2021-02-12T17:16:28.429 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f33f3fff700 1 -- 172.21.2.102:0/101234922 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec006970 con 0x7f33fc14ed20 2021-02-12T17:16:28.429 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f340259f700 1 -- 172.21.2.102:0/101234922 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33fc14d4e0 con 0x7f33fc14ed20 2021-02-12T17:16:28.429 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f33f3fff700 1 -- 172.21.2.102:0/101234922 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec006d30 con 0x7f33fc14ed20 2021-02-12T17:16:28.429 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.422+0000 7f340259f700 1 -- 172.21.2.102:0/101234922 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33fc154c20 con 0x7f33fc14ed20 2021-02-12T17:16:28.429 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.423+0000 7f340259f700 1 -- 172.21.2.102:0/101234922 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33fc09edc0 con 0x7f33fc14ed20 2021-02-12T17:16:28.429 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.423+0000 7f33f3fff700 1 -- 172.21.2.102:0/101234922 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f33ec025030 con 0x7f33fc14ed20 2021-02-12T17:16:28.429 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.423+0000 7f33f3fff700 1 --2- 172.21.2.102:0/101234922 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f33e0059d60 0x7f33e005c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.429 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.424+0000 7f33f3fff700 1 -- 172.21.2.102:0/101234922 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f33ec074e50 con 0x7f33fc14ed20 2021-02-12T17:16:28.429 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.424+0000 7f33fbfff700 1 --2- 172.21.2.102:0/101234922 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f33e0059d60 0x7f33e005c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.429 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.424+0000 7f33fbfff700 1 --2- 172.21.2.102:0/101234922 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f33e0059d60 0x7f33e005c220 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f33e4000f90 tx=0x7f33e4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:28.430 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.426+0000 7f33f3fff700 1 -- 172.21.2.102:0/101234922 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f33fc09edc0 con 0x7f33fc14ed20 2021-02-12T17:16:28.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.556+0000 7f340259f700 1 -- 172.21.2.102:0/101234922 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f33fc09edc0 con 0x7f33fc14ed20 2021-02-12T17:16:28.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.556+0000 7f33f3fff700 1 -- 172.21.2.102:0/101234922 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+10 (secure 0 0 0) 0x7f33fc09edc0 con 0x7f33fc14ed20 2021-02-12T17:16:28.557 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:28.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.557+0000 7f340259f700 1 -- 172.21.2.102:0/101234922 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f33e0059d60 msgr2=0x7f33e005c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.557+0000 7f340259f700 1 --2- 172.21.2.102:0/101234922 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f33e0059d60 0x7f33e005c220 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f33e4000f90 tx=0x7f33e4009040).stop 2021-02-12T17:16:28.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.557+0000 7f340259f700 1 -- 172.21.2.102:0/101234922 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f33fc14ed20 msgr2=0x7f33fc09cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.557+0000 7f340259f700 1 --2- 172.21.2.102:0/101234922 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f33fc14ed20 0x7f33fc09cb40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f33dc0043c0 tx=0x7f33ec016000).stop 2021-02-12T17:16:28.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.557+0000 7f340259f700 1 -- 172.21.2.102:0/101234922 shutdown_connections 2021-02-12T17:16:28.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.557+0000 7f340259f700 1 --2- 172.21.2.102:0/101234922 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f33fc14f1a0 0x7f33fc09d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.557+0000 7f340259f700 1 --2- 172.21.2.102:0/101234922 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f33dc0044d0 0x7f33fc09f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.557+0000 7f340259f700 1 --2- 172.21.2.102:0/101234922 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f33e0059d60 0x7f33e005c220 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.557+0000 7f340259f700 1 --2- 172.21.2.102:0/101234922 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f33fc14ed20 0x7f33fc09cb40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.557+0000 7f340259f700 1 -- 172.21.2.102:0/101234922 >> 172.21.2.102:0/101234922 conn(0x7f33fc061830 msgr2=0x7f33fc0bb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:28.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.557+0000 7f340259f700 1 -- 172.21.2.102:0/101234922 shutdown_connections 2021-02-12T17:16:28.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.557+0000 7f340259f700 1 -- 172.21.2.102:0/101234922 wait complete. 2021-02-12T17:16:28.567 INFO:tasks.mds_thrash:mds thrasher using random seed: 1613150188 2021-02-12T17:16:28.568 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:28.657 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.656+0000 7f63e7405700 1 Processor -- start 2021-02-12T17:16:28.657 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.656+0000 7f63e7405700 1 -- start start 2021-02-12T17:16:28.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.656+0000 7f63e7405700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f63e00b8d20 0x7f63e0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.656+0000 7f63e7405700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f63e014e530 0x7f63e00b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.656+0000 7f63e7405700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e00622a0 con 0x7f63e0062740 2021-02-12T17:16:28.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.656+0000 7f63e7405700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e0068d20 con 0x7f63e014e530 2021-02-12T17:16:28.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.656+0000 7f63e7405700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e014ea10 con 0x7f63e00b8d20 2021-02-12T17:16:28.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.656+0000 7f63e49a0700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f63e014e530 0x7f63e00b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.656+0000 7f63e49a0700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f63e014e530 0x7f63e00b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45362/0 (socket says 172.21.2.102:45362) 2021-02-12T17:16:28.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.656+0000 7f63e49a0700 1 -- 172.21.2.102:0/3077116241 learned_addr learned my addr 172.21.2.102:0/3077116241 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:28.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.657+0000 7f63e49a0700 1 -- 172.21.2.102:0/3077116241 >> v2:172.21.2.104:3300/0 conn(0x7f63e00b8d20 msgr2=0x7f63e0068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:28.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.657+0000 7f63e49a0700 1 --2- 172.21.2.102:0/3077116241 >> v2:172.21.2.104:3300/0 conn(0x7f63e00b8d20 0x7f63e0068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.657+0000 7f63e49a0700 1 -- 172.21.2.102:0/3077116241 >> v1:172.21.2.104:6789/0 conn(0x7f63e0062740 legacy=0x7f63e0062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:28.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.657+0000 7f63e49a0700 1 -- 172.21.2.102:0/3077116241 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e00b63f0 con 0x7f63e014e530 2021-02-12T17:16:28.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.657+0000 7f63e49a0700 1 --2- 172.21.2.102:0/3077116241 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63e014e530 0x7f63e00b7250 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f63e006abc0 tx=0x7f63d4006ea0).ready entity=mon.0 client_cookie=e8b478da1e063dd9 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:28.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.657+0000 7f63d3fff700 1 -- 172.21.2.102:0/3077116241 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4009800 con 0x7f63e014e530 2021-02-12T17:16:28.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.657+0000 7f63d3fff700 1 -- 172.21.2.102:0/3077116241 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d4009960 con 0x7f63e014e530 2021-02-12T17:16:28.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.657+0000 7f63d3fff700 1 -- 172.21.2.102:0/3077116241 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4009ce0 con 0x7f63e014e530 2021-02-12T17:16:28.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.657+0000 7f63e7405700 1 -- 172.21.2.102:0/3077116241 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63e014e530 msgr2=0x7f63e00b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.657+0000 7f63e7405700 1 --2- 172.21.2.102:0/3077116241 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63e014e530 0x7f63e00b7250 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f63e006abc0 tx=0x7f63d4006ea0).stop 2021-02-12T17:16:28.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.657+0000 7f63e7405700 1 -- 172.21.2.102:0/3077116241 shutdown_connections 2021-02-12T17:16:28.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.657+0000 7f63e7405700 1 --2- 172.21.2.102:0/3077116241 >> v2:172.21.2.104:3300/0 conn(0x7f63e00b8d20 0x7f63e0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.657+0000 7f63e7405700 1 --2- 172.21.2.102:0/3077116241 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63e014e530 0x7f63e00b7250 secure :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0x7f63e006abc0 tx=0x7f63d4006ea0).stop 2021-02-12T17:16:28.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.657+0000 7f63e7405700 1 -- 172.21.2.102:0/3077116241 >> 172.21.2.102:0/3077116241 conn(0x7f63e00bc480 msgr2=0x7f63e00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:28.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.658+0000 7f63e7405700 1 -- 172.21.2.102:0/3077116241 shutdown_connections 2021-02-12T17:16:28.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.658+0000 7f63e7405700 1 -- 172.21.2.102:0/3077116241 wait complete. 2021-02-12T17:16:28.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.658+0000 7f63e7405700 1 Processor -- start 2021-02-12T17:16:28.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.659+0000 7f63e7405700 1 -- start start 2021-02-12T17:16:28.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.659+0000 7f63e7405700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f63e0062740 0x7f63e00b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.659+0000 7f63e7405700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f63e00b8d20 0x7f63e00ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.659+0000 7f63e7405700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63e00ae9a0 0x7f63e00acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.659+0000 7f63e7405700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e015e550 con 0x7f63e00ae9a0 2021-02-12T17:16:28.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.659+0000 7f63e7405700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e0140190 con 0x7f63e00b8d20 2021-02-12T17:16:28.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.659+0000 7f63e7405700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e015d630 con 0x7f63e0062740 2021-02-12T17:16:28.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.659+0000 7f63e59a2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63e00ae9a0 0x7f63e00acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.659+0000 7f63e59a2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63e00ae9a0 0x7f63e00acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45368/0 (socket says 172.21.2.102:45368) 2021-02-12T17:16:28.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.659+0000 7f63e59a2700 1 -- 172.21.2.102:0/2638935870 learned_addr learned my addr 172.21.2.102:0/2638935870 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:28.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.660+0000 7f63e59a2700 1 -- 172.21.2.102:0/2638935870 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f63e0062740 msgr2=0x7f63e00b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.660+0000 7f63e59a2700 1 --2- 172.21.2.102:0/2638935870 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f63e0062740 0x7f63e00b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.660+0000 7f63e59a2700 1 -- 172.21.2.102:0/2638935870 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f63e00b8d20 msgr2=0x7f63e00ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.660+0000 7f63e59a2700 1 --2- 172.21.2.102:0/2638935870 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f63e00b8d20 0x7f63e00ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.660+0000 7f63e59a2700 1 -- 172.21.2.102:0/2638935870 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e015d8d0 con 0x7f63e00ae9a0 2021-02-12T17:16:28.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.660+0000 7f63e59a2700 1 --2- 172.21.2.102:0/2638935870 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63e00ae9a0 0x7f63e00acf10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f63d800bae0 tx=0x7f63d80091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:28.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.660+0000 7f63d17fa700 1 -- 172.21.2.102:0/2638935870 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800c7f0 con 0x7f63e00ae9a0 2021-02-12T17:16:28.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.660+0000 7f63d17fa700 1 -- 172.21.2.102:0/2638935870 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d800c990 con 0x7f63e00ae9a0 2021-02-12T17:16:28.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.660+0000 7f63e7405700 1 -- 172.21.2.102:0/2638935870 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e015db70 con 0x7f63e00ae9a0 2021-02-12T17:16:28.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.660+0000 7f63e7405700 1 -- 172.21.2.102:0/2638935870 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e015e0b0 con 0x7f63e00ae9a0 2021-02-12T17:16:28.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.660+0000 7f63d17fa700 1 -- 172.21.2.102:0/2638935870 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800cb40 con 0x7f63e00ae9a0 2021-02-12T17:16:28.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.661+0000 7f63e7405700 1 -- 172.21.2.102:0/2638935870 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e015e240 con 0x7f63e00ae9a0 2021-02-12T17:16:28.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.661+0000 7f63d17fa700 1 -- 172.21.2.102:0/2638935870 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f63d801c070 con 0x7f63e00ae9a0 2021-02-12T17:16:28.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.661+0000 7f63d17fa700 1 --2- 172.21.2.102:0/2638935870 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f63c0059d30 0x7f63c005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.661+0000 7f63d17fa700 1 -- 172.21.2.102:0/2638935870 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f63d8073500 con 0x7f63e00ae9a0 2021-02-12T17:16:28.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.661+0000 7f63e51a1700 1 --2- 172.21.2.102:0/2638935870 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f63c0059d30 0x7f63c005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.662+0000 7f63e51a1700 1 --2- 172.21.2.102:0/2638935870 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f63c0059d30 0x7f63c005c1f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f63e014b9a0 tx=0x7f63dc006900).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:28.665 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.664+0000 7f63d17fa700 1 -- 172.21.2.102:0/2638935870 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f63d8046c20 con 0x7f63e00ae9a0 2021-02-12T17:16:28.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.794+0000 7f63e7405700 1 -- 172.21.2.102:0/2638935870 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63e0045460 con 0x7f63e00ae9a0 2021-02-12T17:16:28.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.795+0000 7f63d17fa700 1 -- 172.21.2.102:0/2638935870 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19888 (secure 0 0 0) 0x7f63d801a070 con 0x7f63e00ae9a0 2021-02-12T17:16:28.796 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:28.796 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":27,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:09.532002+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}},{"pool":5,"pool_name":"b_metadata","create_time":"2021-02-12T17:16:06.678651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}}},{"pool":6,"pool_name":"b_data","create_time":"2021-02-12T17:16:07.511756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"b"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:28.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.796+0000 7f63e7405700 1 -- 172.21.2.102:0/2638935870 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f63c0059d30 msgr2=0x7f63c005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.796+0000 7f63e7405700 1 --2- 172.21.2.102:0/2638935870 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f63c0059d30 0x7f63c005c1f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f63e014b9a0 tx=0x7f63dc006900).stop 2021-02-12T17:16:28.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.796+0000 7f63e7405700 1 -- 172.21.2.102:0/2638935870 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63e00ae9a0 msgr2=0x7f63e00acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.796+0000 7f63e7405700 1 --2- 172.21.2.102:0/2638935870 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63e00ae9a0 0x7f63e00acf10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f63d800bae0 tx=0x7f63d80091a0).stop 2021-02-12T17:16:28.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.796+0000 7f63e7405700 1 -- 172.21.2.102:0/2638935870 shutdown_connections 2021-02-12T17:16:28.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.796+0000 7f63e7405700 1 --2- 172.21.2.102:0/2638935870 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f63c0059d30 0x7f63c005c1f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.796+0000 7f63e7405700 1 --2- 172.21.2.102:0/2638935870 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63e00ae9a0 0x7f63e00acf10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.796+0000 7f63e7405700 1 --2- 172.21.2.102:0/2638935870 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f63e0062740 0x7f63e00b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.796+0000 7f63e7405700 1 --2- 172.21.2.102:0/2638935870 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f63e00b8d20 0x7f63e00ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.796+0000 7f63e7405700 1 -- 172.21.2.102:0/2638935870 >> 172.21.2.102:0/2638935870 conn(0x7f63e00bc480 msgr2=0x7f63e014ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:28.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.796+0000 7f63e7405700 1 -- 172.21.2.102:0/2638935870 shutdown_connections 2021-02-12T17:16:28.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.796+0000 7f63e7405700 1 -- 172.21.2.102:0/2638935870 wait complete. 2021-02-12T17:16:28.806 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-12T17:15:54.614238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-12T17:15:56.701902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'a_metadata', 'create_time': '2021-02-12T17:15:59.832660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}}, {'pool': 4, 'pool_name': 'a_data', 'create_time': '2021-02-12T17:16:00.965024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'a'}}}, {'pool': 5, 'pool_name': 'b_metadata', 'create_time': '2021-02-12T17:16:06.678651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}}, {'pool': 6, 'pool_name': 'b_data', 'create_time': '2021-02-12T17:16:07.511756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'b'}}}] 2021-02-12T17:16:28.807 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-02-12T17:16:28.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.894+0000 7f38254f6700 1 Processor -- start 2021-02-12T17:16:28.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.894+0000 7f38254f6700 1 -- start start 2021-02-12T17:16:28.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f38254f6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f38200bc2b0 0x7f3820151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f38254f6700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f38200b0940 0x7f3820151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f38254f6700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f382009ada0 0x7f3820151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f38254f6700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3820151ff0 con 0x7f38200b0940 2021-02-12T17:16:28.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f38254f6700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38200b27d0 con 0x7f382009ada0 2021-02-12T17:16:28.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f38254f6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3820066b70 con 0x7f38200bc2b0 2021-02-12T17:16:28.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f381e7fc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f38200b0940 0x7f3820151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f381e7fc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f38200b0940 0x7f3820151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45372/0 (socket says 172.21.2.102:45372) 2021-02-12T17:16:28.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f381e7fc700 1 -- 172.21.2.102:0/1540973997 learned_addr learned my addr 172.21.2.102:0/1540973997 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:28.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f381e7fc700 1 -- 172.21.2.102:0/1540973997 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f38200bc2b0 msgr2=0x7f3820151120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:28.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f381e7fc700 1 --2- 172.21.2.102:0/1540973997 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f38200bc2b0 0x7f3820151120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f381e7fc700 1 -- 172.21.2.102:0/1540973997 >> v2:172.21.2.104:3300/0 conn(0x7f382009ada0 msgr2=0x7f3820151b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:28.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f381e7fc700 1 --2- 172.21.2.102:0/1540973997 >> v2:172.21.2.104:3300/0 conn(0x7f382009ada0 0x7f3820151b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f381e7fc700 1 -- 172.21.2.102:0/1540973997 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38200685b0 con 0x7f38200b0940 2021-02-12T17:16:28.898 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f381e7fc700 1 --2- 172.21.2.102:0/1540973997 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38200b0940 0x7f3820151610 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f382006a8c0 tx=0x7f3808006ea0).ready entity=mon.0 client_cookie=5f8df2c6c2456b23 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:28.899 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f381dffb700 1 -- 172.21.2.102:0/1540973997 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38080098d0 con 0x7f38200b0940 2021-02-12T17:16:28.899 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f381dffb700 1 -- 172.21.2.102:0/1540973997 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3808009a30 con 0x7f38200b0940 2021-02-12T17:16:28.899 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.895+0000 7f381dffb700 1 -- 172.21.2.102:0/1540973997 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808009db0 con 0x7f38200b0940 2021-02-12T17:16:28.899 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.896+0000 7f38254f6700 1 -- 172.21.2.102:0/1540973997 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38200b0940 msgr2=0x7f3820151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.899 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.896+0000 7f38254f6700 1 --2- 172.21.2.102:0/1540973997 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38200b0940 0x7f3820151610 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f382006a8c0 tx=0x7f3808006ea0).stop 2021-02-12T17:16:28.899 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.896+0000 7f38254f6700 1 -- 172.21.2.102:0/1540973997 shutdown_connections 2021-02-12T17:16:28.899 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.896+0000 7f38254f6700 1 --2- 172.21.2.102:0/1540973997 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f38200bc2b0 0x7f3820151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.899 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.896+0000 7f38254f6700 1 --2- 172.21.2.102:0/1540973997 >> v2:172.21.2.104:3300/0 conn(0x7f382009ada0 0x7f3820151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.899 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.896+0000 7f38254f6700 1 --2- 172.21.2.102:0/1540973997 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38200b0940 0x7f3820151610 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:28.899 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.896+0000 7f38254f6700 1 -- 172.21.2.102:0/1540973997 >> 172.21.2.102:0/1540973997 conn(0x7f3820061830 msgr2=0x7f38200bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:28.899 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.896+0000 7f38254f6700 1 -- 172.21.2.102:0/1540973997 shutdown_connections 2021-02-12T17:16:28.899 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.896+0000 7f38254f6700 1 -- 172.21.2.102:0/1540973997 wait complete. 2021-02-12T17:16:28.900 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.897+0000 7f38254f6700 1 Processor -- start 2021-02-12T17:16:28.900 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.897+0000 7f38254f6700 1 -- start start 2021-02-12T17:16:28.900 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.897+0000 7f38254f6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f382009ada0 0x7f3820062f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.900 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.897+0000 7f38254f6700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38200b0940 0x7f3820063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.900 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.897+0000 7f38254f6700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38200bc2b0 0x7f382014a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.900 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.897+0000 7f38254f6700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38200a0690 con 0x7f38200bc2b0 2021-02-12T17:16:28.900 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.897+0000 7f38254f6700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382009fb80 con 0x7f38200b0940 2021-02-12T17:16:28.900 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.897+0000 7f38254f6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382009fe20 con 0x7f382009ada0 2021-02-12T17:16:28.900 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.897+0000 7f381f7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38200bc2b0 0x7f382014a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.900 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.898+0000 7f381f7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38200bc2b0 0x7f382014a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45382/0 (socket says 172.21.2.102:45382) 2021-02-12T17:16:28.900 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.898+0000 7f381f7fe700 1 -- 172.21.2.102:0/495074880 learned_addr learned my addr 172.21.2.102:0/495074880 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:28.902 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.898+0000 7f381f7fe700 1 -- 172.21.2.102:0/495074880 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f382009ada0 msgr2=0x7f3820062f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.902 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.898+0000 7f381f7fe700 1 --2- 172.21.2.102:0/495074880 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f382009ada0 0x7f3820062f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.902 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.898+0000 7f381f7fe700 1 -- 172.21.2.102:0/495074880 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38200b0940 msgr2=0x7f3820063470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:28.902 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.898+0000 7f381f7fe700 1 --2- 172.21.2.102:0/495074880 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38200b0940 0x7f3820063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:28.902 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.898+0000 7f381f7fe700 1 -- 172.21.2.102:0/495074880 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38200a11b0 con 0x7f38200bc2b0 2021-02-12T17:16:28.902 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.898+0000 7f381f7fe700 1 --2- 172.21.2.102:0/495074880 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38200bc2b0 0x7f382014a480 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f381800bae0 tx=0x7f38180091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:28.902 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.898+0000 7f3816ffd700 1 -- 172.21.2.102:0/495074880 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800c7f0 con 0x7f38200bc2b0 2021-02-12T17:16:28.902 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.898+0000 7f3816ffd700 1 -- 172.21.2.102:0/495074880 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381800c990 con 0x7f38200bc2b0 2021-02-12T17:16:28.902 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.898+0000 7f38254f6700 1 -- 172.21.2.102:0/495074880 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38200a1450 con 0x7f38200bc2b0 2021-02-12T17:16:28.902 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.898+0000 7f3816ffd700 1 -- 172.21.2.102:0/495074880 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800cb40 con 0x7f38200bc2b0 2021-02-12T17:16:28.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.899+0000 7f38254f6700 1 -- 172.21.2.102:0/495074880 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38200a08d0 con 0x7f38200bc2b0 2021-02-12T17:16:28.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.899+0000 7f38254f6700 1 -- 172.21.2.102:0/495074880 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38200a15e0 con 0x7f38200bc2b0 2021-02-12T17:16:28.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.899+0000 7f3816ffd700 1 -- 172.21.2.102:0/495074880 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f381801c070 con 0x7f38200bc2b0 2021-02-12T17:16:28.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.900+0000 7f3816ffd700 1 --2- 172.21.2.102:0/495074880 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3804059d80 0x7f380405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:28.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.900+0000 7f3816ffd700 1 -- 172.21.2.102:0/495074880 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f38180734b0 con 0x7f38200bc2b0 2021-02-12T17:16:28.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.900+0000 7f381effd700 1 --2- 172.21.2.102:0/495074880 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3804059d80 0x7f380405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:28.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.900+0000 7f381effd700 1 --2- 172.21.2.102:0/495074880 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3804059d80 0x7f380405c240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3820161bd0 tx=0x7f3810006900).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:28.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:28.903+0000 7f3816ffd700 1 -- 172.21.2.102:0/495074880 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f3818046c50 con 0x7f38200bc2b0 2021-02-12T17:16:29.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.031+0000 7f38254f6700 1 -- 172.21.2.102:0/495074880 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3820045460 con 0x7f38200bc2b0 2021-02-12T17:16:29.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.031+0000 7f3816ffd700 1 -- 172.21.2.102:0/495074880 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v27) v1 ==== 110+0+10 (secure 0 0 0) 0x7f381804a270 con 0x7f38200bc2b0 2021-02-12T17:16:29.033 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 1 2021-02-12T17:16:29.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.032+0000 7f38254f6700 1 -- 172.21.2.102:0/495074880 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3804059d80 msgr2=0x7f380405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.032+0000 7f38254f6700 1 --2- 172.21.2.102:0/495074880 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3804059d80 0x7f380405c240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3820161bd0 tx=0x7f3810006900).stop 2021-02-12T17:16:29.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.032+0000 7f38254f6700 1 -- 172.21.2.102:0/495074880 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38200bc2b0 msgr2=0x7f382014a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.032+0000 7f38254f6700 1 --2- 172.21.2.102:0/495074880 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38200bc2b0 0x7f382014a480 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f381800bae0 tx=0x7f38180091a0).stop 2021-02-12T17:16:29.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.032+0000 7f38254f6700 1 -- 172.21.2.102:0/495074880 shutdown_connections 2021-02-12T17:16:29.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.032+0000 7f38254f6700 1 --2- 172.21.2.102:0/495074880 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3804059d80 0x7f380405c240 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.032+0000 7f38254f6700 1 --2- 172.21.2.102:0/495074880 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38200bc2b0 0x7f382014a480 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.032+0000 7f38254f6700 1 --2- 172.21.2.102:0/495074880 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f382009ada0 0x7f3820062f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.032+0000 7f38254f6700 1 --2- 172.21.2.102:0/495074880 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38200b0940 0x7f3820063470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.032+0000 7f38254f6700 1 -- 172.21.2.102:0/495074880 >> 172.21.2.102:0/495074880 conn(0x7f3820061830 msgr2=0x7f38200b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:29.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.032+0000 7f38254f6700 1 -- 172.21.2.102:0/495074880 shutdown_connections 2021-02-12T17:16:29.035 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.033+0000 7f38254f6700 1 -- 172.21.2.102:0/495074880 wait complete. 2021-02-12T17:16:29.042 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-02-12T17:16:29.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.130+0000 7f3fbbfff700 1 Processor -- start 2021-02-12T17:16:29.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.130+0000 7f3fbbfff700 1 -- start start 2021-02-12T17:16:29.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.130+0000 7f3fbbfff700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3fbc14d790 0x7f3fbc0b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.130+0000 7f3fbbfff700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fbc068d60 con 0x7f3fbc0669e0 2021-02-12T17:16:29.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.130+0000 7f3fbbfff700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fbc068820 con 0x7f3fbc0b89c0 2021-02-12T17:16:29.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.130+0000 7f3fbbfff700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc068ac0 con 0x7f3fbc14d790 2021-02-12T17:16:29.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.130+0000 7f3fba7fc700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f3fbc0669e0 0x7f3fbc14d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54032/0 (socket says 172.21.2.102:54032) 2021-02-12T17:16:29.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.130+0000 7f3fba7fc700 1 -- 172.21.2.102:0/3592855669 learned_addr learned my addr 172.21.2.102:0/3592855669 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:29.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 -- 172.21.2.102:0/3592855669 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665652229 0 0) 0x7f3fbc068d60 con 0x7f3fbc0669e0 2021-02-12T17:16:29.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 -- 172.21.2.102:0/3592855669 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f9c003230 con 0x7f3fbc0669e0 2021-02-12T17:16:29.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 -- 172.21.2.102:0/3592855669 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1969378139 0 0) 0x7f3f9c003230 con 0x7f3fbc0669e0 2021-02-12T17:16:29.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 -- 172.21.2.102:0/3592855669 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3fbc14d790 msgr2=0x7f3fbc0b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:29.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 --2- 172.21.2.102:0/3592855669 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3fbc14d790 0x7f3fbc0b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 -- 172.21.2.102:0/3592855669 >> v1:172.21.2.104:6789/0 conn(0x7f3fbc0b89c0 legacy=0x7f3fbc14e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:29.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 -- 172.21.2.102:0/3592855669 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc14dc40 con 0x7f3fbc0669e0 2021-02-12T17:16:29.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 -- 172.21.2.102:0/3592855669 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f3fac0014e0 con 0x7f3fbc0669e0 2021-02-12T17:16:29.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 -- 172.21.2.102:0/3592855669 >> v1:172.21.2.102:6789/0 conn(0x7f3fbc0669e0 legacy=0x7f3fbc14d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 --2- 172.21.2.102:0/3592855669 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3f9c0037d0 0x7f3f9c003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 --2- 172.21.2.102:0/3592855669 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3fbc14d790 0x7f3f9c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 --2- 172.21.2.102:0/3592855669 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f9c0049c0 0x7f3f9c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 -- 172.21.2.102:0/3592855669 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc068ac0 con 0x7f3f9c0049c0 2021-02-12T17:16:29.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 -- 172.21.2.102:0/3592855669 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c004250 con 0x7f3f9c0037d0 2021-02-12T17:16:29.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fb9ffb700 1 -- 172.21.2.102:0/3592855669 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c00b720 con 0x7f3fbc14d790 2021-02-12T17:16:29.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fbb7fe700 1 --2- 172.21.2.102:0/3592855669 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f9c0049c0 0x7f3f9c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.131+0000 7f3fbaffd700 1 --2- 172.21.2.102:0/3592855669 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3f9c0037d0 0x7f3f9c003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fba7fc700 1 --2- 172.21.2.102:0/3592855669 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3fbc14d790 0x7f3f9c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fbb7fe700 1 -- 172.21.2.102:0/3592855669 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3fbc14d790 msgr2=0x7f3f9c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:29.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fbb7fe700 1 --2- 172.21.2.102:0/3592855669 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3fbc14d790 0x7f3f9c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fbb7fe700 1 -- 172.21.2.102:0/3592855669 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3f9c0037d0 msgr2=0x7f3f9c003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:29.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fbb7fe700 1 --2- 172.21.2.102:0/3592855669 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3f9c0037d0 0x7f3f9c003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fbb7fe700 1 -- 172.21.2.102:0/3592855669 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc14dc40 con 0x7f3f9c0049c0 2021-02-12T17:16:29.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fbb7fe700 1 --2- 172.21.2.102:0/3592855669 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f9c0049c0 0x7f3f9c004e40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f3fbc14db70 tx=0x7f3fb4009220).ready entity=mon.0 client_cookie=6c26facf359e2404 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:29.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fb9ffb700 1 -- 172.21.2.102:0/3592855669 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb400b990 con 0x7f3f9c0049c0 2021-02-12T17:16:29.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fb9ffb700 1 -- 172.21.2.102:0/3592855669 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb400baf0 con 0x7f3f9c0049c0 2021-02-12T17:16:29.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fb9ffb700 1 -- 172.21.2.102:0/3592855669 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4011400 con 0x7f3f9c0049c0 2021-02-12T17:16:29.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fbbfff700 1 -- 172.21.2.102:0/3592855669 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f9c0049c0 msgr2=0x7f3f9c004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fbbfff700 1 --2- 172.21.2.102:0/3592855669 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f9c0049c0 0x7f3f9c004e40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f3fbc14db70 tx=0x7f3fb4009220).stop 2021-02-12T17:16:29.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fbb7fe700 1 -- 172.21.2.102:0/3592855669 reap_dead start 2021-02-12T17:16:29.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fbbfff700 1 -- 172.21.2.102:0/3592855669 shutdown_connections 2021-02-12T17:16:29.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fbbfff700 1 -- 172.21.2.102:0/3592855669 >> 172.21.2.102:0/3592855669 conn(0x7f3fbc0bc2e0 msgr2=0x7f3fbc0b82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:29.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fbbfff700 1 -- 172.21.2.102:0/3592855669 shutdown_connections 2021-02-12T17:16:29.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.132+0000 7f3fbbfff700 1 -- 172.21.2.102:0/3592855669 wait complete. 2021-02-12T17:16:29.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.133+0000 7f3fbbfff700 1 Processor -- start 2021-02-12T17:16:29.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.133+0000 7f3fbbfff700 1 -- start start 2021-02-12T17:16:29.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbbfff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f9c0049c0 0x7f3fbc0b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbbfff700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3fbc1512d0 0x7f3fbc14ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbbfff700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3fbc150480 0x7f3fbc0b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbbfff700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc151bd0 con 0x7f3f9c0049c0 2021-02-12T17:16:29.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbbfff700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc09af10 con 0x7f3fbc150480 2021-02-12T17:16:29.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbbfff700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc160ee0 con 0x7f3fbc1512d0 2021-02-12T17:16:29.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbaffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f9c0049c0 0x7f3fbc0b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbaffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f9c0049c0 0x7f3fbc0b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45398/0 (socket says 172.21.2.102:45398) 2021-02-12T17:16:29.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbaffd700 1 -- 172.21.2.102:0/709000486 learned_addr learned my addr 172.21.2.102:0/709000486 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:29.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbaffd700 1 -- 172.21.2.102:0/709000486 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3fbc1512d0 msgr2=0x7f3fbc14ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbaffd700 1 --2- 172.21.2.102:0/709000486 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3fbc1512d0 0x7f3fbc14ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbb7fe700 1 --2- 172.21.2.102:0/709000486 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3fbc150480 0x7f3fbc0b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbaffd700 1 -- 172.21.2.102:0/709000486 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3fbc150480 msgr2=0x7f3fbc0b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbaffd700 1 --2- 172.21.2.102:0/709000486 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3fbc150480 0x7f3fbc0b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbaffd700 1 -- 172.21.2.102:0/709000486 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc09b140 con 0x7f3f9c0049c0 2021-02-12T17:16:29.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbb7fe700 1 --2- 172.21.2.102:0/709000486 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3fbc150480 0x7f3fbc0b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:29.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbaffd700 1 --2- 172.21.2.102:0/709000486 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f9c0049c0 0x7f3fbc0b4460 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f3fa400f8a0 tx=0x7f3fa4007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:29.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fb2ffd700 1 -- 172.21.2.102:0/709000486 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa400d700 con 0x7f3f9c0049c0 2021-02-12T17:16:29.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fb2ffd700 1 -- 172.21.2.102:0/709000486 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa400d860 con 0x7f3f9c0049c0 2021-02-12T17:16:29.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbbfff700 1 -- 172.21.2.102:0/709000486 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc09b3e0 con 0x7f3f9c0049c0 2021-02-12T17:16:29.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fb2ffd700 1 -- 172.21.2.102:0/709000486 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa400dc20 con 0x7f3f9c0049c0 2021-02-12T17:16:29.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.134+0000 7f3fbbfff700 1 -- 172.21.2.102:0/709000486 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fbc0b49d0 con 0x7f3f9c0049c0 2021-02-12T17:16:29.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.135+0000 7f3fbbfff700 1 -- 172.21.2.102:0/709000486 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fbc09b840 con 0x7f3f9c0049c0 2021-02-12T17:16:29.143 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.135+0000 7f3fb2ffd700 1 -- 172.21.2.102:0/709000486 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f3fa401c410 con 0x7f3f9c0049c0 2021-02-12T17:16:29.143 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.136+0000 7f3fb2ffd700 1 --2- 172.21.2.102:0/709000486 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3fa0059d30 0x7f3fa005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.143 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.136+0000 7f3fb2ffd700 1 -- 172.21.2.102:0/709000486 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f3fa4073e80 con 0x7f3f9c0049c0 2021-02-12T17:16:29.143 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.136+0000 7f3fba7fc700 1 --2- 172.21.2.102:0/709000486 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3fa0059d30 0x7f3fa005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.143 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.136+0000 7f3fba7fc700 1 --2- 172.21.2.102:0/709000486 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3fa0059d30 0x7f3fa005c1f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f3fac000fd0 tx=0x7f3fac000e90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:29.143 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.139+0000 7f3fb2ffd700 1 -- 172.21.2.102:0/709000486 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f3fa4047520 con 0x7f3f9c0049c0 2021-02-12T17:16:29.268 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.267+0000 7f3fbbfff700 1 -- 172.21.2.102:0/709000486 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3fbc044c00 con 0x7f3f9c0049c0 2021-02-12T17:16:29.269 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.267+0000 7f3fb2ffd700 1 -- 172.21.2.102:0/709000486 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3fa404ab40 con 0x7f3f9c0049c0 2021-02-12T17:16:29.269 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:29.270 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.268+0000 7f3fbbfff700 1 -- 172.21.2.102:0/709000486 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3fa0059d30 msgr2=0x7f3fa005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.270 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.268+0000 7f3fbbfff700 1 --2- 172.21.2.102:0/709000486 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3fa0059d30 0x7f3fa005c1f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f3fac000fd0 tx=0x7f3fac000e90).stop 2021-02-12T17:16:29.270 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.268+0000 7f3fbbfff700 1 -- 172.21.2.102:0/709000486 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f9c0049c0 msgr2=0x7f3fbc0b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.270 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.268+0000 7f3fbbfff700 1 --2- 172.21.2.102:0/709000486 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f9c0049c0 0x7f3fbc0b4460 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f3fa400f8a0 tx=0x7f3fa4007bd0).stop 2021-02-12T17:16:29.270 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.269+0000 7f3fbbfff700 1 -- 172.21.2.102:0/709000486 shutdown_connections 2021-02-12T17:16:29.270 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.269+0000 7f3fbbfff700 1 --2- 172.21.2.102:0/709000486 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3fbc150480 0x7f3fbc0b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.270 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.269+0000 7f3fbbfff700 1 --2- 172.21.2.102:0/709000486 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3fa0059d30 0x7f3fa005c1f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.270 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.269+0000 7f3fbbfff700 1 --2- 172.21.2.102:0/709000486 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f9c0049c0 0x7f3fbc0b4460 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.271 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.269+0000 7f3fbbfff700 1 --2- 172.21.2.102:0/709000486 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3fbc1512d0 0x7f3fbc14ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.271 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.269+0000 7f3fbbfff700 1 -- 172.21.2.102:0/709000486 >> 172.21.2.102:0/709000486 conn(0x7f3fbc0bc2e0 msgr2=0x7f3fbc0ba430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:29.271 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.269+0000 7f3fbbfff700 1 -- 172.21.2.102:0/709000486 shutdown_connections 2021-02-12T17:16:29.271 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.269+0000 7f3fbbfff700 1 -- 172.21.2.102:0/709000486 wait complete. 2021-02-12T17:16:29.278 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2021-02-12T17:16:29.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.366+0000 7f1046d54700 1 Processor -- start 2021-02-12T17:16:29.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.366+0000 7f1046d54700 1 -- start start 2021-02-12T17:16:29.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.367+0000 7f1046d54700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f10400bc2b0 0x7f1040151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.367+0000 7f1046d54700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1040066b70 con 0x7f1040151d20 2021-02-12T17:16:29.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.367+0000 7f1046d54700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10400685b0 con 0x7f10400b0940 2021-02-12T17:16:29.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.367+0000 7f1046d54700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10400b27d0 con 0x7f10400bc2b0 2021-02-12T17:16:29.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.367+0000 7f10452f1700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f1040151d20 0x7f10401584c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54050/0 (socket says 172.21.2.102:54050) 2021-02-12T17:16:29.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.367+0000 7f10452f1700 1 -- 172.21.2.102:0/3957736579 learned_addr learned my addr 172.21.2.102:0/3957736579 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:29.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.367+0000 7f103f7fe700 1 -- 172.21.2.102:0/3957736579 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984698088 0 0) 0x7f1040066b70 con 0x7f1040151d20 2021-02-12T17:16:29.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.367+0000 7f103f7fe700 1 -- 172.21.2.102:0/3957736579 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1020003230 con 0x7f1040151d20 2021-02-12T17:16:29.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.367+0000 7f1044af0700 1 --2- 172.21.2.102:0/3957736579 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f10400bc2b0 0x7f1040151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 -- 172.21.2.102:0/3957736579 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2158779244 0 0) 0x7f1020003230 con 0x7f1040151d20 2021-02-12T17:16:29.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 -- 172.21.2.102:0/3957736579 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f10400bc2b0 msgr2=0x7f1040151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:29.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 --2- 172.21.2.102:0/3957736579 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f10400bc2b0 0x7f1040151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 -- 172.21.2.102:0/3957736579 >> v1:172.21.2.104:6789/0 conn(0x7f10400b0940 legacy=0x7f1040151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 -- 172.21.2.102:0/3957736579 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10400b7110 con 0x7f1040151d20 2021-02-12T17:16:29.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 -- 172.21.2.102:0/3957736579 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f1038001860 con 0x7f1040151d20 2021-02-12T17:16:29.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 -- 172.21.2.102:0/3957736579 >> v1:172.21.2.102:6789/0 conn(0x7f1040151d20 legacy=0x7f10401584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 --2- 172.21.2.102:0/3957736579 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f10400bc2b0 0x7f1020003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 --2- 172.21.2.102:0/3957736579 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1020003cb0 0x7f10200044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 --2- 172.21.2.102:0/3957736579 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f10200049c0 0x7f1020004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 -- 172.21.2.102:0/3957736579 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10400b27d0 con 0x7f10200049c0 2021-02-12T17:16:29.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 -- 172.21.2.102:0/3957736579 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1020004240 con 0x7f1020003cb0 2021-02-12T17:16:29.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 -- 172.21.2.102:0/3957736579 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102000b720 con 0x7f10400bc2b0 2021-02-12T17:16:29.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f10452f1700 1 --2- 172.21.2.102:0/3957736579 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f10200049c0 0x7f1020004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103ffff700 1 --2- 172.21.2.102:0/3957736579 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1020003cb0 0x7f10200044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f1044af0700 1 --2- 172.21.2.102:0/3957736579 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f10400bc2b0 0x7f1020003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f10452f1700 1 -- 172.21.2.102:0/3957736579 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f10400bc2b0 msgr2=0x7f1020003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:29.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f10452f1700 1 --2- 172.21.2.102:0/3957736579 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f10400bc2b0 0x7f1020003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f10452f1700 1 -- 172.21.2.102:0/3957736579 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1020003cb0 msgr2=0x7f10200044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:29.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f10452f1700 1 --2- 172.21.2.102:0/3957736579 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1020003cb0 0x7f10200044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f10452f1700 1 -- 172.21.2.102:0/3957736579 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1020003230 con 0x7f10200049c0 2021-02-12T17:16:29.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f10452f1700 1 --2- 172.21.2.102:0/3957736579 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f10200049c0 0x7f1020004e40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f10400b5f90 tx=0x7f10400621c0).ready entity=mon.0 client_cookie=db50d07bc00f294c server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:29.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 -- 172.21.2.102:0/3957736579 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038005b70 con 0x7f10200049c0 2021-02-12T17:16:29.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 -- 172.21.2.102:0/3957736579 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1038005cd0 con 0x7f10200049c0 2021-02-12T17:16:29.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.368+0000 7f103f7fe700 1 -- 172.21.2.102:0/3957736579 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038007300 con 0x7f10200049c0 2021-02-12T17:16:29.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.369+0000 7f1046d54700 1 -- 172.21.2.102:0/3957736579 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f10200049c0 msgr2=0x7f1020004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.369+0000 7f1046d54700 1 --2- 172.21.2.102:0/3957736579 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f10200049c0 0x7f1020004e40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f10400b5f90 tx=0x7f10400621c0).stop 2021-02-12T17:16:29.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.369+0000 7f10452f1700 1 -- 172.21.2.102:0/3957736579 reap_dead start 2021-02-12T17:16:29.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.369+0000 7f1046d54700 1 -- 172.21.2.102:0/3957736579 shutdown_connections 2021-02-12T17:16:29.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.369+0000 7f1046d54700 1 -- 172.21.2.102:0/3957736579 >> 172.21.2.102:0/3957736579 conn(0x7f1040061830 msgr2=0x7f10400bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:29.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.369+0000 7f1046d54700 1 -- 172.21.2.102:0/3957736579 shutdown_connections 2021-02-12T17:16:29.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.369+0000 7f1046d54700 1 -- 172.21.2.102:0/3957736579 wait complete. 2021-02-12T17:16:29.375 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.370+0000 7f1046d54700 1 Processor -- start 2021-02-12T17:16:29.375 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.370+0000 7f1046d54700 1 -- start start 2021-02-12T17:16:29.375 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.370+0000 7f1046d54700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f10400b3230 0x7f104015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.375 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.370+0000 7f1046d54700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1040090990 0x7f104015d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.375 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.370+0000 7f1046d54700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f10400a14d0 0x7f104014b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.375 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.370+0000 7f1046d54700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10400900a0 con 0x7f10400a14d0 2021-02-12T17:16:29.375 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.370+0000 7f1046d54700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1040090290 con 0x7f1040090990 2021-02-12T17:16:29.375 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.370+0000 7f1046d54700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10400b4d40 con 0x7f10400b3230 2021-02-12T17:16:29.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.371+0000 7f10452f1700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f10400a14d0 0x7f104014b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.371+0000 7f10452f1700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f10400a14d0 0x7f104014b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45418/0 (socket says 172.21.2.102:45418) 2021-02-12T17:16:29.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.371+0000 7f10452f1700 1 -- 172.21.2.102:0/1297689458 learned_addr learned my addr 172.21.2.102:0/1297689458 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:29.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.371+0000 7f10452f1700 1 -- 172.21.2.102:0/1297689458 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f10400b3230 msgr2=0x7f104015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.371+0000 7f10452f1700 1 --2- 172.21.2.102:0/1297689458 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f10400b3230 0x7f104015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.371+0000 7f10452f1700 1 -- 172.21.2.102:0/1297689458 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1040090990 msgr2=0x7f104015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.371+0000 7f10452f1700 1 --2- 172.21.2.102:0/1297689458 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1040090990 0x7f104015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.371+0000 7f10452f1700 1 -- 172.21.2.102:0/1297689458 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10400b4fe0 con 0x7f10400a14d0 2021-02-12T17:16:29.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.371+0000 7f10452f1700 1 --2- 172.21.2.102:0/1297689458 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f10400a14d0 0x7f104014b420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f1020005450 tx=0x7f1038013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:29.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.371+0000 7f103cff9700 1 -- 172.21.2.102:0/1297689458 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103801b070 con 0x7f10400a14d0 2021-02-12T17:16:29.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.371+0000 7f103cff9700 1 -- 172.21.2.102:0/1297689458 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10380072e0 con 0x7f10400a14d0 2021-02-12T17:16:29.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.371+0000 7f1046d54700 1 -- 172.21.2.102:0/1297689458 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10400b5280 con 0x7f10400a14d0 2021-02-12T17:16:29.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.371+0000 7f103cff9700 1 -- 172.21.2.102:0/1297689458 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10380138b0 con 0x7f10400a14d0 2021-02-12T17:16:29.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.371+0000 7f1046d54700 1 -- 172.21.2.102:0/1297689458 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10400b49c0 con 0x7f10400a14d0 2021-02-12T17:16:29.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.372+0000 7f1046d54700 1 -- 172.21.2.102:0/1297689458 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10400906b0 con 0x7f10400a14d0 2021-02-12T17:16:29.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.372+0000 7f103cff9700 1 -- 172.21.2.102:0/1297689458 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f1038027070 con 0x7f10400a14d0 2021-02-12T17:16:29.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.372+0000 7f103cff9700 1 --2- 172.21.2.102:0/1297689458 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1024059d30 0x7f102405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.372+0000 7f103cff9700 1 -- 172.21.2.102:0/1297689458 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f1038005e40 con 0x7f10400a14d0 2021-02-12T17:16:29.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.373+0000 7f1044af0700 1 --2- 172.21.2.102:0/1297689458 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1024059d30 0x7f102405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.373+0000 7f1044af0700 1 --2- 172.21.2.102:0/1297689458 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1024059d30 0x7f102405c1f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1028006cf0 tx=0x7f1028008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:29.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.375+0000 7f103cff9700 1 -- 172.21.2.102:0/1297689458 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f1038048510 con 0x7f10400a14d0 2021-02-12T17:16:29.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.504+0000 7f1046d54700 1 -- 172.21.2.102:0/1297689458 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1040045460 con 0x7f10400a14d0 2021-02-12T17:16:29.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.505+0000 7f103cff9700 1 -- 172.21.2.102:0/1297689458 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+10 (secure 0 0 0) 0x7f1038017070 con 0x7f10400a14d0 2021-02-12T17:16:29.506 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:29.507 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.506+0000 7f1046d54700 1 -- 172.21.2.102:0/1297689458 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1024059d30 msgr2=0x7f102405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.507 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.506+0000 7f1046d54700 1 --2- 172.21.2.102:0/1297689458 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1024059d30 0x7f102405c1f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1028006cf0 tx=0x7f1028008040).stop 2021-02-12T17:16:29.507 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.506+0000 7f1046d54700 1 -- 172.21.2.102:0/1297689458 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f10400a14d0 msgr2=0x7f104014b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.507 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.506+0000 7f1046d54700 1 --2- 172.21.2.102:0/1297689458 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f10400a14d0 0x7f104014b420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f1020005450 tx=0x7f1038013000).stop 2021-02-12T17:16:29.507 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.506+0000 7f1046d54700 1 -- 172.21.2.102:0/1297689458 shutdown_connections 2021-02-12T17:16:29.507 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.506+0000 7f1046d54700 1 --2- 172.21.2.102:0/1297689458 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1024059d30 0x7f102405c1f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.507 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.506+0000 7f1046d54700 1 --2- 172.21.2.102:0/1297689458 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f10400a14d0 0x7f104014b420 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.507 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.506+0000 7f1046d54700 1 --2- 172.21.2.102:0/1297689458 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f10400b3230 0x7f104015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.508 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.506+0000 7f1046d54700 1 --2- 172.21.2.102:0/1297689458 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1040090990 0x7f104015d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.508 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.506+0000 7f1046d54700 1 -- 172.21.2.102:0/1297689458 >> 172.21.2.102:0/1297689458 conn(0x7f1040061830 msgr2=0x7f10401510b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:29.508 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.506+0000 7f1046d54700 1 -- 172.21.2.102:0/1297689458 shutdown_connections 2021-02-12T17:16:29.508 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.506+0000 7f1046d54700 1 -- 172.21.2.102:0/1297689458 wait complete. 2021-02-12T17:16:29.516 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2021-02-12T17:16:29.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.604+0000 7fadc2f0a700 1 Processor -- start 2021-02-12T17:16:29.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.604+0000 7fadc2f0a700 1 -- start start 2021-02-12T17:16:29.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.605+0000 7fadc2f0a700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fadbc0bc2b0 0x7fadbc151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.605+0000 7fadc2f0a700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadbc066b70 con 0x7fadbc151d20 2021-02-12T17:16:29.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.605+0000 7fadc2f0a700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadbc0685b0 con 0x7fadbc0b0940 2021-02-12T17:16:29.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.605+0000 7fadc2f0a700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadbc0b27d0 con 0x7fadbc0bc2b0 2021-02-12T17:16:29.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.605+0000 7fadc14a7700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fadbc151d20 0x7fadbc1584c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54070/0 (socket says 172.21.2.102:54070) 2021-02-12T17:16:29.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.605+0000 7fadc14a7700 1 -- 172.21.2.102:0/4225674597 learned_addr learned my addr 172.21.2.102:0/4225674597 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:29.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.605+0000 7fadc0ca6700 1 --2- 172.21.2.102:0/4225674597 >> v2:172.21.2.102:3300/0 conn(0x7fadbc0bc2b0 0x7fadbc151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.605+0000 7fadc0ca6700 1 -- 172.21.2.102:0/4225674597 >> v1:172.21.2.104:6789/0 conn(0x7fadbc0b0940 legacy=0x7fadbc151610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:29.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.605+0000 7fadc0ca6700 1 -- 172.21.2.102:0/4225674597 >> v1:172.21.2.102:6789/0 conn(0x7fadbc151d20 legacy=0x7fadbc1584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.606+0000 7fadc0ca6700 1 -- 172.21.2.102:0/4225674597 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc0b7110 con 0x7fadbc0bc2b0 2021-02-12T17:16:29.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.605+0000 7fadbb7fe700 1 -- 172.21.2.102:0/4225674597 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226638047 0 0) 0x7fadbc066b70 con 0x7fadbc151d20 2021-02-12T17:16:29.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.606+0000 7fadc0ca6700 1 --2- 172.21.2.102:0/4225674597 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fadbc0bc2b0 0x7fadbc151120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fada400b980 tx=0x7fada4006de0).ready entity=mon.0 client_cookie=bf534ec96f68b430 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:29.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.606+0000 7fadbb7fe700 1 -- 172.21.2.102:0/4225674597 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada4009830 con 0x7fadbc0bc2b0 2021-02-12T17:16:29.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.606+0000 7fadbb7fe700 1 -- 172.21.2.102:0/4225674597 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada4009990 con 0x7fadbc0bc2b0 2021-02-12T17:16:29.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.606+0000 7fadbb7fe700 1 -- 172.21.2.102:0/4225674597 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada4009d10 con 0x7fadbc0bc2b0 2021-02-12T17:16:29.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.606+0000 7fadc2f0a700 1 -- 172.21.2.102:0/4225674597 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fadbc0bc2b0 msgr2=0x7fadbc151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.606+0000 7fadc2f0a700 1 --2- 172.21.2.102:0/4225674597 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fadbc0bc2b0 0x7fadbc151120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fada400b980 tx=0x7fada4006de0).stop 2021-02-12T17:16:29.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.606+0000 7fadc2f0a700 1 -- 172.21.2.102:0/4225674597 shutdown_connections 2021-02-12T17:16:29.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.606+0000 7fadc2f0a700 1 --2- 172.21.2.102:0/4225674597 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fadbc0bc2b0 0x7fadbc151120 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.606+0000 7fadc2f0a700 1 -- 172.21.2.102:0/4225674597 >> 172.21.2.102:0/4225674597 conn(0x7fadbc061830 msgr2=0x7fadbc0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:29.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.606+0000 7fadc2f0a700 1 -- 172.21.2.102:0/4225674597 shutdown_connections 2021-02-12T17:16:29.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.606+0000 7fadc2f0a700 1 -- 172.21.2.102:0/4225674597 wait complete. 2021-02-12T17:16:29.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.607+0000 7fadc2f0a700 1 Processor -- start 2021-02-12T17:16:29.611 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.607+0000 7fadc2f0a700 1 -- start start 2021-02-12T17:16:29.611 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc2f0a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fadbc0b0940 0x7fadbc061df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.611 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc2f0a700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fadbc0bc2b0 0x7fadbc09dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.611 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc2f0a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fadbc151d20 0x7fadbc09c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.611 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc2f0a700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc09d310 con 0x7fadbc0b0940 2021-02-12T17:16:29.611 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc2f0a700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc15d280 con 0x7fadbc0bc2b0 2021-02-12T17:16:29.611 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc2f0a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0622e0 con 0x7fadbc151d20 2021-02-12T17:16:29.611 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc0ca6700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fadbc0b0940 0x7fadbc061df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.611 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc0ca6700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fadbc0b0940 0x7fadbc061df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45434/0 (socket says 172.21.2.102:45434) 2021-02-12T17:16:29.611 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc0ca6700 1 -- 172.21.2.102:0/2770873073 learned_addr learned my addr 172.21.2.102:0/2770873073 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:29.611 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc0ca6700 1 -- 172.21.2.102:0/2770873073 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fadbc151d20 msgr2=0x7fadbc09c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.611 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc0ca6700 1 --2- 172.21.2.102:0/2770873073 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fadbc151d20 0x7fadbc09c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc0ca6700 1 -- 172.21.2.102:0/2770873073 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fadbc0bc2b0 msgr2=0x7fadbc09dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc0ca6700 1 --2- 172.21.2.102:0/2770873073 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fadbc0bc2b0 0x7fadbc09dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc0ca6700 1 -- 172.21.2.102:0/2770873073 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc15d4e0 con 0x7fadbc0b0940 2021-02-12T17:16:29.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadc0ca6700 1 --2- 172.21.2.102:0/2770873073 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fadbc0b0940 0x7fadbc061df0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fadbc05d280 tx=0x7fada4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:29.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadb8ff9700 1 -- 172.21.2.102:0/2770873073 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada401c420 con 0x7fadbc0b0940 2021-02-12T17:16:29.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadb8ff9700 1 -- 172.21.2.102:0/2770873073 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada401c580 con 0x7fadbc0b0940 2021-02-12T17:16:29.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.608+0000 7fadb8ff9700 1 -- 172.21.2.102:0/2770873073 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada401c920 con 0x7fadbc0b0940 2021-02-12T17:16:29.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.609+0000 7fadc2f0a700 1 -- 172.21.2.102:0/2770873073 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadbc09d560 con 0x7fadbc0b0940 2021-02-12T17:16:29.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.609+0000 7fadc2f0a700 1 -- 172.21.2.102:0/2770873073 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadbc09e190 con 0x7fadbc0b0940 2021-02-12T17:16:29.613 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.609+0000 7fadc2f0a700 1 -- 172.21.2.102:0/2770873073 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadbc09d9c0 con 0x7fadbc0b0940 2021-02-12T17:16:29.613 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.609+0000 7fadb8ff9700 1 -- 172.21.2.102:0/2770873073 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fada400f070 con 0x7fadbc0b0940 2021-02-12T17:16:29.613 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.610+0000 7fadb8ff9700 1 --2- 172.21.2.102:0/2770873073 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fada0059d30 0x7fada005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.613 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.610+0000 7fadb8ff9700 1 -- 172.21.2.102:0/2770873073 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fada4075680 con 0x7fadbc0b0940 2021-02-12T17:16:29.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.610+0000 7fadbbfff700 1 --2- 172.21.2.102:0/2770873073 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fada0059d30 0x7fada005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.610+0000 7fadbbfff700 1 --2- 172.21.2.102:0/2770873073 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fada0059d30 0x7fada005c1f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fadbc157940 tx=0x7fadac0069a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:29.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.613+0000 7fadb8ff9700 1 -- 172.21.2.102:0/2770873073 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fada4048eb0 con 0x7fadbc0b0940 2021-02-12T17:16:29.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.743+0000 7fadc2f0a700 1 -- 172.21.2.102:0/2770873073 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7fadbc045460 con 0x7fadbc0b0940 2021-02-12T17:16:29.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.743+0000 7fadb8ff9700 1 -- 172.21.2.102:0/2770873073 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+10 (secure 0 0 0) 0x7fada404c4d0 con 0x7fadbc0b0940 2021-02-12T17:16:29.745 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:29.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.744+0000 7fadc2f0a700 1 -- 172.21.2.102:0/2770873073 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fada0059d30 msgr2=0x7fada005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.744+0000 7fadc2f0a700 1 --2- 172.21.2.102:0/2770873073 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fada0059d30 0x7fada005c1f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fadbc157940 tx=0x7fadac0069a0).stop 2021-02-12T17:16:29.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.744+0000 7fadc2f0a700 1 -- 172.21.2.102:0/2770873073 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fadbc0b0940 msgr2=0x7fadbc061df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.744+0000 7fadc2f0a700 1 --2- 172.21.2.102:0/2770873073 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fadbc0b0940 0x7fadbc061df0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fadbc05d280 tx=0x7fada4016000).stop 2021-02-12T17:16:29.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.744+0000 7fadc2f0a700 1 -- 172.21.2.102:0/2770873073 shutdown_connections 2021-02-12T17:16:29.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.744+0000 7fadc2f0a700 1 --2- 172.21.2.102:0/2770873073 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fadbc151d20 0x7fadbc09c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.744+0000 7fadc2f0a700 1 --2- 172.21.2.102:0/2770873073 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fada0059d30 0x7fada005c1f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.744+0000 7fadc2f0a700 1 --2- 172.21.2.102:0/2770873073 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fadbc0b0940 0x7fadbc061df0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.744+0000 7fadc2f0a700 1 --2- 172.21.2.102:0/2770873073 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fadbc0bc2b0 0x7fadbc09dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.744+0000 7fadc2f0a700 1 -- 172.21.2.102:0/2770873073 >> 172.21.2.102:0/2770873073 conn(0x7fadbc061830 msgr2=0x7fadbc0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:29.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.744+0000 7fadc2f0a700 1 -- 172.21.2.102:0/2770873073 shutdown_connections 2021-02-12T17:16:29.747 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.744+0000 7fadc2f0a700 1 -- 172.21.2.102:0/2770873073 wait complete. 2021-02-12T17:16:29.754 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2021-02-12T17:16:29.843 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.842+0000 7f73151f8700 1 Processor -- start 2021-02-12T17:16:29.843 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.842+0000 7f73151f8700 1 -- start start 2021-02-12T17:16:29.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.842+0000 7f73151f8700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f73100bc2b0 0x7f7310151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.842+0000 7f73151f8700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f73100b0940 0x7f7310151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.842+0000 7f73151f8700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7310066b70 con 0x7f731009ada0 2021-02-12T17:16:29.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.842+0000 7f73151f8700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73100b27d0 con 0x7f73100b0940 2021-02-12T17:16:29.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.842+0000 7f73151f8700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73100b7110 con 0x7f73100bc2b0 2021-02-12T17:16:29.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.843+0000 7f730e59c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f73100b0940 0x7f7310151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.843+0000 7f730f59e700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f731009ada0 0x7f731014d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54082/0 (socket says 172.21.2.102:54082) 2021-02-12T17:16:29.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.843+0000 7f730f59e700 1 -- 172.21.2.102:0/815502124 learned_addr learned my addr 172.21.2.102:0/815502124 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:29.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.843+0000 7f730dd9b700 1 -- 172.21.2.102:0/815502124 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129429175 0 0) 0x7f7310066b70 con 0x7f731009ada0 2021-02-12T17:16:29.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.843+0000 7f730dd9b700 1 -- 172.21.2.102:0/815502124 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f0003230 con 0x7f731009ada0 2021-02-12T17:16:29.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.843+0000 7f730e59c700 1 -- 172.21.2.102:0/815502124 >> v2:172.21.2.104:3300/0 conn(0x7f73100bc2b0 msgr2=0x7f7310151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:29.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.843+0000 7f730e59c700 1 --2- 172.21.2.102:0/815502124 >> v2:172.21.2.104:3300/0 conn(0x7f73100bc2b0 0x7f7310151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.843+0000 7f730e59c700 1 -- 172.21.2.102:0/815502124 >> v1:172.21.2.102:6789/0 conn(0x7f731009ada0 legacy=0x7f731014d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.843+0000 7f730e59c700 1 -- 172.21.2.102:0/815502124 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73100685b0 con 0x7f73100b0940 2021-02-12T17:16:29.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.843+0000 7f730e59c700 1 --2- 172.21.2.102:0/815502124 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73100b0940 0x7f7310151610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f73100b94d0 tx=0x7f72f8006de0).ready entity=mon.0 client_cookie=a3c8ff4332bbc78f server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:29.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.844+0000 7f730dd9b700 1 -- 172.21.2.102:0/815502124 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8009630 con 0x7f73100b0940 2021-02-12T17:16:29.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.844+0000 7f730dd9b700 1 -- 172.21.2.102:0/815502124 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8009790 con 0x7f73100b0940 2021-02-12T17:16:29.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.844+0000 7f730dd9b700 1 -- 172.21.2.102:0/815502124 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8009b10 con 0x7f73100b0940 2021-02-12T17:16:29.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.844+0000 7f73151f8700 1 -- 172.21.2.102:0/815502124 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73100b0940 msgr2=0x7f7310151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.844+0000 7f73151f8700 1 --2- 172.21.2.102:0/815502124 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73100b0940 0x7f7310151610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f73100b94d0 tx=0x7f72f8006de0).stop 2021-02-12T17:16:29.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.844+0000 7f73151f8700 1 -- 172.21.2.102:0/815502124 shutdown_connections 2021-02-12T17:16:29.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.844+0000 7f73151f8700 1 --2- 172.21.2.102:0/815502124 >> v2:172.21.2.104:3300/0 conn(0x7f73100bc2b0 0x7f7310151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:29.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.844+0000 7f73151f8700 1 --2- 172.21.2.102:0/815502124 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73100b0940 0x7f7310151610 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.844+0000 7f73151f8700 1 -- 172.21.2.102:0/815502124 >> 172.21.2.102:0/815502124 conn(0x7f7310061830 msgr2=0x7f73100bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:29.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.844+0000 7f73151f8700 1 -- 172.21.2.102:0/815502124 shutdown_connections 2021-02-12T17:16:29.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.844+0000 7f73151f8700 1 -- 172.21.2.102:0/815502124 wait complete. 2021-02-12T17:16:29.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.845+0000 7f73151f8700 1 Processor -- start 2021-02-12T17:16:29.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.845+0000 7f73151f8700 1 -- start start 2021-02-12T17:16:29.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.845+0000 7f73151f8700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f731009ada0 0x7f731009eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.845+0000 7f73151f8700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73100b0940 0x7f7310149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.845+0000 7f73151f8700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f73100bc2b0 0x7f7310149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.845+0000 7f73151f8700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73100a0d40 con 0x7f731009ada0 2021-02-12T17:16:29.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.845+0000 7f73151f8700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73100a0fe0 con 0x7f73100b0940 2021-02-12T17:16:29.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.845+0000 7f73151f8700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73100a1280 con 0x7f73100bc2b0 2021-02-12T17:16:29.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f730ed9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f731009ada0 0x7f731009eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f730ed9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f731009ada0 0x7f731009eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45444/0 (socket says 172.21.2.102:45444) 2021-02-12T17:16:29.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f730ed9d700 1 -- 172.21.2.102:0/714864559 learned_addr learned my addr 172.21.2.102:0/714864559 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:29.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f730e59c700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73100b0940 0x7f7310149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f730f59e700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f73100bc2b0 0x7f7310149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f730ed9d700 1 -- 172.21.2.102:0/714864559 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f73100bc2b0 msgr2=0x7f7310149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f730ed9d700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f73100bc2b0 0x7f7310149d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f730ed9d700 1 -- 172.21.2.102:0/714864559 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73100b0940 msgr2=0x7f7310149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f730ed9d700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73100b0940 0x7f7310149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f730ed9d700 1 -- 172.21.2.102:0/714864559 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73100a1520 con 0x7f731009ada0 2021-02-12T17:16:29.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f730f59e700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f73100bc2b0 0x7f7310149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:29.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f730ed9d700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f731009ada0 0x7f731009eb30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f7300009790 tx=0x7f7300006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:29.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f7306ffd700 1 -- 172.21.2.102:0/714864559 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730000d520 con 0x7f731009ada0 2021-02-12T17:16:29.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f7306ffd700 1 -- 172.21.2.102:0/714864559 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7300000e90 con 0x7f731009ada0 2021-02-12T17:16:29.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f73151f8700 1 -- 172.21.2.102:0/714864559 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7310061ea0 con 0x7f731009ada0 2021-02-12T17:16:29.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f7306ffd700 1 -- 172.21.2.102:0/714864559 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730000d8d0 con 0x7f731009ada0 2021-02-12T17:16:29.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.846+0000 7f73151f8700 1 -- 172.21.2.102:0/714864559 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731009f020 con 0x7f731009ada0 2021-02-12T17:16:29.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.847+0000 7f73151f8700 1 -- 172.21.2.102:0/714864559 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7310045460 con 0x7f731009ada0 2021-02-12T17:16:29.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.847+0000 7f7306ffd700 1 -- 172.21.2.102:0/714864559 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f730000dc40 con 0x7f731009ada0 2021-02-12T17:16:29.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.848+0000 7f7306ffd700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f72f4059d30 0x7f72f405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:29.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.848+0000 7f7306ffd700 1 -- 172.21.2.102:0/714864559 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f7300073c60 con 0x7f731009ada0 2021-02-12T17:16:29.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.848+0000 7f730e59c700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f72f4059d30 0x7f72f405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:29.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.848+0000 7f730e59c700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f72f4059d30 0x7f72f405c1f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f73100b0d40 tx=0x7f72f8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:29.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.850+0000 7f7306ffd700 1 -- 172.21.2.102:0/714864559 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f7300047380 con 0x7f731009ada0 2021-02-12T17:16:29.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.977+0000 7f73151f8700 1 -- 172.21.2.102:0/714864559 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73100b7650 con 0x7f731009ada0 2021-02-12T17:16:29.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.977+0000 7f7306ffd700 1 -- 172.21.2.102:0/714864559 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+10 (secure 0 0 0) 0x7f730004a9a0 con 0x7f731009ada0 2021-02-12T17:16:29.979 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:29.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.978+0000 7f73151f8700 1 -- 172.21.2.102:0/714864559 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f72f4059d30 msgr2=0x7f72f405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.978+0000 7f73151f8700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f72f4059d30 0x7f72f405c1f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f73100b0d40 tx=0x7f72f8016000).stop 2021-02-12T17:16:29.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.978+0000 7f73151f8700 1 -- 172.21.2.102:0/714864559 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f731009ada0 msgr2=0x7f731009eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:29.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.978+0000 7f73151f8700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f731009ada0 0x7f731009eb30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f7300009790 tx=0x7f7300006eb0).stop 2021-02-12T17:16:29.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.978+0000 7f73151f8700 1 -- 172.21.2.102:0/714864559 shutdown_connections 2021-02-12T17:16:29.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.978+0000 7f73151f8700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f73100bc2b0 0x7f7310149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.978+0000 7f73151f8700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f72f4059d30 0x7f72f405c1f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.978+0000 7f73151f8700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f731009ada0 0x7f731009eb30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.978+0000 7f73151f8700 1 --2- 172.21.2.102:0/714864559 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73100b0940 0x7f7310149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:29.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.978+0000 7f73151f8700 1 -- 172.21.2.102:0/714864559 >> 172.21.2.102:0/714864559 conn(0x7f7310061830 msgr2=0x7f73100b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:29.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.978+0000 7f73151f8700 1 -- 172.21.2.102:0/714864559 shutdown_connections 2021-02-12T17:16:29.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:29.978+0000 7f73151f8700 1 -- 172.21.2.102:0/714864559 wait complete. 2021-02-12T17:16:29.989 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2021-02-12T17:16:30.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.078+0000 7fbe978c6700 1 Processor -- start 2021-02-12T17:16:30.080 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.078+0000 7fbe978c6700 1 -- start start 2021-02-12T17:16:30.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe978c6700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fbe900bc2b0 0x7fbe90151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe978c6700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fbe900b0940 0x7fbe90151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe978c6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbe9009ada0 0x7fbe90151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe978c6700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe90151ff0 con 0x7fbe900bc2b0 2021-02-12T17:16:30.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe978c6700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe900b27d0 con 0x7fbe900b0940 2021-02-12T17:16:30.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe978c6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90066b70 con 0x7fbe9009ada0 2021-02-12T17:16:30.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe95662700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fbe900bc2b0 0x7fbe90151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe95662700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fbe900bc2b0 0x7fbe90151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45454/0 (socket says 172.21.2.102:45454) 2021-02-12T17:16:30.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe95662700 1 -- 172.21.2.102:0/3103583555 learned_addr learned my addr 172.21.2.102:0/3103583555 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:30.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe95e63700 1 --2- 172.21.2.102:0/3103583555 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbe9009ada0 0x7fbe90151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe95662700 1 -- 172.21.2.102:0/3103583555 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbe9009ada0 msgr2=0x7fbe90151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:30.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe95662700 1 --2- 172.21.2.102:0/3103583555 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbe9009ada0 0x7fbe90151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe94e61700 1 --2- 172.21.2.102:0/3103583555 >> v2:172.21.2.104:3300/0 conn(0x7fbe900b0940 0x7fbe90151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe95662700 1 -- 172.21.2.102:0/3103583555 >> v2:172.21.2.104:3300/0 conn(0x7fbe900b0940 msgr2=0x7fbe90151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:30.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe95662700 1 --2- 172.21.2.102:0/3103583555 >> v2:172.21.2.104:3300/0 conn(0x7fbe900b0940 0x7fbe90151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe95662700 1 -- 172.21.2.102:0/3103583555 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe900685b0 con 0x7fbe900bc2b0 2021-02-12T17:16:30.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe94e61700 1 --2- 172.21.2.102:0/3103583555 >> v2:172.21.2.104:3300/0 conn(0x7fbe900b0940 0x7fbe90151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:30.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.079+0000 7fbe95662700 1 --2- 172.21.2.102:0/3103583555 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbe900bc2b0 0x7fbe90151120 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fbe900b6280 tx=0x7fbe8c006ea0).ready entity=mon.0 client_cookie=bb6050d67337eee5 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:30.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.080+0000 7fbe7ffff700 1 -- 172.21.2.102:0/3103583555 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0098d0 con 0x7fbe900bc2b0 2021-02-12T17:16:30.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.080+0000 7fbe7ffff700 1 -- 172.21.2.102:0/3103583555 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c009a30 con 0x7fbe900bc2b0 2021-02-12T17:16:30.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.080+0000 7fbe7ffff700 1 -- 172.21.2.102:0/3103583555 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c009db0 con 0x7fbe900bc2b0 2021-02-12T17:16:30.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.080+0000 7fbe978c6700 1 -- 172.21.2.102:0/3103583555 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbe900bc2b0 msgr2=0x7fbe90151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.080+0000 7fbe978c6700 1 --2- 172.21.2.102:0/3103583555 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbe900bc2b0 0x7fbe90151120 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fbe900b6280 tx=0x7fbe8c006ea0).stop 2021-02-12T17:16:30.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.080+0000 7fbe978c6700 1 -- 172.21.2.102:0/3103583555 shutdown_connections 2021-02-12T17:16:30.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.080+0000 7fbe978c6700 1 --2- 172.21.2.102:0/3103583555 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbe9009ada0 0x7fbe90151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.080+0000 7fbe978c6700 1 --2- 172.21.2.102:0/3103583555 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbe900bc2b0 0x7fbe90151120 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.080+0000 7fbe978c6700 1 --2- 172.21.2.102:0/3103583555 >> v2:172.21.2.104:3300/0 conn(0x7fbe900b0940 0x7fbe90151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.080+0000 7fbe978c6700 1 -- 172.21.2.102:0/3103583555 >> 172.21.2.102:0/3103583555 conn(0x7fbe90061830 msgr2=0x7fbe900bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:30.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.080+0000 7fbe978c6700 1 -- 172.21.2.102:0/3103583555 shutdown_connections 2021-02-12T17:16:30.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.080+0000 7fbe978c6700 1 -- 172.21.2.102:0/3103583555 wait complete. 2021-02-12T17:16:30.085 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.081+0000 7fbe978c6700 1 Processor -- start 2021-02-12T17:16:30.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.081+0000 7fbe978c6700 1 -- start start 2021-02-12T17:16:30.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe978c6700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbe9009ada0 0x7fbe9009ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe978c6700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbe900b0940 0x7fbe900a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe978c6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbe900bc2b0 0x7fbe900a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe978c6700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe900b3e90 con 0x7fbe900b0940 2021-02-12T17:16:30.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe978c6700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9015df80 con 0x7fbe9009ada0 2021-02-12T17:16:30.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe978c6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9015e220 con 0x7fbe900bc2b0 2021-02-12T17:16:30.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe94e61700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbe900b0940 0x7fbe900a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe94e61700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbe900b0940 0x7fbe900a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45458/0 (socket says 172.21.2.102:45458) 2021-02-12T17:16:30.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe94e61700 1 -- 172.21.2.102:0/2078158071 learned_addr learned my addr 172.21.2.102:0/2078158071 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:30.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe94e61700 1 -- 172.21.2.102:0/2078158071 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbe900bc2b0 msgr2=0x7fbe900a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe95662700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbe9009ada0 0x7fbe9009ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe95e63700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbe900bc2b0 0x7fbe900a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe94e61700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbe900bc2b0 0x7fbe900a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe94e61700 1 -- 172.21.2.102:0/2078158071 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbe9009ada0 msgr2=0x7fbe9009ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe94e61700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbe9009ada0 0x7fbe9009ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe94e61700 1 -- 172.21.2.102:0/2078158071 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe900b40c0 con 0x7fbe900b0940 2021-02-12T17:16:30.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe95662700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbe9009ada0 0x7fbe9009ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:30.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe95e63700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbe900bc2b0 0x7fbe900a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:30.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.082+0000 7fbe94e61700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbe900b0940 0x7fbe900a0410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fbe8000cb50 tx=0x7fbe80008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:30.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.083+0000 7fbe7d7fa700 1 -- 172.21.2.102:0/2078158071 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe800077d0 con 0x7fbe900b0940 2021-02-12T17:16:30.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.083+0000 7fbe7d7fa700 1 -- 172.21.2.102:0/2078158071 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe80007930 con 0x7fbe900b0940 2021-02-12T17:16:30.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.083+0000 7fbe7d7fa700 1 -- 172.21.2.102:0/2078158071 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80007cb0 con 0x7fbe900b0940 2021-02-12T17:16:30.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.083+0000 7fbe978c6700 1 -- 172.21.2.102:0/2078158071 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe900b4360 con 0x7fbe900b0940 2021-02-12T17:16:30.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.083+0000 7fbe978c6700 1 -- 172.21.2.102:0/2078158071 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe900b3280 con 0x7fbe900b0940 2021-02-12T17:16:30.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.084+0000 7fbe978c6700 1 -- 172.21.2.102:0/2078158071 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe900b44f0 con 0x7fbe900b0940 2021-02-12T17:16:30.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.084+0000 7fbe7d7fa700 1 -- 172.21.2.102:0/2078158071 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fbe80011620 con 0x7fbe900b0940 2021-02-12T17:16:30.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.084+0000 7fbe7d7fa700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbe70059d80 0x7fbe7005c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.084+0000 7fbe7d7fa700 1 -- 172.21.2.102:0/2078158071 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fbe80073f90 con 0x7fbe900b0940 2021-02-12T17:16:30.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.084+0000 7fbe95662700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbe70059d80 0x7fbe7005c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.085+0000 7fbe95662700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbe70059d80 0x7fbe7005c240 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fbe8c007fd0 tx=0x7fbe8c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:30.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.087+0000 7fbe7d7fa700 1 -- 172.21.2.102:0/2078158071 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fbe80047730 con 0x7fbe900b0940 2021-02-12T17:16:30.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.214+0000 7fbe978c6700 1 -- 172.21.2.102:0/2078158071 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7fbe90045460 con 0x7fbe900b0940 2021-02-12T17:16:30.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.215+0000 7fbe7d7fa700 1 -- 172.21.2.102:0/2078158071 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+10 (secure 0 0 0) 0x7fbe8004ad50 con 0x7fbe900b0940 2021-02-12T17:16:30.216 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:30.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.216+0000 7fbe978c6700 1 -- 172.21.2.102:0/2078158071 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbe70059d80 msgr2=0x7fbe7005c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.216+0000 7fbe978c6700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbe70059d80 0x7fbe7005c240 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fbe8c007fd0 tx=0x7fbe8c016000).stop 2021-02-12T17:16:30.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.216+0000 7fbe978c6700 1 -- 172.21.2.102:0/2078158071 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbe900b0940 msgr2=0x7fbe900a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.216+0000 7fbe978c6700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbe900b0940 0x7fbe900a0410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fbe8000cb50 tx=0x7fbe80008040).stop 2021-02-12T17:16:30.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.216+0000 7fbe978c6700 1 -- 172.21.2.102:0/2078158071 shutdown_connections 2021-02-12T17:16:30.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.216+0000 7fbe978c6700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbe900bc2b0 0x7fbe900a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.216+0000 7fbe978c6700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbe9009ada0 0x7fbe9009ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.216+0000 7fbe978c6700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbe70059d80 0x7fbe7005c240 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.216+0000 7fbe978c6700 1 --2- 172.21.2.102:0/2078158071 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbe900b0940 0x7fbe900a0410 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.216+0000 7fbe978c6700 1 -- 172.21.2.102:0/2078158071 >> 172.21.2.102:0/2078158071 conn(0x7fbe90061830 msgr2=0x7fbe90063e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:30.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.216+0000 7fbe978c6700 1 -- 172.21.2.102:0/2078158071 shutdown_connections 2021-02-12T17:16:30.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.216+0000 7fbe978c6700 1 -- 172.21.2.102:0/2078158071 wait complete. 2021-02-12T17:16:30.226 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2021-02-12T17:16:30.226 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:16:30.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.312+0000 7fde44749700 1 Processor -- start 2021-02-12T17:16:30.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.312+0000 7fde44749700 1 -- start start 2021-02-12T17:16:30.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde44749700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fde3c14e530 0x7fde3c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde44749700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fde3c062740 0x7fde3c062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde44749700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3c0b7960 con 0x7fde3c0b8d20 2021-02-12T17:16:30.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde44749700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3c068d20 con 0x7fde3c062740 2021-02-12T17:16:30.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde44749700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0622a0 con 0x7fde3c14e530 2021-02-12T17:16:30.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde424e5700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fde3c0b8d20 0x7fde3c0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54110/0 (socket says 172.21.2.102:54110) 2021-02-12T17:16:30.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde424e5700 1 -- 172.21.2.102:0/837791464 learned_addr learned my addr 172.21.2.102:0/837791464 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:30.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde414e3700 1 -- 172.21.2.102:0/837791464 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675661676 0 0) 0x7fde3c0b7960 con 0x7fde3c0b8d20 2021-02-12T17:16:30.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde414e3700 1 -- 172.21.2.102:0/837791464 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde24003230 con 0x7fde3c0b8d20 2021-02-12T17:16:30.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde42ce6700 1 --2- 172.21.2.102:0/837791464 >> v2:172.21.2.104:3300/0 conn(0x7fde3c062740 0x7fde3c062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde41ce4700 1 --2- 172.21.2.102:0/837791464 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fde3c14e530 0x7fde3c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde414e3700 1 -- 172.21.2.102:0/837791464 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4137871172 0 0) 0x7fde24003230 con 0x7fde3c0b8d20 2021-02-12T17:16:30.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde414e3700 1 -- 172.21.2.102:0/837791464 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fde3c14e530 msgr2=0x7fde3c068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:30.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde414e3700 1 --2- 172.21.2.102:0/837791464 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fde3c14e530 0x7fde3c068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde414e3700 1 -- 172.21.2.102:0/837791464 >> v2:172.21.2.104:3300/0 conn(0x7fde3c062740 msgr2=0x7fde3c062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:30.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde414e3700 1 --2- 172.21.2.102:0/837791464 >> v2:172.21.2.104:3300/0 conn(0x7fde3c062740 0x7fde3c062bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde414e3700 1 -- 172.21.2.102:0/837791464 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c14ea10 con 0x7fde3c0b8d20 2021-02-12T17:16:30.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde414e3700 1 -- 172.21.2.102:0/837791464 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fde380014e0 con 0x7fde3c0b8d20 2021-02-12T17:16:30.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.313+0000 7fde414e3700 1 -- 172.21.2.102:0/837791464 >> v1:172.21.2.102:6789/0 conn(0x7fde3c0b8d20 legacy=0x7fde3c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde414e3700 1 --2- 172.21.2.102:0/837791464 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fde240037a0 0x7fde24003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde414e3700 1 --2- 172.21.2.102:0/837791464 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fde240044d0 0x7fde24004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde414e3700 1 --2- 172.21.2.102:0/837791464 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fde3c14e530 0x7fde24004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde414e3700 1 -- 172.21.2.102:0/837791464 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c068d20 con 0x7fde240037a0 2021-02-12T17:16:30.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde414e3700 1 -- 172.21.2.102:0/837791464 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0622a0 con 0x7fde240044d0 2021-02-12T17:16:30.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde414e3700 1 -- 172.21.2.102:0/837791464 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde24005330 con 0x7fde3c14e530 2021-02-12T17:16:30.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde424e5700 1 --2- 172.21.2.102:0/837791464 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fde240037a0 0x7fde24003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde41ce4700 1 --2- 172.21.2.102:0/837791464 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fde240044d0 0x7fde24004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde424e5700 1 -- 172.21.2.102:0/837791464 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fde3c14e530 msgr2=0x7fde24004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:30.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde424e5700 1 --2- 172.21.2.102:0/837791464 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fde3c14e530 0x7fde24004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:30.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde424e5700 1 -- 172.21.2.102:0/837791464 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fde240044d0 msgr2=0x7fde24004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:30.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde424e5700 1 --2- 172.21.2.102:0/837791464 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fde240044d0 0x7fde24004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde424e5700 1 -- 172.21.2.102:0/837791464 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde24003230 con 0x7fde240037a0 2021-02-12T17:16:30.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde41ce4700 1 --2- 172.21.2.102:0/837791464 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fde240044d0 0x7fde24004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:30.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde424e5700 1 --2- 172.21.2.102:0/837791464 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fde240037a0 0x7fde24003bc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fde3800c210 tx=0x7fde3c14eba0).ready entity=mon.0 client_cookie=4b031a274548d7d0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:30.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde414e3700 1 -- 172.21.2.102:0/837791464 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde380076e0 con 0x7fde240037a0 2021-02-12T17:16:30.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde414e3700 1 -- 172.21.2.102:0/837791464 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde380070d0 con 0x7fde240037a0 2021-02-12T17:16:30.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.314+0000 7fde414e3700 1 -- 172.21.2.102:0/837791464 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde38007470 con 0x7fde240037a0 2021-02-12T17:16:30.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.315+0000 7fde44749700 1 -- 172.21.2.102:0/837791464 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fde240037a0 msgr2=0x7fde24003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.315+0000 7fde44749700 1 --2- 172.21.2.102:0/837791464 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fde240037a0 0x7fde24003bc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fde3800c210 tx=0x7fde3c14eba0).stop 2021-02-12T17:16:30.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.315+0000 7fde42ce6700 1 -- 172.21.2.102:0/837791464 reap_dead start 2021-02-12T17:16:30.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.315+0000 7fde44749700 1 -- 172.21.2.102:0/837791464 shutdown_connections 2021-02-12T17:16:30.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.315+0000 7fde44749700 1 -- 172.21.2.102:0/837791464 >> 172.21.2.102:0/837791464 conn(0x7fde3c0bc480 msgr2=0x7fde3c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:30.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.315+0000 7fde44749700 1 -- 172.21.2.102:0/837791464 shutdown_connections 2021-02-12T17:16:30.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.315+0000 7fde44749700 1 -- 172.21.2.102:0/837791464 wait complete. 2021-02-12T17:16:30.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.316+0000 7fde44749700 1 Processor -- start 2021-02-12T17:16:30.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.316+0000 7fde44749700 1 -- start start 2021-02-12T17:16:30.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.316+0000 7fde44749700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fde240037a0 0x7fde3c14dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.316+0000 7fde44749700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fde3c1538a0 0x7fde3c14aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.316+0000 7fde44749700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fde3c14af50 0x7fde3c0b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.316+0000 7fde44749700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c152140 con 0x7fde3c1538a0 2021-02-12T17:16:30.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.316+0000 7fde44749700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c152370 con 0x7fde240037a0 2021-02-12T17:16:30.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.316+0000 7fde44749700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c152610 con 0x7fde3c14af50 2021-02-12T17:16:30.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.316+0000 7fde41ce4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fde3c1538a0 0x7fde3c14aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.316+0000 7fde424e5700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fde240037a0 0x7fde3c14dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.316+0000 7fde41ce4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fde3c1538a0 0x7fde3c14aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45478/0 (socket says 172.21.2.102:45478) 2021-02-12T17:16:30.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.316+0000 7fde41ce4700 1 -- 172.21.2.102:0/1238578247 learned_addr learned my addr 172.21.2.102:0/1238578247 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:30.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.316+0000 7fde42ce6700 1 --2- 172.21.2.102:0/1238578247 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fde3c14af50 0x7fde3c0b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.317+0000 7fde41ce4700 1 -- 172.21.2.102:0/1238578247 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fde3c14af50 msgr2=0x7fde3c0b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.317+0000 7fde41ce4700 1 --2- 172.21.2.102:0/1238578247 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fde3c14af50 0x7fde3c0b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.317+0000 7fde41ce4700 1 -- 172.21.2.102:0/1238578247 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fde240037a0 msgr2=0x7fde3c14dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.317+0000 7fde41ce4700 1 --2- 172.21.2.102:0/1238578247 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fde240037a0 0x7fde3c14dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.317+0000 7fde41ce4700 1 -- 172.21.2.102:0/1238578247 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c1528b0 con 0x7fde3c1538a0 2021-02-12T17:16:30.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.317+0000 7fde41ce4700 1 --2- 172.21.2.102:0/1238578247 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fde3c1538a0 0x7fde3c14aa60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fde2c00e870 tx=0x7fde2c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:30.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.317+0000 7fde2a7fc700 1 -- 172.21.2.102:0/1238578247 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c013430 con 0x7fde3c1538a0 2021-02-12T17:16:30.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.317+0000 7fde2a7fc700 1 -- 172.21.2.102:0/1238578247 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2c013590 con 0x7fde3c1538a0 2021-02-12T17:16:30.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.317+0000 7fde44749700 1 -- 172.21.2.102:0/1238578247 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3c152b50 con 0x7fde3c1538a0 2021-02-12T17:16:30.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.317+0000 7fde44749700 1 -- 172.21.2.102:0/1238578247 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3c14e1e0 con 0x7fde3c1538a0 2021-02-12T17:16:30.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.317+0000 7fde2a7fc700 1 -- 172.21.2.102:0/1238578247 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c013910 con 0x7fde3c1538a0 2021-02-12T17:16:30.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.318+0000 7fde44749700 1 -- 172.21.2.102:0/1238578247 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3c064560 con 0x7fde3c1538a0 2021-02-12T17:16:30.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.318+0000 7fde2a7fc700 1 -- 172.21.2.102:0/1238578247 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fde2c013c80 con 0x7fde3c1538a0 2021-02-12T17:16:30.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.318+0000 7fde2a7fc700 1 --2- 172.21.2.102:0/1238578247 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fde1c059d80 0x7fde1c05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.318+0000 7fde2a7fc700 1 -- 172.21.2.102:0/1238578247 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fde2c073be0 con 0x7fde3c1538a0 2021-02-12T17:16:30.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.318+0000 7fde424e5700 1 --2- 172.21.2.102:0/1238578247 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fde1c059d80 0x7fde1c05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.319+0000 7fde424e5700 1 --2- 172.21.2.102:0/1238578247 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fde1c059d80 0x7fde1c05c240 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fde3800ccf0 tx=0x7fde38015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:30.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.321+0000 7fde2a7fc700 1 -- 172.21.2.102:0/1238578247 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fde2c047380 con 0x7fde3c1538a0 2021-02-12T17:16:30.483 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.481+0000 7fde44749700 1 -- 172.21.2.102:0/1238578247 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde3c045460 con 0x7fde3c1538a0 2021-02-12T17:16:30.483 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.482+0000 7fde2a7fc700 1 -- 172.21.2.102:0/1238578247 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7fde2c04a9a0 con 0x7fde3c1538a0 2021-02-12T17:16:30.484 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:30.484 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:16:30.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.483+0000 7fde44749700 1 -- 172.21.2.102:0/1238578247 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fde1c059d80 msgr2=0x7fde1c05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.483+0000 7fde44749700 1 --2- 172.21.2.102:0/1238578247 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fde1c059d80 0x7fde1c05c240 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fde3800ccf0 tx=0x7fde38015000).stop 2021-02-12T17:16:30.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.483+0000 7fde44749700 1 -- 172.21.2.102:0/1238578247 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fde3c1538a0 msgr2=0x7fde3c14aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.483+0000 7fde44749700 1 --2- 172.21.2.102:0/1238578247 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fde3c1538a0 0x7fde3c14aa60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fde2c00e870 tx=0x7fde2c008040).stop 2021-02-12T17:16:30.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.483+0000 7fde44749700 1 -- 172.21.2.102:0/1238578247 shutdown_connections 2021-02-12T17:16:30.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.483+0000 7fde44749700 1 --2- 172.21.2.102:0/1238578247 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fde3c14af50 0x7fde3c0b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.483+0000 7fde44749700 1 --2- 172.21.2.102:0/1238578247 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fde240037a0 0x7fde3c14dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.483+0000 7fde44749700 1 --2- 172.21.2.102:0/1238578247 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fde1c059d80 0x7fde1c05c240 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.483+0000 7fde44749700 1 --2- 172.21.2.102:0/1238578247 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fde3c1538a0 0x7fde3c14aa60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.483+0000 7fde44749700 1 -- 172.21.2.102:0/1238578247 >> 172.21.2.102:0/1238578247 conn(0x7fde3c0bc480 msgr2=0x7fde3c0b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:30.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.484+0000 7fde44749700 1 -- 172.21.2.102:0/1238578247 shutdown_connections 2021-02-12T17:16:30.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.484+0000 7fde44749700 1 -- 172.21.2.102:0/1238578247 wait complete. 2021-02-12T17:16:30.486 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:16:30.493 INFO:tasks.mds_thrash:Ready to start thrashing 2021-02-12T17:16:30.494 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2021-02-12T17:16:30.494 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-02-12T17:16:30.582 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.580+0000 7f3da0a9f700 1 Processor -- start 2021-02-12T17:16:30.582 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.581+0000 7f3da0a9f700 1 -- start start 2021-02-12T17:16:30.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.581+0000 7f3da0a9f700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f3d9c0b8d20 0x7f3d9c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.581+0000 7f3da0a9f700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3d9c14e530 0x7f3d9c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.581+0000 7f3da0a9f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d9c062740 0x7f3d9c062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.581+0000 7f3da0a9f700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9c068d20 con 0x7f3d9c14e530 2021-02-12T17:16:30.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.581+0000 7f3da0a9f700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9c0622a0 con 0x7f3d9c0b8d20 2021-02-12T17:16:30.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.581+0000 7f3da0a9f700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c14ea10 con 0x7f3d9c062740 2021-02-12T17:16:30.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.581+0000 7f3d99d9b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3d9c14e530 0x7f3d9c0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.581+0000 7f3d99d9b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3d9c14e530 0x7f3d9c0b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45490/0 (socket says 172.21.2.102:45490) 2021-02-12T17:16:30.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.581+0000 7f3d99d9b700 1 -- 172.21.2.102:0/2711134845 learned_addr learned my addr 172.21.2.102:0/2711134845 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:30.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3d99d9b700 1 -- 172.21.2.102:0/2711134845 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d9c062740 msgr2=0x7f3d9c062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:30.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3d99d9b700 1 --2- 172.21.2.102:0/2711134845 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d9c062740 0x7f3d9c062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:30.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3d99d9b700 1 -- 172.21.2.102:0/2711134845 >> v2:172.21.2.104:3300/0 conn(0x7f3d9c0b8d20 msgr2=0x7f3d9c068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:30.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3d99d9b700 1 --2- 172.21.2.102:0/2711134845 >> v2:172.21.2.104:3300/0 conn(0x7f3d9c0b8d20 0x7f3d9c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:30.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3d99d9b700 1 -- 172.21.2.102:0/2711134845 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c0b63f0 con 0x7f3d9c14e530 2021-02-12T17:16:30.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3d99d9b700 1 --2- 172.21.2.102:0/2711134845 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3d9c14e530 0x7f3d9c0b7250 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f3d9c06abc0 tx=0x7f3d84006ea0).ready entity=mon.0 client_cookie=df8ffb784d50d024 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:30.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3d9959a700 1 -- 172.21.2.102:0/2711134845 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84009840 con 0x7f3d9c14e530 2021-02-12T17:16:30.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3d9959a700 1 -- 172.21.2.102:0/2711134845 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d840099a0 con 0x7f3d9c14e530 2021-02-12T17:16:30.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3d9959a700 1 -- 172.21.2.102:0/2711134845 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84009d20 con 0x7f3d9c14e530 2021-02-12T17:16:30.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3da0a9f700 1 -- 172.21.2.102:0/2711134845 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3d9c14e530 msgr2=0x7f3d9c0b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3da0a9f700 1 --2- 172.21.2.102:0/2711134845 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3d9c14e530 0x7f3d9c0b7250 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f3d9c06abc0 tx=0x7f3d84006ea0).stop 2021-02-12T17:16:30.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3da0a9f700 1 -- 172.21.2.102:0/2711134845 shutdown_connections 2021-02-12T17:16:30.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3da0a9f700 1 --2- 172.21.2.102:0/2711134845 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d9c062740 0x7f3d9c062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:30.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3da0a9f700 1 --2- 172.21.2.102:0/2711134845 >> v2:172.21.2.104:3300/0 conn(0x7f3d9c0b8d20 0x7f3d9c068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:30.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3da0a9f700 1 --2- 172.21.2.102:0/2711134845 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3d9c14e530 0x7f3d9c0b7250 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3da0a9f700 1 -- 172.21.2.102:0/2711134845 >> 172.21.2.102:0/2711134845 conn(0x7f3d9c0bc480 msgr2=0x7f3d9c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:30.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3da0a9f700 1 -- 172.21.2.102:0/2711134845 shutdown_connections 2021-02-12T17:16:30.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.582+0000 7f3da0a9f700 1 -- 172.21.2.102:0/2711134845 wait complete. 2021-02-12T17:16:30.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.583+0000 7f3da0a9f700 1 Processor -- start 2021-02-12T17:16:30.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.583+0000 7f3da0a9f700 1 -- start start 2021-02-12T17:16:30.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3da0a9f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d9c062740 0x7f3d9c0b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3da0a9f700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3d9c0b8d20 0x7f3d9c0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3da0a9f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3d9c14e530 0x7f3d9c0af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3da0a9f700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c14b5d0 con 0x7f3d9c14e530 2021-02-12T17:16:30.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3da0a9f700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c0b9a30 con 0x7f3d9c0b8d20 2021-02-12T17:16:30.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3da0a9f700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c0b9cd0 con 0x7f3d9c062740 2021-02-12T17:16:30.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3d9ad9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3d9c14e530 0x7f3d9c0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3d9ad9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3d9c14e530 0x7f3d9c0af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45496/0 (socket says 172.21.2.102:45496) 2021-02-12T17:16:30.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3d9ad9d700 1 -- 172.21.2.102:0/1056415840 learned_addr learned my addr 172.21.2.102:0/1056415840 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:30.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3d9ad9d700 1 -- 172.21.2.102:0/1056415840 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d9c062740 msgr2=0x7f3d9c0b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3d9ad9d700 1 --2- 172.21.2.102:0/1056415840 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d9c062740 0x7f3d9c0b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:30.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3d9ad9d700 1 -- 172.21.2.102:0/1056415840 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3d9c0b8d20 msgr2=0x7f3d9c0ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3d99d9b700 1 --2- 172.21.2.102:0/1056415840 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3d9c0b8d20 0x7f3d9c0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3d9ad9d700 1 --2- 172.21.2.102:0/1056415840 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3d9c0b8d20 0x7f3d9c0ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3d9ad9d700 1 -- 172.21.2.102:0/1056415840 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c0b9f70 con 0x7f3d9c14e530 2021-02-12T17:16:30.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3d99d9b700 1 --2- 172.21.2.102:0/1056415840 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3d9c0b8d20 0x7f3d9c0ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:30.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3d9ad9d700 1 --2- 172.21.2.102:0/1056415840 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3d9c14e530 0x7f3d9c0af390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f3d9400bae0 tx=0x7f3d94009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:30.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3d927fc700 1 -- 172.21.2.102:0/1056415840 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9400c8d0 con 0x7f3d9c14e530 2021-02-12T17:16:30.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3d927fc700 1 -- 172.21.2.102:0/1056415840 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9400ca30 con 0x7f3d9c14e530 2021-02-12T17:16:30.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3da0a9f700 1 -- 172.21.2.102:0/1056415840 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9c0ba210 con 0x7f3d9c14e530 2021-02-12T17:16:30.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3d927fc700 1 -- 172.21.2.102:0/1056415840 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9400cbe0 con 0x7f3d9c14e530 2021-02-12T17:16:30.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.584+0000 7f3da0a9f700 1 -- 172.21.2.102:0/1056415840 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9c0adbc0 con 0x7f3d9c14e530 2021-02-12T17:16:30.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.585+0000 7f3da0a9f700 1 -- 172.21.2.102:0/1056415840 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d9c045460 con 0x7f3d9c14e530 2021-02-12T17:16:30.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.585+0000 7f3d927fc700 1 -- 172.21.2.102:0/1056415840 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f3d9401c070 con 0x7f3d9c14e530 2021-02-12T17:16:30.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.586+0000 7f3d927fc700 1 --2- 172.21.2.102:0/1056415840 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3d80059d30 0x7f3d8005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.586+0000 7f3d927fc700 1 -- 172.21.2.102:0/1056415840 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f3d94073570 con 0x7f3d9c14e530 2021-02-12T17:16:30.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.586+0000 7f3d9a59c700 1 --2- 172.21.2.102:0/1056415840 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3d80059d30 0x7f3d8005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.586+0000 7f3d9a59c700 1 --2- 172.21.2.102:0/1056415840 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3d80059d30 0x7f3d8005c1f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3d8c0094c0 tx=0x7f3d8c0069f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:30.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.588+0000 7f3d927fc700 1 -- 172.21.2.102:0/1056415840 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f3d94046c90 con 0x7f3d9c14e530 2021-02-12T17:16:30.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.714+0000 7f3da0a9f700 1 -- 172.21.2.102:0/1056415840 --> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d9c151f40 con 0x7f3d80059d30 2021-02-12T17:16:30.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.717+0000 7f3d927fc700 1 -- 172.21.2.102:0/1056415840 <== mgr.4107 v2:172.21.2.102:6832/37352 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+120181 (secure 0 0 0) 0x7f3d9c151f40 con 0x7f3d80059d30 2021-02-12T17:16:30.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.718+0000 7f3da0a9f700 1 -- 172.21.2.102:0/1056415840 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3d80059d30 msgr2=0x7f3d8005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.718+0000 7f3da0a9f700 1 --2- 172.21.2.102:0/1056415840 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3d80059d30 0x7f3d8005c1f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3d8c0094c0 tx=0x7f3d8c0069f0).stop 2021-02-12T17:16:30.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.718+0000 7f3da0a9f700 1 -- 172.21.2.102:0/1056415840 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3d9c14e530 msgr2=0x7f3d9c0af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.718+0000 7f3da0a9f700 1 --2- 172.21.2.102:0/1056415840 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3d9c14e530 0x7f3d9c0af390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f3d9400bae0 tx=0x7f3d94009220).stop 2021-02-12T17:16:30.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.718+0000 7f3da0a9f700 1 -- 172.21.2.102:0/1056415840 shutdown_connections 2021-02-12T17:16:30.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.718+0000 7f3da0a9f700 1 --2- 172.21.2.102:0/1056415840 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3d80059d30 0x7f3d8005c1f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.718+0000 7f3da0a9f700 1 --2- 172.21.2.102:0/1056415840 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3d9c14e530 0x7f3d9c0af390 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.718+0000 7f3da0a9f700 1 --2- 172.21.2.102:0/1056415840 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3d9c062740 0x7f3d9c0b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:30.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.718+0000 7f3da0a9f700 1 --2- 172.21.2.102:0/1056415840 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3d9c0b8d20 0x7f3d9c0ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.723 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.718+0000 7f3da0a9f700 1 -- 172.21.2.102:0/1056415840 >> 172.21.2.102:0/1056415840 conn(0x7f3d9c0bc480 msgr2=0x7f3d9c14cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:30.723 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.718+0000 7f3da0a9f700 1 -- 172.21.2.102:0/1056415840 shutdown_connections 2021-02-12T17:16:30.723 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.718+0000 7f3da0a9f700 1 -- 172.21.2.102:0/1056415840 wait complete. 2021-02-12T17:16:30.724 INFO:teuthology.orchestra.run.gibba002.stderr:dumped all 2021-02-12T17:16:30.724 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:30.728 INFO:teuthology.orchestra.run.gibba002.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2021-02-12T17:16:29.591523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5492,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41820,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":39360,"kb_avail":754932900,"statfs":{"total":773094113280,"available":773051289600,"internally_reserved":0,"allocated":2453504,"data_stored":972879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40304640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":880,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002178"},"pg_stats":[{"pgid":"6.3","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537876+0000","last_change":"2021-02-12T17:16:08.536920+0000","last_active":"2021-02-12T17:16:08.537876+0000","last_peered":"2021-02-12T17:16:08.537876+0000","last_clean":"2021-02-12T17:16:08.537876+0000","last_became_active":"2021-02-12T17:16:08.536774+0000","last_became_peered":"2021-02-12T17:16:08.536774+0000","last_unstale":"2021-02-12T17:16:08.537876+0000","last_undegraded":"2021-02-12T17:16:08.537876+0000","last_fullsized":"2021-02-12T17:16:08.537876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"22'4","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534492+0000","last_change":"2021-02-12T17:16:01.721000+0000","last_active":"2021-02-12T17:16:08.534492+0000","last_peered":"2021-02-12T17:16:08.534492+0000","last_clean":"2021-02-12T17:16:08.534492+0000","last_became_active":"2021-02-12T17:16:01.720788+0000","last_became_peered":"2021-02-12T17:16:01.720788+0000","last_unstale":"2021-02-12T17:16:08.534492+0000","last_undegraded":"2021-02-12T17:16:08.534492+0000","last_fullsized":"2021-02-12T17:16:08.534492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534240+0000","last_change":"2021-02-12T17:15:58.624633+0000","last_active":"2021-02-12T17:16:08.534240+0000","last_peered":"2021-02-12T17:16:08.534240+0000","last_clean":"2021-02-12T17:16:08.534240+0000","last_became_active":"2021-02-12T17:15:58.624463+0000","last_became_peered":"2021-02-12T17:15:58.624463+0000","last_unstale":"2021-02-12T17:16:08.534240+0000","last_undegraded":"2021-02-12T17:16:08.534240+0000","last_fullsized":"2021-02-12T17:16:08.534240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535181+0000","last_change":"2021-02-12T17:16:02.000491+0000","last_active":"2021-02-12T17:16:08.535181+0000","last_peered":"2021-02-12T17:16:08.535181+0000","last_clean":"2021-02-12T17:16:08.535181+0000","last_became_active":"2021-02-12T17:16:02.000325+0000","last_became_peered":"2021-02-12T17:16:02.000325+0000","last_unstale":"2021-02-12T17:16:08.535181+0000","last_undegraded":"2021-02-12T17:16:08.535181+0000","last_fullsized":"2021-02-12T17:16:08.535181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'8","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539481+0000","last_change":"2021-02-12T17:16:08.266576+0000","last_active":"2021-02-12T17:16:08.539481+0000","last_peered":"2021-02-12T17:16:08.539481+0000","last_clean":"2021-02-12T17:16:08.539481+0000","last_became_active":"2021-02-12T17:16:08.266349+0000","last_became_peered":"2021-02-12T17:16:08.266349+0000","last_unstale":"2021-02-12T17:16:08.539481+0000","last_undegraded":"2021-02-12T17:16:08.539481+0000","last_fullsized":"2021-02-12T17:16:08.539481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534571+0000","last_change":"2021-02-12T17:15:58.624453+0000","last_active":"2021-02-12T17:16:08.534571+0000","last_peered":"2021-02-12T17:16:08.534571+0000","last_clean":"2021-02-12T17:16:08.534571+0000","last_became_active":"2021-02-12T17:15:58.624258+0000","last_became_peered":"2021-02-12T17:15:58.624258+0000","last_unstale":"2021-02-12T17:16:08.534571+0000","last_undegraded":"2021-02-12T17:16:08.534571+0000","last_fullsized":"2021-02-12T17:16:08.534571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'6","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533638+0000","last_change":"2021-02-12T17:16:01.721442+0000","last_active":"2021-02-12T17:16:08.533638+0000","last_peered":"2021-02-12T17:16:08.533638+0000","last_clean":"2021-02-12T17:16:08.533638+0000","last_became_active":"2021-02-12T17:16:01.721222+0000","last_became_peered":"2021-02-12T17:16:01.721222+0000","last_unstale":"2021-02-12T17:16:08.533638+0000","last_undegraded":"2021-02-12T17:16:08.533638+0000","last_fullsized":"2021-02-12T17:16:08.533638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":576,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533455+0000","last_change":"2021-02-12T17:16:02.001124+0000","last_active":"2021-02-12T17:16:08.533455+0000","last_peered":"2021-02-12T17:16:08.533455+0000","last_clean":"2021-02-12T17:16:08.533455+0000","last_became_active":"2021-02-12T17:16:02.000908+0000","last_became_peered":"2021-02-12T17:16:02.000908+0000","last_unstale":"2021-02-12T17:16:08.533455+0000","last_undegraded":"2021-02-12T17:16:08.533455+0000","last_fullsized":"2021-02-12T17:16:08.533455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"10","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535130+0000","last_change":"2021-02-12T17:16:08.267064+0000","last_active":"2021-02-12T17:16:08.535130+0000","last_peered":"2021-02-12T17:16:08.535130+0000","last_clean":"2021-02-12T17:16:08.535130+0000","last_became_active":"2021-02-12T17:16:08.266819+0000","last_became_peered":"2021-02-12T17:16:08.266819+0000","last_unstale":"2021-02-12T17:16:08.535130+0000","last_undegraded":"2021-02-12T17:16:08.535130+0000","last_fullsized":"2021-02-12T17:16:08.535130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539615+0000","last_change":"2021-02-12T17:16:08.539171+0000","last_active":"2021-02-12T17:16:08.539615+0000","last_peered":"2021-02-12T17:16:08.539615+0000","last_clean":"2021-02-12T17:16:08.539615+0000","last_became_active":"2021-02-12T17:16:08.538969+0000","last_became_peered":"2021-02-12T17:16:08.538969+0000","last_unstale":"2021-02-12T17:16:08.539615+0000","last_undegraded":"2021-02-12T17:16:08.539615+0000","last_fullsized":"2021-02-12T17:16:08.539615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'10","reported_seq":"25","reported_epoch":"27","state":"active+clean","last_fresh":"2021-02-12T17:16:23.347010+0000","last_change":"2021-02-12T17:16:01.722429+0000","last_active":"2021-02-12T17:16:23.347010+0000","last_peered":"2021-02-12T17:16:23.347010+0000","last_clean":"2021-02-12T17:16:23.347010+0000","last_became_active":"2021-02-12T17:16:01.722278+0000","last_became_peered":"2021-02-12T17:16:01.722278+0000","last_unstale":"2021-02-12T17:16:23.347010+0000","last_undegraded":"2021-02-12T17:16:23.347010+0000","last_fullsized":"2021-02-12T17:16:23.347010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534759+0000","last_change":"2021-02-12T17:15:59.564623+0000","last_active":"2021-02-12T17:16:08.534759+0000","last_peered":"2021-02-12T17:16:08.534759+0000","last_clean":"2021-02-12T17:16:08.534759+0000","last_became_active":"2021-02-12T17:15:59.564259+0000","last_became_peered":"2021-02-12T17:15:59.564259+0000","last_unstale":"2021-02-12T17:16:08.534759+0000","last_undegraded":"2021-02-12T17:16:08.534759+0000","last_fullsized":"2021-02-12T17:16:08.534759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534404+0000","last_change":"2021-02-12T17:16:01.998996+0000","last_active":"2021-02-12T17:16:08.534404+0000","last_peered":"2021-02-12T17:16:08.534404+0000","last_clean":"2021-02-12T17:16:08.534404+0000","last_became_active":"2021-02-12T17:16:01.998787+0000","last_became_peered":"2021-02-12T17:16:01.998787+0000","last_unstale":"2021-02-12T17:16:08.534404+0000","last_undegraded":"2021-02-12T17:16:08.534404+0000","last_fullsized":"2021-02-12T17:16:08.534404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"26'1","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537289+0000","last_change":"2021-02-12T17:16:08.266772+0000","last_active":"2021-02-12T17:16:08.537289+0000","last_peered":"2021-02-12T17:16:08.537289+0000","last_clean":"2021-02-12T17:16:08.537289+0000","last_became_active":"2021-02-12T17:16:08.266590+0000","last_became_peered":"2021-02-12T17:16:08.266590+0000","last_unstale":"2021-02-12T17:16:08.537289+0000","last_undegraded":"2021-02-12T17:16:08.537289+0000","last_fullsized":"2021-02-12T17:16:08.537289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538271+0000","last_change":"2021-02-12T17:16:08.537438+0000","last_active":"2021-02-12T17:16:08.538271+0000","last_peered":"2021-02-12T17:16:08.538271+0000","last_clean":"2021-02-12T17:16:08.538271+0000","last_became_active":"2021-02-12T17:16:08.537259+0000","last_became_peered":"2021-02-12T17:16:08.537259+0000","last_unstale":"2021-02-12T17:16:08.538271+0000","last_undegraded":"2021-02-12T17:16:08.538271+0000","last_fullsized":"2021-02-12T17:16:08.538271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537972+0000","last_change":"2021-02-12T17:16:08.536661+0000","last_active":"2021-02-12T17:16:08.537972+0000","last_peered":"2021-02-12T17:16:08.537972+0000","last_clean":"2021-02-12T17:16:08.537972+0000","last_became_active":"2021-02-12T17:16:08.536432+0000","last_became_peered":"2021-02-12T17:16:08.536432+0000","last_unstale":"2021-02-12T17:16:08.537972+0000","last_undegraded":"2021-02-12T17:16:08.537972+0000","last_fullsized":"2021-02-12T17:16:08.537972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534307+0000","last_change":"2021-02-12T17:16:01.721350+0000","last_active":"2021-02-12T17:16:08.534307+0000","last_peered":"2021-02-12T17:16:08.534307+0000","last_clean":"2021-02-12T17:16:08.534307+0000","last_became_active":"2021-02-12T17:16:01.721143+0000","last_became_peered":"2021-02-12T17:16:01.721143+0000","last_unstale":"2021-02-12T17:16:08.534307+0000","last_undegraded":"2021-02-12T17:16:08.534307+0000","last_fullsized":"2021-02-12T17:16:08.534307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534765+0000","last_change":"2021-02-12T17:15:58.623963+0000","last_active":"2021-02-12T17:16:08.534765+0000","last_peered":"2021-02-12T17:16:08.534765+0000","last_clean":"2021-02-12T17:16:08.534765+0000","last_became_active":"2021-02-12T17:15:58.623796+0000","last_became_peered":"2021-02-12T17:15:58.623796+0000","last_unstale":"2021-02-12T17:16:08.534765+0000","last_undegraded":"2021-02-12T17:16:08.534765+0000","last_fullsized":"2021-02-12T17:16:08.534765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534425+0000","last_change":"2021-02-12T17:16:02.001353+0000","last_active":"2021-02-12T17:16:08.534425+0000","last_peered":"2021-02-12T17:16:08.534425+0000","last_clean":"2021-02-12T17:16:08.534425+0000","last_became_active":"2021-02-12T17:16:02.001120+0000","last_became_peered":"2021-02-12T17:16:02.001120+0000","last_unstale":"2021-02-12T17:16:08.534425+0000","last_undegraded":"2021-02-12T17:16:08.534425+0000","last_fullsized":"2021-02-12T17:16:08.534425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"26'6","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538852+0000","last_change":"2021-02-12T17:16:08.266750+0000","last_active":"2021-02-12T17:16:08.538852+0000","last_peered":"2021-02-12T17:16:08.538852+0000","last_clean":"2021-02-12T17:16:08.538852+0000","last_became_active":"2021-02-12T17:16:08.266527+0000","last_became_peered":"2021-02-12T17:16:08.266527+0000","last_unstale":"2021-02-12T17:16:08.538852+0000","last_undegraded":"2021-02-12T17:16:08.538852+0000","last_fullsized":"2021-02-12T17:16:08.538852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":576,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538178+0000","last_change":"2021-02-12T17:16:08.537723+0000","last_active":"2021-02-12T17:16:08.538178+0000","last_peered":"2021-02-12T17:16:08.538178+0000","last_clean":"2021-02-12T17:16:08.538178+0000","last_became_active":"2021-02-12T17:16:08.537507+0000","last_became_peered":"2021-02-12T17:16:08.537507+0000","last_unstale":"2021-02-12T17:16:08.538178+0000","last_undegraded":"2021-02-12T17:16:08.538178+0000","last_fullsized":"2021-02-12T17:16:08.538178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533639+0000","last_change":"2021-02-12T17:16:01.721104+0000","last_active":"2021-02-12T17:16:08.533639+0000","last_peered":"2021-02-12T17:16:08.533639+0000","last_clean":"2021-02-12T17:16:08.533639+0000","last_became_active":"2021-02-12T17:16:01.720876+0000","last_became_peered":"2021-02-12T17:16:01.720876+0000","last_unstale":"2021-02-12T17:16:08.533639+0000","last_undegraded":"2021-02-12T17:16:08.533639+0000","last_fullsized":"2021-02-12T17:16:08.533639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534709+0000","last_change":"2021-02-12T17:15:57.566001+0000","last_active":"2021-02-12T17:16:08.534709+0000","last_peered":"2021-02-12T17:16:08.534709+0000","last_clean":"2021-02-12T17:16:08.534709+0000","last_became_active":"2021-02-12T17:15:57.565738+0000","last_became_peered":"2021-02-12T17:15:57.565738+0000","last_unstale":"2021-02-12T17:16:08.534709+0000","last_undegraded":"2021-02-12T17:16:08.534709+0000","last_fullsized":"2021-02-12T17:16:08.534709+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:55.600099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:55.600099+0000","last_clean_scrub_stamp":"2021-02-12T17:15:55.600099+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535046+0000","last_change":"2021-02-12T17:15:58.624830+0000","last_active":"2021-02-12T17:16:08.535046+0000","last_peered":"2021-02-12T17:16:08.535046+0000","last_clean":"2021-02-12T17:16:08.535046+0000","last_became_active":"2021-02-12T17:15:58.624647+0000","last_became_peered":"2021-02-12T17:15:58.624647+0000","last_unstale":"2021-02-12T17:16:08.535046+0000","last_undegraded":"2021-02-12T17:16:08.535046+0000","last_fullsized":"2021-02-12T17:16:08.535046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534228+0000","last_change":"2021-02-12T17:16:03.011987+0000","last_active":"2021-02-12T17:16:08.534228+0000","last_peered":"2021-02-12T17:16:08.534228+0000","last_clean":"2021-02-12T17:16:08.534228+0000","last_became_active":"2021-02-12T17:16:03.011668+0000","last_became_peered":"2021-02-12T17:16:03.011668+0000","last_unstale":"2021-02-12T17:16:08.534228+0000","last_undegraded":"2021-02-12T17:16:08.534228+0000","last_fullsized":"2021-02-12T17:16:08.534228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"27'10","reported_seq":"20","reported_epoch":"27","state":"active+clean","last_fresh":"2021-02-12T17:16:25.351443+0000","last_change":"2021-02-12T17:16:08.267110+0000","last_active":"2021-02-12T17:16:25.351443+0000","last_peered":"2021-02-12T17:16:25.351443+0000","last_clean":"2021-02-12T17:16:25.351443+0000","last_became_active":"2021-02-12T17:16:08.266920+0000","last_became_peered":"2021-02-12T17:16:08.266920+0000","last_unstale":"2021-02-12T17:16:25.351443+0000","last_undegraded":"2021-02-12T17:16:25.351443+0000","last_fullsized":"2021-02-12T17:16:25.351443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537881+0000","last_change":"2021-02-12T17:16:08.536884+0000","last_active":"2021-02-12T17:16:08.537881+0000","last_peered":"2021-02-12T17:16:08.537881+0000","last_clean":"2021-02-12T17:16:08.537881+0000","last_became_active":"2021-02-12T17:16:08.536645+0000","last_became_peered":"2021-02-12T17:16:08.536645+0000","last_unstale":"2021-02-12T17:16:08.537881+0000","last_undegraded":"2021-02-12T17:16:08.537881+0000","last_fullsized":"2021-02-12T17:16:08.537881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"21'8","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534414+0000","last_change":"2021-02-12T17:16:01.722384+0000","last_active":"2021-02-12T17:16:08.534414+0000","last_peered":"2021-02-12T17:16:08.534414+0000","last_clean":"2021-02-12T17:16:08.534414+0000","last_became_active":"2021-02-12T17:16:01.722205+0000","last_became_peered":"2021-02-12T17:16:01.722205+0000","last_unstale":"2021-02-12T17:16:08.534414+0000","last_undegraded":"2021-02-12T17:16:08.534414+0000","last_fullsized":"2021-02-12T17:16:08.534414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533448+0000","last_change":"2021-02-12T17:15:59.594109+0000","last_active":"2021-02-12T17:16:08.533448+0000","last_peered":"2021-02-12T17:16:08.533448+0000","last_clean":"2021-02-12T17:16:08.533448+0000","last_became_active":"2021-02-12T17:15:59.593760+0000","last_became_peered":"2021-02-12T17:15:59.593760+0000","last_unstale":"2021-02-12T17:16:08.533448+0000","last_undegraded":"2021-02-12T17:16:08.533448+0000","last_fullsized":"2021-02-12T17:16:08.533448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534623+0000","last_change":"2021-02-12T17:16:01.999606+0000","last_active":"2021-02-12T17:16:08.534623+0000","last_peered":"2021-02-12T17:16:08.534623+0000","last_clean":"2021-02-12T17:16:08.534623+0000","last_became_active":"2021-02-12T17:16:01.999372+0000","last_became_peered":"2021-02-12T17:16:01.999372+0000","last_unstale":"2021-02-12T17:16:08.534623+0000","last_undegraded":"2021-02-12T17:16:08.534623+0000","last_fullsized":"2021-02-12T17:16:08.534623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'4","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2021-02-12T17:16:10.411461+0000","last_change":"2021-02-12T17:16:08.266989+0000","last_active":"2021-02-12T17:16:10.411461+0000","last_peered":"2021-02-12T17:16:10.411461+0000","last_clean":"2021-02-12T17:16:10.411461+0000","last_became_active":"2021-02-12T17:16:08.266748+0000","last_became_peered":"2021-02-12T17:16:08.266748+0000","last_unstale":"2021-02-12T17:16:10.411461+0000","last_undegraded":"2021-02-12T17:16:10.411461+0000","last_fullsized":"2021-02-12T17:16:10.411461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539087+0000","last_change":"2021-02-12T17:16:08.536725+0000","last_active":"2021-02-12T17:16:08.539087+0000","last_peered":"2021-02-12T17:16:08.539087+0000","last_clean":"2021-02-12T17:16:08.539087+0000","last_became_active":"2021-02-12T17:16:08.536504+0000","last_became_peered":"2021-02-12T17:16:08.536504+0000","last_unstale":"2021-02-12T17:16:08.539087+0000","last_undegraded":"2021-02-12T17:16:08.539087+0000","last_fullsized":"2021-02-12T17:16:08.539087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"21'5","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535179+0000","last_change":"2021-02-12T17:16:01.721973+0000","last_active":"2021-02-12T17:16:08.535179+0000","last_peered":"2021-02-12T17:16:08.535179+0000","last_clean":"2021-02-12T17:16:08.535179+0000","last_became_active":"2021-02-12T17:16:01.721814+0000","last_became_peered":"2021-02-12T17:16:01.721814+0000","last_unstale":"2021-02-12T17:16:08.535179+0000","last_undegraded":"2021-02-12T17:16:08.535179+0000","last_fullsized":"2021-02-12T17:16:08.535179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535007+0000","last_change":"2021-02-12T17:15:58.624836+0000","last_active":"2021-02-12T17:16:08.535007+0000","last_peered":"2021-02-12T17:16:08.535007+0000","last_clean":"2021-02-12T17:16:08.535007+0000","last_became_active":"2021-02-12T17:15:58.624621+0000","last_became_peered":"2021-02-12T17:15:58.624621+0000","last_unstale":"2021-02-12T17:16:08.535007+0000","last_undegraded":"2021-02-12T17:16:08.535007+0000","last_fullsized":"2021-02-12T17:16:08.535007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534638+0000","last_change":"2021-02-12T17:16:02.003453+0000","last_active":"2021-02-12T17:16:08.534638+0000","last_peered":"2021-02-12T17:16:08.534638+0000","last_clean":"2021-02-12T17:16:08.534638+0000","last_became_active":"2021-02-12T17:16:02.003266+0000","last_became_peered":"2021-02-12T17:16:02.003266+0000","last_unstale":"2021-02-12T17:16:08.534638+0000","last_undegraded":"2021-02-12T17:16:08.534638+0000","last_fullsized":"2021-02-12T17:16:08.534638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'6","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539389+0000","last_change":"2021-02-12T17:16:08.266987+0000","last_active":"2021-02-12T17:16:08.539389+0000","last_peered":"2021-02-12T17:16:08.539389+0000","last_clean":"2021-02-12T17:16:08.539389+0000","last_became_active":"2021-02-12T17:16:08.266792+0000","last_became_peered":"2021-02-12T17:16:08.266792+0000","last_unstale":"2021-02-12T17:16:08.539389+0000","last_undegraded":"2021-02-12T17:16:08.539389+0000","last_fullsized":"2021-02-12T17:16:08.539389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"21'6","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535024+0000","last_change":"2021-02-12T17:16:01.722204+0000","last_active":"2021-02-12T17:16:08.535024+0000","last_peered":"2021-02-12T17:16:08.535024+0000","last_clean":"2021-02-12T17:16:08.535024+0000","last_became_active":"2021-02-12T17:16:01.722060+0000","last_became_peered":"2021-02-12T17:16:01.722060+0000","last_unstale":"2021-02-12T17:16:08.535024+0000","last_undegraded":"2021-02-12T17:16:08.535024+0000","last_fullsized":"2021-02-12T17:16:08.535024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534569+0000","last_change":"2021-02-12T17:15:59.564122+0000","last_active":"2021-02-12T17:16:08.534569+0000","last_peered":"2021-02-12T17:16:08.534569+0000","last_clean":"2021-02-12T17:16:08.534569+0000","last_became_active":"2021-02-12T17:15:59.563695+0000","last_became_peered":"2021-02-12T17:15:59.563695+0000","last_unstale":"2021-02-12T17:16:08.534569+0000","last_undegraded":"2021-02-12T17:16:08.534569+0000","last_fullsized":"2021-02-12T17:16:08.534569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534411+0000","last_change":"2021-02-12T17:16:01.999102+0000","last_active":"2021-02-12T17:16:08.534411+0000","last_peered":"2021-02-12T17:16:08.534411+0000","last_clean":"2021-02-12T17:16:08.534411+0000","last_became_active":"2021-02-12T17:16:01.998815+0000","last_became_peered":"2021-02-12T17:16:01.998815+0000","last_unstale":"2021-02-12T17:16:08.534411+0000","last_undegraded":"2021-02-12T17:16:08.534411+0000","last_fullsized":"2021-02-12T17:16:08.534411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"26'5","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539870+0000","last_change":"2021-02-12T17:16:08.267434+0000","last_active":"2021-02-12T17:16:08.539870+0000","last_peered":"2021-02-12T17:16:08.539870+0000","last_clean":"2021-02-12T17:16:08.539870+0000","last_became_active":"2021-02-12T17:16:08.267218+0000","last_became_peered":"2021-02-12T17:16:08.267218+0000","last_unstale":"2021-02-12T17:16:08.539870+0000","last_undegraded":"2021-02-12T17:16:08.539870+0000","last_fullsized":"2021-02-12T17:16:08.539870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538696+0000","last_change":"2021-02-12T17:16:08.535970+0000","last_active":"2021-02-12T17:16:08.538696+0000","last_peered":"2021-02-12T17:16:08.538696+0000","last_clean":"2021-02-12T17:16:08.538696+0000","last_became_active":"2021-02-12T17:16:08.535744+0000","last_became_peered":"2021-02-12T17:16:08.535744+0000","last_unstale":"2021-02-12T17:16:08.538696+0000","last_undegraded":"2021-02-12T17:16:08.538696+0000","last_fullsized":"2021-02-12T17:16:08.538696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":2746,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":16,"acting":16,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2746,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":120499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5312,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366528,"statfs":{"total":96636764160,"available":96631324672,"internally_reserved":0,"allocated":319488,"data_stored":123177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":120693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4039999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5244,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366596,"statfs":{"total":96636764160,"available":96631394304,"internally_reserved":0,"allocated":315392,"data_stored":123977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":120499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]}]}} 2021-02-12T17:16:30.730 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-02-12T17:16:30.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.816+0000 7fd127b46700 1 Processor -- start 2021-02-12T17:16:30.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.817+0000 7fd127b46700 1 -- start start 2021-02-12T17:16:30.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.817+0000 7fd127b46700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fd1200ba7a0 0x7fd1200b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.817+0000 7fd127b46700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1200ba3d0 con 0x7fd1200b9f90 2021-02-12T17:16:30.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.817+0000 7fd127b46700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1200b4290 con 0x7fd120147f70 2021-02-12T17:16:30.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.817+0000 7fd127b46700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd120148420 con 0x7fd1200ba7a0 2021-02-12T17:16:30.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.817+0000 7fd1260e3700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fd1200b9f90 0x7fd1200659e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54148/0 (socket says 172.21.2.102:54148) 2021-02-12T17:16:30.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.817+0000 7fd1260e3700 1 -- 172.21.2.102:0/4046844824 learned_addr learned my addr 172.21.2.102:0/4046844824 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:30.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.818+0000 7fd1258e2700 1 --2- 172.21.2.102:0/4046844824 >> v2:172.21.2.104:3300/0 conn(0x7fd1200ba7a0 0x7fd1200b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.818+0000 7fd1248e0700 1 -- 172.21.2.102:0/4046844824 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843974132 0 0) 0x7fd1200ba3d0 con 0x7fd1200b9f90 2021-02-12T17:16:30.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.818+0000 7fd1248e0700 1 -- 172.21.2.102:0/4046844824 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd108003230 con 0x7fd1200b9f90 2021-02-12T17:16:30.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.818+0000 7fd1258e2700 1 -- 172.21.2.102:0/4046844824 >> v1:172.21.2.104:6789/0 conn(0x7fd120147f70 legacy=0x7fd1200b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.818+0000 7fd1248e0700 1 -- 172.21.2.102:0/4046844824 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1300008307 0 0) 0x7fd108003230 con 0x7fd1200b9f90 2021-02-12T17:16:30.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.818+0000 7fd1258e2700 1 -- 172.21.2.102:0/4046844824 >> v1:172.21.2.102:6789/0 conn(0x7fd1200b9f90 legacy=0x7fd1200659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.818+0000 7fd1258e2700 1 -- 172.21.2.102:0/4046844824 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1200b4530 con 0x7fd1200ba7a0 2021-02-12T17:16:30.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.818+0000 7fd1258e2700 1 --2- 172.21.2.102:0/4046844824 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd1200ba7a0 0x7fd1200b3bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fd11c00b980 tx=0x7fd11c006de0).ready entity=mon.1 client_cookie=894225b3066bd714 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:30.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.818+0000 7fd1248e0700 1 -- 172.21.2.102:0/4046844824 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118001860 con 0x7fd1200ba7a0 2021-02-12T17:16:30.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.818+0000 7fd1248e0700 1 -- 172.21.2.102:0/4046844824 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c00be70 con 0x7fd1200ba7a0 2021-02-12T17:16:30.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.818+0000 7fd1248e0700 1 -- 172.21.2.102:0/4046844824 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0096e0 con 0x7fd1200ba7a0 2021-02-12T17:16:30.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.819+0000 7fd127b46700 1 -- 172.21.2.102:0/4046844824 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd1200ba7a0 msgr2=0x7fd1200b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.819+0000 7fd127b46700 1 --2- 172.21.2.102:0/4046844824 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd1200ba7a0 0x7fd1200b3bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fd11c00b980 tx=0x7fd11c006de0).stop 2021-02-12T17:16:30.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.819+0000 7fd127b46700 1 -- 172.21.2.102:0/4046844824 shutdown_connections 2021-02-12T17:16:30.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.819+0000 7fd127b46700 1 --2- 172.21.2.102:0/4046844824 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd1200ba7a0 0x7fd1200b3bf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.819+0000 7fd127b46700 1 -- 172.21.2.102:0/4046844824 >> 172.21.2.102:0/4046844824 conn(0x7fd120069830 msgr2=0x7fd120069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:30.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.819+0000 7fd127b46700 1 -- 172.21.2.102:0/4046844824 shutdown_connections 2021-02-12T17:16:30.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.819+0000 7fd127b46700 1 -- 172.21.2.102:0/4046844824 wait complete. 2021-02-12T17:16:30.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.820+0000 7fd127b46700 1 Processor -- start 2021-02-12T17:16:30.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.820+0000 7fd127b46700 1 -- start start 2021-02-12T17:16:30.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.820+0000 7fd127b46700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd1200b9f90 0x7fd12015d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.820+0000 7fd127b46700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd1200ba7a0 0x7fd120159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.820+0000 7fd127b46700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd120147f70 0x7fd12014a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.820+0000 7fd127b46700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12015c710 con 0x7fd1200b9f90 2021-02-12T17:16:30.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.820+0000 7fd127b46700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12015d570 con 0x7fd1200ba7a0 2021-02-12T17:16:30.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.820+0000 7fd127b46700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200b6400 con 0x7fd120147f70 2021-02-12T17:16:30.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd1258e2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd1200b9f90 0x7fd12015d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd1258e2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd1200b9f90 0x7fd12015d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45508/0 (socket says 172.21.2.102:45508) 2021-02-12T17:16:30.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd1258e2700 1 -- 172.21.2.102:0/191987714 learned_addr learned my addr 172.21.2.102:0/191987714 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:30.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd1250e1700 1 --2- 172.21.2.102:0/191987714 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd1200ba7a0 0x7fd120159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd1258e2700 1 -- 172.21.2.102:0/191987714 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd120147f70 msgr2=0x7fd12014a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd1258e2700 1 --2- 172.21.2.102:0/191987714 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd120147f70 0x7fd12014a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:30.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd1258e2700 1 -- 172.21.2.102:0/191987714 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd1200ba7a0 msgr2=0x7fd120159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd1258e2700 1 --2- 172.21.2.102:0/191987714 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd1200ba7a0 0x7fd120159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd1258e2700 1 -- 172.21.2.102:0/191987714 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1200b7100 con 0x7fd1200b9f90 2021-02-12T17:16:30.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd1250e1700 1 --2- 172.21.2.102:0/191987714 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd1200ba7a0 0x7fd120159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:30.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd1258e2700 1 --2- 172.21.2.102:0/191987714 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd1200b9f90 0x7fd12015d080 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fd11c006e20 tx=0x7fd11c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:30.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd10dffb700 1 -- 172.21.2.102:0/191987714 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c011a00 con 0x7fd1200b9f90 2021-02-12T17:16:30.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd10dffb700 1 -- 172.21.2.102:0/191987714 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c011b60 con 0x7fd1200b9f90 2021-02-12T17:16:30.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd127b46700 1 -- 172.21.2.102:0/191987714 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1200b73a0 con 0x7fd1200b9f90 2021-02-12T17:16:30.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd10dffb700 1 -- 172.21.2.102:0/191987714 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c01d430 con 0x7fd1200b9f90 2021-02-12T17:16:30.828 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.821+0000 7fd127b46700 1 -- 172.21.2.102:0/191987714 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12015cbe0 con 0x7fd1200b9f90 2021-02-12T17:16:30.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.822+0000 7fd127b46700 1 -- 172.21.2.102:0/191987714 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12006a1c0 con 0x7fd1200b9f90 2021-02-12T17:16:30.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.822+0000 7fd10dffb700 1 -- 172.21.2.102:0/191987714 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fd11c00f070 con 0x7fd1200b9f90 2021-02-12T17:16:30.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.822+0000 7fd10dffb700 1 --2- 172.21.2.102:0/191987714 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd100059db0 0x7fd10005c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:30.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.823+0000 7fd10dffb700 1 -- 172.21.2.102:0/191987714 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fd11c075350 con 0x7fd1200b9f90 2021-02-12T17:16:30.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.823+0000 7fd1250e1700 1 --2- 172.21.2.102:0/191987714 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd100059db0 0x7fd10005c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:30.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.823+0000 7fd1250e1700 1 --2- 172.21.2.102:0/191987714 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd100059db0 0x7fd10005c270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fd1200a0db0 tx=0x7fd110009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:30.830 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.825+0000 7fd10dffb700 1 -- 172.21.2.102:0/191987714 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fd11c048af0 con 0x7fd1200b9f90 2021-02-12T17:16:30.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.948+0000 7fd127b46700 1 -- 172.21.2.102:0/191987714 --> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd12015cda0 con 0x7fd100059db0 2021-02-12T17:16:30.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.951+0000 7fd10dffb700 1 -- 172.21.2.102:0/191987714 <== mgr.4107 v2:172.21.2.102:6832/37352 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+120181 (secure 0 0 0) 0x7fd12015cda0 con 0x7fd100059db0 2021-02-12T17:16:30.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.953+0000 7fd127b46700 1 -- 172.21.2.102:0/191987714 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd100059db0 msgr2=0x7fd10005c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.953+0000 7fd127b46700 1 --2- 172.21.2.102:0/191987714 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd100059db0 0x7fd10005c270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fd1200a0db0 tx=0x7fd110009040).stop 2021-02-12T17:16:30.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.953+0000 7fd127b46700 1 -- 172.21.2.102:0/191987714 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd1200b9f90 msgr2=0x7fd12015d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:30.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.953+0000 7fd127b46700 1 --2- 172.21.2.102:0/191987714 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd1200b9f90 0x7fd12015d080 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fd11c006e20 tx=0x7fd11c016000).stop 2021-02-12T17:16:30.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.953+0000 7fd127b46700 1 -- 172.21.2.102:0/191987714 shutdown_connections 2021-02-12T17:16:30.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.953+0000 7fd127b46700 1 --2- 172.21.2.102:0/191987714 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd120147f70 0x7fd12014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:30.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.953+0000 7fd127b46700 1 --2- 172.21.2.102:0/191987714 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd100059db0 0x7fd10005c270 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.953+0000 7fd127b46700 1 --2- 172.21.2.102:0/191987714 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd1200b9f90 0x7fd12015d080 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.953+0000 7fd127b46700 1 --2- 172.21.2.102:0/191987714 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd1200ba7a0 0x7fd120159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:30.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.953+0000 7fd127b46700 1 -- 172.21.2.102:0/191987714 >> 172.21.2.102:0/191987714 conn(0x7fd120069830 msgr2=0x7fd1201485a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:30.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.953+0000 7fd127b46700 1 -- 172.21.2.102:0/191987714 shutdown_connections 2021-02-12T17:16:30.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:30.953+0000 7fd127b46700 1 -- 172.21.2.102:0/191987714 wait complete. 2021-02-12T17:16:30.955 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:30.956 INFO:teuthology.orchestra.run.gibba002.stderr:dumped all 2021-02-12T17:16:30.963 INFO:teuthology.orchestra.run.gibba002.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2021-02-12T17:16:29.591523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5492,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41820,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":39360,"kb_avail":754932900,"statfs":{"total":773094113280,"available":773051289600,"internally_reserved":0,"allocated":2453504,"data_stored":972879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40304640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":880,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002178"},"pg_stats":[{"pgid":"6.3","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537876+0000","last_change":"2021-02-12T17:16:08.536920+0000","last_active":"2021-02-12T17:16:08.537876+0000","last_peered":"2021-02-12T17:16:08.537876+0000","last_clean":"2021-02-12T17:16:08.537876+0000","last_became_active":"2021-02-12T17:16:08.536774+0000","last_became_peered":"2021-02-12T17:16:08.536774+0000","last_unstale":"2021-02-12T17:16:08.537876+0000","last_undegraded":"2021-02-12T17:16:08.537876+0000","last_fullsized":"2021-02-12T17:16:08.537876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"22'4","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534492+0000","last_change":"2021-02-12T17:16:01.721000+0000","last_active":"2021-02-12T17:16:08.534492+0000","last_peered":"2021-02-12T17:16:08.534492+0000","last_clean":"2021-02-12T17:16:08.534492+0000","last_became_active":"2021-02-12T17:16:01.720788+0000","last_became_peered":"2021-02-12T17:16:01.720788+0000","last_unstale":"2021-02-12T17:16:08.534492+0000","last_undegraded":"2021-02-12T17:16:08.534492+0000","last_fullsized":"2021-02-12T17:16:08.534492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534240+0000","last_change":"2021-02-12T17:15:58.624633+0000","last_active":"2021-02-12T17:16:08.534240+0000","last_peered":"2021-02-12T17:16:08.534240+0000","last_clean":"2021-02-12T17:16:08.534240+0000","last_became_active":"2021-02-12T17:15:58.624463+0000","last_became_peered":"2021-02-12T17:15:58.624463+0000","last_unstale":"2021-02-12T17:16:08.534240+0000","last_undegraded":"2021-02-12T17:16:08.534240+0000","last_fullsized":"2021-02-12T17:16:08.534240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535181+0000","last_change":"2021-02-12T17:16:02.000491+0000","last_active":"2021-02-12T17:16:08.535181+0000","last_peered":"2021-02-12T17:16:08.535181+0000","last_clean":"2021-02-12T17:16:08.535181+0000","last_became_active":"2021-02-12T17:16:02.000325+0000","last_became_peered":"2021-02-12T17:16:02.000325+0000","last_unstale":"2021-02-12T17:16:08.535181+0000","last_undegraded":"2021-02-12T17:16:08.535181+0000","last_fullsized":"2021-02-12T17:16:08.535181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'8","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539481+0000","last_change":"2021-02-12T17:16:08.266576+0000","last_active":"2021-02-12T17:16:08.539481+0000","last_peered":"2021-02-12T17:16:08.539481+0000","last_clean":"2021-02-12T17:16:08.539481+0000","last_became_active":"2021-02-12T17:16:08.266349+0000","last_became_peered":"2021-02-12T17:16:08.266349+0000","last_unstale":"2021-02-12T17:16:08.539481+0000","last_undegraded":"2021-02-12T17:16:08.539481+0000","last_fullsized":"2021-02-12T17:16:08.539481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534571+0000","last_change":"2021-02-12T17:15:58.624453+0000","last_active":"2021-02-12T17:16:08.534571+0000","last_peered":"2021-02-12T17:16:08.534571+0000","last_clean":"2021-02-12T17:16:08.534571+0000","last_became_active":"2021-02-12T17:15:58.624258+0000","last_became_peered":"2021-02-12T17:15:58.624258+0000","last_unstale":"2021-02-12T17:16:08.534571+0000","last_undegraded":"2021-02-12T17:16:08.534571+0000","last_fullsized":"2021-02-12T17:16:08.534571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'6","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533638+0000","last_change":"2021-02-12T17:16:01.721442+0000","last_active":"2021-02-12T17:16:08.533638+0000","last_peered":"2021-02-12T17:16:08.533638+0000","last_clean":"2021-02-12T17:16:08.533638+0000","last_became_active":"2021-02-12T17:16:01.721222+0000","last_became_peered":"2021-02-12T17:16:01.721222+0000","last_unstale":"2021-02-12T17:16:08.533638+0000","last_undegraded":"2021-02-12T17:16:08.533638+0000","last_fullsized":"2021-02-12T17:16:08.533638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":576,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533455+0000","last_change":"2021-02-12T17:16:02.001124+0000","last_active":"2021-02-12T17:16:08.533455+0000","last_peered":"2021-02-12T17:16:08.533455+0000","last_clean":"2021-02-12T17:16:08.533455+0000","last_became_active":"2021-02-12T17:16:02.000908+0000","last_became_peered":"2021-02-12T17:16:02.000908+0000","last_unstale":"2021-02-12T17:16:08.533455+0000","last_undegraded":"2021-02-12T17:16:08.533455+0000","last_fullsized":"2021-02-12T17:16:08.533455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"10","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535130+0000","last_change":"2021-02-12T17:16:08.267064+0000","last_active":"2021-02-12T17:16:08.535130+0000","last_peered":"2021-02-12T17:16:08.535130+0000","last_clean":"2021-02-12T17:16:08.535130+0000","last_became_active":"2021-02-12T17:16:08.266819+0000","last_became_peered":"2021-02-12T17:16:08.266819+0000","last_unstale":"2021-02-12T17:16:08.535130+0000","last_undegraded":"2021-02-12T17:16:08.535130+0000","last_fullsized":"2021-02-12T17:16:08.535130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539615+0000","last_change":"2021-02-12T17:16:08.539171+0000","last_active":"2021-02-12T17:16:08.539615+0000","last_peered":"2021-02-12T17:16:08.539615+0000","last_clean":"2021-02-12T17:16:08.539615+0000","last_became_active":"2021-02-12T17:16:08.538969+0000","last_became_peered":"2021-02-12T17:16:08.538969+0000","last_unstale":"2021-02-12T17:16:08.539615+0000","last_undegraded":"2021-02-12T17:16:08.539615+0000","last_fullsized":"2021-02-12T17:16:08.539615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'10","reported_seq":"25","reported_epoch":"27","state":"active+clean","last_fresh":"2021-02-12T17:16:23.347010+0000","last_change":"2021-02-12T17:16:01.722429+0000","last_active":"2021-02-12T17:16:23.347010+0000","last_peered":"2021-02-12T17:16:23.347010+0000","last_clean":"2021-02-12T17:16:23.347010+0000","last_became_active":"2021-02-12T17:16:01.722278+0000","last_became_peered":"2021-02-12T17:16:01.722278+0000","last_unstale":"2021-02-12T17:16:23.347010+0000","last_undegraded":"2021-02-12T17:16:23.347010+0000","last_fullsized":"2021-02-12T17:16:23.347010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534759+0000","last_change":"2021-02-12T17:15:59.564623+0000","last_active":"2021-02-12T17:16:08.534759+0000","last_peered":"2021-02-12T17:16:08.534759+0000","last_clean":"2021-02-12T17:16:08.534759+0000","last_became_active":"2021-02-12T17:15:59.564259+0000","last_became_peered":"2021-02-12T17:15:59.564259+0000","last_unstale":"2021-02-12T17:16:08.534759+0000","last_undegraded":"2021-02-12T17:16:08.534759+0000","last_fullsized":"2021-02-12T17:16:08.534759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534404+0000","last_change":"2021-02-12T17:16:01.998996+0000","last_active":"2021-02-12T17:16:08.534404+0000","last_peered":"2021-02-12T17:16:08.534404+0000","last_clean":"2021-02-12T17:16:08.534404+0000","last_became_active":"2021-02-12T17:16:01.998787+0000","last_became_peered":"2021-02-12T17:16:01.998787+0000","last_unstale":"2021-02-12T17:16:08.534404+0000","last_undegraded":"2021-02-12T17:16:08.534404+0000","last_fullsized":"2021-02-12T17:16:08.534404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"26'1","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537289+0000","last_change":"2021-02-12T17:16:08.266772+0000","last_active":"2021-02-12T17:16:08.537289+0000","last_peered":"2021-02-12T17:16:08.537289+0000","last_clean":"2021-02-12T17:16:08.537289+0000","last_became_active":"2021-02-12T17:16:08.266590+0000","last_became_peered":"2021-02-12T17:16:08.266590+0000","last_unstale":"2021-02-12T17:16:08.537289+0000","last_undegraded":"2021-02-12T17:16:08.537289+0000","last_fullsized":"2021-02-12T17:16:08.537289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538271+0000","last_change":"2021-02-12T17:16:08.537438+0000","last_active":"2021-02-12T17:16:08.538271+0000","last_peered":"2021-02-12T17:16:08.538271+0000","last_clean":"2021-02-12T17:16:08.538271+0000","last_became_active":"2021-02-12T17:16:08.537259+0000","last_became_peered":"2021-02-12T17:16:08.537259+0000","last_unstale":"2021-02-12T17:16:08.538271+0000","last_undegraded":"2021-02-12T17:16:08.538271+0000","last_fullsized":"2021-02-12T17:16:08.538271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537972+0000","last_change":"2021-02-12T17:16:08.536661+0000","last_active":"2021-02-12T17:16:08.537972+0000","last_peered":"2021-02-12T17:16:08.537972+0000","last_clean":"2021-02-12T17:16:08.537972+0000","last_became_active":"2021-02-12T17:16:08.536432+0000","last_became_peered":"2021-02-12T17:16:08.536432+0000","last_unstale":"2021-02-12T17:16:08.537972+0000","last_undegraded":"2021-02-12T17:16:08.537972+0000","last_fullsized":"2021-02-12T17:16:08.537972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534307+0000","last_change":"2021-02-12T17:16:01.721350+0000","last_active":"2021-02-12T17:16:08.534307+0000","last_peered":"2021-02-12T17:16:08.534307+0000","last_clean":"2021-02-12T17:16:08.534307+0000","last_became_active":"2021-02-12T17:16:01.721143+0000","last_became_peered":"2021-02-12T17:16:01.721143+0000","last_unstale":"2021-02-12T17:16:08.534307+0000","last_undegraded":"2021-02-12T17:16:08.534307+0000","last_fullsized":"2021-02-12T17:16:08.534307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534765+0000","last_change":"2021-02-12T17:15:58.623963+0000","last_active":"2021-02-12T17:16:08.534765+0000","last_peered":"2021-02-12T17:16:08.534765+0000","last_clean":"2021-02-12T17:16:08.534765+0000","last_became_active":"2021-02-12T17:15:58.623796+0000","last_became_peered":"2021-02-12T17:15:58.623796+0000","last_unstale":"2021-02-12T17:16:08.534765+0000","last_undegraded":"2021-02-12T17:16:08.534765+0000","last_fullsized":"2021-02-12T17:16:08.534765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534425+0000","last_change":"2021-02-12T17:16:02.001353+0000","last_active":"2021-02-12T17:16:08.534425+0000","last_peered":"2021-02-12T17:16:08.534425+0000","last_clean":"2021-02-12T17:16:08.534425+0000","last_became_active":"2021-02-12T17:16:02.001120+0000","last_became_peered":"2021-02-12T17:16:02.001120+0000","last_unstale":"2021-02-12T17:16:08.534425+0000","last_undegraded":"2021-02-12T17:16:08.534425+0000","last_fullsized":"2021-02-12T17:16:08.534425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"26'6","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538852+0000","last_change":"2021-02-12T17:16:08.266750+0000","last_active":"2021-02-12T17:16:08.538852+0000","last_peered":"2021-02-12T17:16:08.538852+0000","last_clean":"2021-02-12T17:16:08.538852+0000","last_became_active":"2021-02-12T17:16:08.266527+0000","last_became_peered":"2021-02-12T17:16:08.266527+0000","last_unstale":"2021-02-12T17:16:08.538852+0000","last_undegraded":"2021-02-12T17:16:08.538852+0000","last_fullsized":"2021-02-12T17:16:08.538852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":576,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538178+0000","last_change":"2021-02-12T17:16:08.537723+0000","last_active":"2021-02-12T17:16:08.538178+0000","last_peered":"2021-02-12T17:16:08.538178+0000","last_clean":"2021-02-12T17:16:08.538178+0000","last_became_active":"2021-02-12T17:16:08.537507+0000","last_became_peered":"2021-02-12T17:16:08.537507+0000","last_unstale":"2021-02-12T17:16:08.538178+0000","last_undegraded":"2021-02-12T17:16:08.538178+0000","last_fullsized":"2021-02-12T17:16:08.538178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533639+0000","last_change":"2021-02-12T17:16:01.721104+0000","last_active":"2021-02-12T17:16:08.533639+0000","last_peered":"2021-02-12T17:16:08.533639+0000","last_clean":"2021-02-12T17:16:08.533639+0000","last_became_active":"2021-02-12T17:16:01.720876+0000","last_became_peered":"2021-02-12T17:16:01.720876+0000","last_unstale":"2021-02-12T17:16:08.533639+0000","last_undegraded":"2021-02-12T17:16:08.533639+0000","last_fullsized":"2021-02-12T17:16:08.533639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534709+0000","last_change":"2021-02-12T17:15:57.566001+0000","last_active":"2021-02-12T17:16:08.534709+0000","last_peered":"2021-02-12T17:16:08.534709+0000","last_clean":"2021-02-12T17:16:08.534709+0000","last_became_active":"2021-02-12T17:15:57.565738+0000","last_became_peered":"2021-02-12T17:15:57.565738+0000","last_unstale":"2021-02-12T17:16:08.534709+0000","last_undegraded":"2021-02-12T17:16:08.534709+0000","last_fullsized":"2021-02-12T17:16:08.534709+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:55.600099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:55.600099+0000","last_clean_scrub_stamp":"2021-02-12T17:15:55.600099+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535046+0000","last_change":"2021-02-12T17:15:58.624830+0000","last_active":"2021-02-12T17:16:08.535046+0000","last_peered":"2021-02-12T17:16:08.535046+0000","last_clean":"2021-02-12T17:16:08.535046+0000","last_became_active":"2021-02-12T17:15:58.624647+0000","last_became_peered":"2021-02-12T17:15:58.624647+0000","last_unstale":"2021-02-12T17:16:08.535046+0000","last_undegraded":"2021-02-12T17:16:08.535046+0000","last_fullsized":"2021-02-12T17:16:08.535046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534228+0000","last_change":"2021-02-12T17:16:03.011987+0000","last_active":"2021-02-12T17:16:08.534228+0000","last_peered":"2021-02-12T17:16:08.534228+0000","last_clean":"2021-02-12T17:16:08.534228+0000","last_became_active":"2021-02-12T17:16:03.011668+0000","last_became_peered":"2021-02-12T17:16:03.011668+0000","last_unstale":"2021-02-12T17:16:08.534228+0000","last_undegraded":"2021-02-12T17:16:08.534228+0000","last_fullsized":"2021-02-12T17:16:08.534228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"27'10","reported_seq":"20","reported_epoch":"27","state":"active+clean","last_fresh":"2021-02-12T17:16:25.351443+0000","last_change":"2021-02-12T17:16:08.267110+0000","last_active":"2021-02-12T17:16:25.351443+0000","last_peered":"2021-02-12T17:16:25.351443+0000","last_clean":"2021-02-12T17:16:25.351443+0000","last_became_active":"2021-02-12T17:16:08.266920+0000","last_became_peered":"2021-02-12T17:16:08.266920+0000","last_unstale":"2021-02-12T17:16:25.351443+0000","last_undegraded":"2021-02-12T17:16:25.351443+0000","last_fullsized":"2021-02-12T17:16:25.351443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537881+0000","last_change":"2021-02-12T17:16:08.536884+0000","last_active":"2021-02-12T17:16:08.537881+0000","last_peered":"2021-02-12T17:16:08.537881+0000","last_clean":"2021-02-12T17:16:08.537881+0000","last_became_active":"2021-02-12T17:16:08.536645+0000","last_became_peered":"2021-02-12T17:16:08.536645+0000","last_unstale":"2021-02-12T17:16:08.537881+0000","last_undegraded":"2021-02-12T17:16:08.537881+0000","last_fullsized":"2021-02-12T17:16:08.537881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"21'8","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534414+0000","last_change":"2021-02-12T17:16:01.722384+0000","last_active":"2021-02-12T17:16:08.534414+0000","last_peered":"2021-02-12T17:16:08.534414+0000","last_clean":"2021-02-12T17:16:08.534414+0000","last_became_active":"2021-02-12T17:16:01.722205+0000","last_became_peered":"2021-02-12T17:16:01.722205+0000","last_unstale":"2021-02-12T17:16:08.534414+0000","last_undegraded":"2021-02-12T17:16:08.534414+0000","last_fullsized":"2021-02-12T17:16:08.534414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533448+0000","last_change":"2021-02-12T17:15:59.594109+0000","last_active":"2021-02-12T17:16:08.533448+0000","last_peered":"2021-02-12T17:16:08.533448+0000","last_clean":"2021-02-12T17:16:08.533448+0000","last_became_active":"2021-02-12T17:15:59.593760+0000","last_became_peered":"2021-02-12T17:15:59.593760+0000","last_unstale":"2021-02-12T17:16:08.533448+0000","last_undegraded":"2021-02-12T17:16:08.533448+0000","last_fullsized":"2021-02-12T17:16:08.533448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534623+0000","last_change":"2021-02-12T17:16:01.999606+0000","last_active":"2021-02-12T17:16:08.534623+0000","last_peered":"2021-02-12T17:16:08.534623+0000","last_clean":"2021-02-12T17:16:08.534623+0000","last_became_active":"2021-02-12T17:16:01.999372+0000","last_became_peered":"2021-02-12T17:16:01.999372+0000","last_unstale":"2021-02-12T17:16:08.534623+0000","last_undegraded":"2021-02-12T17:16:08.534623+0000","last_fullsized":"2021-02-12T17:16:08.534623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'4","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2021-02-12T17:16:10.411461+0000","last_change":"2021-02-12T17:16:08.266989+0000","last_active":"2021-02-12T17:16:10.411461+0000","last_peered":"2021-02-12T17:16:10.411461+0000","last_clean":"2021-02-12T17:16:10.411461+0000","last_became_active":"2021-02-12T17:16:08.266748+0000","last_became_peered":"2021-02-12T17:16:08.266748+0000","last_unstale":"2021-02-12T17:16:10.411461+0000","last_undegraded":"2021-02-12T17:16:10.411461+0000","last_fullsized":"2021-02-12T17:16:10.411461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539087+0000","last_change":"2021-02-12T17:16:08.536725+0000","last_active":"2021-02-12T17:16:08.539087+0000","last_peered":"2021-02-12T17:16:08.539087+0000","last_clean":"2021-02-12T17:16:08.539087+0000","last_became_active":"2021-02-12T17:16:08.536504+0000","last_became_peered":"2021-02-12T17:16:08.536504+0000","last_unstale":"2021-02-12T17:16:08.539087+0000","last_undegraded":"2021-02-12T17:16:08.539087+0000","last_fullsized":"2021-02-12T17:16:08.539087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"21'5","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535179+0000","last_change":"2021-02-12T17:16:01.721973+0000","last_active":"2021-02-12T17:16:08.535179+0000","last_peered":"2021-02-12T17:16:08.535179+0000","last_clean":"2021-02-12T17:16:08.535179+0000","last_became_active":"2021-02-12T17:16:01.721814+0000","last_became_peered":"2021-02-12T17:16:01.721814+0000","last_unstale":"2021-02-12T17:16:08.535179+0000","last_undegraded":"2021-02-12T17:16:08.535179+0000","last_fullsized":"2021-02-12T17:16:08.535179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535007+0000","last_change":"2021-02-12T17:15:58.624836+0000","last_active":"2021-02-12T17:16:08.535007+0000","last_peered":"2021-02-12T17:16:08.535007+0000","last_clean":"2021-02-12T17:16:08.535007+0000","last_became_active":"2021-02-12T17:15:58.624621+0000","last_became_peered":"2021-02-12T17:15:58.624621+0000","last_unstale":"2021-02-12T17:16:08.535007+0000","last_undegraded":"2021-02-12T17:16:08.535007+0000","last_fullsized":"2021-02-12T17:16:08.535007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534638+0000","last_change":"2021-02-12T17:16:02.003453+0000","last_active":"2021-02-12T17:16:08.534638+0000","last_peered":"2021-02-12T17:16:08.534638+0000","last_clean":"2021-02-12T17:16:08.534638+0000","last_became_active":"2021-02-12T17:16:02.003266+0000","last_became_peered":"2021-02-12T17:16:02.003266+0000","last_unstale":"2021-02-12T17:16:08.534638+0000","last_undegraded":"2021-02-12T17:16:08.534638+0000","last_fullsized":"2021-02-12T17:16:08.534638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'6","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539389+0000","last_change":"2021-02-12T17:16:08.266987+0000","last_active":"2021-02-12T17:16:08.539389+0000","last_peered":"2021-02-12T17:16:08.539389+0000","last_clean":"2021-02-12T17:16:08.539389+0000","last_became_active":"2021-02-12T17:16:08.266792+0000","last_became_peered":"2021-02-12T17:16:08.266792+0000","last_unstale":"2021-02-12T17:16:08.539389+0000","last_undegraded":"2021-02-12T17:16:08.539389+0000","last_fullsized":"2021-02-12T17:16:08.539389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"21'6","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535024+0000","last_change":"2021-02-12T17:16:01.722204+0000","last_active":"2021-02-12T17:16:08.535024+0000","last_peered":"2021-02-12T17:16:08.535024+0000","last_clean":"2021-02-12T17:16:08.535024+0000","last_became_active":"2021-02-12T17:16:01.722060+0000","last_became_peered":"2021-02-12T17:16:01.722060+0000","last_unstale":"2021-02-12T17:16:08.535024+0000","last_undegraded":"2021-02-12T17:16:08.535024+0000","last_fullsized":"2021-02-12T17:16:08.535024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534569+0000","last_change":"2021-02-12T17:15:59.564122+0000","last_active":"2021-02-12T17:16:08.534569+0000","last_peered":"2021-02-12T17:16:08.534569+0000","last_clean":"2021-02-12T17:16:08.534569+0000","last_became_active":"2021-02-12T17:15:59.563695+0000","last_became_peered":"2021-02-12T17:15:59.563695+0000","last_unstale":"2021-02-12T17:16:08.534569+0000","last_undegraded":"2021-02-12T17:16:08.534569+0000","last_fullsized":"2021-02-12T17:16:08.534569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534411+0000","last_change":"2021-02-12T17:16:01.999102+0000","last_active":"2021-02-12T17:16:08.534411+0000","last_peered":"2021-02-12T17:16:08.534411+0000","last_clean":"2021-02-12T17:16:08.534411+0000","last_became_active":"2021-02-12T17:16:01.998815+0000","last_became_peered":"2021-02-12T17:16:01.998815+0000","last_unstale":"2021-02-12T17:16:08.534411+0000","last_undegraded":"2021-02-12T17:16:08.534411+0000","last_fullsized":"2021-02-12T17:16:08.534411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"26'5","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539870+0000","last_change":"2021-02-12T17:16:08.267434+0000","last_active":"2021-02-12T17:16:08.539870+0000","last_peered":"2021-02-12T17:16:08.539870+0000","last_clean":"2021-02-12T17:16:08.539870+0000","last_became_active":"2021-02-12T17:16:08.267218+0000","last_became_peered":"2021-02-12T17:16:08.267218+0000","last_unstale":"2021-02-12T17:16:08.539870+0000","last_undegraded":"2021-02-12T17:16:08.539870+0000","last_fullsized":"2021-02-12T17:16:08.539870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538696+0000","last_change":"2021-02-12T17:16:08.535970+0000","last_active":"2021-02-12T17:16:08.538696+0000","last_peered":"2021-02-12T17:16:08.538696+0000","last_clean":"2021-02-12T17:16:08.538696+0000","last_became_active":"2021-02-12T17:16:08.535744+0000","last_became_peered":"2021-02-12T17:16:08.535744+0000","last_unstale":"2021-02-12T17:16:08.538696+0000","last_undegraded":"2021-02-12T17:16:08.538696+0000","last_fullsized":"2021-02-12T17:16:08.538696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":2746,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":16,"acting":16,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2746,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":120499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5312,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366528,"statfs":{"total":96636764160,"available":96631324672,"internally_reserved":0,"allocated":319488,"data_stored":123177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":120693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4039999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5244,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366596,"statfs":{"total":96636764160,"available":96631394304,"internally_reserved":0,"allocated":315392,"data_stored":123977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":120499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]}]}} 2021-02-12T17:16:30.965 INFO:tasks.mds_thrash.ceph_manager:clean! 2021-02-12T17:16:30.965 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-02-12T17:16:31.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.053+0000 7f55525da700 1 Processor -- start 2021-02-12T17:16:31.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.053+0000 7f55525da700 1 -- start start 2021-02-12T17:16:31.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.053+0000 7f55525da700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f554c0b8d20 0x7f554c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.053+0000 7f55525da700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f554c14e530 0x7f554c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.053+0000 7f55525da700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c0622a0 con 0x7f554c062740 2021-02-12T17:16:31.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.053+0000 7f55525da700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c068d20 con 0x7f554c14e530 2021-02-12T17:16:31.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.053+0000 7f55525da700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c14ea10 con 0x7f554c0b8d20 2021-02-12T17:16:31.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.053+0000 7f554b7fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f554c14e530 0x7f554c0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.054+0000 7f554b7fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f554c14e530 0x7f554c0b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45518/0 (socket says 172.21.2.102:45518) 2021-02-12T17:16:31.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.054+0000 7f554b7fe700 1 -- 172.21.2.102:0/3143570527 learned_addr learned my addr 172.21.2.102:0/3143570527 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:31.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.054+0000 7f554b7fe700 1 -- 172.21.2.102:0/3143570527 >> v2:172.21.2.104:3300/0 conn(0x7f554c0b8d20 msgr2=0x7f554c068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:31.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.054+0000 7f554b7fe700 1 --2- 172.21.2.102:0/3143570527 >> v2:172.21.2.104:3300/0 conn(0x7f554c0b8d20 0x7f554c068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:31.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.054+0000 7f554b7fe700 1 -- 172.21.2.102:0/3143570527 >> v1:172.21.2.104:6789/0 conn(0x7f554c062740 legacy=0x7f554c062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:31.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.054+0000 7f554b7fe700 1 -- 172.21.2.102:0/3143570527 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0b63f0 con 0x7f554c14e530 2021-02-12T17:16:31.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.054+0000 7f554b7fe700 1 --2- 172.21.2.102:0/3143570527 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f554c14e530 0x7f554c0b7250 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f554c06abc0 tx=0x7f5540006ea0).ready entity=mon.0 client_cookie=3f0c065de0bcb524 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:31.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.054+0000 7f554affd700 1 -- 172.21.2.102:0/3143570527 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540009800 con 0x7f554c14e530 2021-02-12T17:16:31.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.054+0000 7f554affd700 1 -- 172.21.2.102:0/3143570527 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5540009960 con 0x7f554c14e530 2021-02-12T17:16:31.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.054+0000 7f554affd700 1 -- 172.21.2.102:0/3143570527 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540009ce0 con 0x7f554c14e530 2021-02-12T17:16:31.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.054+0000 7f55525da700 1 -- 172.21.2.102:0/3143570527 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f554c14e530 msgr2=0x7f554c0b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.054+0000 7f55525da700 1 --2- 172.21.2.102:0/3143570527 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f554c14e530 0x7f554c0b7250 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f554c06abc0 tx=0x7f5540006ea0).stop 2021-02-12T17:16:31.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.055+0000 7f55525da700 1 -- 172.21.2.102:0/3143570527 shutdown_connections 2021-02-12T17:16:31.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.055+0000 7f55525da700 1 --2- 172.21.2.102:0/3143570527 >> v2:172.21.2.104:3300/0 conn(0x7f554c0b8d20 0x7f554c068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:31.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.055+0000 7f55525da700 1 --2- 172.21.2.102:0/3143570527 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f554c14e530 0x7f554c0b7250 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.055+0000 7f55525da700 1 -- 172.21.2.102:0/3143570527 >> 172.21.2.102:0/3143570527 conn(0x7f554c0bc480 msgr2=0x7f554c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:31.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.055+0000 7f55525da700 1 -- 172.21.2.102:0/3143570527 shutdown_connections 2021-02-12T17:16:31.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.055+0000 7f55525da700 1 -- 172.21.2.102:0/3143570527 wait complete. 2021-02-12T17:16:31.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.055+0000 7f55525da700 1 Processor -- start 2021-02-12T17:16:31.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f55525da700 1 -- start start 2021-02-12T17:16:31.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f55525da700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f554c062740 0x7f554c0ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f55525da700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f554c0b8d20 0x7f554c14cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f55525da700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f554c14e530 0x7f554c14d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f55525da700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0adbf0 con 0x7f554c0b8d20 2021-02-12T17:16:31.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f55525da700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0b5890 con 0x7f554c14e530 2021-02-12T17:16:31.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f55525da700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0b5b90 con 0x7f554c062740 2021-02-12T17:16:31.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f554b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f554c0b8d20 0x7f554c14cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f554b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f554c0b8d20 0x7f554c14cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45522/0 (socket says 172.21.2.102:45522) 2021-02-12T17:16:31.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f554b7fe700 1 -- 172.21.2.102:0/1304399066 learned_addr learned my addr 172.21.2.102:0/1304399066 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:31.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f554b7fe700 1 -- 172.21.2.102:0/1304399066 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f554c062740 msgr2=0x7f554c0ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f554b7fe700 1 --2- 172.21.2.102:0/1304399066 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f554c062740 0x7f554c0ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:31.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f554b7fe700 1 -- 172.21.2.102:0/1304399066 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f554c14e530 msgr2=0x7f554c14d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f554b7fe700 1 --2- 172.21.2.102:0/1304399066 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f554c14e530 0x7f554c14d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:31.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.056+0000 7f554b7fe700 1 -- 172.21.2.102:0/1304399066 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0b5e30 con 0x7f554c0b8d20 2021-02-12T17:16:31.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.057+0000 7f554b7fe700 1 --2- 172.21.2.102:0/1304399066 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f554c0b8d20 0x7f554c14cb40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f554c0653c0 tx=0x7f5540016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:31.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.057+0000 7f5533fff700 1 -- 172.21.2.102:0/1304399066 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554001c420 con 0x7f554c0b8d20 2021-02-12T17:16:31.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.057+0000 7f5533fff700 1 -- 172.21.2.102:0/1304399066 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554001c580 con 0x7f554c0b8d20 2021-02-12T17:16:31.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.057+0000 7f55525da700 1 -- 172.21.2.102:0/1304399066 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c0ad4b0 con 0x7f554c0b8d20 2021-02-12T17:16:31.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.057+0000 7f55525da700 1 -- 172.21.2.102:0/1304399066 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c0b5580 con 0x7f554c0b8d20 2021-02-12T17:16:31.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.057+0000 7f5533fff700 1 -- 172.21.2.102:0/1304399066 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554001c940 con 0x7f554c0b8d20 2021-02-12T17:16:31.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.058+0000 7f55525da700 1 -- 172.21.2.102:0/1304399066 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c0ad910 con 0x7f554c0b8d20 2021-02-12T17:16:31.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.058+0000 7f5533fff700 1 -- 172.21.2.102:0/1304399066 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f554000f070 con 0x7f554c0b8d20 2021-02-12T17:16:31.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.058+0000 7f5533fff700 1 --2- 172.21.2.102:0/1304399066 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f552c059d80 0x7f552c05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.058+0000 7f5533fff700 1 -- 172.21.2.102:0/1304399066 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f55400754a0 con 0x7f554c0b8d20 2021-02-12T17:16:31.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.058+0000 7f554bfff700 1 --2- 172.21.2.102:0/1304399066 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f552c059d80 0x7f552c05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.058+0000 7f554bfff700 1 --2- 172.21.2.102:0/1304399066 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f552c059d80 0x7f552c05c240 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5544009800 tx=0x7f5544006d20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:31.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.061+0000 7f5533fff700 1 -- 172.21.2.102:0/1304399066 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f5540048c40 con 0x7f554c0b8d20 2021-02-12T17:16:31.189 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.187+0000 7f55525da700 1 -- 172.21.2.102:0/1304399066 --> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f554c045460 con 0x7f552c059d80 2021-02-12T17:16:31.193 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.190+0000 7f5533fff700 1 -- 172.21.2.102:0/1304399066 <== mgr.4107 v2:172.21.2.102:6832/37352 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+120181 (secure 0 0 0) 0x7f554c045460 con 0x7f552c059d80 2021-02-12T17:16:31.193 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.192+0000 7f55525da700 1 -- 172.21.2.102:0/1304399066 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f552c059d80 msgr2=0x7f552c05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.193 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.192+0000 7f55525da700 1 --2- 172.21.2.102:0/1304399066 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f552c059d80 0x7f552c05c240 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5544009800 tx=0x7f5544006d20).stop 2021-02-12T17:16:31.193 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.192+0000 7f55525da700 1 -- 172.21.2.102:0/1304399066 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f554c0b8d20 msgr2=0x7f554c14cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.193 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.192+0000 7f55525da700 1 --2- 172.21.2.102:0/1304399066 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f554c0b8d20 0x7f554c14cb40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f554c0653c0 tx=0x7f5540016000).stop 2021-02-12T17:16:31.193 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:31.194 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.192+0000 7f55525da700 1 -- 172.21.2.102:0/1304399066 shutdown_connections 2021-02-12T17:16:31.194 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.192+0000 7f55525da700 1 --2- 172.21.2.102:0/1304399066 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f554c14e530 0x7f554c14d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:31.194 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.192+0000 7f55525da700 1 --2- 172.21.2.102:0/1304399066 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f554c062740 0x7f554c0ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:31.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.192+0000 7f55525da700 1 --2- 172.21.2.102:0/1304399066 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f552c059d80 0x7f552c05c240 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.192+0000 7f55525da700 1 --2- 172.21.2.102:0/1304399066 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f554c0b8d20 0x7f554c14cb40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.192+0000 7f55525da700 1 -- 172.21.2.102:0/1304399066 >> 172.21.2.102:0/1304399066 conn(0x7f554c0bc480 msgr2=0x7f554c0b7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:31.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.192+0000 7f55525da700 1 -- 172.21.2.102:0/1304399066 shutdown_connections 2021-02-12T17:16:31.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.192+0000 7f55525da700 1 -- 172.21.2.102:0/1304399066 wait complete. 2021-02-12T17:16:31.195 INFO:teuthology.orchestra.run.gibba002.stderr:dumped all 2021-02-12T17:16:31.202 INFO:teuthology.orchestra.run.gibba002.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2021-02-12T17:16:29.591523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5492,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41820,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":39360,"kb_avail":754932900,"statfs":{"total":773094113280,"available":773051289600,"internally_reserved":0,"allocated":2453504,"data_stored":972879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40304640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":880,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002178"},"pg_stats":[{"pgid":"6.3","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537876+0000","last_change":"2021-02-12T17:16:08.536920+0000","last_active":"2021-02-12T17:16:08.537876+0000","last_peered":"2021-02-12T17:16:08.537876+0000","last_clean":"2021-02-12T17:16:08.537876+0000","last_became_active":"2021-02-12T17:16:08.536774+0000","last_became_peered":"2021-02-12T17:16:08.536774+0000","last_unstale":"2021-02-12T17:16:08.537876+0000","last_undegraded":"2021-02-12T17:16:08.537876+0000","last_fullsized":"2021-02-12T17:16:08.537876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"22'4","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534492+0000","last_change":"2021-02-12T17:16:01.721000+0000","last_active":"2021-02-12T17:16:08.534492+0000","last_peered":"2021-02-12T17:16:08.534492+0000","last_clean":"2021-02-12T17:16:08.534492+0000","last_became_active":"2021-02-12T17:16:01.720788+0000","last_became_peered":"2021-02-12T17:16:01.720788+0000","last_unstale":"2021-02-12T17:16:08.534492+0000","last_undegraded":"2021-02-12T17:16:08.534492+0000","last_fullsized":"2021-02-12T17:16:08.534492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534240+0000","last_change":"2021-02-12T17:15:58.624633+0000","last_active":"2021-02-12T17:16:08.534240+0000","last_peered":"2021-02-12T17:16:08.534240+0000","last_clean":"2021-02-12T17:16:08.534240+0000","last_became_active":"2021-02-12T17:15:58.624463+0000","last_became_peered":"2021-02-12T17:15:58.624463+0000","last_unstale":"2021-02-12T17:16:08.534240+0000","last_undegraded":"2021-02-12T17:16:08.534240+0000","last_fullsized":"2021-02-12T17:16:08.534240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535181+0000","last_change":"2021-02-12T17:16:02.000491+0000","last_active":"2021-02-12T17:16:08.535181+0000","last_peered":"2021-02-12T17:16:08.535181+0000","last_clean":"2021-02-12T17:16:08.535181+0000","last_became_active":"2021-02-12T17:16:02.000325+0000","last_became_peered":"2021-02-12T17:16:02.000325+0000","last_unstale":"2021-02-12T17:16:08.535181+0000","last_undegraded":"2021-02-12T17:16:08.535181+0000","last_fullsized":"2021-02-12T17:16:08.535181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'8","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539481+0000","last_change":"2021-02-12T17:16:08.266576+0000","last_active":"2021-02-12T17:16:08.539481+0000","last_peered":"2021-02-12T17:16:08.539481+0000","last_clean":"2021-02-12T17:16:08.539481+0000","last_became_active":"2021-02-12T17:16:08.266349+0000","last_became_peered":"2021-02-12T17:16:08.266349+0000","last_unstale":"2021-02-12T17:16:08.539481+0000","last_undegraded":"2021-02-12T17:16:08.539481+0000","last_fullsized":"2021-02-12T17:16:08.539481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534571+0000","last_change":"2021-02-12T17:15:58.624453+0000","last_active":"2021-02-12T17:16:08.534571+0000","last_peered":"2021-02-12T17:16:08.534571+0000","last_clean":"2021-02-12T17:16:08.534571+0000","last_became_active":"2021-02-12T17:15:58.624258+0000","last_became_peered":"2021-02-12T17:15:58.624258+0000","last_unstale":"2021-02-12T17:16:08.534571+0000","last_undegraded":"2021-02-12T17:16:08.534571+0000","last_fullsized":"2021-02-12T17:16:08.534571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'6","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533638+0000","last_change":"2021-02-12T17:16:01.721442+0000","last_active":"2021-02-12T17:16:08.533638+0000","last_peered":"2021-02-12T17:16:08.533638+0000","last_clean":"2021-02-12T17:16:08.533638+0000","last_became_active":"2021-02-12T17:16:01.721222+0000","last_became_peered":"2021-02-12T17:16:01.721222+0000","last_unstale":"2021-02-12T17:16:08.533638+0000","last_undegraded":"2021-02-12T17:16:08.533638+0000","last_fullsized":"2021-02-12T17:16:08.533638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":576,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533455+0000","last_change":"2021-02-12T17:16:02.001124+0000","last_active":"2021-02-12T17:16:08.533455+0000","last_peered":"2021-02-12T17:16:08.533455+0000","last_clean":"2021-02-12T17:16:08.533455+0000","last_became_active":"2021-02-12T17:16:02.000908+0000","last_became_peered":"2021-02-12T17:16:02.000908+0000","last_unstale":"2021-02-12T17:16:08.533455+0000","last_undegraded":"2021-02-12T17:16:08.533455+0000","last_fullsized":"2021-02-12T17:16:08.533455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"10","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535130+0000","last_change":"2021-02-12T17:16:08.267064+0000","last_active":"2021-02-12T17:16:08.535130+0000","last_peered":"2021-02-12T17:16:08.535130+0000","last_clean":"2021-02-12T17:16:08.535130+0000","last_became_active":"2021-02-12T17:16:08.266819+0000","last_became_peered":"2021-02-12T17:16:08.266819+0000","last_unstale":"2021-02-12T17:16:08.535130+0000","last_undegraded":"2021-02-12T17:16:08.535130+0000","last_fullsized":"2021-02-12T17:16:08.535130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539615+0000","last_change":"2021-02-12T17:16:08.539171+0000","last_active":"2021-02-12T17:16:08.539615+0000","last_peered":"2021-02-12T17:16:08.539615+0000","last_clean":"2021-02-12T17:16:08.539615+0000","last_became_active":"2021-02-12T17:16:08.538969+0000","last_became_peered":"2021-02-12T17:16:08.538969+0000","last_unstale":"2021-02-12T17:16:08.539615+0000","last_undegraded":"2021-02-12T17:16:08.539615+0000","last_fullsized":"2021-02-12T17:16:08.539615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'10","reported_seq":"25","reported_epoch":"27","state":"active+clean","last_fresh":"2021-02-12T17:16:23.347010+0000","last_change":"2021-02-12T17:16:01.722429+0000","last_active":"2021-02-12T17:16:23.347010+0000","last_peered":"2021-02-12T17:16:23.347010+0000","last_clean":"2021-02-12T17:16:23.347010+0000","last_became_active":"2021-02-12T17:16:01.722278+0000","last_became_peered":"2021-02-12T17:16:01.722278+0000","last_unstale":"2021-02-12T17:16:23.347010+0000","last_undegraded":"2021-02-12T17:16:23.347010+0000","last_fullsized":"2021-02-12T17:16:23.347010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534759+0000","last_change":"2021-02-12T17:15:59.564623+0000","last_active":"2021-02-12T17:16:08.534759+0000","last_peered":"2021-02-12T17:16:08.534759+0000","last_clean":"2021-02-12T17:16:08.534759+0000","last_became_active":"2021-02-12T17:15:59.564259+0000","last_became_peered":"2021-02-12T17:15:59.564259+0000","last_unstale":"2021-02-12T17:16:08.534759+0000","last_undegraded":"2021-02-12T17:16:08.534759+0000","last_fullsized":"2021-02-12T17:16:08.534759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534404+0000","last_change":"2021-02-12T17:16:01.998996+0000","last_active":"2021-02-12T17:16:08.534404+0000","last_peered":"2021-02-12T17:16:08.534404+0000","last_clean":"2021-02-12T17:16:08.534404+0000","last_became_active":"2021-02-12T17:16:01.998787+0000","last_became_peered":"2021-02-12T17:16:01.998787+0000","last_unstale":"2021-02-12T17:16:08.534404+0000","last_undegraded":"2021-02-12T17:16:08.534404+0000","last_fullsized":"2021-02-12T17:16:08.534404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"26'1","reported_seq":"11","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537289+0000","last_change":"2021-02-12T17:16:08.266772+0000","last_active":"2021-02-12T17:16:08.537289+0000","last_peered":"2021-02-12T17:16:08.537289+0000","last_clean":"2021-02-12T17:16:08.537289+0000","last_became_active":"2021-02-12T17:16:08.266590+0000","last_became_peered":"2021-02-12T17:16:08.266590+0000","last_unstale":"2021-02-12T17:16:08.537289+0000","last_undegraded":"2021-02-12T17:16:08.537289+0000","last_fullsized":"2021-02-12T17:16:08.537289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538271+0000","last_change":"2021-02-12T17:16:08.537438+0000","last_active":"2021-02-12T17:16:08.538271+0000","last_peered":"2021-02-12T17:16:08.538271+0000","last_clean":"2021-02-12T17:16:08.538271+0000","last_became_active":"2021-02-12T17:16:08.537259+0000","last_became_peered":"2021-02-12T17:16:08.537259+0000","last_unstale":"2021-02-12T17:16:08.538271+0000","last_undegraded":"2021-02-12T17:16:08.538271+0000","last_fullsized":"2021-02-12T17:16:08.538271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537972+0000","last_change":"2021-02-12T17:16:08.536661+0000","last_active":"2021-02-12T17:16:08.537972+0000","last_peered":"2021-02-12T17:16:08.537972+0000","last_clean":"2021-02-12T17:16:08.537972+0000","last_became_active":"2021-02-12T17:16:08.536432+0000","last_became_peered":"2021-02-12T17:16:08.536432+0000","last_unstale":"2021-02-12T17:16:08.537972+0000","last_undegraded":"2021-02-12T17:16:08.537972+0000","last_fullsized":"2021-02-12T17:16:08.537972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534307+0000","last_change":"2021-02-12T17:16:01.721350+0000","last_active":"2021-02-12T17:16:08.534307+0000","last_peered":"2021-02-12T17:16:08.534307+0000","last_clean":"2021-02-12T17:16:08.534307+0000","last_became_active":"2021-02-12T17:16:01.721143+0000","last_became_peered":"2021-02-12T17:16:01.721143+0000","last_unstale":"2021-02-12T17:16:08.534307+0000","last_undegraded":"2021-02-12T17:16:08.534307+0000","last_fullsized":"2021-02-12T17:16:08.534307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534765+0000","last_change":"2021-02-12T17:15:58.623963+0000","last_active":"2021-02-12T17:16:08.534765+0000","last_peered":"2021-02-12T17:16:08.534765+0000","last_clean":"2021-02-12T17:16:08.534765+0000","last_became_active":"2021-02-12T17:15:58.623796+0000","last_became_peered":"2021-02-12T17:15:58.623796+0000","last_unstale":"2021-02-12T17:16:08.534765+0000","last_undegraded":"2021-02-12T17:16:08.534765+0000","last_fullsized":"2021-02-12T17:16:08.534765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534425+0000","last_change":"2021-02-12T17:16:02.001353+0000","last_active":"2021-02-12T17:16:08.534425+0000","last_peered":"2021-02-12T17:16:08.534425+0000","last_clean":"2021-02-12T17:16:08.534425+0000","last_became_active":"2021-02-12T17:16:02.001120+0000","last_became_peered":"2021-02-12T17:16:02.001120+0000","last_unstale":"2021-02-12T17:16:08.534425+0000","last_undegraded":"2021-02-12T17:16:08.534425+0000","last_fullsized":"2021-02-12T17:16:08.534425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"26'6","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538852+0000","last_change":"2021-02-12T17:16:08.266750+0000","last_active":"2021-02-12T17:16:08.538852+0000","last_peered":"2021-02-12T17:16:08.538852+0000","last_clean":"2021-02-12T17:16:08.538852+0000","last_became_active":"2021-02-12T17:16:08.266527+0000","last_became_peered":"2021-02-12T17:16:08.266527+0000","last_unstale":"2021-02-12T17:16:08.538852+0000","last_undegraded":"2021-02-12T17:16:08.538852+0000","last_fullsized":"2021-02-12T17:16:08.538852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":576,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538178+0000","last_change":"2021-02-12T17:16:08.537723+0000","last_active":"2021-02-12T17:16:08.538178+0000","last_peered":"2021-02-12T17:16:08.538178+0000","last_clean":"2021-02-12T17:16:08.538178+0000","last_became_active":"2021-02-12T17:16:08.537507+0000","last_became_peered":"2021-02-12T17:16:08.537507+0000","last_unstale":"2021-02-12T17:16:08.538178+0000","last_undegraded":"2021-02-12T17:16:08.538178+0000","last_fullsized":"2021-02-12T17:16:08.538178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533639+0000","last_change":"2021-02-12T17:16:01.721104+0000","last_active":"2021-02-12T17:16:08.533639+0000","last_peered":"2021-02-12T17:16:08.533639+0000","last_clean":"2021-02-12T17:16:08.533639+0000","last_became_active":"2021-02-12T17:16:01.720876+0000","last_became_peered":"2021-02-12T17:16:01.720876+0000","last_unstale":"2021-02-12T17:16:08.533639+0000","last_undegraded":"2021-02-12T17:16:08.533639+0000","last_fullsized":"2021-02-12T17:16:08.533639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534709+0000","last_change":"2021-02-12T17:15:57.566001+0000","last_active":"2021-02-12T17:16:08.534709+0000","last_peered":"2021-02-12T17:16:08.534709+0000","last_clean":"2021-02-12T17:16:08.534709+0000","last_became_active":"2021-02-12T17:15:57.565738+0000","last_became_peered":"2021-02-12T17:15:57.565738+0000","last_unstale":"2021-02-12T17:16:08.534709+0000","last_undegraded":"2021-02-12T17:16:08.534709+0000","last_fullsized":"2021-02-12T17:16:08.534709+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:55.600099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:55.600099+0000","last_clean_scrub_stamp":"2021-02-12T17:15:55.600099+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535046+0000","last_change":"2021-02-12T17:15:58.624830+0000","last_active":"2021-02-12T17:16:08.535046+0000","last_peered":"2021-02-12T17:16:08.535046+0000","last_clean":"2021-02-12T17:16:08.535046+0000","last_became_active":"2021-02-12T17:15:58.624647+0000","last_became_peered":"2021-02-12T17:15:58.624647+0000","last_unstale":"2021-02-12T17:16:08.535046+0000","last_undegraded":"2021-02-12T17:16:08.535046+0000","last_fullsized":"2021-02-12T17:16:08.535046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534228+0000","last_change":"2021-02-12T17:16:03.011987+0000","last_active":"2021-02-12T17:16:08.534228+0000","last_peered":"2021-02-12T17:16:08.534228+0000","last_clean":"2021-02-12T17:16:08.534228+0000","last_became_active":"2021-02-12T17:16:03.011668+0000","last_became_peered":"2021-02-12T17:16:03.011668+0000","last_unstale":"2021-02-12T17:16:08.534228+0000","last_undegraded":"2021-02-12T17:16:08.534228+0000","last_fullsized":"2021-02-12T17:16:08.534228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"27'10","reported_seq":"20","reported_epoch":"27","state":"active+clean","last_fresh":"2021-02-12T17:16:25.351443+0000","last_change":"2021-02-12T17:16:08.267110+0000","last_active":"2021-02-12T17:16:25.351443+0000","last_peered":"2021-02-12T17:16:25.351443+0000","last_clean":"2021-02-12T17:16:25.351443+0000","last_became_active":"2021-02-12T17:16:08.266920+0000","last_became_peered":"2021-02-12T17:16:08.266920+0000","last_unstale":"2021-02-12T17:16:25.351443+0000","last_undegraded":"2021-02-12T17:16:25.351443+0000","last_fullsized":"2021-02-12T17:16:25.351443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.537881+0000","last_change":"2021-02-12T17:16:08.536884+0000","last_active":"2021-02-12T17:16:08.537881+0000","last_peered":"2021-02-12T17:16:08.537881+0000","last_clean":"2021-02-12T17:16:08.537881+0000","last_became_active":"2021-02-12T17:16:08.536645+0000","last_became_peered":"2021-02-12T17:16:08.536645+0000","last_unstale":"2021-02-12T17:16:08.537881+0000","last_undegraded":"2021-02-12T17:16:08.537881+0000","last_fullsized":"2021-02-12T17:16:08.537881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"21'8","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534414+0000","last_change":"2021-02-12T17:16:01.722384+0000","last_active":"2021-02-12T17:16:08.534414+0000","last_peered":"2021-02-12T17:16:08.534414+0000","last_clean":"2021-02-12T17:16:08.534414+0000","last_became_active":"2021-02-12T17:16:01.722205+0000","last_became_peered":"2021-02-12T17:16:01.722205+0000","last_unstale":"2021-02-12T17:16:08.534414+0000","last_undegraded":"2021-02-12T17:16:08.534414+0000","last_fullsized":"2021-02-12T17:16:08.534414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.533448+0000","last_change":"2021-02-12T17:15:59.594109+0000","last_active":"2021-02-12T17:16:08.533448+0000","last_peered":"2021-02-12T17:16:08.533448+0000","last_clean":"2021-02-12T17:16:08.533448+0000","last_became_active":"2021-02-12T17:15:59.593760+0000","last_became_peered":"2021-02-12T17:15:59.593760+0000","last_unstale":"2021-02-12T17:16:08.533448+0000","last_undegraded":"2021-02-12T17:16:08.533448+0000","last_fullsized":"2021-02-12T17:16:08.533448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534623+0000","last_change":"2021-02-12T17:16:01.999606+0000","last_active":"2021-02-12T17:16:08.534623+0000","last_peered":"2021-02-12T17:16:08.534623+0000","last_clean":"2021-02-12T17:16:08.534623+0000","last_became_active":"2021-02-12T17:16:01.999372+0000","last_became_peered":"2021-02-12T17:16:01.999372+0000","last_unstale":"2021-02-12T17:16:08.534623+0000","last_undegraded":"2021-02-12T17:16:08.534623+0000","last_fullsized":"2021-02-12T17:16:08.534623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'4","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2021-02-12T17:16:10.411461+0000","last_change":"2021-02-12T17:16:08.266989+0000","last_active":"2021-02-12T17:16:10.411461+0000","last_peered":"2021-02-12T17:16:10.411461+0000","last_clean":"2021-02-12T17:16:10.411461+0000","last_became_active":"2021-02-12T17:16:08.266748+0000","last_became_peered":"2021-02-12T17:16:08.266748+0000","last_unstale":"2021-02-12T17:16:10.411461+0000","last_undegraded":"2021-02-12T17:16:10.411461+0000","last_fullsized":"2021-02-12T17:16:10.411461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539087+0000","last_change":"2021-02-12T17:16:08.536725+0000","last_active":"2021-02-12T17:16:08.539087+0000","last_peered":"2021-02-12T17:16:08.539087+0000","last_clean":"2021-02-12T17:16:08.539087+0000","last_became_active":"2021-02-12T17:16:08.536504+0000","last_became_peered":"2021-02-12T17:16:08.536504+0000","last_unstale":"2021-02-12T17:16:08.539087+0000","last_undegraded":"2021-02-12T17:16:08.539087+0000","last_fullsized":"2021-02-12T17:16:08.539087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"21'5","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535179+0000","last_change":"2021-02-12T17:16:01.721973+0000","last_active":"2021-02-12T17:16:08.535179+0000","last_peered":"2021-02-12T17:16:08.535179+0000","last_clean":"2021-02-12T17:16:08.535179+0000","last_became_active":"2021-02-12T17:16:01.721814+0000","last_became_peered":"2021-02-12T17:16:01.721814+0000","last_unstale":"2021-02-12T17:16:08.535179+0000","last_undegraded":"2021-02-12T17:16:08.535179+0000","last_fullsized":"2021-02-12T17:16:08.535179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535007+0000","last_change":"2021-02-12T17:15:58.624836+0000","last_active":"2021-02-12T17:16:08.535007+0000","last_peered":"2021-02-12T17:16:08.535007+0000","last_clean":"2021-02-12T17:16:08.535007+0000","last_became_active":"2021-02-12T17:15:58.624621+0000","last_became_peered":"2021-02-12T17:15:58.624621+0000","last_unstale":"2021-02-12T17:16:08.535007+0000","last_undegraded":"2021-02-12T17:16:08.535007+0000","last_fullsized":"2021-02-12T17:16:08.535007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534638+0000","last_change":"2021-02-12T17:16:02.003453+0000","last_active":"2021-02-12T17:16:08.534638+0000","last_peered":"2021-02-12T17:16:08.534638+0000","last_clean":"2021-02-12T17:16:08.534638+0000","last_became_active":"2021-02-12T17:16:02.003266+0000","last_became_peered":"2021-02-12T17:16:02.003266+0000","last_unstale":"2021-02-12T17:16:08.534638+0000","last_undegraded":"2021-02-12T17:16:08.534638+0000","last_fullsized":"2021-02-12T17:16:08.534638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'6","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539389+0000","last_change":"2021-02-12T17:16:08.266987+0000","last_active":"2021-02-12T17:16:08.539389+0000","last_peered":"2021-02-12T17:16:08.539389+0000","last_clean":"2021-02-12T17:16:08.539389+0000","last_became_active":"2021-02-12T17:16:08.266792+0000","last_became_peered":"2021-02-12T17:16:08.266792+0000","last_unstale":"2021-02-12T17:16:08.539389+0000","last_undegraded":"2021-02-12T17:16:08.539389+0000","last_fullsized":"2021-02-12T17:16:08.539389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"21'6","reported_seq":"21","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.535024+0000","last_change":"2021-02-12T17:16:01.722204+0000","last_active":"2021-02-12T17:16:08.535024+0000","last_peered":"2021-02-12T17:16:08.535024+0000","last_clean":"2021-02-12T17:16:08.535024+0000","last_became_active":"2021-02-12T17:16:01.722060+0000","last_became_peered":"2021-02-12T17:16:01.722060+0000","last_unstale":"2021-02-12T17:16:08.535024+0000","last_undegraded":"2021-02-12T17:16:08.535024+0000","last_fullsized":"2021-02-12T17:16:08.535024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:00.709176+0000","last_clean_scrub_stamp":"2021-02-12T17:16:00.709176+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534569+0000","last_change":"2021-02-12T17:15:59.564122+0000","last_active":"2021-02-12T17:16:08.534569+0000","last_peered":"2021-02-12T17:16:08.534569+0000","last_clean":"2021-02-12T17:16:08.534569+0000","last_became_active":"2021-02-12T17:15:59.563695+0000","last_became_peered":"2021-02-12T17:15:59.563695+0000","last_unstale":"2021-02-12T17:16:08.534569+0000","last_undegraded":"2021-02-12T17:16:08.534569+0000","last_fullsized":"2021-02-12T17:16:08.534569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:15:57.609104+0000","last_clean_scrub_stamp":"2021-02-12T17:15:57.609104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.534411+0000","last_change":"2021-02-12T17:16:01.999102+0000","last_active":"2021-02-12T17:16:08.534411+0000","last_peered":"2021-02-12T17:16:08.534411+0000","last_clean":"2021-02-12T17:16:08.534411+0000","last_became_active":"2021-02-12T17:16:01.998815+0000","last_became_peered":"2021-02-12T17:16:01.998815+0000","last_unstale":"2021-02-12T17:16:08.534411+0000","last_undegraded":"2021-02-12T17:16:08.534411+0000","last_fullsized":"2021-02-12T17:16:08.534411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:01.712515+0000","last_clean_scrub_stamp":"2021-02-12T17:16:01.712515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"26'5","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.539870+0000","last_change":"2021-02-12T17:16:08.267434+0000","last_active":"2021-02-12T17:16:08.539870+0000","last_peered":"2021-02-12T17:16:08.539870+0000","last_clean":"2021-02-12T17:16:08.539870+0000","last_became_active":"2021-02-12T17:16:08.267218+0000","last_became_peered":"2021-02-12T17:16:08.267218+0000","last_unstale":"2021-02-12T17:16:08.539870+0000","last_undegraded":"2021-02-12T17:16:08.539870+0000","last_fullsized":"2021-02-12T17:16:08.539870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:07.253001+0000","last_clean_scrub_stamp":"2021-02-12T17:16:07.253001+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"9","reported_epoch":"26","state":"active+clean","last_fresh":"2021-02-12T17:16:08.538696+0000","last_change":"2021-02-12T17:16:08.535970+0000","last_active":"2021-02-12T17:16:08.538696+0000","last_peered":"2021-02-12T17:16:08.538696+0000","last_clean":"2021-02-12T17:16:08.538696+0000","last_became_active":"2021-02-12T17:16:08.535744+0000","last_became_peered":"2021-02-12T17:16:08.535744+0000","last_unstale":"2021-02-12T17:16:08.538696+0000","last_undegraded":"2021-02-12T17:16:08.538696+0000","last_fullsized":"2021-02-12T17:16:08.538696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-12T17:16:08.256777+0000","last_clean_scrub_stamp":"2021-02-12T17:16:08.256777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":2746,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":16,"acting":16,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2746,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":120499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5312,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366528,"statfs":{"total":96636764160,"available":96631324672,"internally_reserved":0,"allocated":319488,"data_stored":123177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":120693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4039999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5244,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366596,"statfs":{"total":96636764160,"available":96631394304,"internally_reserved":0,"allocated":315392,"data_stored":123977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":120499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5236,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366604,"statfs":{"total":96636764160,"available":96631402496,"internally_reserved":0,"allocated":307200,"data_stored":121201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]}]}} 2021-02-12T17:16:31.204 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:31.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.290+0000 7f243fab6700 1 Processor -- start 2021-02-12T17:16:31.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.290+0000 7f243fab6700 1 -- start start 2021-02-12T17:16:31.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.291+0000 7f243fab6700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f24380b8d20 0x7f2438068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.291+0000 7f243fab6700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f243814e530 0x7f24380b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.291+0000 7f243fab6700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24380622a0 con 0x7f2438062740 2021-02-12T17:16:31.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.291+0000 7f243fab6700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2438068d20 con 0x7f243814e530 2021-02-12T17:16:31.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.291+0000 7f243fab6700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243814ea10 con 0x7f24380b8d20 2021-02-12T17:16:31.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.291+0000 7f243e053700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f2438062740 0x7f2438062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54176/0 (socket says 172.21.2.102:54176) 2021-02-12T17:16:31.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.291+0000 7f243e053700 1 -- 172.21.2.102:0/2168438392 learned_addr learned my addr 172.21.2.102:0/2168438392 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:31.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.291+0000 7f243d051700 1 --2- 172.21.2.102:0/2168438392 >> v2:172.21.2.102:3300/0 conn(0x7f243814e530 0x7f24380b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.294 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.291+0000 7f243d852700 1 --2- 172.21.2.102:0/2168438392 >> v2:172.21.2.104:3300/0 conn(0x7f24380b8d20 0x7f2438068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.294 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243d051700 1 -- 172.21.2.102:0/2168438392 >> v2:172.21.2.104:3300/0 conn(0x7f24380b8d20 msgr2=0x7f2438068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:31.294 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243d051700 1 --2- 172.21.2.102:0/2168438392 >> v2:172.21.2.104:3300/0 conn(0x7f24380b8d20 0x7f2438068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.294 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243d051700 1 -- 172.21.2.102:0/2168438392 >> v1:172.21.2.102:6789/0 conn(0x7f2438062740 legacy=0x7f2438062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.294 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243d051700 1 -- 172.21.2.102:0/2168438392 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380b63f0 con 0x7f243814e530 2021-02-12T17:16:31.294 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243d852700 1 --2- 172.21.2.102:0/2168438392 >> v2:172.21.2.104:3300/0 conn(0x7f24380b8d20 0x7f2438068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:31.294 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243d051700 1 --2- 172.21.2.102:0/2168438392 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f243814e530 0x7f24380b7250 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f243806abc0 tx=0x7f2434006de0).ready entity=mon.0 client_cookie=cf8d735160ea347 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:31.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243c850700 1 -- 172.21.2.102:0/2168438392 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24340097e0 con 0x7f243814e530 2021-02-12T17:16:31.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243c850700 1 -- 172.21.2.102:0/2168438392 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2434009940 con 0x7f243814e530 2021-02-12T17:16:31.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243c850700 1 -- 172.21.2.102:0/2168438392 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434009cc0 con 0x7f243814e530 2021-02-12T17:16:31.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243fab6700 1 -- 172.21.2.102:0/2168438392 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f243814e530 msgr2=0x7f24380b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243fab6700 1 --2- 172.21.2.102:0/2168438392 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f243814e530 0x7f24380b7250 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f243806abc0 tx=0x7f2434006de0).stop 2021-02-12T17:16:31.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243fab6700 1 -- 172.21.2.102:0/2168438392 shutdown_connections 2021-02-12T17:16:31.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243fab6700 1 --2- 172.21.2.102:0/2168438392 >> v2:172.21.2.104:3300/0 conn(0x7f24380b8d20 0x7f2438068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243fab6700 1 --2- 172.21.2.102:0/2168438392 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f243814e530 0x7f24380b7250 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.292+0000 7f243fab6700 1 -- 172.21.2.102:0/2168438392 >> 172.21.2.102:0/2168438392 conn(0x7f24380bc480 msgr2=0x7f24380b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:31.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.293+0000 7f243fab6700 1 -- 172.21.2.102:0/2168438392 shutdown_connections 2021-02-12T17:16:31.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.293+0000 7f243fab6700 1 -- 172.21.2.102:0/2168438392 wait complete. 2021-02-12T17:16:31.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.293+0000 7f243fab6700 1 Processor -- start 2021-02-12T17:16:31.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.293+0000 7f243fab6700 1 -- start start 2021-02-12T17:16:31.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243fab6700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2438062740 0x7f243815d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243fab6700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24380b8d20 0x7f243811d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243fab6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f243814e530 0x7f24380b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243fab6700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24380badd0 con 0x7f2438062740 2021-02-12T17:16:31.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243fab6700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24380af850 con 0x7f24380b8d20 2021-02-12T17:16:31.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243fab6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24380afaf0 con 0x7f243814e530 2021-02-12T17:16:31.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243d852700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2438062740 0x7f243815d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243d852700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2438062740 0x7f243815d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45536/0 (socket says 172.21.2.102:45536) 2021-02-12T17:16:31.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243d852700 1 -- 172.21.2.102:0/721617047 learned_addr learned my addr 172.21.2.102:0/721617047 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:31.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243d051700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24380b8d20 0x7f243811d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243e053700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f243814e530 0x7f24380b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243d852700 1 -- 172.21.2.102:0/721617047 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f243814e530 msgr2=0x7f24380b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243d852700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f243814e530 0x7f24380b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243d852700 1 -- 172.21.2.102:0/721617047 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24380b8d20 msgr2=0x7f243811d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243d852700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24380b8d20 0x7f243811d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243d852700 1 -- 172.21.2.102:0/721617047 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380afd90 con 0x7f2438062740 2021-02-12T17:16:31.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243d051700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24380b8d20 0x7f243811d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:31.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243e053700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f243814e530 0x7f24380b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:31.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.294+0000 7f243d852700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2438062740 0x7f243815d520 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f242800cb50 tx=0x7f2428008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:31.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.295+0000 7f2425ffb700 1 -- 172.21.2.102:0/721617047 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24280077d0 con 0x7f2438062740 2021-02-12T17:16:31.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.295+0000 7f2425ffb700 1 -- 172.21.2.102:0/721617047 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2428007930 con 0x7f2438062740 2021-02-12T17:16:31.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.295+0000 7f243fab6700 1 -- 172.21.2.102:0/721617047 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24380b0030 con 0x7f2438062740 2021-02-12T17:16:31.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.295+0000 7f2425ffb700 1 -- 172.21.2.102:0/721617047 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428007cb0 con 0x7f2438062740 2021-02-12T17:16:31.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.295+0000 7f243fab6700 1 -- 172.21.2.102:0/721617047 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243811da60 con 0x7f2438062740 2021-02-12T17:16:31.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.295+0000 7f243fab6700 1 -- 172.21.2.102:0/721617047 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24380b0490 con 0x7f2438062740 2021-02-12T17:16:31.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.295+0000 7f2425ffb700 1 -- 172.21.2.102:0/721617047 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f2428011620 con 0x7f2438062740 2021-02-12T17:16:31.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.296+0000 7f2425ffb700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2418059d30 0x7f241805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.296+0000 7f2425ffb700 1 -- 172.21.2.102:0/721617047 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f2428073c90 con 0x7f2438062740 2021-02-12T17:16:31.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.296+0000 7f243d051700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2418059d30 0x7f241805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.296+0000 7f243d051700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2418059d30 0x7f241805c1f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f243815e620 tx=0x7f2434016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:31.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.298+0000 7f2425ffb700 1 -- 172.21.2.102:0/721617047 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f2428047460 con 0x7f2438062740 2021-02-12T17:16:31.429 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.428+0000 7f243fab6700 1 -- 172.21.2.102:0/721617047 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2438045460 con 0x7f2438062740 2021-02-12T17:16:31.430 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.429+0000 7f2425ffb700 1 -- 172.21.2.102:0/721617047 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19888 (secure 0 0 0) 0x7f242804aa80 con 0x7f2438062740 2021-02-12T17:16:31.431 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:31.431 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":27,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:09.532002+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}},{"pool":5,"pool_name":"b_metadata","create_time":"2021-02-12T17:16:06.678651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}}},{"pool":6,"pool_name":"b_data","create_time":"2021-02-12T17:16:07.511756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"b"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:31.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.430+0000 7f243fab6700 1 -- 172.21.2.102:0/721617047 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2418059d30 msgr2=0x7f241805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.430+0000 7f243fab6700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2418059d30 0x7f241805c1f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f243815e620 tx=0x7f2434016000).stop 2021-02-12T17:16:31.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.430+0000 7f243fab6700 1 -- 172.21.2.102:0/721617047 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2438062740 msgr2=0x7f243815d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.430+0000 7f243fab6700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2438062740 0x7f243815d520 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f242800cb50 tx=0x7f2428008040).stop 2021-02-12T17:16:31.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.430+0000 7f243fab6700 1 -- 172.21.2.102:0/721617047 shutdown_connections 2021-02-12T17:16:31.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.430+0000 7f243fab6700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f243814e530 0x7f24380b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.430+0000 7f243fab6700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2418059d30 0x7f241805c1f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.430+0000 7f243fab6700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2438062740 0x7f243815d520 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.430+0000 7f243fab6700 1 --2- 172.21.2.102:0/721617047 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f24380b8d20 0x7f243811d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.430+0000 7f243fab6700 1 -- 172.21.2.102:0/721617047 >> 172.21.2.102:0/721617047 conn(0x7f24380bc480 msgr2=0x7f243814cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:31.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.430+0000 7f243fab6700 1 -- 172.21.2.102:0/721617047 shutdown_connections 2021-02-12T17:16:31.433 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.430+0000 7f243fab6700 1 -- 172.21.2.102:0/721617047 wait complete. 2021-02-12T17:16:31.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-12T17:15:54.614238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-12T17:15:56.701902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'a_metadata', 'create_time': '2021-02-12T17:15:59.832660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}}, {'pool': 4, 'pool_name': 'a_data', 'create_time': '2021-02-12T17:16:00.965024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'a'}}}, {'pool': 5, 'pool_name': 'b_metadata', 'create_time': '2021-02-12T17:16:06.678651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}}, {'pool': 6, 'pool_name': 'b_data', 'create_time': '2021-02-12T17:16:07.511756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'b'}}}] 2021-02-12T17:16:31.441 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-02-12T17:16:31.532 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.531+0000 7fe24410e700 1 Processor -- start 2021-02-12T17:16:31.532 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.531+0000 7fe24410e700 1 -- start start 2021-02-12T17:16:31.533 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe24410e700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fe23c0b0940 0x7fe23c14e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.533 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe24410e700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23c066b70 con 0x7fe23c09ada0 2021-02-12T17:16:31.533 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe24410e700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23c0685b0 con 0x7fe23c0bc2b0 2021-02-12T17:16:31.533 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe24410e700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23c0b27d0 con 0x7fe23c0b0940 2021-02-12T17:16:31.533 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe2426ab700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fe23c09ada0 0x7fe23c151830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54190/0 (socket says 172.21.2.102:54190) 2021-02-12T17:16:31.534 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe2426ab700 1 -- 172.21.2.102:0/11660214 learned_addr learned my addr 172.21.2.102:0/11660214 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:31.534 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 -- 172.21.2.102:0/11660214 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813239812 0 0) 0x7fe23c066b70 con 0x7fe23c09ada0 2021-02-12T17:16:31.534 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 -- 172.21.2.102:0/11660214 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe224003230 con 0x7fe23c09ada0 2021-02-12T17:16:31.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 -- 172.21.2.102:0/11660214 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3926980790 0 0) 0x7fe224003230 con 0x7fe23c09ada0 2021-02-12T17:16:31.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 -- 172.21.2.102:0/11660214 >> v2:172.21.2.104:3300/0 conn(0x7fe23c0b0940 msgr2=0x7fe23c14e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:31.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 --2- 172.21.2.102:0/11660214 >> v2:172.21.2.104:3300/0 conn(0x7fe23c0b0940 0x7fe23c14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:31.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 -- 172.21.2.102:0/11660214 >> v1:172.21.2.104:6789/0 conn(0x7fe23c0bc2b0 legacy=0x7fe23c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:31.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 -- 172.21.2.102:0/11660214 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c14e550 con 0x7fe23c09ada0 2021-02-12T17:16:31.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 -- 172.21.2.102:0/11660214 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fe234001860 con 0x7fe23c09ada0 2021-02-12T17:16:31.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 -- 172.21.2.102:0/11660214 >> v1:172.21.2.102:6789/0 conn(0x7fe23c09ada0 legacy=0x7fe23c151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 --2- 172.21.2.102:0/11660214 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe2240037a0 0x7fe224003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 --2- 172.21.2.102:0/11660214 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe2240044d0 0x7fe224004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 --2- 172.21.2.102:0/11660214 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe224004e40 0x7fe22400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 -- 172.21.2.102:0/11660214 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c0b27d0 con 0x7fe224004e40 2021-02-12T17:16:31.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 -- 172.21.2.102:0/11660214 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2240052f0 con 0x7fe2240044d0 2021-02-12T17:16:31.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.532+0000 7fe240ea8700 1 -- 172.21.2.102:0/11660214 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22400bc10 con 0x7fe2240037a0 2021-02-12T17:16:31.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe2426ab700 1 --2- 172.21.2.102:0/11660214 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe224004e40 0x7fe22400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe2416a9700 1 --2- 172.21.2.102:0/11660214 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe2240044d0 0x7fe224004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe241eaa700 1 --2- 172.21.2.102:0/11660214 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe2240037a0 0x7fe224003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe2426ab700 1 -- 172.21.2.102:0/11660214 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe2240037a0 msgr2=0x7fe224003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:31.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe2426ab700 1 --2- 172.21.2.102:0/11660214 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe2240037a0 0x7fe224003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe2426ab700 1 -- 172.21.2.102:0/11660214 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe2240044d0 msgr2=0x7fe224004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:31.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe2426ab700 1 --2- 172.21.2.102:0/11660214 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe2240044d0 0x7fe224004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.538 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe2426ab700 1 -- 172.21.2.102:0/11660214 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c14e550 con 0x7fe224004e40 2021-02-12T17:16:31.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe2426ab700 1 -- 172.21.2.102:0/11660214 reap_dead start 2021-02-12T17:16:31.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe2426ab700 1 --2- 172.21.2.102:0/11660214 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe224004e40 0x7fe22400b720 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fe23400c890 tx=0x7fe234007b40).ready entity=mon.0 client_cookie=b967cc21b5793333 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:31.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe240ea8700 1 -- 172.21.2.102:0/11660214 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234005b70 con 0x7fe224004e40 2021-02-12T17:16:31.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe240ea8700 1 -- 172.21.2.102:0/11660214 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe234005cd0 con 0x7fe224004e40 2021-02-12T17:16:31.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe240ea8700 1 -- 172.21.2.102:0/11660214 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234007320 con 0x7fe224004e40 2021-02-12T17:16:31.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe24410e700 1 -- 172.21.2.102:0/11660214 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe224004e40 msgr2=0x7fe22400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe24410e700 1 --2- 172.21.2.102:0/11660214 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe224004e40 0x7fe22400b720 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fe23400c890 tx=0x7fe234007b40).stop 2021-02-12T17:16:31.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe24410e700 1 -- 172.21.2.102:0/11660214 shutdown_connections 2021-02-12T17:16:31.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe24410e700 1 --2- 172.21.2.102:0/11660214 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe224004e40 0x7fe22400b720 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe24410e700 1 -- 172.21.2.102:0/11660214 >> 172.21.2.102:0/11660214 conn(0x7fe23c061830 msgr2=0x7fe23c0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:31.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe24410e700 1 -- 172.21.2.102:0/11660214 shutdown_connections 2021-02-12T17:16:31.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.533+0000 7fe24410e700 1 -- 172.21.2.102:0/11660214 wait complete. 2021-02-12T17:16:31.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.534+0000 7fe24410e700 1 Processor -- start 2021-02-12T17:16:31.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.534+0000 7fe24410e700 1 -- start start 2021-02-12T17:16:31.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe24410e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe224004e40 0x7fe23c09dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe24410e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe23c09c7d0 0x7fe23c0bad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe24410e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe23c160ae0 0x7fe23c160f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe24410e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c09e290 con 0x7fe224004e40 2021-02-12T17:16:31.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe24410e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c0a0ed0 con 0x7fe23c160ae0 2021-02-12T17:16:31.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe24410e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c0b5060 con 0x7fe23c09c7d0 2021-02-12T17:16:31.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe241eaa700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe224004e40 0x7fe23c09dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe241eaa700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe224004e40 0x7fe23c09dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45554/0 (socket says 172.21.2.102:45554) 2021-02-12T17:16:31.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe241eaa700 1 -- 172.21.2.102:0/3873655230 learned_addr learned my addr 172.21.2.102:0/3873655230 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:31.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe2416a9700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe23c09c7d0 0x7fe23c0bad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe2426ab700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe23c160ae0 0x7fe23c160f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe241eaa700 1 -- 172.21.2.102:0/3873655230 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe23c09c7d0 msgr2=0x7fe23c0bad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe241eaa700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe23c09c7d0 0x7fe23c0bad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe241eaa700 1 -- 172.21.2.102:0/3873655230 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe23c160ae0 msgr2=0x7fe23c160f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe241eaa700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe23c160ae0 0x7fe23c160f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe241eaa700 1 -- 172.21.2.102:0/3873655230 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c0b5290 con 0x7fe224004e40 2021-02-12T17:16:31.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe2426ab700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe23c160ae0 0x7fe23c160f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:31.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe241eaa700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe224004e40 0x7fe23c09dda0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fe23000e7b0 tx=0x7fe230009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:31.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe22dffb700 1 -- 172.21.2.102:0/3873655230 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230007020 con 0x7fe224004e40 2021-02-12T17:16:31.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe22dffb700 1 -- 172.21.2.102:0/3873655230 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe230010040 con 0x7fe224004e40 2021-02-12T17:16:31.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe24410e700 1 -- 172.21.2.102:0/3873655230 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23c0b5530 con 0x7fe224004e40 2021-02-12T17:16:31.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe22dffb700 1 -- 172.21.2.102:0/3873655230 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230007390 con 0x7fe224004e40 2021-02-12T17:16:31.541 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.535+0000 7fe24410e700 1 -- 172.21.2.102:0/3873655230 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23c0b5a70 con 0x7fe224004e40 2021-02-12T17:16:31.542 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.536+0000 7fe24410e700 1 -- 172.21.2.102:0/3873655230 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23c045460 con 0x7fe224004e40 2021-02-12T17:16:31.542 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.536+0000 7fe22dffb700 1 -- 172.21.2.102:0/3873655230 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fe23000a720 con 0x7fe224004e40 2021-02-12T17:16:31.542 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.536+0000 7fe22dffb700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe21c059d30 0x7fe21c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.536+0000 7fe22dffb700 1 -- 172.21.2.102:0/3873655230 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fe230073240 con 0x7fe224004e40 2021-02-12T17:16:31.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.537+0000 7fe2416a9700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe21c059d30 0x7fe21c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.537+0000 7fe2416a9700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe21c059d30 0x7fe21c05c1f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fe23c067710 tx=0x7fe238008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:31.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.539+0000 7fe22dffb700 1 -- 172.21.2.102:0/3873655230 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fe230046a10 con 0x7fe224004e40 2021-02-12T17:16:31.671 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.669+0000 7fe24410e700 1 -- 172.21.2.102:0/3873655230 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe23c0bb760 con 0x7fe224004e40 2021-02-12T17:16:31.671 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.670+0000 7fe22dffb700 1 -- 172.21.2.102:0/3873655230 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v27) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe230007e60 con 0x7fe224004e40 2021-02-12T17:16:31.671 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 1 2021-02-12T17:16:31.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.671+0000 7fe24410e700 1 -- 172.21.2.102:0/3873655230 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe21c059d30 msgr2=0x7fe21c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.671+0000 7fe24410e700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe21c059d30 0x7fe21c05c1f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fe23c067710 tx=0x7fe238008040).stop 2021-02-12T17:16:31.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.671+0000 7fe24410e700 1 -- 172.21.2.102:0/3873655230 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe224004e40 msgr2=0x7fe23c09dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.671+0000 7fe24410e700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe224004e40 0x7fe23c09dda0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fe23000e7b0 tx=0x7fe230009040).stop 2021-02-12T17:16:31.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.671+0000 7fe24410e700 1 -- 172.21.2.102:0/3873655230 shutdown_connections 2021-02-12T17:16:31.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.671+0000 7fe24410e700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe23c160ae0 0x7fe23c160f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.671+0000 7fe24410e700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe21c059d30 0x7fe21c05c1f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.671+0000 7fe24410e700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe224004e40 0x7fe23c09dda0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.671+0000 7fe24410e700 1 --2- 172.21.2.102:0/3873655230 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe23c09c7d0 0x7fe23c0bad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.671+0000 7fe24410e700 1 -- 172.21.2.102:0/3873655230 >> 172.21.2.102:0/3873655230 conn(0x7fe23c061830 msgr2=0x7fe23c063e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:31.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.671+0000 7fe24410e700 1 -- 172.21.2.102:0/3873655230 shutdown_connections 2021-02-12T17:16:31.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.671+0000 7fe24410e700 1 -- 172.21.2.102:0/3873655230 wait complete. 2021-02-12T17:16:31.681 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-02-12T17:16:31.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.769+0000 7f2f64413700 1 Processor -- start 2021-02-12T17:16:31.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.769+0000 7f2f64413700 1 -- start start 2021-02-12T17:16:31.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.770+0000 7f2f64413700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f2f5c09ada0 0x7f2f5c14e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.770+0000 7f2f64413700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5c066b70 con 0x7f2f5c0b0940 2021-02-12T17:16:31.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.770+0000 7f2f64413700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5c0685b0 con 0x7f2f5c0bc2b0 2021-02-12T17:16:31.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.770+0000 7f2f64413700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5c0b27d0 con 0x7f2f5c09ada0 2021-02-12T17:16:31.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.770+0000 7f2f619ae700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f2f5c0b0940 0x7f2f5c151830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54206/0 (socket says 172.21.2.102:54206) 2021-02-12T17:16:31.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.770+0000 7f2f619ae700 1 -- 172.21.2.102:0/1241455140 learned_addr learned my addr 172.21.2.102:0/1241455140 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:31.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.770+0000 7f2f611ad700 1 -- 172.21.2.102:0/1241455140 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266677817 0 0) 0x7f2f5c066b70 con 0x7f2f5c0b0940 2021-02-12T17:16:31.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.770+0000 7f2f611ad700 1 -- 172.21.2.102:0/1241455140 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f44003230 con 0x7f2f5c0b0940 2021-02-12T17:16:31.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f629b0700 1 --2- 172.21.2.102:0/1241455140 >> v2:172.21.2.104:3300/0 conn(0x7f2f5c09ada0 0x7f2f5c14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f611ad700 1 -- 172.21.2.102:0/1241455140 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3734942252 0 0) 0x7f2f44003230 con 0x7f2f5c0b0940 2021-02-12T17:16:31.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f611ad700 1 -- 172.21.2.102:0/1241455140 >> v2:172.21.2.104:3300/0 conn(0x7f2f5c09ada0 msgr2=0x7f2f5c14e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:31.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f611ad700 1 --2- 172.21.2.102:0/1241455140 >> v2:172.21.2.104:3300/0 conn(0x7f2f5c09ada0 0x7f2f5c14e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f611ad700 1 -- 172.21.2.102:0/1241455140 >> v1:172.21.2.104:6789/0 conn(0x7f2f5c0bc2b0 legacy=0x7f2f5c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:31.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f611ad700 1 -- 172.21.2.102:0/1241455140 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c14e550 con 0x7f2f5c0b0940 2021-02-12T17:16:31.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f611ad700 1 -- 172.21.2.102:0/1241455140 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f2f500014e0 con 0x7f2f5c0b0940 2021-02-12T17:16:31.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f611ad700 1 -- 172.21.2.102:0/1241455140 >> v1:172.21.2.102:6789/0 conn(0x7f2f5c0b0940 legacy=0x7f2f5c151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f611ad700 1 --2- 172.21.2.102:0/1241455140 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f440037f0 0x7f2f44003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f611ad700 1 --2- 172.21.2.102:0/1241455140 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f440044d0 0x7f2f44004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f611ad700 1 --2- 172.21.2.102:0/1241455140 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f44004e40 0x7f2f4400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f611ad700 1 -- 172.21.2.102:0/1241455140 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0b27d0 con 0x7f2f44004e40 2021-02-12T17:16:31.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f611ad700 1 -- 172.21.2.102:0/1241455140 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f440052f0 con 0x7f2f440044d0 2021-02-12T17:16:31.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f611ad700 1 -- 172.21.2.102:0/1241455140 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4400bc10 con 0x7f2f440037f0 2021-02-12T17:16:31.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f629b0700 1 --2- 172.21.2.102:0/1241455140 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f44004e40 0x7f2f4400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f619ae700 1 --2- 172.21.2.102:0/1241455140 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f440044d0 0x7f2f44004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f621af700 1 --2- 172.21.2.102:0/1241455140 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f440037f0 0x7f2f44003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f629b0700 1 -- 172.21.2.102:0/1241455140 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f440037f0 msgr2=0x7f2f44003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:31.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f629b0700 1 --2- 172.21.2.102:0/1241455140 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f440037f0 0x7f2f44003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f629b0700 1 -- 172.21.2.102:0/1241455140 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f440044d0 msgr2=0x7f2f44004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:31.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f629b0700 1 --2- 172.21.2.102:0/1241455140 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f440044d0 0x7f2f44004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f629b0700 1 -- 172.21.2.102:0/1241455140 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f44003230 con 0x7f2f44004e40 2021-02-12T17:16:31.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f629b0700 1 -- 172.21.2.102:0/1241455140 reap_dead start 2021-02-12T17:16:31.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.771+0000 7f2f629b0700 1 --2- 172.21.2.102:0/1241455140 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f44004e40 0x7f2f4400b720 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f2f54009d70 tx=0x7f2f54008040).ready entity=mon.0 client_cookie=8b0df1095461e36d server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:31.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.772+0000 7f2f611ad700 1 -- 172.21.2.102:0/1241455140 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400c070 con 0x7f2f44004e40 2021-02-12T17:16:31.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.772+0000 7f2f611ad700 1 -- 172.21.2.102:0/1241455140 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5400e990 con 0x7f2f44004e40 2021-02-12T17:16:31.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.772+0000 7f2f611ad700 1 -- 172.21.2.102:0/1241455140 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400ed30 con 0x7f2f44004e40 2021-02-12T17:16:31.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.772+0000 7f2f64413700 1 -- 172.21.2.102:0/1241455140 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f44004e40 msgr2=0x7f2f4400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.772+0000 7f2f64413700 1 --2- 172.21.2.102:0/1241455140 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f44004e40 0x7f2f4400b720 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f2f54009d70 tx=0x7f2f54008040).stop 2021-02-12T17:16:31.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.772+0000 7f2f64413700 1 -- 172.21.2.102:0/1241455140 shutdown_connections 2021-02-12T17:16:31.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.772+0000 7f2f64413700 1 --2- 172.21.2.102:0/1241455140 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f44004e40 0x7f2f4400b720 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.772+0000 7f2f64413700 1 -- 172.21.2.102:0/1241455140 >> 172.21.2.102:0/1241455140 conn(0x7f2f5c061830 msgr2=0x7f2f5c0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:31.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.772+0000 7f2f64413700 1 -- 172.21.2.102:0/1241455140 shutdown_connections 2021-02-12T17:16:31.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.772+0000 7f2f64413700 1 -- 172.21.2.102:0/1241455140 wait complete. 2021-02-12T17:16:31.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.773+0000 7f2f64413700 1 Processor -- start 2021-02-12T17:16:31.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.773+0000 7f2f64413700 1 -- start start 2021-02-12T17:16:31.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.773+0000 7f2f64413700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f44004e40 0x7f2f5c09f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.773+0000 7f2f64413700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f5c09da90 0x7f2f5c0a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.773+0000 7f2f64413700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f5c0a1020 0x7f2f5c15d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.773+0000 7f2f64413700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c09e240 con 0x7f2f5c0a1020 2021-02-12T17:16:31.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.773+0000 7f2f64413700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c09dfa0 con 0x7f2f44004e40 2021-02-12T17:16:31.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.773+0000 7f2f64413700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c09eaf0 con 0x7f2f5c09da90 2021-02-12T17:16:31.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.774+0000 7f2f629b0700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f5c0a1020 0x7f2f5c15d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.774+0000 7f2f629b0700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f5c0a1020 0x7f2f5c15d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45576/0 (socket says 172.21.2.102:45576) 2021-02-12T17:16:31.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.774+0000 7f2f629b0700 1 -- 172.21.2.102:0/2780507639 learned_addr learned my addr 172.21.2.102:0/2780507639 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:31.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.774+0000 7f2f629b0700 1 -- 172.21.2.102:0/2780507639 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f5c09da90 msgr2=0x7f2f5c0a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.774+0000 7f2f629b0700 1 --2- 172.21.2.102:0/2780507639 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f5c09da90 0x7f2f5c0a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:31.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.774+0000 7f2f629b0700 1 -- 172.21.2.102:0/2780507639 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f44004e40 msgr2=0x7f2f5c09f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.774+0000 7f2f629b0700 1 --2- 172.21.2.102:0/2780507639 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f44004e40 0x7f2f5c09f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:31.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.774+0000 7f2f629b0700 1 -- 172.21.2.102:0/2780507639 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c09ed90 con 0x7f2f5c0a1020 2021-02-12T17:16:31.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.774+0000 7f2f629b0700 1 --2- 172.21.2.102:0/2780507639 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f5c0a1020 0x7f2f5c15d2a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f2f5c0bb980 tx=0x7f2f54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:31.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.774+0000 7f2f4e7fc700 1 -- 172.21.2.102:0/2780507639 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5401c5b0 con 0x7f2f5c0a1020 2021-02-12T17:16:31.780 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.774+0000 7f2f4e7fc700 1 -- 172.21.2.102:0/2780507639 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5401c710 con 0x7f2f5c0a1020 2021-02-12T17:16:31.780 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.774+0000 7f2f64413700 1 -- 172.21.2.102:0/2780507639 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5c09f030 con 0x7f2f5c0a1020 2021-02-12T17:16:31.780 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.774+0000 7f2f4e7fc700 1 -- 172.21.2.102:0/2780507639 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5401cad0 con 0x7f2f5c0a1020 2021-02-12T17:16:31.780 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.774+0000 7f2f64413700 1 -- 172.21.2.102:0/2780507639 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5c08fa40 con 0x7f2f5c0a1020 2021-02-12T17:16:31.780 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.775+0000 7f2f64413700 1 -- 172.21.2.102:0/2780507639 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c0bae60 con 0x7f2f5c0a1020 2021-02-12T17:16:31.780 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.775+0000 7f2f4e7fc700 1 -- 172.21.2.102:0/2780507639 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f2f5401d440 con 0x7f2f5c0a1020 2021-02-12T17:16:31.780 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.775+0000 7f2f4e7fc700 1 --2- 172.21.2.102:0/2780507639 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2f3c059d60 0x7f2f3c05c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:31.780 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.776+0000 7f2f4e7fc700 1 -- 172.21.2.102:0/2780507639 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f2f54075520 con 0x7f2f5c0a1020 2021-02-12T17:16:31.780 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.776+0000 7f2f621af700 1 --2- 172.21.2.102:0/2780507639 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2f3c059d60 0x7f2f3c05c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:31.780 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.776+0000 7f2f621af700 1 --2- 172.21.2.102:0/2780507639 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2f3c059d60 0x7f2f3c05c220 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2f580034a0 tx=0x7f2f58009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:31.781 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.778+0000 7f2f4e7fc700 1 -- 172.21.2.102:0/2780507639 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f2f54048be0 con 0x7f2f5c0a1020 2021-02-12T17:16:31.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.906+0000 7f2f64413700 1 -- 172.21.2.102:0/2780507639 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2f5c045460 con 0x7f2f5c0a1020 2021-02-12T17:16:31.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.907+0000 7f2f4e7fc700 1 -- 172.21.2.102:0/2780507639 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2f5404c200 con 0x7f2f5c0a1020 2021-02-12T17:16:31.908 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:31.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.908+0000 7f2f64413700 1 -- 172.21.2.102:0/2780507639 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2f3c059d60 msgr2=0x7f2f3c05c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.908+0000 7f2f64413700 1 --2- 172.21.2.102:0/2780507639 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2f3c059d60 0x7f2f3c05c220 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2f580034a0 tx=0x7f2f58009040).stop 2021-02-12T17:16:31.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.908+0000 7f2f64413700 1 -- 172.21.2.102:0/2780507639 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f5c0a1020 msgr2=0x7f2f5c15d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:31.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.908+0000 7f2f64413700 1 --2- 172.21.2.102:0/2780507639 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f5c0a1020 0x7f2f5c15d2a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f2f5c0bb980 tx=0x7f2f54008040).stop 2021-02-12T17:16:31.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.908+0000 7f2f64413700 1 -- 172.21.2.102:0/2780507639 shutdown_connections 2021-02-12T17:16:31.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.908+0000 7f2f64413700 1 --2- 172.21.2.102:0/2780507639 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2f3c059d60 0x7f2f3c05c220 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.908+0000 7f2f64413700 1 --2- 172.21.2.102:0/2780507639 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2f5c0a1020 0x7f2f5c15d2a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:31.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.908+0000 7f2f64413700 1 --2- 172.21.2.102:0/2780507639 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2f44004e40 0x7f2f5c09f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:31.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.908+0000 7f2f64413700 1 --2- 172.21.2.102:0/2780507639 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2f5c09da90 0x7f2f5c0a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:31.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.908+0000 7f2f64413700 1 -- 172.21.2.102:0/2780507639 >> 172.21.2.102:0/2780507639 conn(0x7f2f5c061830 msgr2=0x7f2f5c0b83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:31.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.908+0000 7f2f64413700 1 -- 172.21.2.102:0/2780507639 shutdown_connections 2021-02-12T17:16:31.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:31.908+0000 7f2f64413700 1 -- 172.21.2.102:0/2780507639 wait complete. 2021-02-12T17:16:31.918 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2021-02-12T17:16:32.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.007+0000 7ff15466d700 1 Processor -- start 2021-02-12T17:16:32.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.007+0000 7ff15466d700 1 -- start start 2021-02-12T17:16:32.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.007+0000 7ff15466d700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff14c0bc2b0 0x7ff14c151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.007+0000 7ff15466d700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7ff14c0b0940 0x7ff14c151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.007+0000 7ff15466d700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c066b70 con 0x7ff14c09ada0 2021-02-12T17:16:32.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.007+0000 7ff15466d700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c0b27d0 con 0x7ff14c0b0940 2021-02-12T17:16:32.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.007+0000 7ff15466d700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0b7110 con 0x7ff14c0bc2b0 2021-02-12T17:16:32.019 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff152c0a700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7ff14c09ada0 0x7ff14c14d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54224/0 (socket says 172.21.2.102:54224) 2021-02-12T17:16:32.019 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff152c0a700 1 -- 172.21.2.102:0/1937778199 learned_addr learned my addr 172.21.2.102:0/1937778199 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:32.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 -- 172.21.2.102:0/1937778199 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3778937168 0 0) 0x7ff14c066b70 con 0x7ff14c09ada0 2021-02-12T17:16:32.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 -- 172.21.2.102:0/1937778199 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff134003230 con 0x7ff14c09ada0 2021-02-12T17:16:32.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151c08700 1 --2- 172.21.2.102:0/1937778199 >> v2:172.21.2.104:3300/0 conn(0x7ff14c0b0940 0x7ff14c151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 -- 172.21.2.102:0/1937778199 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 329131940 0 0) 0x7ff134003230 con 0x7ff14c09ada0 2021-02-12T17:16:32.021 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 -- 172.21.2.102:0/1937778199 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff14c0bc2b0 msgr2=0x7ff14c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:32.021 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff152409700 1 --2- 172.21.2.102:0/1937778199 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff14c0bc2b0 0x7ff14c151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.021 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 --2- 172.21.2.102:0/1937778199 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff14c0bc2b0 0x7ff14c151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.021 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 -- 172.21.2.102:0/1937778199 >> v2:172.21.2.104:3300/0 conn(0x7ff14c0b0940 msgr2=0x7ff14c151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:32.021 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 --2- 172.21.2.102:0/1937778199 >> v2:172.21.2.104:3300/0 conn(0x7ff14c0b0940 0x7ff14c151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.021 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 -- 172.21.2.102:0/1937778199 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0685b0 con 0x7ff14c09ada0 2021-02-12T17:16:32.021 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 -- 172.21.2.102:0/1937778199 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7ff144001860 con 0x7ff14c09ada0 2021-02-12T17:16:32.022 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff152409700 1 --2- 172.21.2.102:0/1937778199 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff14c0bc2b0 0x7ff14c151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:32.022 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 -- 172.21.2.102:0/1937778199 >> v1:172.21.2.102:6789/0 conn(0x7ff14c09ada0 legacy=0x7ff14c14d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.022 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 --2- 172.21.2.102:0/1937778199 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff14c0bc2b0 0x7ff1340037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.022 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 --2- 172.21.2.102:0/1937778199 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff134003ce0 0x7ff1340044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.022 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 --2- 172.21.2.102:0/1937778199 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff1340049c0 0x7ff134004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.022 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 -- 172.21.2.102:0/1937778199 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0b27d0 con 0x7ff134003ce0 2021-02-12T17:16:32.023 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 -- 172.21.2.102:0/1937778199 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0b7110 con 0x7ff1340049c0 2021-02-12T17:16:32.023 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151407700 1 -- 172.21.2.102:0/1937778199 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff134004280 con 0x7ff14c0bc2b0 2021-02-12T17:16:32.023 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.008+0000 7ff151c08700 1 --2- 172.21.2.102:0/1937778199 >> v2:172.21.2.104:3300/0 conn(0x7ff14c0b0940 0x7ff14c151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:32.023 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.009+0000 7ff151c08700 1 --2- 172.21.2.102:0/1937778199 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff134003ce0 0x7ff1340044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.023 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.009+0000 7ff152409700 1 --2- 172.21.2.102:0/1937778199 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff14c0bc2b0 0x7ff1340037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.023 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.009+0000 7ff152c0a700 1 --2- 172.21.2.102:0/1937778199 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff1340049c0 0x7ff134004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.024 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.009+0000 7ff151c08700 1 -- 172.21.2.102:0/1937778199 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff14c0bc2b0 msgr2=0x7ff1340037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:32.024 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.009+0000 7ff151c08700 1 --2- 172.21.2.102:0/1937778199 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff14c0bc2b0 0x7ff1340037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.024 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.009+0000 7ff151c08700 1 -- 172.21.2.102:0/1937778199 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff1340049c0 msgr2=0x7ff134004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:32.024 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.009+0000 7ff151c08700 1 --2- 172.21.2.102:0/1937778199 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff1340049c0 0x7ff134004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.024 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.009+0000 7ff151c08700 1 -- 172.21.2.102:0/1937778199 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff134003230 con 0x7ff134003ce0 2021-02-12T17:16:32.024 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.009+0000 7ff152409700 1 --2- 172.21.2.102:0/1937778199 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff14c0bc2b0 0x7ff1340037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:32.024 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.009+0000 7ff151c08700 1 --2- 172.21.2.102:0/1937778199 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff134003ce0 0x7ff1340044d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7ff14c09e710 tx=0x7ff140008040).ready entity=mon.0 client_cookie=602bd02d3832dee6 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.025 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.009+0000 7ff151407700 1 -- 172.21.2.102:0/1937778199 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14000c800 con 0x7ff134003ce0 2021-02-12T17:16:32.025 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.009+0000 7ff151407700 1 -- 172.21.2.102:0/1937778199 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14000c960 con 0x7ff134003ce0 2021-02-12T17:16:32.025 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.009+0000 7ff151407700 1 -- 172.21.2.102:0/1937778199 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14000cce0 con 0x7ff134003ce0 2021-02-12T17:16:32.025 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.010+0000 7ff15466d700 1 -- 172.21.2.102:0/1937778199 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff134003ce0 msgr2=0x7ff1340044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.025 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.010+0000 7ff15466d700 1 --2- 172.21.2.102:0/1937778199 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff134003ce0 0x7ff1340044d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7ff14c09e710 tx=0x7ff140008040).stop 2021-02-12T17:16:32.025 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.010+0000 7ff152c0a700 1 -- 172.21.2.102:0/1937778199 reap_dead start 2021-02-12T17:16:32.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.010+0000 7ff15466d700 1 -- 172.21.2.102:0/1937778199 shutdown_connections 2021-02-12T17:16:32.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.010+0000 7ff15466d700 1 -- 172.21.2.102:0/1937778199 >> 172.21.2.102:0/1937778199 conn(0x7ff14c061830 msgr2=0x7ff14c0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:32.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.010+0000 7ff15466d700 1 -- 172.21.2.102:0/1937778199 shutdown_connections 2021-02-12T17:16:32.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.010+0000 7ff15466d700 1 -- 172.21.2.102:0/1937778199 wait complete. 2021-02-12T17:16:32.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.011+0000 7ff15466d700 1 Processor -- start 2021-02-12T17:16:32.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.011+0000 7ff15466d700 1 -- start start 2021-02-12T17:16:32.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.011+0000 7ff15466d700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff134003ce0 0x7ff14c061df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.011+0000 7ff15466d700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff14c09e970 0x7ff14c14da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.011+0000 7ff15466d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff14c160750 0x7ff14c160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.011+0000 7ff15466d700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c062960 con 0x7ff14c160750 2021-02-12T17:16:32.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.011+0000 7ff15466d700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c062b90 con 0x7ff14c09e970 2021-02-12T17:16:32.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.011+0000 7ff15466d700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c062e30 con 0x7ff134003ce0 2021-02-12T17:16:32.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.011+0000 7ff152c0a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff14c160750 0x7ff14c160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.011+0000 7ff152c0a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff14c160750 0x7ff14c160bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45594/0 (socket says 172.21.2.102:45594) 2021-02-12T17:16:32.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.011+0000 7ff152c0a700 1 -- 172.21.2.102:0/1904164242 learned_addr learned my addr 172.21.2.102:0/1904164242 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:32.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.012+0000 7ff152c0a700 1 -- 172.21.2.102:0/1904164242 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff134003ce0 msgr2=0x7ff14c061df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.012+0000 7ff152c0a700 1 --2- 172.21.2.102:0/1904164242 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff134003ce0 0x7ff14c061df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:32.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.012+0000 7ff152c0a700 1 -- 172.21.2.102:0/1904164242 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff14c09e970 msgr2=0x7ff14c14da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.012+0000 7ff152c0a700 1 --2- 172.21.2.102:0/1904164242 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff14c09e970 0x7ff14c14da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:32.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.012+0000 7ff152c0a700 1 -- 172.21.2.102:0/1904164242 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0a0310 con 0x7ff14c160750 2021-02-12T17:16:32.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.012+0000 7ff152c0a700 1 --2- 172.21.2.102:0/1904164242 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff14c160750 0x7ff14c160bd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7ff144007a90 tx=0x7ff144007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.012+0000 7ff13e7fc700 1 -- 172.21.2.102:0/1904164242 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1440077c0 con 0x7ff14c160750 2021-02-12T17:16:32.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.012+0000 7ff13e7fc700 1 -- 172.21.2.102:0/1904164242 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14400fbd0 con 0x7ff14c160750 2021-02-12T17:16:32.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.012+0000 7ff15466d700 1 -- 172.21.2.102:0/1904164242 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c0a05b0 con 0x7ff14c160750 2021-02-12T17:16:32.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.012+0000 7ff13e7fc700 1 -- 172.21.2.102:0/1904164242 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144012350 con 0x7ff14c160750 2021-02-12T17:16:32.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.012+0000 7ff15466d700 1 -- 172.21.2.102:0/1904164242 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c0a0000 con 0x7ff14c160750 2021-02-12T17:16:32.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.013+0000 7ff15466d700 1 -- 172.21.2.102:0/1904164242 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14c064640 con 0x7ff14c160750 2021-02-12T17:16:32.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.013+0000 7ff13e7fc700 1 -- 172.21.2.102:0/1904164242 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7ff1440126c0 con 0x7ff14c160750 2021-02-12T17:16:32.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.013+0000 7ff13e7fc700 1 --2- 172.21.2.102:0/1904164242 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff12c059db0 0x7ff12c05c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.013+0000 7ff13e7fc700 1 -- 172.21.2.102:0/1904164242 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7ff144073450 con 0x7ff14c160750 2021-02-12T17:16:32.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.013+0000 7ff152409700 1 --2- 172.21.2.102:0/1904164242 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff12c059db0 0x7ff12c05c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.013+0000 7ff152409700 1 --2- 172.21.2.102:0/1904164242 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff12c059db0 0x7ff12c05c270 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7ff148006fd0 tx=0x7ff148008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.016+0000 7ff13e7fc700 1 -- 172.21.2.102:0/1904164242 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7ff144046d00 con 0x7ff14c160750 2021-02-12T17:16:32.144 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.143+0000 7ff15466d700 1 -- 172.21.2.102:0/1904164242 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff14c0a0740 con 0x7ff14c160750 2021-02-12T17:16:32.145 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.143+0000 7ff13e7fc700 1 -- 172.21.2.102:0/1904164242 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+10 (secure 0 0 0) 0x7ff144019030 con 0x7ff14c160750 2021-02-12T17:16:32.145 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:32.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.144+0000 7ff15466d700 1 -- 172.21.2.102:0/1904164242 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff12c059db0 msgr2=0x7ff12c05c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.144+0000 7ff15466d700 1 --2- 172.21.2.102:0/1904164242 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff12c059db0 0x7ff12c05c270 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7ff148006fd0 tx=0x7ff148008040).stop 2021-02-12T17:16:32.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.144+0000 7ff15466d700 1 -- 172.21.2.102:0/1904164242 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff14c160750 msgr2=0x7ff14c160bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.144+0000 7ff15466d700 1 --2- 172.21.2.102:0/1904164242 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff14c160750 0x7ff14c160bd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7ff144007a90 tx=0x7ff144007ac0).stop 2021-02-12T17:16:32.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.144+0000 7ff15466d700 1 -- 172.21.2.102:0/1904164242 shutdown_connections 2021-02-12T17:16:32.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.144+0000 7ff15466d700 1 --2- 172.21.2.102:0/1904164242 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff12c059db0 0x7ff12c05c270 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.144+0000 7ff15466d700 1 --2- 172.21.2.102:0/1904164242 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff14c160750 0x7ff14c160bd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.144+0000 7ff15466d700 1 --2- 172.21.2.102:0/1904164242 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff134003ce0 0x7ff14c061df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:32.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.144+0000 7ff15466d700 1 --2- 172.21.2.102:0/1904164242 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff14c09e970 0x7ff14c14da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:32.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.144+0000 7ff15466d700 1 -- 172.21.2.102:0/1904164242 >> 172.21.2.102:0/1904164242 conn(0x7ff14c061830 msgr2=0x7ff14c14b330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:32.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.145+0000 7ff15466d700 1 -- 172.21.2.102:0/1904164242 shutdown_connections 2021-02-12T17:16:32.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.145+0000 7ff15466d700 1 -- 172.21.2.102:0/1904164242 wait complete. 2021-02-12T17:16:32.154 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2021-02-12T17:16:32.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.242+0000 7f7fb0b20700 1 Processor -- start 2021-02-12T17:16:32.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.242+0000 7f7fb0b20700 1 -- start start 2021-02-12T17:16:32.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.243+0000 7f7fb0b20700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f7fac0bc2b0 0x7f7fac151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.243+0000 7f7fb0b20700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac066b70 con 0x7f7fac0b0940 2021-02-12T17:16:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.243+0000 7f7fb0b20700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac0685b0 con 0x7f7fac151d20 2021-02-12T17:16:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.243+0000 7f7fb0b20700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac0b27d0 con 0x7f7fac0bc2b0 2021-02-12T17:16:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.243+0000 7f7fa9d9b700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f7fac0b0940 0x7f7fac151610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54242/0 (socket says 172.21.2.102:54242) 2021-02-12T17:16:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.243+0000 7f7fa9d9b700 1 -- 172.21.2.102:0/2624712647 learned_addr learned my addr 172.21.2.102:0/2624712647 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.243+0000 7f7faa59c700 1 --2- 172.21.2.102:0/2624712647 >> v2:172.21.2.104:3300/0 conn(0x7f7fac0bc2b0 0x7f7fac151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.243+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663114174 0 0) 0x7f7fac066b70 con 0x7f7fac0b0940 2021-02-12T17:16:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.243+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f8c003230 con 0x7f7fac0b0940 2021-02-12T17:16:32.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312148601 0 0) 0x7f7fac0685b0 con 0x7f7fac151d20 2021-02-12T17:16:32.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 --> v1:172.21.2.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fac066b70 con 0x7f7fac151d20 2021-02-12T17:16:32.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 262536030 0 0) 0x7f7f8c003230 con 0x7f7fac0b0940 2021-02-12T17:16:32.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 >> v2:172.21.2.104:3300/0 conn(0x7f7fac0bc2b0 msgr2=0x7f7fac151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:32.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 --2- 172.21.2.102:0/2624712647 >> v2:172.21.2.104:3300/0 conn(0x7f7fac0bc2b0 0x7f7fac151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 >> v1:172.21.2.104:6789/0 conn(0x7f7fac151d20 legacy=0x7f7fac1584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac0b7110 con 0x7f7fac0b0940 2021-02-12T17:16:32.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f7f94001460 con 0x7f7fac0b0940 2021-02-12T17:16:32.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7faa59c700 1 --2- 172.21.2.102:0/2624712647 >> v2:172.21.2.104:3300/0 conn(0x7f7fac0bc2b0 0x7f7fac151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:16:32.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 >> v1:172.21.2.102:6789/0 conn(0x7f7fac0b0940 legacy=0x7f7fac151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 --2- 172.21.2.102:0/2624712647 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7f8c003900 0x7f7f8c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 --2- 172.21.2.102:0/2624712647 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7f8c0044d0 0x7f7f8c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 --2- 172.21.2.102:0/2624712647 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7f8c004e40 0x7f7f8c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0b27d0 con 0x7f7f8c0044d0 2021-02-12T17:16:32.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c00bc10 con 0x7f7f8c003900 2021-02-12T17:16:32.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c00bd50 con 0x7f7f8c004e40 2021-02-12T17:16:32.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa9d9b700 1 --2- 172.21.2.102:0/2624712647 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7f8c0044d0 0x7f7f8c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7faa59c700 1 --2- 172.21.2.102:0/2624712647 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7f8c003900 0x7f7f8c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7faad9d700 1 --2- 172.21.2.102:0/2624712647 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7f8c004e40 0x7f7f8c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa9d9b700 1 -- 172.21.2.102:0/2624712647 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7f8c004e40 msgr2=0x7f7f8c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:32.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa9d9b700 1 --2- 172.21.2.102:0/2624712647 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7f8c004e40 0x7f7f8c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa9d9b700 1 -- 172.21.2.102:0/2624712647 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7f8c003900 msgr2=0x7f7f8c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:32.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa9d9b700 1 --2- 172.21.2.102:0/2624712647 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7f8c003900 0x7f7f8c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7fa9d9b700 1 -- 172.21.2.102:0/2624712647 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c003230 con 0x7f7f8c0044d0 2021-02-12T17:16:32.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.244+0000 7f7faad9d700 1 -- 172.21.2.102:0/2624712647 reap_dead start 2021-02-12T17:16:32.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.245+0000 7f7fa9d9b700 1 --2- 172.21.2.102:0/2624712647 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7f8c0044d0 0x7f7f8c004950 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f7f9400c160 tx=0x7f7fac0684a0).ready entity=mon.0 client_cookie=ae4ebdf5adfa4973 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.245+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9400cd70 con 0x7f7f8c0044d0 2021-02-12T17:16:32.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.245+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f940070d0 con 0x7f7f8c0044d0 2021-02-12T17:16:32.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.245+0000 7f7fa959a700 1 -- 172.21.2.102:0/2624712647 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94007490 con 0x7f7f8c0044d0 2021-02-12T17:16:32.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.245+0000 7f7fb0b20700 1 -- 172.21.2.102:0/2624712647 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7f8c0044d0 msgr2=0x7f7f8c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.245+0000 7f7fb0b20700 1 --2- 172.21.2.102:0/2624712647 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7f8c0044d0 0x7f7f8c004950 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f7f9400c160 tx=0x7f7fac0684a0).stop 2021-02-12T17:16:32.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.245+0000 7f7fb0b20700 1 -- 172.21.2.102:0/2624712647 shutdown_connections 2021-02-12T17:16:32.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.245+0000 7f7fb0b20700 1 --2- 172.21.2.102:0/2624712647 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7f8c0044d0 0x7f7f8c004950 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.245+0000 7f7fb0b20700 1 -- 172.21.2.102:0/2624712647 >> 172.21.2.102:0/2624712647 conn(0x7f7fac061830 msgr2=0x7f7fac0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:32.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.245+0000 7f7fb0b20700 1 -- 172.21.2.102:0/2624712647 shutdown_connections 2021-02-12T17:16:32.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.245+0000 7f7fb0b20700 1 -- 172.21.2.102:0/2624712647 wait complete. 2021-02-12T17:16:32.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.246+0000 7f7fb0b20700 1 Processor -- start 2021-02-12T17:16:32.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.246+0000 7f7fb0b20700 1 -- start start 2021-02-12T17:16:32.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7fb0b20700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7f8c0044d0 0x7f7fac15da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7fb0b20700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7fac08fa40 0x7f7fac0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7fb0b20700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7fac14fd50 0x7f7fac1501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7fb0b20700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac1506c0 con 0x7f7f8c0044d0 2021-02-12T17:16:32.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7fb0b20700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac14f0d0 con 0x7f7fac08fa40 2021-02-12T17:16:32.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7fb0b20700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac14f370 con 0x7f7fac14fd50 2021-02-12T17:16:32.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7faa59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7f8c0044d0 0x7f7fac15da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7faad9d700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7fac14fd50 0x7f7fac1501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7faad9d700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7fac14fd50 0x7f7fac1501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.102:47762/0 (socket says 172.21.2.102:47762) 2021-02-12T17:16:32.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7faa59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7f8c0044d0 0x7f7fac15da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45610/0 (socket says 172.21.2.102:45610) 2021-02-12T17:16:32.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7faad9d700 1 -- 172.21.2.102:0/3709432274 learned_addr learned my addr 172.21.2.102:0/3709432274 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:32.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7fa9d9b700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7fac08fa40 0x7f7fac0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7faa59c700 1 -- 172.21.2.102:0/3709432274 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7fac14fd50 msgr2=0x7f7fac1501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7faa59c700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7fac14fd50 0x7f7fac1501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7faa59c700 1 -- 172.21.2.102:0/3709432274 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7fac08fa40 msgr2=0x7f7fac0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7faa59c700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7fac08fa40 0x7f7fac0b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7faa59c700 1 -- 172.21.2.102:0/3709432274 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac14f610 con 0x7f7f8c0044d0 2021-02-12T17:16:32.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7faad9d700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7fac14fd50 0x7f7fac1501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:16:32.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7fa9d9b700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7fac08fa40 0x7f7fac0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:16:32.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.247+0000 7f7faa59c700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7f8c0044d0 0x7f7fac15da10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f7f9c00bfd0 tx=0x7f7f9c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.248+0000 7f7fa27fc700 1 -- 172.21.2.102:0/3709432274 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c00fa10 con 0x7f7f8c0044d0 2021-02-12T17:16:32.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.248+0000 7f7fa27fc700 1 -- 172.21.2.102:0/3709432274 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c00fb70 con 0x7f7f8c0044d0 2021-02-12T17:16:32.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.248+0000 7f7fa27fc700 1 -- 172.21.2.102:0/3709432274 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c014440 con 0x7f7f8c0044d0 2021-02-12T17:16:32.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.248+0000 7f7fb0b20700 1 -- 172.21.2.102:0/3709432274 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac14f8b0 con 0x7f7f8c0044d0 2021-02-12T17:16:32.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.248+0000 7f7fb0b20700 1 -- 172.21.2.102:0/3709432274 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac0b3d00 con 0x7f7f8c0044d0 2021-02-12T17:16:32.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.248+0000 7f7fb0b20700 1 -- 172.21.2.102:0/3709432274 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac045460 con 0x7f7f8c0044d0 2021-02-12T17:16:32.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.249+0000 7f7fa27fc700 1 -- 172.21.2.102:0/3709432274 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f7f9c0147f0 con 0x7f7f8c0044d0 2021-02-12T17:16:32.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.249+0000 7f7fa27fc700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7f90059d30 0x7f7f9005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.249+0000 7f7fa27fc700 1 -- 172.21.2.102:0/3709432274 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f7f9c074760 con 0x7f7f8c0044d0 2021-02-12T17:16:32.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.249+0000 7f7fa9d9b700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7f90059d30 0x7f7f9005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.249+0000 7f7fa9d9b700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7f90059d30 0x7f7f9005c1f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f7f94000bc0 tx=0x7f7f94013000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.252+0000 7f7fa27fc700 1 -- 172.21.2.102:0/3709432274 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f7f9c047f90 con 0x7f7f8c0044d0 2021-02-12T17:16:32.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.383+0000 7f7fb0b20700 1 -- 172.21.2.102:0/3709432274 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f7fac0b7650 con 0x7f7f8c0044d0 2021-02-12T17:16:32.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.383+0000 7f7fa27fc700 1 -- 172.21.2.102:0/3709432274 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+10 (secure 0 0 0) 0x7f7f9c04b5b0 con 0x7f7f8c0044d0 2021-02-12T17:16:32.385 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:32.386 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.385+0000 7f7fb0b20700 1 -- 172.21.2.102:0/3709432274 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7f90059d30 msgr2=0x7f7f9005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.386 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.385+0000 7f7fb0b20700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7f90059d30 0x7f7f9005c1f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f7f94000bc0 tx=0x7f7f94013000).stop 2021-02-12T17:16:32.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.385+0000 7f7fb0b20700 1 -- 172.21.2.102:0/3709432274 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7f8c0044d0 msgr2=0x7f7fac15da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.385+0000 7f7fb0b20700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7f8c0044d0 0x7f7fac15da10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f7f9c00bfd0 tx=0x7f7f9c008040).stop 2021-02-12T17:16:32.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.385+0000 7f7fb0b20700 1 -- 172.21.2.102:0/3709432274 shutdown_connections 2021-02-12T17:16:32.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.385+0000 7f7fb0b20700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7fac14fd50 0x7f7fac1501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.385+0000 7f7fb0b20700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7f90059d30 0x7f7f9005c1f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.385+0000 7f7fb0b20700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7f8c0044d0 0x7f7fac15da10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.385+0000 7f7fb0b20700 1 --2- 172.21.2.102:0/3709432274 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7fac08fa40 0x7f7fac0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.385+0000 7f7fb0b20700 1 -- 172.21.2.102:0/3709432274 >> 172.21.2.102:0/3709432274 conn(0x7f7fac061830 msgr2=0x7f7fac09dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:32.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.385+0000 7f7fb0b20700 1 -- 172.21.2.102:0/3709432274 shutdown_connections 2021-02-12T17:16:32.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.385+0000 7f7fb0b20700 1 -- 172.21.2.102:0/3709432274 wait complete. 2021-02-12T17:16:32.395 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2021-02-12T17:16:32.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.483+0000 7f79ab173700 1 Processor -- start 2021-02-12T17:16:32.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.483+0000 7f79ab173700 1 -- start start 2021-02-12T17:16:32.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.483+0000 7f79ab173700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f79a40b0940 0x7f79a414e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.483+0000 7f79ab173700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f79a409ada0 0x7f79a4151830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.483+0000 7f79ab173700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a4066b70 con 0x7f79a40bc2b0 2021-02-12T17:16:32.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.483+0000 7f79ab173700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a40b27d0 con 0x7f79a409ada0 2021-02-12T17:16:32.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.483+0000 7f79ab173700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a414e550 con 0x7f79a40b0940 2021-02-12T17:16:32.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.484+0000 7f79a9710700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f79a409ada0 0x7f79a4151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.484+0000 7f79a8f0f700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f79a40bc2b0 0x7f79a4151120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54262/0 (socket says 172.21.2.102:54262) 2021-02-12T17:16:32.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.484+0000 7f79a8f0f700 1 -- 172.21.2.102:0/746569988 learned_addr learned my addr 172.21.2.102:0/746569988 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:32.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.484+0000 7f79a9710700 1 -- 172.21.2.102:0/746569988 >> v2:172.21.2.104:3300/0 conn(0x7f79a40b0940 msgr2=0x7f79a414e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:32.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.484+0000 7f79a9710700 1 --2- 172.21.2.102:0/746569988 >> v2:172.21.2.104:3300/0 conn(0x7f79a40b0940 0x7f79a414e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:32.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.484+0000 7f79a9710700 1 -- 172.21.2.102:0/746569988 >> v1:172.21.2.102:6789/0 conn(0x7f79a40bc2b0 legacy=0x7f79a4151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.484+0000 7f79a9710700 1 -- 172.21.2.102:0/746569988 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a40685b0 con 0x7f79a409ada0 2021-02-12T17:16:32.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.484+0000 7f79a9710700 1 --2- 172.21.2.102:0/746569988 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79a409ada0 0x7f79a4151830 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f79a40b6280 tx=0x7f799c0091d0).ready entity=mon.0 client_cookie=f042af2e12eef5e1 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.484+0000 7f79a37fe700 1 -- 172.21.2.102:0/746569988 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c009e70 con 0x7f79a409ada0 2021-02-12T17:16:32.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.484+0000 7f79a37fe700 1 -- 172.21.2.102:0/746569988 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c00bbf0 con 0x7f79a409ada0 2021-02-12T17:16:32.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.484+0000 7f79a37fe700 1 -- 172.21.2.102:0/746569988 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c011400 con 0x7f79a409ada0 2021-02-12T17:16:32.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.485+0000 7f79ab173700 1 -- 172.21.2.102:0/746569988 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79a409ada0 msgr2=0x7f79a4151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.485+0000 7f79ab173700 1 --2- 172.21.2.102:0/746569988 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79a409ada0 0x7f79a4151830 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f79a40b6280 tx=0x7f799c0091d0).stop 2021-02-12T17:16:32.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.485+0000 7f79ab173700 1 -- 172.21.2.102:0/746569988 shutdown_connections 2021-02-12T17:16:32.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.485+0000 7f79ab173700 1 --2- 172.21.2.102:0/746569988 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79a409ada0 0x7f79a4151830 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.485+0000 7f79ab173700 1 --2- 172.21.2.102:0/746569988 >> v2:172.21.2.104:3300/0 conn(0x7f79a40b0940 0x7f79a414e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:32.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.485+0000 7f79ab173700 1 -- 172.21.2.102:0/746569988 >> 172.21.2.102:0/746569988 conn(0x7f79a4061830 msgr2=0x7f79a40bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:32.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.485+0000 7f79ab173700 1 -- 172.21.2.102:0/746569988 shutdown_connections 2021-02-12T17:16:32.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.485+0000 7f79ab173700 1 -- 172.21.2.102:0/746569988 wait complete. 2021-02-12T17:16:32.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.486+0000 7f79ab173700 1 Processor -- start 2021-02-12T17:16:32.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.486+0000 7f79ab173700 1 -- start start 2021-02-12T17:16:32.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79ab173700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79a409ada0 0x7f79a40b8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79ab173700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f79a40b0940 0x7f79a4063c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79ab173700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f79a40bc2b0 0x7f79a4160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79ab173700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a415d710 con 0x7f79a409ada0 2021-02-12T17:16:32.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79ab173700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a4152490 con 0x7f79a40bc2b0 2021-02-12T17:16:32.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79ab173700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a4151a10 con 0x7f79a40b0940 2021-02-12T17:16:32.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79a8f0f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79a409ada0 0x7f79a40b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79a8f0f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79a409ada0 0x7f79a40b8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45624/0 (socket says 172.21.2.102:45624) 2021-02-12T17:16:32.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79a8f0f700 1 -- 172.21.2.102:0/2221882870 learned_addr learned my addr 172.21.2.102:0/2221882870 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:32.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79a8f0f700 1 -- 172.21.2.102:0/2221882870 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f79a40b0940 msgr2=0x7f79a4063c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.491 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79a8f0f700 1 --2- 172.21.2.102:0/2221882870 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f79a40b0940 0x7f79a4063c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:32.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79a8f0f700 1 -- 172.21.2.102:0/2221882870 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f79a40bc2b0 msgr2=0x7f79a4160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79a8f0f700 1 --2- 172.21.2.102:0/2221882870 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f79a40bc2b0 0x7f79a4160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:32.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79a8f0f700 1 -- 172.21.2.102:0/2221882870 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a4151cb0 con 0x7f79a409ada0 2021-02-12T17:16:32.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79a8f0f700 1 --2- 172.21.2.102:0/2221882870 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79a409ada0 0x7f79a40b8580 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f798c00c710 tx=0x7f798c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79a0ff9700 1 -- 172.21.2.102:0/2221882870 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c007320 con 0x7f79a409ada0 2021-02-12T17:16:32.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79a0ff9700 1 -- 172.21.2.102:0/2221882870 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c007480 con 0x7f79a409ada0 2021-02-12T17:16:32.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79ab173700 1 -- 172.21.2.102:0/2221882870 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a4151f50 con 0x7f79a409ada0 2021-02-12T17:16:32.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79a0ff9700 1 -- 172.21.2.102:0/2221882870 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c0057f0 con 0x7f79a409ada0 2021-02-12T17:16:32.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.487+0000 7f79ab173700 1 -- 172.21.2.102:0/2221882870 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a40b8a70 con 0x7f79a409ada0 2021-02-12T17:16:32.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.488+0000 7f79ab173700 1 -- 172.21.2.102:0/2221882870 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a4045460 con 0x7f79a409ada0 2021-02-12T17:16:32.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.488+0000 7f79a0ff9700 1 -- 172.21.2.102:0/2221882870 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f798c010030 con 0x7f79a409ada0 2021-02-12T17:16:32.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.488+0000 7f79a0ff9700 1 --2- 172.21.2.102:0/2221882870 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7988059d30 0x7f798805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.489+0000 7f79a0ff9700 1 -- 172.21.2.102:0/2221882870 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f798c0739b0 con 0x7f79a409ada0 2021-02-12T17:16:32.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.489+0000 7f79a3fff700 1 --2- 172.21.2.102:0/2221882870 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7988059d30 0x7f798805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.489+0000 7f79a3fff700 1 --2- 172.21.2.102:0/2221882870 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7988059d30 0x7f798805c1f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f79a41516a0 tx=0x7f7994006a70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.491+0000 7f79a0ff9700 1 -- 172.21.2.102:0/2221882870 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f798c0470d0 con 0x7f79a409ada0 2021-02-12T17:16:32.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.621+0000 7f79ab173700 1 -- 172.21.2.102:0/2221882870 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79a409aaf0 con 0x7f79a409ada0 2021-02-12T17:16:32.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.621+0000 7f79a0ff9700 1 -- 172.21.2.102:0/2221882870 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+10 (secure 0 0 0) 0x7f798c04a6f0 con 0x7f79a409ada0 2021-02-12T17:16:32.622 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:32.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.622+0000 7f79ab173700 1 -- 172.21.2.102:0/2221882870 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7988059d30 msgr2=0x7f798805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.622+0000 7f79ab173700 1 --2- 172.21.2.102:0/2221882870 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7988059d30 0x7f798805c1f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f79a41516a0 tx=0x7f7994006a70).stop 2021-02-12T17:16:32.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.622+0000 7f79ab173700 1 -- 172.21.2.102:0/2221882870 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79a409ada0 msgr2=0x7f79a40b8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.622+0000 7f79ab173700 1 --2- 172.21.2.102:0/2221882870 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79a409ada0 0x7f79a40b8580 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f798c00c710 tx=0x7f798c007c90).stop 2021-02-12T17:16:32.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.622+0000 7f79ab173700 1 -- 172.21.2.102:0/2221882870 shutdown_connections 2021-02-12T17:16:32.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.622+0000 7f79ab173700 1 --2- 172.21.2.102:0/2221882870 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f79a40bc2b0 0x7f79a4160fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:32.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.622+0000 7f79ab173700 1 --2- 172.21.2.102:0/2221882870 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7988059d30 0x7f798805c1f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.622+0000 7f79ab173700 1 --2- 172.21.2.102:0/2221882870 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f79a409ada0 0x7f79a40b8580 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.622+0000 7f79ab173700 1 --2- 172.21.2.102:0/2221882870 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f79a40b0940 0x7f79a4063c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:32.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.622+0000 7f79ab173700 1 -- 172.21.2.102:0/2221882870 >> 172.21.2.102:0/2221882870 conn(0x7f79a4061830 msgr2=0x7f79a40bb130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:32.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.622+0000 7f79ab173700 1 -- 172.21.2.102:0/2221882870 shutdown_connections 2021-02-12T17:16:32.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.622+0000 7f79ab173700 1 -- 172.21.2.102:0/2221882870 wait complete. 2021-02-12T17:16:32.632 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2021-02-12T17:16:32.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.720+0000 7f75d195b700 1 Processor -- start 2021-02-12T17:16:32.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.720+0000 7f75d195b700 1 -- start start 2021-02-12T17:16:32.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.720+0000 7f75d195b700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f75cc0bc2b0 0x7f75cc151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.720+0000 7f75d195b700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc066b70 con 0x7f75cc151d20 2021-02-12T17:16:32.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.720+0000 7f75d195b700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc0685b0 con 0x7f75cc0b0940 2021-02-12T17:16:32.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.720+0000 7f75d195b700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc0b27d0 con 0x7f75cc0bc2b0 2021-02-12T17:16:32.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.720+0000 7f75cb7fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f75cc151d20 0x7f75cc1584c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54276/0 (socket says 172.21.2.102:54276) 2021-02-12T17:16:32.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.720+0000 7f75cb7fe700 1 -- 172.21.2.102:0/4063610125 learned_addr learned my addr 172.21.2.102:0/4063610125 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:32.724 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 -- 172.21.2.102:0/4063610125 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251518218 0 0) 0x7f75cc066b70 con 0x7f75cc151d20 2021-02-12T17:16:32.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 -- 172.21.2.102:0/4063610125 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75ac003230 con 0x7f75cc151d20 2021-02-12T17:16:32.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75caffd700 1 --2- 172.21.2.102:0/4063610125 >> v2:172.21.2.104:3300/0 conn(0x7f75cc0bc2b0 0x7f75cc151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 -- 172.21.2.102:0/4063610125 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3579512102 0 0) 0x7f75ac003230 con 0x7f75cc151d20 2021-02-12T17:16:32.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 -- 172.21.2.102:0/4063610125 >> v2:172.21.2.104:3300/0 conn(0x7f75cc0bc2b0 msgr2=0x7f75cc151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:32.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 --2- 172.21.2.102:0/4063610125 >> v2:172.21.2.104:3300/0 conn(0x7f75cc0bc2b0 0x7f75cc151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 -- 172.21.2.102:0/4063610125 >> v1:172.21.2.104:6789/0 conn(0x7f75cc0b0940 legacy=0x7f75cc151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 -- 172.21.2.102:0/4063610125 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0b7110 con 0x7f75cc151d20 2021-02-12T17:16:32.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 -- 172.21.2.102:0/4063610125 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f75c4001860 con 0x7f75cc151d20 2021-02-12T17:16:32.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 -- 172.21.2.102:0/4063610125 >> v1:172.21.2.102:6789/0 conn(0x7f75cc151d20 legacy=0x7f75cc1584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 --2- 172.21.2.102:0/4063610125 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75ac003770 0x7f75ac003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 --2- 172.21.2.102:0/4063610125 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75ac0044d0 0x7f75ac004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 --2- 172.21.2.102:0/4063610125 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75ac004e40 0x7f75ac00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 -- 172.21.2.102:0/4063610125 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0b27d0 con 0x7f75ac003770 2021-02-12T17:16:32.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 -- 172.21.2.102:0/4063610125 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0052f0 con 0x7f75ac004e40 2021-02-12T17:16:32.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75c9ffb700 1 -- 172.21.2.102:0/4063610125 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac00bc10 con 0x7f75ac0044d0 2021-02-12T17:16:32.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.721+0000 7f75caffd700 1 --2- 172.21.2.102:0/4063610125 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75ac003770 0x7f75ac003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75cb7fe700 1 --2- 172.21.2.102:0/4063610125 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75ac004e40 0x7f75ac00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75ca7fc700 1 --2- 172.21.2.102:0/4063610125 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75ac0044d0 0x7f75ac004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75caffd700 1 -- 172.21.2.102:0/4063610125 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75ac0044d0 msgr2=0x7f75ac004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:32.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75caffd700 1 --2- 172.21.2.102:0/4063610125 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75ac0044d0 0x7f75ac004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75caffd700 1 -- 172.21.2.102:0/4063610125 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75ac004e40 msgr2=0x7f75ac00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:32.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75caffd700 1 --2- 172.21.2.102:0/4063610125 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75ac004e40 0x7f75ac00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75caffd700 1 -- 172.21.2.102:0/4063610125 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac003230 con 0x7f75ac003770 2021-02-12T17:16:32.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75cb7fe700 1 --2- 172.21.2.102:0/4063610125 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75ac004e40 0x7f75ac00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:32.726 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75cb7fe700 1 -- 172.21.2.102:0/4063610125 reap_dead start 2021-02-12T17:16:32.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75caffd700 1 --2- 172.21.2.102:0/4063610125 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75ac003770 0x7f75ac003b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f75bc00bb90 tx=0x7f75bc008040).ready entity=mon.0 client_cookie=80284c0faa9439fb server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75c9ffb700 1 -- 172.21.2.102:0/4063610125 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00b2b0 con 0x7f75ac003770 2021-02-12T17:16:32.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75c9ffb700 1 -- 172.21.2.102:0/4063610125 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc00ea00 con 0x7f75ac003770 2021-02-12T17:16:32.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75c9ffb700 1 -- 172.21.2.102:0/4063610125 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00eda0 con 0x7f75ac003770 2021-02-12T17:16:32.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75d195b700 1 -- 172.21.2.102:0/4063610125 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75ac003770 msgr2=0x7f75ac003b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75d195b700 1 --2- 172.21.2.102:0/4063610125 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75ac003770 0x7f75ac003b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f75bc00bb90 tx=0x7f75bc008040).stop 2021-02-12T17:16:32.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75d195b700 1 -- 172.21.2.102:0/4063610125 shutdown_connections 2021-02-12T17:16:32.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75d195b700 1 --2- 172.21.2.102:0/4063610125 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75ac003770 0x7f75ac003b90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75d195b700 1 -- 172.21.2.102:0/4063610125 >> 172.21.2.102:0/4063610125 conn(0x7f75cc061830 msgr2=0x7f75cc0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:32.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75d195b700 1 -- 172.21.2.102:0/4063610125 shutdown_connections 2021-02-12T17:16:32.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.722+0000 7f75d195b700 1 -- 172.21.2.102:0/4063610125 wait complete. 2021-02-12T17:16:32.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.723+0000 7f75d195b700 1 Processor -- start 2021-02-12T17:16:32.727 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.723+0000 7f75d195b700 1 -- start start 2021-02-12T17:16:32.729 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75d195b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75ac003770 0x7f75cc15d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.729 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75d195b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75cc0baf70 0x7f75cc091df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.730 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75d195b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75cc14d580 0x7f75cc14da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.730 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75d195b700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0640d0 con 0x7f75cc14d580 2021-02-12T17:16:32.730 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75d195b700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc14def0 con 0x7f75cc0baf70 2021-02-12T17:16:32.730 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75d195b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc063950 con 0x7f75ac003770 2021-02-12T17:16:32.730 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75cb7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75cc14d580 0x7f75cc14da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.730 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75cb7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75cc14d580 0x7f75cc14da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45648/0 (socket says 172.21.2.102:45648) 2021-02-12T17:16:32.730 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75cb7fe700 1 -- 172.21.2.102:0/3668675990 learned_addr learned my addr 172.21.2.102:0/3668675990 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:32.730 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75ca7fc700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75cc0baf70 0x7f75cc091df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.730 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75caffd700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75ac003770 0x7f75cc15d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.730 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75cb7fe700 1 -- 172.21.2.102:0/3668675990 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75ac003770 msgr2=0x7f75cc15d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.730 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75cb7fe700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75ac003770 0x7f75cc15d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.730 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75cb7fe700 1 -- 172.21.2.102:0/3668675990 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75cc0baf70 msgr2=0x7f75cc091df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.730 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75cb7fe700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75cc0baf70 0x7f75cc091df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.731 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75cb7fe700 1 -- 172.21.2.102:0/3668675990 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0b5680 con 0x7f75cc14d580 2021-02-12T17:16:32.731 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75caffd700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75ac003770 0x7f75cc15d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:32.731 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75ca7fc700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75cc0baf70 0x7f75cc091df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:32.731 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.724+0000 7f75cb7fe700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75cc14d580 0x7f75cc14da00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f75cc065c60 tx=0x7f75cc0684a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.731 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.725+0000 7f75c2ffd700 1 -- 172.21.2.102:0/3668675990 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400e930 con 0x7f75cc14d580 2021-02-12T17:16:32.731 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.725+0000 7f75c2ffd700 1 -- 172.21.2.102:0/3668675990 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c400ea90 con 0x7f75cc14d580 2021-02-12T17:16:32.731 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.725+0000 7f75d195b700 1 -- 172.21.2.102:0/3668675990 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc063200 con 0x7f75cc14d580 2021-02-12T17:16:32.731 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.725+0000 7f75d195b700 1 -- 172.21.2.102:0/3668675990 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc0b5b80 con 0x7f75cc14d580 2021-02-12T17:16:32.731 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.725+0000 7f75c2ffd700 1 -- 172.21.2.102:0/3668675990 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400ee50 con 0x7f75cc14d580 2021-02-12T17:16:32.731 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.725+0000 7f75d195b700 1 -- 172.21.2.102:0/3668675990 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a4004f60 con 0x7f75cc14d580 2021-02-12T17:16:32.731 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.726+0000 7f75c2ffd700 1 -- 172.21.2.102:0/3668675990 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f75c4014650 con 0x7f75cc14d580 2021-02-12T17:16:32.731 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.726+0000 7f75c2ffd700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f75b0059d30 0x7f75b005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.731 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.726+0000 7f75c2ffd700 1 -- 172.21.2.102:0/3668675990 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f75c4073a90 con 0x7f75cc14d580 2021-02-12T17:16:32.732 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.726+0000 7f75caffd700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f75b0059d30 0x7f75b005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.732 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.726+0000 7f75caffd700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f75b0059d30 0x7f75b005c1f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f75bc006cf0 tx=0x7f75bc01a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.732 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.729+0000 7f75c2ffd700 1 -- 172.21.2.102:0/3668675990 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f75c404ae60 con 0x7f75cc14d580 2021-02-12T17:16:32.858 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.856+0000 7f75d195b700 1 -- 172.21.2.102:0/3668675990 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f75a4005790 con 0x7f75cc14d580 2021-02-12T17:16:32.858 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.857+0000 7f75c2ffd700 1 -- 172.21.2.102:0/3668675990 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+10 (secure 0 0 0) 0x7f75c4047200 con 0x7f75cc14d580 2021-02-12T17:16:32.858 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:32.859 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.858+0000 7f75d195b700 1 -- 172.21.2.102:0/3668675990 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f75b0059d30 msgr2=0x7f75b005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.859 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.858+0000 7f75d195b700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f75b0059d30 0x7f75b005c1f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f75bc006cf0 tx=0x7f75bc01a000).stop 2021-02-12T17:16:32.859 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.858+0000 7f75d195b700 1 -- 172.21.2.102:0/3668675990 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75cc14d580 msgr2=0x7f75cc14da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.859 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.858+0000 7f75d195b700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75cc14d580 0x7f75cc14da00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f75cc065c60 tx=0x7f75cc0684a0).stop 2021-02-12T17:16:32.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.858+0000 7f75d195b700 1 -- 172.21.2.102:0/3668675990 shutdown_connections 2021-02-12T17:16:32.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.858+0000 7f75d195b700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f75b0059d30 0x7f75b005c1f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.858+0000 7f75d195b700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75cc14d580 0x7f75cc14da00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.858+0000 7f75d195b700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75ac003770 0x7f75cc15d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.858+0000 7f75d195b700 1 --2- 172.21.2.102:0/3668675990 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75cc0baf70 0x7f75cc091df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.858+0000 7f75d195b700 1 -- 172.21.2.102:0/3668675990 >> 172.21.2.102:0/3668675990 conn(0x7f75cc061830 msgr2=0x7f75cc150f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:32.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.858+0000 7f75d195b700 1 -- 172.21.2.102:0/3668675990 shutdown_connections 2021-02-12T17:16:32.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.858+0000 7f75d195b700 1 -- 172.21.2.102:0/3668675990 wait complete. 2021-02-12T17:16:32.868 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:16:32.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.953+0000 7ff88022a700 1 Processor -- start 2021-02-12T17:16:32.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.953+0000 7ff88022a700 1 -- start start 2021-02-12T17:16:32.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.953+0000 7ff88022a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff87814e530 0x7ff878068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.953+0000 7ff88022a700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7ff878062740 0x7ff878062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.953+0000 7ff88022a700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8780b7960 con 0x7ff8780b8d20 2021-02-12T17:16:32.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.953+0000 7ff88022a700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff878068d20 con 0x7ff878062740 2021-02-12T17:16:32.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.953+0000 7ff88022a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780622a0 con 0x7ff87814e530 2021-02-12T17:16:32.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.954+0000 7ff87e7c7700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7ff878062740 0x7ff878062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.954+0000 7ff87e7c7700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7ff878062740 0x7ff878062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:44016/0 (socket says 172.21.2.102:44016) 2021-02-12T17:16:32.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.954+0000 7ff87e7c7700 1 -- 172.21.2.102:0/2217311311 learned_addr learned my addr 172.21.2.102:0/2217311311 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:32.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.954+0000 7ff87d7c5700 1 --2- 172.21.2.102:0/2217311311 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff87814e530 0x7ff878068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.954+0000 7ff87e7c7700 1 -- 172.21.2.102:0/2217311311 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff87814e530 msgr2=0x7ff878068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:32.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.954+0000 7ff87e7c7700 1 --2- 172.21.2.102:0/2217311311 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff87814e530 0x7ff878068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.954+0000 7ff87e7c7700 1 -- 172.21.2.102:0/2217311311 >> v1:172.21.2.104:6789/0 conn(0x7ff8780b8d20 legacy=0x7ff8780b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.954+0000 7ff87e7c7700 1 -- 172.21.2.102:0/2217311311 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87814ea10 con 0x7ff878062740 2021-02-12T17:16:32.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.955+0000 7ff87e7c7700 1 --2- 172.21.2.102:0/2217311311 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff878062740 0x7ff878062bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff870009d50 tx=0x7ff870009290).ready entity=mon.1 client_cookie=21adedddbcffc05f server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.955+0000 7ff87cfc4700 1 -- 172.21.2.102:0/2217311311 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87000bbf0 con 0x7ff878062740 2021-02-12T17:16:32.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.955+0000 7ff87cfc4700 1 -- 172.21.2.102:0/2217311311 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87000bd50 con 0x7ff878062740 2021-02-12T17:16:32.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.955+0000 7ff87cfc4700 1 -- 172.21.2.102:0/2217311311 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870011610 con 0x7ff878062740 2021-02-12T17:16:32.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.955+0000 7ff88022a700 1 -- 172.21.2.102:0/2217311311 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff878062740 msgr2=0x7ff878062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.955+0000 7ff88022a700 1 --2- 172.21.2.102:0/2217311311 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff878062740 0x7ff878062bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff870009d50 tx=0x7ff870009290).stop 2021-02-12T17:16:32.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.955+0000 7ff88022a700 1 -- 172.21.2.102:0/2217311311 shutdown_connections 2021-02-12T17:16:32.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.955+0000 7ff88022a700 1 --2- 172.21.2.102:0/2217311311 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff878062740 0x7ff878062bf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.955+0000 7ff88022a700 1 --2- 172.21.2.102:0/2217311311 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff87814e530 0x7ff878068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.955+0000 7ff88022a700 1 -- 172.21.2.102:0/2217311311 >> 172.21.2.102:0/2217311311 conn(0x7ff8780bc480 msgr2=0x7ff8780b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:32.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.955+0000 7ff88022a700 1 -- 172.21.2.102:0/2217311311 shutdown_connections 2021-02-12T17:16:32.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.955+0000 7ff88022a700 1 -- 172.21.2.102:0/2217311311 wait complete. 2021-02-12T17:16:32.960 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.956+0000 7ff88022a700 1 Processor -- start 2021-02-12T17:16:32.960 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.956+0000 7ff88022a700 1 -- start start 2021-02-12T17:16:32.960 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff88022a700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff878062740 0x7ff878161680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.960 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff88022a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff8780b8d20 0x7ff8781536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.960 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff88022a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff87814e530 0x7ff8780ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.960 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff88022a700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780aee00 con 0x7ff8780b8d20 2021-02-12T17:16:32.960 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff88022a700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780b4f50 con 0x7ff878062740 2021-02-12T17:16:32.960 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff88022a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff878160ca0 con 0x7ff87814e530 2021-02-12T17:16:32.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff87d7c5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff8780b8d20 0x7ff8781536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff87dfc6700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff878062740 0x7ff878161680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff87dfc6700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff878062740 0x7ff878161680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:44018/0 (socket says 172.21.2.102:44018) 2021-02-12T17:16:32.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff87d7c5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff8780b8d20 0x7ff8781536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45660/0 (socket says 172.21.2.102:45660) 2021-02-12T17:16:32.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff87dfc6700 1 -- 172.21.2.102:0/45557994 learned_addr learned my addr 172.21.2.102:0/45557994 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:32.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff87e7c7700 1 --2- 172.21.2.102:0/45557994 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff87814e530 0x7ff8780ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff87dfc6700 1 -- 172.21.2.102:0/45557994 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff87814e530 msgr2=0x7ff8780ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff87dfc6700 1 --2- 172.21.2.102:0/45557994 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff87814e530 0x7ff8780ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff87dfc6700 1 -- 172.21.2.102:0/45557994 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff8780b8d20 msgr2=0x7ff8781536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:32.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff87dfc6700 1 --2- 172.21.2.102:0/45557994 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff8780b8d20 0x7ff8781536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:32.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff87dfc6700 1 -- 172.21.2.102:0/45557994 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff878160f40 con 0x7ff878062740 2021-02-12T17:16:32.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.957+0000 7ff87dfc6700 1 --2- 172.21.2.102:0/45557994 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff878062740 0x7ff878161680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7ff87400c710 tx=0x7ff874007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.958+0000 7ff869ffb700 1 -- 172.21.2.102:0/45557994 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874007020 con 0x7ff878062740 2021-02-12T17:16:32.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.958+0000 7ff869ffb700 1 -- 172.21.2.102:0/45557994 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff874007180 con 0x7ff878062740 2021-02-12T17:16:32.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.958+0000 7ff88022a700 1 -- 172.21.2.102:0/45557994 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8781611e0 con 0x7ff878062740 2021-02-12T17:16:32.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.958+0000 7ff869ffb700 1 -- 172.21.2.102:0/45557994 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8740064e0 con 0x7ff878062740 2021-02-12T17:16:32.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.958+0000 7ff88022a700 1 -- 172.21.2.102:0/45557994 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8780b5950 con 0x7ff878062740 2021-02-12T17:16:32.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.958+0000 7ff88022a700 1 -- 172.21.2.102:0/45557994 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff878063340 con 0x7ff878062740 2021-02-12T17:16:32.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.958+0000 7ff869ffb700 1 -- 172.21.2.102:0/45557994 <== mon.1 v2:172.21.2.104:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7ff874010070 con 0x7ff878062740 2021-02-12T17:16:32.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.959+0000 7ff869ffb700 1 --2- 172.21.2.102:0/45557994 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff858059d60 0x7ff85805c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:32.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.959+0000 7ff869ffb700 1 -- 172.21.2.102:0/45557994 <== mon.1 v2:172.21.2.104:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7ff874072ed0 con 0x7ff878062740 2021-02-12T17:16:32.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.959+0000 7ff87d7c5700 1 --2- 172.21.2.102:0/45557994 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff858059d60 0x7ff85805c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:32.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.959+0000 7ff87d7c5700 1 --2- 172.21.2.102:0/45557994 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff858059d60 0x7ff85805c220 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff8780b27f0 tx=0x7ff86c006de0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:32.963 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:32.962+0000 7ff869ffb700 1 -- 172.21.2.102:0/45557994 <== mon.1 v2:172.21.2.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7ff8740466a0 con 0x7ff878062740 2021-02-12T17:16:33.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.118+0000 7ff88022a700 1 -- 172.21.2.102:0/45557994 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff87805d600 con 0x7ff878062740 2021-02-12T17:16:33.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.119+0000 7ff869ffb700 1 -- 172.21.2.102:0/45557994 <== mon.1 v2:172.21.2.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7ff874049cc0 con 0x7ff878062740 2021-02-12T17:16:33.121 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:33.121 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:16:33.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.120+0000 7ff88022a700 1 -- 172.21.2.102:0/45557994 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff858059d60 msgr2=0x7ff85805c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.120+0000 7ff88022a700 1 --2- 172.21.2.102:0/45557994 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff858059d60 0x7ff85805c220 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff8780b27f0 tx=0x7ff86c006de0).stop 2021-02-12T17:16:33.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.120+0000 7ff88022a700 1 -- 172.21.2.102:0/45557994 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff878062740 msgr2=0x7ff878161680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.120+0000 7ff88022a700 1 --2- 172.21.2.102:0/45557994 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff878062740 0x7ff878161680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7ff87400c710 tx=0x7ff874007c40).stop 2021-02-12T17:16:33.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.121+0000 7ff88022a700 1 -- 172.21.2.102:0/45557994 shutdown_connections 2021-02-12T17:16:33.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.121+0000 7ff88022a700 1 --2- 172.21.2.102:0/45557994 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff87814e530 0x7ff8780ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.121+0000 7ff88022a700 1 --2- 172.21.2.102:0/45557994 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff878062740 0x7ff878161680 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.121+0000 7ff88022a700 1 --2- 172.21.2.102:0/45557994 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff858059d60 0x7ff85805c220 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.121+0000 7ff88022a700 1 --2- 172.21.2.102:0/45557994 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff8780b8d20 0x7ff8781536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.121+0000 7ff88022a700 1 -- 172.21.2.102:0/45557994 >> 172.21.2.102:0/45557994 conn(0x7ff8780bc480 msgr2=0x7ff8781519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:33.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.121+0000 7ff88022a700 1 -- 172.21.2.102:0/45557994 shutdown_connections 2021-02-12T17:16:33.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.121+0000 7ff88022a700 1 -- 172.21.2.102:0/45557994 wait complete. 2021-02-12T17:16:33.123 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:16:33.131 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:33.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.217+0000 7f9693599700 1 Processor -- start 2021-02-12T17:16:33.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.217+0000 7f9693599700 1 -- start start 2021-02-12T17:16:33.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9693599700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f968c0b8d20 0x7f968c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9693599700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f968c14e530 0x7f968c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9693599700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f968c062740 0x7f968c062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9693599700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c068d20 con 0x7f968c062740 2021-02-12T17:16:33.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9693599700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c0622a0 con 0x7f968c14e530 2021-02-12T17:16:33.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9693599700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c14ea10 con 0x7f968c0b8d20 2021-02-12T17:16:33.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9691b36700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f968c062740 0x7f968c062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9691b36700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f968c062740 0x7f968c062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45666/0 (socket says 172.21.2.102:45666) 2021-02-12T17:16:33.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9691b36700 1 -- 172.21.2.102:0/3977669034 learned_addr learned my addr 172.21.2.102:0/3977669034 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:33.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9691b36700 1 -- 172.21.2.102:0/3977669034 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f968c0b8d20 msgr2=0x7f968c068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:33.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9691b36700 1 --2- 172.21.2.102:0/3977669034 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f968c0b8d20 0x7f968c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:33.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9691b36700 1 -- 172.21.2.102:0/3977669034 >> v2:172.21.2.104:3300/0 conn(0x7f968c14e530 msgr2=0x7f968c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:33.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9691b36700 1 --2- 172.21.2.102:0/3977669034 >> v2:172.21.2.104:3300/0 conn(0x7f968c14e530 0x7f968c0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:33.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9691b36700 1 -- 172.21.2.102:0/3977669034 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c0b63f0 con 0x7f968c062740 2021-02-12T17:16:33.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f9691b36700 1 --2- 172.21.2.102:0/3977669034 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f968c062740 0x7f968c062bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f968c06aa60 tx=0x7f9684009290).ready entity=mon.0 client_cookie=7de5d76781ac03cd server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:33.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f967bfff700 1 -- 172.21.2.102:0/3977669034 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400bbf0 con 0x7f968c062740 2021-02-12T17:16:33.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f967bfff700 1 -- 172.21.2.102:0/3977669034 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968400bd50 con 0x7f968c062740 2021-02-12T17:16:33.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.218+0000 7f967bfff700 1 -- 172.21.2.102:0/3977669034 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684011610 con 0x7f968c062740 2021-02-12T17:16:33.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.219+0000 7f9693599700 1 -- 172.21.2.102:0/3977669034 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f968c062740 msgr2=0x7f968c062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.219+0000 7f9693599700 1 --2- 172.21.2.102:0/3977669034 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f968c062740 0x7f968c062bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f968c06aa60 tx=0x7f9684009290).stop 2021-02-12T17:16:33.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.219+0000 7f9693599700 1 -- 172.21.2.102:0/3977669034 shutdown_connections 2021-02-12T17:16:33.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.219+0000 7f9693599700 1 --2- 172.21.2.102:0/3977669034 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f968c0b8d20 0x7f968c068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:33.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.219+0000 7f9693599700 1 --2- 172.21.2.102:0/3977669034 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f968c062740 0x7f968c062bf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.219+0000 7f9693599700 1 --2- 172.21.2.102:0/3977669034 >> v2:172.21.2.104:3300/0 conn(0x7f968c14e530 0x7f968c0b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:33.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.219+0000 7f9693599700 1 -- 172.21.2.102:0/3977669034 >> 172.21.2.102:0/3977669034 conn(0x7f968c0bc480 msgr2=0x7f968c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:33.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.219+0000 7f9693599700 1 -- 172.21.2.102:0/3977669034 shutdown_connections 2021-02-12T17:16:33.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.219+0000 7f9693599700 1 -- 172.21.2.102:0/3977669034 wait complete. 2021-02-12T17:16:33.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.220+0000 7f9693599700 1 Processor -- start 2021-02-12T17:16:33.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.220+0000 7f9693599700 1 -- start start 2021-02-12T17:16:33.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.220+0000 7f9693599700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f968c062740 0x7f968c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.220+0000 7f9693599700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f968c0b8d20 0x7f968c153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.220+0000 7f9693599700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f968c14e530 0x7f968c15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.220+0000 7f9693599700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0b58b0 con 0x7f968c062740 2021-02-12T17:16:33.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.220+0000 7f9693599700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0b21d0 con 0x7f968c14e530 2021-02-12T17:16:33.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.220+0000 7f9693599700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0b2470 con 0x7f968c0b8d20 2021-02-12T17:16:33.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f9691335700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f968c062740 0x7f968c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f9691335700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f968c062740 0x7f968c0b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45674/0 (socket says 172.21.2.102:45674) 2021-02-12T17:16:33.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f9691335700 1 -- 172.21.2.102:0/4243285962 learned_addr learned my addr 172.21.2.102:0/4243285962 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:33.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f9690b34700 1 --2- 172.21.2.102:0/4243285962 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f968c0b8d20 0x7f968c153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f9691b36700 1 --2- 172.21.2.102:0/4243285962 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f968c14e530 0x7f968c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f9691335700 1 -- 172.21.2.102:0/4243285962 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f968c0b8d20 msgr2=0x7f968c153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f9691335700 1 --2- 172.21.2.102:0/4243285962 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f968c0b8d20 0x7f968c153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f9691335700 1 -- 172.21.2.102:0/4243285962 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f968c14e530 msgr2=0x7f968c15d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f9691335700 1 --2- 172.21.2.102:0/4243285962 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f968c14e530 0x7f968c15d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f9691335700 1 -- 172.21.2.102:0/4243285962 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c15d180 con 0x7f968c062740 2021-02-12T17:16:33.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f9691335700 1 --2- 172.21.2.102:0/4243285962 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f968c062740 0x7f968c0b4ec0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f967c009790 tx=0x7f967c006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:33.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f96797fa700 1 -- 172.21.2.102:0/4243285962 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c00d5a0 con 0x7f968c062740 2021-02-12T17:16:33.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f96797fa700 1 -- 172.21.2.102:0/4243285962 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967c000e90 con 0x7f968c062740 2021-02-12T17:16:33.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f9693599700 1 -- 172.21.2.102:0/4243285962 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c15d420 con 0x7f968c062740 2021-02-12T17:16:33.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f96797fa700 1 -- 172.21.2.102:0/4243285962 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c00d950 con 0x7f968c062740 2021-02-12T17:16:33.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.221+0000 7f9693599700 1 -- 172.21.2.102:0/4243285962 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c153fc0 con 0x7f968c062740 2021-02-12T17:16:33.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.222+0000 7f9693599700 1 -- 172.21.2.102:0/4243285962 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968c045460 con 0x7f968c062740 2021-02-12T17:16:33.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.222+0000 7f96797fa700 1 -- 172.21.2.102:0/4243285962 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f967c017030 con 0x7f968c062740 2021-02-12T17:16:33.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.222+0000 7f96797fa700 1 --2- 172.21.2.102:0/4243285962 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f966c059d80 0x7f966c05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.223+0000 7f96797fa700 1 -- 172.21.2.102:0/4243285962 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f967c072f90 con 0x7f968c062740 2021-02-12T17:16:33.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.223+0000 7f9690b34700 1 --2- 172.21.2.102:0/4243285962 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f966c059d80 0x7f966c05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.223+0000 7f9690b34700 1 --2- 172.21.2.102:0/4243285962 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f966c059d80 0x7f966c05c240 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f968c0b53b0 tx=0x7f9688008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:33.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.225+0000 7f96797fa700 1 -- 172.21.2.102:0/4243285962 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f967c0467e0 con 0x7f968c062740 2021-02-12T17:16:33.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.354+0000 7f9693599700 1 -- 172.21.2.102:0/4243285962 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f968c063670 con 0x7f968c062740 2021-02-12T17:16:33.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.355+0000 7f96797fa700 1 -- 172.21.2.102:0/4243285962 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19888 (secure 0 0 0) 0x7f967c015070 con 0x7f968c062740 2021-02-12T17:16:33.357 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:33.357 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":27,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:09.532002+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}},{"pool":5,"pool_name":"b_metadata","create_time":"2021-02-12T17:16:06.678651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}}},{"pool":6,"pool_name":"b_data","create_time":"2021-02-12T17:16:07.511756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"b"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:33.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.356+0000 7f9693599700 1 -- 172.21.2.102:0/4243285962 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f966c059d80 msgr2=0x7f966c05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.356+0000 7f9693599700 1 --2- 172.21.2.102:0/4243285962 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f966c059d80 0x7f966c05c240 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f968c0b53b0 tx=0x7f9688008040).stop 2021-02-12T17:16:33.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.356+0000 7f9693599700 1 -- 172.21.2.102:0/4243285962 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f968c062740 msgr2=0x7f968c0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.356+0000 7f9693599700 1 --2- 172.21.2.102:0/4243285962 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f968c062740 0x7f968c0b4ec0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f967c009790 tx=0x7f967c006eb0).stop 2021-02-12T17:16:33.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.356+0000 7f9693599700 1 -- 172.21.2.102:0/4243285962 shutdown_connections 2021-02-12T17:16:33.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.356+0000 7f9693599700 1 --2- 172.21.2.102:0/4243285962 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f968c14e530 0x7f968c15d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.356+0000 7f9693599700 1 --2- 172.21.2.102:0/4243285962 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f966c059d80 0x7f966c05c240 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.356+0000 7f9693599700 1 --2- 172.21.2.102:0/4243285962 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f968c062740 0x7f968c0b4ec0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.356+0000 7f9693599700 1 --2- 172.21.2.102:0/4243285962 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f968c0b8d20 0x7f968c153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.356+0000 7f9693599700 1 -- 172.21.2.102:0/4243285962 >> 172.21.2.102:0/4243285962 conn(0x7f968c0bc480 msgr2=0x7f968c14cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:33.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.356+0000 7f9693599700 1 -- 172.21.2.102:0/4243285962 shutdown_connections 2021-02-12T17:16:33.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.356+0000 7f9693599700 1 -- 172.21.2.102:0/4243285962 wait complete. 2021-02-12T17:16:33.367 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:33.367 INFO:tasks.mds_thrash.fs.[a]:starting mds_do_thrash for fs a 2021-02-12T17:16:33.367 INFO:tasks.mds_thrash.fs.[a]:waiting for 109 secs before thrashing 2021-02-12T17:16:33.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.452+0000 7f25623be700 1 Processor -- start 2021-02-12T17:16:33.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.452+0000 7f25623be700 1 -- start start 2021-02-12T17:16:33.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.453+0000 7f25623be700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f255c0b6350 0x7f255c1463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.453+0000 7f25623be700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f255c144ea0 0x7f255c145330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.453+0000 7f25623be700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c0b2930 con 0x7f255c067720 2021-02-12T17:16:33.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.453+0000 7f25623be700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255c068980 con 0x7f255c144ea0 2021-02-12T17:16:33.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.453+0000 7f25623be700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0b67b0 con 0x7f255c0b6350 2021-02-12T17:16:33.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.453+0000 7f255bfff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f255c067720 0x7f255c062580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54324/0 (socket says 172.21.2.102:54324) 2021-02-12T17:16:33.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.453+0000 7f255bfff700 1 -- 172.21.2.102:0/4294488010 learned_addr learned my addr 172.21.2.102:0/4294488010 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:33.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.453+0000 7f256095b700 1 --2- 172.21.2.102:0/4294488010 >> v2:172.21.2.104:3300/0 conn(0x7f255c144ea0 0x7f255c145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.453+0000 7f2553fff700 1 --2- 172.21.2.102:0/4294488010 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f255c0b6350 0x7f255c1463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.453+0000 7f255b7fe700 1 -- 172.21.2.102:0/4294488010 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884453884 0 0) 0x7f25440010d0 con 0x7f255c067720 2021-02-12T17:16:33.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.453+0000 7f255b7fe700 1 -- 172.21.2.102:0/4294488010 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f253c003230 con 0x7f255c067720 2021-02-12T17:16:33.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255b7fe700 1 -- 172.21.2.102:0/4294488010 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 310083134 0 0) 0x7f253c003230 con 0x7f255c067720 2021-02-12T17:16:33.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255b7fe700 1 -- 172.21.2.102:0/4294488010 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f255c0b6350 msgr2=0x7f255c1463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:33.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255b7fe700 1 --2- 172.21.2.102:0/4294488010 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f255c0b6350 0x7f255c1463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255b7fe700 1 -- 172.21.2.102:0/4294488010 >> v2:172.21.2.104:3300/0 conn(0x7f255c144ea0 msgr2=0x7f255c145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:33.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255b7fe700 1 --2- 172.21.2.102:0/4294488010 >> v2:172.21.2.104:3300/0 conn(0x7f255c144ea0 0x7f255c145330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255b7fe700 1 -- 172.21.2.102:0/4294488010 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c066db0 con 0x7f255c067720 2021-02-12T17:16:33.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255b7fe700 1 -- 172.21.2.102:0/4294488010 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f2544001670 con 0x7f255c067720 2021-02-12T17:16:33.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255b7fe700 1 -- 172.21.2.102:0/4294488010 >> v1:172.21.2.102:6789/0 conn(0x7f255c067720 legacy=0x7f255c062580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255b7fe700 1 --2- 172.21.2.102:0/4294488010 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f255c0b6350 0x7f253c0037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255b7fe700 1 --2- 172.21.2.102:0/4294488010 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f253c003cb0 0x7f253c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255b7fe700 1 --2- 172.21.2.102:0/4294488010 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f253c0049c0 0x7f253c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255b7fe700 1 -- 172.21.2.102:0/4294488010 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c068980 con 0x7f253c003cb0 2021-02-12T17:16:33.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255b7fe700 1 -- 172.21.2.102:0/4294488010 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0b67b0 con 0x7f253c0049c0 2021-02-12T17:16:33.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255b7fe700 1 -- 172.21.2.102:0/4294488010 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c004270 con 0x7f255c0b6350 2021-02-12T17:16:33.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f2553fff700 1 --2- 172.21.2.102:0/4294488010 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f253c003cb0 0x7f253c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255bfff700 1 --2- 172.21.2.102:0/4294488010 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f255c0b6350 0x7f253c0037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f256095b700 1 --2- 172.21.2.102:0/4294488010 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f253c0049c0 0x7f253c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f2553fff700 1 -- 172.21.2.102:0/4294488010 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f255c0b6350 msgr2=0x7f253c0037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:33.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f2553fff700 1 --2- 172.21.2.102:0/4294488010 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f255c0b6350 0x7f253c0037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f2553fff700 1 -- 172.21.2.102:0/4294488010 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f253c0049c0 msgr2=0x7f253c004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:33.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f2553fff700 1 --2- 172.21.2.102:0/4294488010 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f253c0049c0 0x7f253c004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f2553fff700 1 -- 172.21.2.102:0/4294488010 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c066db0 con 0x7f253c003cb0 2021-02-12T17:16:33.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f255bfff700 1 --2- 172.21.2.102:0/4294488010 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f255c0b6350 0x7f253c0037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:16:33.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f256095b700 1 --2- 172.21.2.102:0/4294488010 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f253c0049c0 0x7f253c004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:33.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.454+0000 7f2553fff700 1 --2- 172.21.2.102:0/4294488010 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f253c003cb0 0x7f253c0044d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f254c00bd20 tx=0x7f254c00b060).ready entity=mon.0 client_cookie=3e74a345bd44c799 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:33.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.455+0000 7f255b7fe700 1 -- 172.21.2.102:0/4294488010 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00b440 con 0x7f253c003cb0 2021-02-12T17:16:33.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.455+0000 7f255b7fe700 1 -- 172.21.2.102:0/4294488010 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c010c00 con 0x7f253c003cb0 2021-02-12T17:16:33.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.455+0000 7f255b7fe700 1 -- 172.21.2.102:0/4294488010 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c0143f0 con 0x7f253c003cb0 2021-02-12T17:16:33.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.455+0000 7f25623be700 1 -- 172.21.2.102:0/4294488010 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f253c003cb0 msgr2=0x7f253c0044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.455+0000 7f25623be700 1 --2- 172.21.2.102:0/4294488010 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f253c003cb0 0x7f253c0044d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f254c00bd20 tx=0x7f254c00b060).stop 2021-02-12T17:16:33.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.455+0000 7f256095b700 1 -- 172.21.2.102:0/4294488010 reap_dead start 2021-02-12T17:16:33.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.455+0000 7f25623be700 1 -- 172.21.2.102:0/4294488010 shutdown_connections 2021-02-12T17:16:33.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.455+0000 7f25623be700 1 -- 172.21.2.102:0/4294488010 >> 172.21.2.102:0/4294488010 conn(0x7f255c0bc480 msgr2=0x7f255c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:33.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.455+0000 7f25623be700 1 -- 172.21.2.102:0/4294488010 shutdown_connections 2021-02-12T17:16:33.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.455+0000 7f25623be700 1 -- 172.21.2.102:0/4294488010 wait complete. 2021-02-12T17:16:33.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.456+0000 7f25623be700 1 Processor -- start 2021-02-12T17:16:33.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.456+0000 7f25623be700 1 -- start start 2021-02-12T17:16:33.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.456+0000 7f25623be700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f255c0b1620 0x7f255c0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.456+0000 7f25623be700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f255c0b0b00 0x7f255c142e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.456+0000 7f25623be700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f255c143370 0x7f255c146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.456+0000 7f25623be700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c1554b0 con 0x7f255c143370 2021-02-12T17:16:33.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.456+0000 7f25623be700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c1498b0 con 0x7f255c0b0b00 2021-02-12T17:16:33.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.456+0000 7f25623be700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c149b50 con 0x7f255c0b1620 2021-02-12T17:16:33.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.457+0000 7f256095b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f255c143370 0x7f255c146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.457+0000 7f2553fff700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f255c0b0b00 0x7f255c142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.457+0000 7f256095b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f255c143370 0x7f255c146e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45696/0 (socket says 172.21.2.102:45696) 2021-02-12T17:16:33.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.457+0000 7f256095b700 1 -- 172.21.2.102:0/120935972 learned_addr learned my addr 172.21.2.102:0/120935972 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:33.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.457+0000 7f255bfff700 1 --2- 172.21.2.102:0/120935972 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f255c0b1620 0x7f255c0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.457+0000 7f2553fff700 1 -- 172.21.2.102:0/120935972 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f255c0b1620 msgr2=0x7f255c0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.457+0000 7f2553fff700 1 --2- 172.21.2.102:0/120935972 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f255c0b1620 0x7f255c0b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.457+0000 7f2553fff700 1 -- 172.21.2.102:0/120935972 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f255c143370 msgr2=0x7f255c146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.457+0000 7f2553fff700 1 --2- 172.21.2.102:0/120935972 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f255c143370 0x7f255c146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.457+0000 7f2553fff700 1 -- 172.21.2.102:0/120935972 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c149df0 con 0x7f255c0b0b00 2021-02-12T17:16:33.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.457+0000 7f256095b700 1 --2- 172.21.2.102:0/120935972 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f255c143370 0x7f255c146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:16:33.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.457+0000 7f2553fff700 1 --2- 172.21.2.102:0/120935972 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f255c0b0b00 0x7f255c142e80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f254c019000 tx=0x7f254c01c000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:33.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.457+0000 7f2558ff9700 1 -- 172.21.2.102:0/120935972 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c014e50 con 0x7f255c0b0b00 2021-02-12T17:16:33.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.457+0000 7f2558ff9700 1 -- 172.21.2.102:0/120935972 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c01d630 con 0x7f255c0b0b00 2021-02-12T17:16:33.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.458+0000 7f25623be700 1 -- 172.21.2.102:0/120935972 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255c14a090 con 0x7f255c0b0b00 2021-02-12T17:16:33.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.458+0000 7f25623be700 1 -- 172.21.2.102:0/120935972 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c14cb80 con 0x7f255c0b0b00 2021-02-12T17:16:33.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.458+0000 7f2558ff9700 1 -- 172.21.2.102:0/120935972 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c01d9f0 con 0x7f255c0b0b00 2021-02-12T17:16:33.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.458+0000 7f25623be700 1 -- 172.21.2.102:0/120935972 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c143750 con 0x7f255c0b0b00 2021-02-12T17:16:33.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.458+0000 7f2558ff9700 1 -- 172.21.2.102:0/120935972 <== mon.1 v2:172.21.2.104:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f254c01dd60 con 0x7f255c0b0b00 2021-02-12T17:16:33.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.459+0000 7f2558ff9700 1 --2- 172.21.2.102:0/120935972 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2540059d30 0x7f254005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.459+0000 7f2558ff9700 1 -- 172.21.2.102:0/120935972 <== mon.1 v2:172.21.2.104:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f254c077bb0 con 0x7f255c0b0b00 2021-02-12T17:16:33.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.459+0000 7f255bfff700 1 --2- 172.21.2.102:0/120935972 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2540059d30 0x7f254005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.459+0000 7f255bfff700 1 --2- 172.21.2.102:0/120935972 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2540059d30 0x7f254005c1f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f2544001540 tx=0x7f2544009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:33.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.462+0000 7f2558ff9700 1 -- 172.21.2.102:0/120935972 <== mon.1 v2:172.21.2.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f254c07e080 con 0x7f255c0b0b00 2021-02-12T17:16:33.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.591+0000 7f25623be700 1 -- 172.21.2.102:0/120935972 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f255c14a220 con 0x7f255c0b0b00 2021-02-12T17:16:33.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.592+0000 7f2558ff9700 1 -- 172.21.2.102:0/120935972 <== mon.1 v2:172.21.2.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19888 (secure 0 0 0) 0x7f254c018070 con 0x7f255c0b0b00 2021-02-12T17:16:33.594 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:33.594 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":27,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:09.532002+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}},{"pool":5,"pool_name":"b_metadata","create_time":"2021-02-12T17:16:06.678651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}}},{"pool":6,"pool_name":"b_data","create_time":"2021-02-12T17:16:07.511756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"b"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:33.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.594+0000 7f25623be700 1 -- 172.21.2.102:0/120935972 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2540059d30 msgr2=0x7f254005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.594+0000 7f25623be700 1 --2- 172.21.2.102:0/120935972 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2540059d30 0x7f254005c1f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f2544001540 tx=0x7f2544009040).stop 2021-02-12T17:16:33.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.594+0000 7f25623be700 1 -- 172.21.2.102:0/120935972 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f255c0b0b00 msgr2=0x7f255c142e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.594+0000 7f25623be700 1 --2- 172.21.2.102:0/120935972 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f255c0b0b00 0x7f255c142e80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f254c019000 tx=0x7f254c01c000).stop 2021-02-12T17:16:33.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.594+0000 7f25623be700 1 -- 172.21.2.102:0/120935972 shutdown_connections 2021-02-12T17:16:33.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.594+0000 7f25623be700 1 --2- 172.21.2.102:0/120935972 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2540059d30 0x7f254005c1f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.594+0000 7f25623be700 1 --2- 172.21.2.102:0/120935972 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f255c143370 0x7f255c146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.594+0000 7f25623be700 1 --2- 172.21.2.102:0/120935972 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f255c0b1620 0x7f255c0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.594+0000 7f25623be700 1 --2- 172.21.2.102:0/120935972 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f255c0b0b00 0x7f255c142e80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.594+0000 7f25623be700 1 -- 172.21.2.102:0/120935972 >> 172.21.2.102:0/120935972 conn(0x7f255c0bc480 msgr2=0x7f255c0b9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:33.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.594+0000 7f25623be700 1 -- 172.21.2.102:0/120935972 shutdown_connections 2021-02-12T17:16:33.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.595+0000 7f25623be700 1 -- 172.21.2.102:0/120935972 wait complete. 2021-02-12T17:16:33.604 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-12T17:15:54.614238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-12T17:15:56.701902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'a_metadata', 'create_time': '2021-02-12T17:15:59.832660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}}, {'pool': 4, 'pool_name': 'a_data', 'create_time': '2021-02-12T17:16:00.965024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'a'}}}, {'pool': 5, 'pool_name': 'b_metadata', 'create_time': '2021-02-12T17:16:06.678651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}}, {'pool': 6, 'pool_name': 'b_data', 'create_time': '2021-02-12T17:16:07.511756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'b'}}}] 2021-02-12T17:16:33.605 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-02-12T17:16:33.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.693+0000 7feab798a700 1 Processor -- start 2021-02-12T17:16:33.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.693+0000 7feab798a700 1 -- start start 2021-02-12T17:16:33.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.694+0000 7feab798a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feab00b0940 0x7feab014e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.694+0000 7feab798a700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7feab009ada0 0x7feab0151830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.694+0000 7feab798a700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab0066b70 con 0x7feab00bc2b0 2021-02-12T17:16:33.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.694+0000 7feab798a700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab00b27d0 con 0x7feab009ada0 2021-02-12T17:16:33.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.694+0000 7feab798a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab014e550 con 0x7feab00b0940 2021-02-12T17:16:33.699 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.694+0000 7feab5f27700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7feab009ada0 0x7feab0151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.699 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.694+0000 7feab5f27700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7feab009ada0 0x7feab0151830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45700/0 (socket says 172.21.2.102:45700) 2021-02-12T17:16:33.699 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.694+0000 7feab5f27700 1 -- 172.21.2.102:0/556925680 learned_addr learned my addr 172.21.2.102:0/556925680 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:33.699 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.694+0000 7feab5f27700 1 -- 172.21.2.102:0/556925680 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feab00b0940 msgr2=0x7feab014e060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:33.699 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.694+0000 7feab5f27700 1 --2- 172.21.2.102:0/556925680 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feab00b0940 0x7feab014e060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:33.699 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.694+0000 7feab5f27700 1 -- 172.21.2.102:0/556925680 >> v1:172.21.2.104:6789/0 conn(0x7feab00bc2b0 legacy=0x7feab0151120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:33.699 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.695+0000 7feab5f27700 1 -- 172.21.2.102:0/556925680 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab00685b0 con 0x7feab009ada0 2021-02-12T17:16:33.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.695+0000 7feab5f27700 1 --2- 172.21.2.102:0/556925680 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feab009ada0 0x7feab0151830 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7feaa8009d50 tx=0x7feaa8009290).ready entity=mon.0 client_cookie=af5bc5f326d5524e server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:33.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.695+0000 7fea9ffff700 1 -- 172.21.2.102:0/556925680 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800bc40 con 0x7feab009ada0 2021-02-12T17:16:33.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.695+0000 7fea9ffff700 1 -- 172.21.2.102:0/556925680 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa800bda0 con 0x7feab009ada0 2021-02-12T17:16:33.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.695+0000 7fea9ffff700 1 -- 172.21.2.102:0/556925680 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8011610 con 0x7feab009ada0 2021-02-12T17:16:33.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.695+0000 7feab798a700 1 -- 172.21.2.102:0/556925680 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feab009ada0 msgr2=0x7feab0151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.695+0000 7feab798a700 1 --2- 172.21.2.102:0/556925680 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feab009ada0 0x7feab0151830 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7feaa8009d50 tx=0x7feaa8009290).stop 2021-02-12T17:16:33.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.695+0000 7feab798a700 1 -- 172.21.2.102:0/556925680 shutdown_connections 2021-02-12T17:16:33.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.695+0000 7feab798a700 1 --2- 172.21.2.102:0/556925680 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feab009ada0 0x7feab0151830 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.695+0000 7feab798a700 1 --2- 172.21.2.102:0/556925680 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feab00b0940 0x7feab014e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:33.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.695+0000 7feab798a700 1 -- 172.21.2.102:0/556925680 >> 172.21.2.102:0/556925680 conn(0x7feab0061830 msgr2=0x7feab00bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:33.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.695+0000 7feab798a700 1 -- 172.21.2.102:0/556925680 shutdown_connections 2021-02-12T17:16:33.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.695+0000 7feab798a700 1 -- 172.21.2.102:0/556925680 wait complete. 2021-02-12T17:16:33.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.696+0000 7feab798a700 1 Processor -- start 2021-02-12T17:16:33.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.696+0000 7feab798a700 1 -- start start 2021-02-12T17:16:33.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab798a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feab009ada0 0x7feab014a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab798a700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7feab00b0940 0x7feab00622f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab798a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feab00bc2b0 0x7feab00627e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab798a700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab01501e0 con 0x7feab009ada0 2021-02-12T17:16:33.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab798a700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab0061e90 con 0x7feab00b0940 2021-02-12T17:16:33.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab798a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab0161880 con 0x7feab00bc2b0 2021-02-12T17:16:33.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab5726700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feab009ada0 0x7feab014a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab5726700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feab009ada0 0x7feab014a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45706/0 (socket says 172.21.2.102:45706) 2021-02-12T17:16:33.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab5726700 1 -- 172.21.2.102:0/2784456221 learned_addr learned my addr 172.21.2.102:0/2784456221 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:33.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab5726700 1 -- 172.21.2.102:0/2784456221 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feab00bc2b0 msgr2=0x7feab00627e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:33.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab5726700 1 --2- 172.21.2.102:0/2784456221 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feab00bc2b0 0x7feab00627e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:33.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab5726700 1 -- 172.21.2.102:0/2784456221 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7feab00b0940 msgr2=0x7feab00622f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:33.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab5726700 1 --2- 172.21.2.102:0/2784456221 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7feab00b0940 0x7feab00622f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:33.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab5726700 1 -- 172.21.2.102:0/2784456221 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab0150440 con 0x7feab009ada0 2021-02-12T17:16:33.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab5726700 1 --2- 172.21.2.102:0/2784456221 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feab009ada0 0x7feab014a2b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7feaa00096e0 tx=0x7feaa0006d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:33.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7fea9d7fa700 1 -- 172.21.2.102:0/2784456221 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000d500 con 0x7feab009ada0 2021-02-12T17:16:33.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7fea9d7fa700 1 -- 172.21.2.102:0/2784456221 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa0000e90 con 0x7feab009ada0 2021-02-12T17:16:33.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab798a700 1 -- 172.21.2.102:0/2784456221 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab01506e0 con 0x7feab009ada0 2021-02-12T17:16:33.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7fea9d7fa700 1 -- 172.21.2.102:0/2784456221 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000d8b0 con 0x7feab009ada0 2021-02-12T17:16:33.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.697+0000 7feab798a700 1 -- 172.21.2.102:0/2784456221 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab014caa0 con 0x7feab009ada0 2021-02-12T17:16:33.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.698+0000 7feab798a700 1 -- 172.21.2.102:0/2784456221 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab0062000 con 0x7feab009ada0 2021-02-12T17:16:33.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.698+0000 7fea9d7fa700 1 -- 172.21.2.102:0/2784456221 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7feaa000dc20 con 0x7feab009ada0 2021-02-12T17:16:33.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.698+0000 7fea9d7fa700 1 --2- 172.21.2.102:0/2784456221 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fea90059d30 0x7fea9005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.698+0000 7fea9d7fa700 1 -- 172.21.2.102:0/2784456221 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7feaa0073440 con 0x7feab009ada0 2021-02-12T17:16:33.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.699+0000 7feab4f25700 1 --2- 172.21.2.102:0/2784456221 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fea90059d30 0x7fea9005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.704 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.699+0000 7feab4f25700 1 --2- 172.21.2.102:0/2784456221 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fea90059d30 0x7fea9005c1f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7feab0064410 tx=0x7feaac006920).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:33.704 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.702+0000 7fea9d7fa700 1 -- 172.21.2.102:0/2784456221 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7feaa0046c70 con 0x7feab009ada0 2021-02-12T17:16:33.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.832+0000 7feab798a700 1 -- 172.21.2.102:0/2784456221 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7feab0045460 con 0x7feab009ada0 2021-02-12T17:16:33.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.832+0000 7fea9d7fa700 1 -- 172.21.2.102:0/2784456221 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v27) v1 ==== 110+0+10 (secure 0 0 0) 0x7feaa004a290 con 0x7feab009ada0 2021-02-12T17:16:33.834 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 1 2021-02-12T17:16:33.834 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.833+0000 7feab798a700 1 -- 172.21.2.102:0/2784456221 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fea90059d30 msgr2=0x7fea9005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.834 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.833+0000 7feab798a700 1 --2- 172.21.2.102:0/2784456221 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fea90059d30 0x7fea9005c1f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7feab0064410 tx=0x7feaac006920).stop 2021-02-12T17:16:33.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.833+0000 7feab798a700 1 -- 172.21.2.102:0/2784456221 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feab009ada0 msgr2=0x7feab014a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.833+0000 7feab798a700 1 --2- 172.21.2.102:0/2784456221 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feab009ada0 0x7feab014a2b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7feaa00096e0 tx=0x7feaa0006d40).stop 2021-02-12T17:16:33.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.833+0000 7feab798a700 1 -- 172.21.2.102:0/2784456221 shutdown_connections 2021-02-12T17:16:33.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.833+0000 7feab798a700 1 --2- 172.21.2.102:0/2784456221 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feab00bc2b0 0x7feab00627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:33.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.833+0000 7feab798a700 1 --2- 172.21.2.102:0/2784456221 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fea90059d30 0x7fea9005c1f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.833+0000 7feab798a700 1 --2- 172.21.2.102:0/2784456221 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feab009ada0 0x7feab014a2b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.833+0000 7feab798a700 1 --2- 172.21.2.102:0/2784456221 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7feab00b0940 0x7feab00622f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:33.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.833+0000 7feab798a700 1 -- 172.21.2.102:0/2784456221 >> 172.21.2.102:0/2784456221 conn(0x7feab0061830 msgr2=0x7feab014d130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:33.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.833+0000 7feab798a700 1 -- 172.21.2.102:0/2784456221 shutdown_connections 2021-02-12T17:16:33.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.833+0000 7feab798a700 1 -- 172.21.2.102:0/2784456221 wait complete. 2021-02-12T17:16:33.843 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-02-12T17:16:33.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.931+0000 7fee8ac2c700 1 Processor -- start 2021-02-12T17:16:33.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.931+0000 7fee8ac2c700 1 -- start start 2021-02-12T17:16:33.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.932+0000 7fee8ac2c700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fee840bc2b0 0x7fee84151120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.932+0000 7fee8ac2c700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee84066b70 con 0x7fee840b0940 2021-02-12T17:16:33.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.932+0000 7fee8ac2c700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee840685b0 con 0x7fee84151d20 2021-02-12T17:16:33.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.932+0000 7fee8ac2c700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee840b27d0 con 0x7fee840bc2b0 2021-02-12T17:16:33.934 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.932+0000 7fee83fff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fee840b0940 0x7fee84151610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54362/0 (socket says 172.21.2.102:54362) 2021-02-12T17:16:33.934 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.932+0000 7fee83fff700 1 -- 172.21.2.102:0/63469286 learned_addr learned my addr 172.21.2.102:0/63469286 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:33.934 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.932+0000 7fee837fe700 1 -- 172.21.2.102:0/63469286 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647745645 0 0) 0x7fee84066b70 con 0x7fee840b0940 2021-02-12T17:16:33.934 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.932+0000 7fee837fe700 1 -- 172.21.2.102:0/63469286 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee64003230 con 0x7fee840b0940 2021-02-12T17:16:33.935 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.932+0000 7fee889c8700 1 --2- 172.21.2.102:0/63469286 >> v2:172.21.2.104:3300/0 conn(0x7fee840bc2b0 0x7fee84151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.935 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.932+0000 7fee837fe700 1 -- 172.21.2.102:0/63469286 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 391910104 0 0) 0x7fee64003230 con 0x7fee840b0940 2021-02-12T17:16:33.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.932+0000 7fee837fe700 1 -- 172.21.2.102:0/63469286 >> v2:172.21.2.104:3300/0 conn(0x7fee840bc2b0 msgr2=0x7fee84151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:33.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.932+0000 7fee837fe700 1 --2- 172.21.2.102:0/63469286 >> v2:172.21.2.104:3300/0 conn(0x7fee840bc2b0 0x7fee84151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.932+0000 7fee837fe700 1 -- 172.21.2.102:0/63469286 >> v1:172.21.2.104:6789/0 conn(0x7fee84151d20 legacy=0x7fee841584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:33.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee837fe700 1 -- 172.21.2.102:0/63469286 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee840b7110 con 0x7fee840b0940 2021-02-12T17:16:33.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee837fe700 1 -- 172.21.2.102:0/63469286 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fee740014e0 con 0x7fee840b0940 2021-02-12T17:16:33.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee837fe700 1 -- 172.21.2.102:0/63469286 >> v1:172.21.2.102:6789/0 conn(0x7fee840b0940 legacy=0x7fee84151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee837fe700 1 --2- 172.21.2.102:0/63469286 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fee640037f0 0x7fee64003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee837fe700 1 --2- 172.21.2.102:0/63469286 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fee640044d0 0x7fee64004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee837fe700 1 --2- 172.21.2.102:0/63469286 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fee64004e40 0x7fee6400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee837fe700 1 -- 172.21.2.102:0/63469286 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee840b27d0 con 0x7fee640037f0 2021-02-12T17:16:33.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee837fe700 1 -- 172.21.2.102:0/63469286 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640052f0 con 0x7fee640044d0 2021-02-12T17:16:33.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee837fe700 1 -- 172.21.2.102:0/63469286 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6400bc10 con 0x7fee64004e40 2021-02-12T17:16:33.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee889c8700 1 --2- 172.21.2.102:0/63469286 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fee640037f0 0x7fee64003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee889c8700 1 -- 172.21.2.102:0/63469286 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fee64004e40 msgr2=0x7fee6400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee889c8700 1 --2- 172.21.2.102:0/63469286 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fee64004e40 0x7fee6400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee889c8700 1 -- 172.21.2.102:0/63469286 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fee640044d0 msgr2=0x7fee64004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee889c8700 1 --2- 172.21.2.102:0/63469286 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fee640044d0 0x7fee64004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee889c8700 1 -- 172.21.2.102:0/63469286 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee64003230 con 0x7fee640037f0 2021-02-12T17:16:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee891c9700 1 -- 172.21.2.102:0/63469286 reap_dead start 2021-02-12T17:16:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee889c8700 1 --2- 172.21.2.102:0/63469286 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fee640037f0 0x7fee64003bf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fee6c00ba70 tx=0x7fee6c008040).ready entity=mon.0 client_cookie=ad74ec2578a63274 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee837fe700 1 -- 172.21.2.102:0/63469286 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c00d8d0 con 0x7fee640037f0 2021-02-12T17:16:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee837fe700 1 -- 172.21.2.102:0/63469286 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c00da30 con 0x7fee640037f0 2021-02-12T17:16:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.933+0000 7fee837fe700 1 -- 172.21.2.102:0/63469286 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c00ddb0 con 0x7fee640037f0 2021-02-12T17:16:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.934+0000 7fee8ac2c700 1 -- 172.21.2.102:0/63469286 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fee640037f0 msgr2=0x7fee64003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.934+0000 7fee8ac2c700 1 --2- 172.21.2.102:0/63469286 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fee640037f0 0x7fee64003bf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fee6c00ba70 tx=0x7fee6c008040).stop 2021-02-12T17:16:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.934+0000 7fee8ac2c700 1 -- 172.21.2.102:0/63469286 shutdown_connections 2021-02-12T17:16:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.934+0000 7fee8ac2c700 1 --2- 172.21.2.102:0/63469286 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fee640037f0 0x7fee64003bf0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.934+0000 7fee8ac2c700 1 -- 172.21.2.102:0/63469286 >> 172.21.2.102:0/63469286 conn(0x7fee84061830 msgr2=0x7fee840bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.934+0000 7fee8ac2c700 1 -- 172.21.2.102:0/63469286 shutdown_connections 2021-02-12T17:16:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.934+0000 7fee8ac2c700 1 -- 172.21.2.102:0/63469286 wait complete. 2021-02-12T17:16:33.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.935+0000 7fee8ac2c700 1 Processor -- start 2021-02-12T17:16:33.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.935+0000 7fee8ac2c700 1 -- start start 2021-02-12T17:16:33.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.935+0000 7fee8ac2c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fee640037f0 0x7fee8409d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.935+0000 7fee8ac2c700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fee8415daf0 0x7fee840b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.935+0000 7fee8ac2c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fee8408fa40 0x7fee84160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.935+0000 7fee8ac2c700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee84150660 con 0x7fee640037f0 2021-02-12T17:16:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.935+0000 7fee8ac2c700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8409da00 con 0x7fee8415daf0 2021-02-12T17:16:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.935+0000 7fee8ac2c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8415d110 con 0x7fee8408fa40 2021-02-12T17:16:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee889c8700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fee640037f0 0x7fee8409d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee889c8700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fee640037f0 0x7fee8409d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45726/0 (socket says 172.21.2.102:45726) 2021-02-12T17:16:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee889c8700 1 -- 172.21.2.102:0/1019302100 learned_addr learned my addr 172.21.2.102:0/1019302100 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee83fff700 1 --2- 172.21.2.102:0/1019302100 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fee8415daf0 0x7fee840b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee889c8700 1 -- 172.21.2.102:0/1019302100 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fee8408fa40 msgr2=0x7fee84160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee889c8700 1 --2- 172.21.2.102:0/1019302100 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fee8408fa40 0x7fee84160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee889c8700 1 -- 172.21.2.102:0/1019302100 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fee8415daf0 msgr2=0x7fee840b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee889c8700 1 --2- 172.21.2.102:0/1019302100 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fee8415daf0 0x7fee840b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee889c8700 1 -- 172.21.2.102:0/1019302100 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8415d3b0 con 0x7fee640037f0 2021-02-12T17:16:33.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee83fff700 1 --2- 172.21.2.102:0/1019302100 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fee8415daf0 0x7fee840b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:33.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee889c8700 1 --2- 172.21.2.102:0/1019302100 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fee640037f0 0x7fee8409d3d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fee6c008010 tx=0x7fee6c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee80ff9700 1 -- 172.21.2.102:0/1019302100 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c01d410 con 0x7fee640037f0 2021-02-12T17:16:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee80ff9700 1 -- 172.21.2.102:0/1019302100 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c01d570 con 0x7fee640037f0 2021-02-12T17:16:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee8ac2c700 1 -- 172.21.2.102:0/1019302100 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8415d650 con 0x7fee640037f0 2021-02-12T17:16:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee80ff9700 1 -- 172.21.2.102:0/1019302100 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c01d910 con 0x7fee640037f0 2021-02-12T17:16:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.936+0000 7fee8ac2c700 1 -- 172.21.2.102:0/1019302100 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee840b3ba0 con 0x7fee640037f0 2021-02-12T17:16:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.937+0000 7fee8ac2c700 1 -- 172.21.2.102:0/1019302100 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee84045460 con 0x7fee640037f0 2021-02-12T17:16:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.937+0000 7fee80ff9700 1 -- 172.21.2.102:0/1019302100 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fee6c02c070 con 0x7fee640037f0 2021-02-12T17:16:33.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.937+0000 7fee80ff9700 1 --2- 172.21.2.102:0/1019302100 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fee68059d30 0x7fee6805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:33.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.937+0000 7fee80ff9700 1 -- 172.21.2.102:0/1019302100 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fee6c075630 con 0x7fee640037f0 2021-02-12T17:16:33.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.938+0000 7fee83fff700 1 --2- 172.21.2.102:0/1019302100 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fee68059d30 0x7fee6805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:33.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.938+0000 7fee83fff700 1 --2- 172.21.2.102:0/1019302100 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fee68059d30 0x7fee6805c1f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fee84091e90 tx=0x7fee74009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:33.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:33.940+0000 7fee80ff9700 1 -- 172.21.2.102:0/1019302100 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fee6c048e60 con 0x7fee640037f0 2021-02-12T17:16:34.071 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.070+0000 7fee8ac2c700 1 -- 172.21.2.102:0/1019302100 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fee84150660 con 0x7fee640037f0 2021-02-12T17:16:34.072 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.071+0000 7fee80ff9700 1 -- 172.21.2.102:0/1019302100 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fee6c04c480 con 0x7fee640037f0 2021-02-12T17:16:34.072 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:34.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.072+0000 7fee8ac2c700 1 -- 172.21.2.102:0/1019302100 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fee68059d30 msgr2=0x7fee6805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.072+0000 7fee8ac2c700 1 --2- 172.21.2.102:0/1019302100 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fee68059d30 0x7fee6805c1f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fee84091e90 tx=0x7fee74009040).stop 2021-02-12T17:16:34.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.072+0000 7fee8ac2c700 1 -- 172.21.2.102:0/1019302100 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fee640037f0 msgr2=0x7fee8409d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.072+0000 7fee8ac2c700 1 --2- 172.21.2.102:0/1019302100 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fee640037f0 0x7fee8409d3d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fee6c008010 tx=0x7fee6c008040).stop 2021-02-12T17:16:34.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.072+0000 7fee8ac2c700 1 -- 172.21.2.102:0/1019302100 shutdown_connections 2021-02-12T17:16:34.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.072+0000 7fee8ac2c700 1 --2- 172.21.2.102:0/1019302100 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fee8408fa40 0x7fee84160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:34.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.072+0000 7fee8ac2c700 1 --2- 172.21.2.102:0/1019302100 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fee68059d30 0x7fee6805c1f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.072+0000 7fee8ac2c700 1 --2- 172.21.2.102:0/1019302100 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fee640037f0 0x7fee8409d3d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.072+0000 7fee8ac2c700 1 --2- 172.21.2.102:0/1019302100 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fee8415daf0 0x7fee840b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.072+0000 7fee8ac2c700 1 -- 172.21.2.102:0/1019302100 >> 172.21.2.102:0/1019302100 conn(0x7fee84061830 msgr2=0x7fee8409dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:34.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.072+0000 7fee8ac2c700 1 -- 172.21.2.102:0/1019302100 shutdown_connections 2021-02-12T17:16:34.074 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.072+0000 7fee8ac2c700 1 -- 172.21.2.102:0/1019302100 wait complete. 2021-02-12T17:16:34.082 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2021-02-12T17:16:34.172 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.171+0000 7f32d6c19700 1 Processor -- start 2021-02-12T17:16:34.172 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.171+0000 7f32d6c19700 1 -- start start 2021-02-12T17:16:34.173 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.171+0000 7f32d6c19700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f32d00b0940 0x7f32d014e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.173 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.171+0000 7f32d6c19700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d0066b70 con 0x7f32d009ada0 2021-02-12T17:16:34.173 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.171+0000 7f32d6c19700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d00685b0 con 0x7f32d00bc2b0 2021-02-12T17:16:34.173 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.171+0000 7f32d6c19700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d00b27d0 con 0x7f32d00b0940 2021-02-12T17:16:34.173 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.171+0000 7f32cffff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f32d00b0940 0x7f32d014e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.171+0000 7f32d51b6700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f32d009ada0 0x7f32d0151830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54380/0 (socket says 172.21.2.102:54380) 2021-02-12T17:16:34.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.171+0000 7f32d51b6700 1 -- 172.21.2.102:0/3387771917 learned_addr learned my addr 172.21.2.102:0/3387771917 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:34.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.172+0000 7f32cffff700 1 -- 172.21.2.102:0/3387771917 >> v1:172.21.2.104:6789/0 conn(0x7f32d00bc2b0 legacy=0x7f32d0151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:34.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.172+0000 7f32cffff700 1 -- 172.21.2.102:0/3387771917 >> v1:172.21.2.102:6789/0 conn(0x7f32d009ada0 legacy=0x7f32d0151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:34.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.172+0000 7f32cffff700 1 -- 172.21.2.102:0/3387771917 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d014e550 con 0x7f32d00b0940 2021-02-12T17:16:34.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.172+0000 7f32cffff700 1 --2- 172.21.2.102:0/3387771917 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32d00b0940 0x7f32d014e060 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f32c000b980 tx=0x7f32c0006de0).ready entity=mon.0 client_cookie=258e7409408ecf6c server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:34.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.172+0000 7f32cf7fe700 1 -- 172.21.2.102:0/3387771917 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0009760 con 0x7f32d00b0940 2021-02-12T17:16:34.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.172+0000 7f32cf7fe700 1 -- 172.21.2.102:0/3387771917 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c00098c0 con 0x7f32d00b0940 2021-02-12T17:16:34.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.172+0000 7f32cf7fe700 1 -- 172.21.2.102:0/3387771917 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0009c40 con 0x7f32d00b0940 2021-02-12T17:16:34.176 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.172+0000 7f32d6c19700 1 -- 172.21.2.102:0/3387771917 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32d00b0940 msgr2=0x7f32d014e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.176 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.172+0000 7f32d6c19700 1 --2- 172.21.2.102:0/3387771917 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32d00b0940 0x7f32d014e060 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f32c000b980 tx=0x7f32c0006de0).stop 2021-02-12T17:16:34.176 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.172+0000 7f32d6c19700 1 -- 172.21.2.102:0/3387771917 shutdown_connections 2021-02-12T17:16:34.176 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.172+0000 7f32d6c19700 1 --2- 172.21.2.102:0/3387771917 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32d00b0940 0x7f32d014e060 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.176 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.172+0000 7f32d6c19700 1 -- 172.21.2.102:0/3387771917 >> 172.21.2.102:0/3387771917 conn(0x7f32d0061830 msgr2=0x7f32d00bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:34.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.172+0000 7f32d6c19700 1 -- 172.21.2.102:0/3387771917 shutdown_connections 2021-02-12T17:16:34.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.172+0000 7f32d6c19700 1 -- 172.21.2.102:0/3387771917 wait complete. 2021-02-12T17:16:34.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.173+0000 7f32d6c19700 1 Processor -- start 2021-02-12T17:16:34.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.173+0000 7f32d6c19700 1 -- start start 2021-02-12T17:16:34.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d6c19700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f32d009ada0 0x7f32d014f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d6c19700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f32d00b0940 0x7f32d009b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d6c19700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32d00bc2b0 0x7f32d009b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d6c19700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d009fdf0 con 0x7f32d00bc2b0 2021-02-12T17:16:34.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d6c19700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d015d3c0 con 0x7f32d009ada0 2021-02-12T17:16:34.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d6c19700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d015d600 con 0x7f32d00b0940 2021-02-12T17:16:34.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d51b6700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32d00bc2b0 0x7f32d009b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d51b6700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32d00bc2b0 0x7f32d009b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45744/0 (socket says 172.21.2.102:45744) 2021-02-12T17:16:34.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d51b6700 1 -- 172.21.2.102:0/670051712 learned_addr learned my addr 172.21.2.102:0/670051712 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:34.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d51b6700 1 -- 172.21.2.102:0/670051712 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f32d00b0940 msgr2=0x7f32d009b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d51b6700 1 --2- 172.21.2.102:0/670051712 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f32d00b0940 0x7f32d009b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:34.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d51b6700 1 -- 172.21.2.102:0/670051712 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f32d009ada0 msgr2=0x7f32d014f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d51b6700 1 --2- 172.21.2.102:0/670051712 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f32d009ada0 0x7f32d014f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:34.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d51b6700 1 -- 172.21.2.102:0/670051712 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d015d8a0 con 0x7f32d00bc2b0 2021-02-12T17:16:34.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.174+0000 7f32d51b6700 1 --2- 172.21.2.102:0/670051712 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32d00bc2b0 0x7f32d009b900 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f32c800cae0 tx=0x7f32c8004a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:34.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.175+0000 7f32ccff9700 1 -- 172.21.2.102:0/670051712 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8005ad0 con 0x7f32d00bc2b0 2021-02-12T17:16:34.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.175+0000 7f32ccff9700 1 -- 172.21.2.102:0/670051712 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c8005c30 con 0x7f32d00bc2b0 2021-02-12T17:16:34.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.175+0000 7f32d6c19700 1 -- 172.21.2.102:0/670051712 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d015db40 con 0x7f32d00bc2b0 2021-02-12T17:16:34.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.175+0000 7f32ccff9700 1 -- 172.21.2.102:0/670051712 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8007110 con 0x7f32d00bc2b0 2021-02-12T17:16:34.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.175+0000 7f32d6c19700 1 -- 172.21.2.102:0/670051712 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d015e080 con 0x7f32d00bc2b0 2021-02-12T17:16:34.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.175+0000 7f32d6c19700 1 -- 172.21.2.102:0/670051712 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d015e280 con 0x7f32d00bc2b0 2021-02-12T17:16:34.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.176+0000 7f32ccff9700 1 -- 172.21.2.102:0/670051712 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f32c8010030 con 0x7f32d00bc2b0 2021-02-12T17:16:34.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.176+0000 7f32ccff9700 1 --2- 172.21.2.102:0/670051712 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f32b4059d30 0x7f32b405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.176+0000 7f32ccff9700 1 -- 172.21.2.102:0/670051712 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f32c8073d80 con 0x7f32d00bc2b0 2021-02-12T17:16:34.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.176+0000 7f32d49b5700 1 --2- 172.21.2.102:0/670051712 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f32b4059d30 0x7f32b405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.177+0000 7f32d49b5700 1 --2- 172.21.2.102:0/670051712 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f32b4059d30 0x7f32b405c1f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f32b800b460 tx=0x7f32b8006900).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:34.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.179+0000 7f32ccff9700 1 -- 172.21.2.102:0/670051712 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f32d015e280 con 0x7f32d00bc2b0 2021-02-12T17:16:34.309 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.307+0000 7f32d6c19700 1 -- 172.21.2.102:0/670051712 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32d015e280 con 0x7f32d00bc2b0 2021-02-12T17:16:34.309 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.308+0000 7f32ccff9700 1 -- 172.21.2.102:0/670051712 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+10 (secure 0 0 0) 0x7f32d015e280 con 0x7f32d00bc2b0 2021-02-12T17:16:34.309 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:34.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.309+0000 7f32d6c19700 1 -- 172.21.2.102:0/670051712 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f32b4059d30 msgr2=0x7f32b405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.309+0000 7f32d6c19700 1 --2- 172.21.2.102:0/670051712 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f32b4059d30 0x7f32b405c1f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f32b800b460 tx=0x7f32b8006900).stop 2021-02-12T17:16:34.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.309+0000 7f32d6c19700 1 -- 172.21.2.102:0/670051712 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32d00bc2b0 msgr2=0x7f32d009b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.309+0000 7f32d6c19700 1 --2- 172.21.2.102:0/670051712 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32d00bc2b0 0x7f32d009b900 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f32c800cae0 tx=0x7f32c8004a60).stop 2021-02-12T17:16:34.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.309+0000 7f32d6c19700 1 -- 172.21.2.102:0/670051712 shutdown_connections 2021-02-12T17:16:34.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.309+0000 7f32d6c19700 1 --2- 172.21.2.102:0/670051712 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f32b4059d30 0x7f32b405c1f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.309+0000 7f32d6c19700 1 --2- 172.21.2.102:0/670051712 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32d00bc2b0 0x7f32d009b900 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.309+0000 7f32d6c19700 1 --2- 172.21.2.102:0/670051712 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f32d009ada0 0x7f32d014f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:34.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.309+0000 7f32d6c19700 1 --2- 172.21.2.102:0/670051712 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f32d00b0940 0x7f32d009b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:34.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.309+0000 7f32d6c19700 1 -- 172.21.2.102:0/670051712 >> 172.21.2.102:0/670051712 conn(0x7f32d0061830 msgr2=0x7f32d0063e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:34.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.309+0000 7f32d6c19700 1 -- 172.21.2.102:0/670051712 shutdown_connections 2021-02-12T17:16:34.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.310+0000 7f32d6c19700 1 -- 172.21.2.102:0/670051712 wait complete. 2021-02-12T17:16:34.319 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2021-02-12T17:16:34.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.409+0000 7f77de430700 1 Processor -- start 2021-02-12T17:16:34.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.409+0000 7f77de430700 1 -- start start 2021-02-12T17:16:34.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.409+0000 7f77de430700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f77d809ada0 0x7f77d814e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.409+0000 7f77de430700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d8066b70 con 0x7f77d80b0940 2021-02-12T17:16:34.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.409+0000 7f77de430700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d80685b0 con 0x7f77d80bc2b0 2021-02-12T17:16:34.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.409+0000 7f77de430700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d80b27d0 con 0x7f77d809ada0 2021-02-12T17:16:34.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.410+0000 7f77dc9cd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f77d809ada0 0x7f77d814e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.410+0000 7f77d77fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f77d80b0940 0x7f77d8151830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54392/0 (socket says 172.21.2.102:54392) 2021-02-12T17:16:34.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.410+0000 7f77d77fe700 1 -- 172.21.2.102:0/3462105157 learned_addr learned my addr 172.21.2.102:0/3462105157 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:34.412 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.410+0000 7f77dc9cd700 1 -- 172.21.2.102:0/3462105157 >> v1:172.21.2.104:6789/0 conn(0x7f77d80bc2b0 legacy=0x7f77d8151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:34.412 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.410+0000 7f77dc9cd700 1 -- 172.21.2.102:0/3462105157 >> v1:172.21.2.102:6789/0 conn(0x7f77d80b0940 legacy=0x7f77d8151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.410+0000 7f77dc9cd700 1 -- 172.21.2.102:0/3462105157 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d814e550 con 0x7f77d809ada0 2021-02-12T17:16:34.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.410+0000 7f77dc9cd700 1 --2- 172.21.2.102:0/3462105157 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f77d809ada0 0x7f77d814e060 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f77d0009c90 tx=0x7f77d00091d0).ready entity=mon.0 client_cookie=5a615dd9f32f1f9 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:34.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.410+0000 7f77d6ffd700 1 -- 172.21.2.102:0/3462105157 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0009ea0 con 0x7f77d809ada0 2021-02-12T17:16:34.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.410+0000 7f77d6ffd700 1 -- 172.21.2.102:0/3462105157 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d000bbb0 con 0x7f77d809ada0 2021-02-12T17:16:34.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.410+0000 7f77d6ffd700 1 -- 172.21.2.102:0/3462105157 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0011400 con 0x7f77d809ada0 2021-02-12T17:16:34.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.411+0000 7f77de430700 1 -- 172.21.2.102:0/3462105157 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f77d809ada0 msgr2=0x7f77d814e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.411+0000 7f77de430700 1 --2- 172.21.2.102:0/3462105157 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f77d809ada0 0x7f77d814e060 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f77d0009c90 tx=0x7f77d00091d0).stop 2021-02-12T17:16:34.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.411+0000 7f77de430700 1 -- 172.21.2.102:0/3462105157 shutdown_connections 2021-02-12T17:16:34.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.411+0000 7f77de430700 1 --2- 172.21.2.102:0/3462105157 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f77d809ada0 0x7f77d814e060 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.411+0000 7f77de430700 1 -- 172.21.2.102:0/3462105157 >> 172.21.2.102:0/3462105157 conn(0x7f77d8061830 msgr2=0x7f77d80bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:34.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.411+0000 7f77de430700 1 -- 172.21.2.102:0/3462105157 shutdown_connections 2021-02-12T17:16:34.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.411+0000 7f77de430700 1 -- 172.21.2.102:0/3462105157 wait complete. 2021-02-12T17:16:34.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.412+0000 7f77de430700 1 Processor -- start 2021-02-12T17:16:34.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.412+0000 7f77de430700 1 -- start start 2021-02-12T17:16:34.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.412+0000 7f77de430700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f77d809ada0 0x7f77d80b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.412+0000 7f77de430700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f77d80b0940 0x7f77d814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.412+0000 7f77de430700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f77d80bc2b0 0x7f77d81531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.412+0000 7f77de430700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d80b3540 con 0x7f77d80bc2b0 2021-02-12T17:16:34.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.412+0000 7f77de430700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d80b8ae0 con 0x7f77d80b0940 2021-02-12T17:16:34.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.412+0000 7f77de430700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d80b2dd0 con 0x7f77d809ada0 2021-02-12T17:16:34.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.412+0000 7f77dc9cd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f77d80bc2b0 0x7f77d81531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.412+0000 7f77dc9cd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f77d80bc2b0 0x7f77d81531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45758/0 (socket says 172.21.2.102:45758) 2021-02-12T17:16:34.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.412+0000 7f77dc9cd700 1 -- 172.21.2.102:0/850282698 learned_addr learned my addr 172.21.2.102:0/850282698 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:34.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.413+0000 7f77d77fe700 1 --2- 172.21.2.102:0/850282698 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f77d80b0940 0x7f77d814f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.413+0000 7f77dc9cd700 1 -- 172.21.2.102:0/850282698 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f77d809ada0 msgr2=0x7f77d80b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.413+0000 7f77dc9cd700 1 --2- 172.21.2.102:0/850282698 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f77d809ada0 0x7f77d80b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:34.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.413+0000 7f77dc9cd700 1 -- 172.21.2.102:0/850282698 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f77d80b0940 msgr2=0x7f77d814f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.413+0000 7f77dc9cd700 1 --2- 172.21.2.102:0/850282698 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f77d80b0940 0x7f77d814f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.413+0000 7f77dc9cd700 1 -- 172.21.2.102:0/850282698 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d80b5ae0 con 0x7f77d80bc2b0 2021-02-12T17:16:34.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.413+0000 7f77d77fe700 1 --2- 172.21.2.102:0/850282698 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f77d80b0940 0x7f77d814f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:34.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.413+0000 7f77dc9cd700 1 --2- 172.21.2.102:0/850282698 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f77d80bc2b0 0x7f77d81531d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f77d000b750 tx=0x7f77d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:34.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.413+0000 7f77cffff700 1 -- 172.21.2.102:0/850282698 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d001b6f0 con 0x7f77d80bc2b0 2021-02-12T17:16:34.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.413+0000 7f77cffff700 1 -- 172.21.2.102:0/850282698 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d001b850 con 0x7f77d80bc2b0 2021-02-12T17:16:34.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.413+0000 7f77de430700 1 -- 172.21.2.102:0/850282698 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d80b83c0 con 0x7f77d80bc2b0 2021-02-12T17:16:34.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.413+0000 7f77cffff700 1 -- 172.21.2.102:0/850282698 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d001bbf0 con 0x7f77d80bc2b0 2021-02-12T17:16:34.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.413+0000 7f77de430700 1 -- 172.21.2.102:0/850282698 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d80b8660 con 0x7f77d80bc2b0 2021-02-12T17:16:34.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.414+0000 7f77de430700 1 -- 172.21.2.102:0/850282698 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d8045460 con 0x7f77d80bc2b0 2021-02-12T17:16:34.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.414+0000 7f77cffff700 1 -- 172.21.2.102:0/850282698 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f77d000f070 con 0x7f77d80bc2b0 2021-02-12T17:16:34.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.414+0000 7f77cffff700 1 --2- 172.21.2.102:0/850282698 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f77bc059d80 0x7f77bc05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.414+0000 7f77cffff700 1 -- 172.21.2.102:0/850282698 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f77d00759c0 con 0x7f77d80bc2b0 2021-02-12T17:16:34.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.414+0000 7f77d7fff700 1 --2- 172.21.2.102:0/850282698 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f77bc059d80 0x7f77bc05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.415+0000 7f77d7fff700 1 --2- 172.21.2.102:0/850282698 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f77bc059d80 0x7f77bc05c240 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f77c000b460 tx=0x7f77c0006900).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:34.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.417+0000 7f77cffff700 1 -- 172.21.2.102:0/850282698 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f77d00490e0 con 0x7f77d80bc2b0 2021-02-12T17:16:34.547 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.546+0000 7f77de430700 1 -- 172.21.2.102:0/850282698 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f77d80b7650 con 0x7f77d80bc2b0 2021-02-12T17:16:34.548 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.547+0000 7f77cffff700 1 -- 172.21.2.102:0/850282698 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+10 (secure 0 0 0) 0x7f77d004c700 con 0x7f77d80bc2b0 2021-02-12T17:16:34.548 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:34.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.548+0000 7f77de430700 1 -- 172.21.2.102:0/850282698 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f77bc059d80 msgr2=0x7f77bc05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.548+0000 7f77de430700 1 --2- 172.21.2.102:0/850282698 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f77bc059d80 0x7f77bc05c240 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f77c000b460 tx=0x7f77c0006900).stop 2021-02-12T17:16:34.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.548+0000 7f77de430700 1 -- 172.21.2.102:0/850282698 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f77d80bc2b0 msgr2=0x7f77d81531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.548+0000 7f77de430700 1 --2- 172.21.2.102:0/850282698 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f77d80bc2b0 0x7f77d81531d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f77d000b750 tx=0x7f77d0017000).stop 2021-02-12T17:16:34.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.548+0000 7f77de430700 1 -- 172.21.2.102:0/850282698 shutdown_connections 2021-02-12T17:16:34.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.548+0000 7f77de430700 1 --2- 172.21.2.102:0/850282698 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f77bc059d80 0x7f77bc05c240 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.548+0000 7f77de430700 1 --2- 172.21.2.102:0/850282698 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f77d80bc2b0 0x7f77d81531d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.548+0000 7f77de430700 1 --2- 172.21.2.102:0/850282698 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f77d809ada0 0x7f77d80b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:34.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.548+0000 7f77de430700 1 --2- 172.21.2.102:0/850282698 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f77d80b0940 0x7f77d814f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.548+0000 7f77de430700 1 -- 172.21.2.102:0/850282698 >> 172.21.2.102:0/850282698 conn(0x7f77d8061830 msgr2=0x7f77d80b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:34.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.548+0000 7f77de430700 1 -- 172.21.2.102:0/850282698 shutdown_connections 2021-02-12T17:16:34.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.548+0000 7f77de430700 1 -- 172.21.2.102:0/850282698 wait complete. 2021-02-12T17:16:34.558 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2021-02-12T17:16:34.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.645+0000 7fc2227bb700 1 Processor -- start 2021-02-12T17:16:34.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.645+0000 7fc2227bb700 1 -- start start 2021-02-12T17:16:34.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.646+0000 7fc2227bb700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fc21c0b2fa0 0x7fc21c0b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.646+0000 7fc2227bb700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc21c0b2360 0x7fc21c146760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.646+0000 7fc2227bb700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c1475a0 con 0x7fc21c0b2bc0 2021-02-12T17:16:34.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.646+0000 7fc2227bb700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c0b9210 con 0x7fc21c0b2fa0 2021-02-12T17:16:34.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.646+0000 7fc2227bb700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0b94b0 con 0x7fc21c0b2360 2021-02-12T17:16:34.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.647+0000 7fc21b7fe700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fc21c0b2fa0 0x7fc21c0b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.647+0000 7fc21bfff700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7fc21c0b2bc0 0x7fc21c147c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:36776/0 (socket says 172.21.2.102:36776) 2021-02-12T17:16:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.647+0000 7fc220d58700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc21c0b2360 0x7fc21c146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.647+0000 7fc21bfff700 1 -- 172.21.2.102:0/3389821260 learned_addr learned my addr 172.21.2.102:0/3389821260 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.647+0000 7fc21b7fe700 1 -- 172.21.2.102:0/3389821260 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc21c0b2360 msgr2=0x7fc21c146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.647+0000 7fc21b7fe700 1 --2- 172.21.2.102:0/3389821260 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc21c0b2360 0x7fc21c146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.647+0000 7fc21b7fe700 1 -- 172.21.2.102:0/3389821260 >> v1:172.21.2.104:6789/0 conn(0x7fc21c0b2bc0 legacy=0x7fc21c147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.647+0000 7fc21b7fe700 1 -- 172.21.2.102:0/3389821260 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c1477d0 con 0x7fc21c0b2fa0 2021-02-12T17:16:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.647+0000 7fc21b7fe700 1 --2- 172.21.2.102:0/3389821260 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc21c0b2fa0 0x7fc21c0b6c00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fc20c00b980 tx=0x7fc20c006de0).ready entity=mon.1 client_cookie=b56861aada2983b3 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.647+0000 7fc21affd700 1 -- 172.21.2.102:0/3389821260 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00be70 con 0x7fc21c0b2fa0 2021-02-12T17:16:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.647+0000 7fc21affd700 1 -- 172.21.2.102:0/3389821260 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c009870 con 0x7fc21c0b2fa0 2021-02-12T17:16:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.648+0000 7fc21affd700 1 -- 172.21.2.102:0/3389821260 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c009bf0 con 0x7fc21c0b2fa0 2021-02-12T17:16:34.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.648+0000 7fc2227bb700 1 -- 172.21.2.102:0/3389821260 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc21c0b2fa0 msgr2=0x7fc21c0b6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.648+0000 7fc2227bb700 1 --2- 172.21.2.102:0/3389821260 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc21c0b2fa0 0x7fc21c0b6c00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fc20c00b980 tx=0x7fc20c006de0).stop 2021-02-12T17:16:34.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.648+0000 7fc2227bb700 1 -- 172.21.2.102:0/3389821260 shutdown_connections 2021-02-12T17:16:34.651 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.648+0000 7fc2227bb700 1 --2- 172.21.2.102:0/3389821260 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc21c0b2360 0x7fc21c146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.651 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.648+0000 7fc2227bb700 1 --2- 172.21.2.102:0/3389821260 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc21c0b2fa0 0x7fc21c0b6c00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.651 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.648+0000 7fc2227bb700 1 -- 172.21.2.102:0/3389821260 >> 172.21.2.102:0/3389821260 conn(0x7fc21c060da0 msgr2=0x7fc21c0611b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:34.651 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.648+0000 7fc2227bb700 1 -- 172.21.2.102:0/3389821260 shutdown_connections 2021-02-12T17:16:34.651 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.648+0000 7fc2227bb700 1 -- 172.21.2.102:0/3389821260 wait complete. 2021-02-12T17:16:34.651 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.649+0000 7fc2227bb700 1 Processor -- start 2021-02-12T17:16:34.651 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.649+0000 7fc2227bb700 1 -- start start 2021-02-12T17:16:34.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc2227bb700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc21c0b2360 0x7fc21c13c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc2227bb700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc21c0b2bc0 0x7fc21c160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc2227bb700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc21c0b2fa0 0x7fc21c161380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc2227bb700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0b36c0 con 0x7fc21c0b2bc0 2021-02-12T17:16:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc2227bb700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c160a30 con 0x7fc21c0b2fa0 2021-02-12T17:16:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc2227bb700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c161870 con 0x7fc21c0b2360 2021-02-12T17:16:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc21b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc21c0b2bc0 0x7fc21c160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc21b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc21c0b2bc0 0x7fc21c160e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45768/0 (socket says 172.21.2.102:45768) 2021-02-12T17:16:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc21b7fe700 1 -- 172.21.2.102:0/1792424848 learned_addr learned my addr 172.21.2.102:0/1792424848 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc220d58700 1 --2- 172.21.2.102:0/1792424848 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc21c0b2fa0 0x7fc21c161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc21b7fe700 1 -- 172.21.2.102:0/1792424848 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc21c0b2360 msgr2=0x7fc21c13c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc21b7fe700 1 --2- 172.21.2.102:0/1792424848 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc21c0b2360 0x7fc21c13c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc21b7fe700 1 -- 172.21.2.102:0/1792424848 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc21c0b2fa0 msgr2=0x7fc21c161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc21b7fe700 1 --2- 172.21.2.102:0/1792424848 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc21c0b2fa0 0x7fc21c161380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc21b7fe700 1 -- 172.21.2.102:0/1792424848 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0a1680 con 0x7fc21c0b2bc0 2021-02-12T17:16:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc21b7fe700 1 --2- 172.21.2.102:0/1792424848 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc21c0b2bc0 0x7fc21c160e90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fc21c062250 tx=0x7fc20c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:34.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc213fff700 1 -- 172.21.2.102:0/1792424848 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c012c50 con 0x7fc21c0b2bc0 2021-02-12T17:16:34.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc213fff700 1 -- 172.21.2.102:0/1792424848 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c012db0 con 0x7fc21c0b2bc0 2021-02-12T17:16:34.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc2227bb700 1 -- 172.21.2.102:0/1792424848 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c0b3920 con 0x7fc21c0b2bc0 2021-02-12T17:16:34.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.650+0000 7fc213fff700 1 -- 172.21.2.102:0/1792424848 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c01c650 con 0x7fc21c0b2bc0 2021-02-12T17:16:34.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.651+0000 7fc2227bb700 1 -- 172.21.2.102:0/1792424848 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c0a1320 con 0x7fc21c0b2bc0 2021-02-12T17:16:34.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.651+0000 7fc2227bb700 1 -- 172.21.2.102:0/1792424848 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c160bd0 con 0x7fc21c0b2bc0 2021-02-12T17:16:34.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.651+0000 7fc213fff700 1 -- 172.21.2.102:0/1792424848 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fc20c00f070 con 0x7fc21c0b2bc0 2021-02-12T17:16:34.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.652+0000 7fc213fff700 1 --2- 172.21.2.102:0/1792424848 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc200059d30 0x7fc20005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.652+0000 7fc213fff700 1 -- 172.21.2.102:0/1792424848 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fc20c075330 con 0x7fc21c0b2bc0 2021-02-12T17:16:34.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.652+0000 7fc21bfff700 1 --2- 172.21.2.102:0/1792424848 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc200059d30 0x7fc20005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.652+0000 7fc21bfff700 1 --2- 172.21.2.102:0/1792424848 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc200059d30 0x7fc20005c1f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fc21c13cfb0 tx=0x7fc2040077f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:34.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.655+0000 7fc213fff700 1 -- 172.21.2.102:0/1792424848 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fc21c160bd0 con 0x7fc21c0b2bc0 2021-02-12T17:16:34.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.784+0000 7fc2227bb700 1 -- 172.21.2.102:0/1792424848 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc21c160bd0 con 0x7fc21c0b2bc0 2021-02-12T17:16:34.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.784+0000 7fc213fff700 1 -- 172.21.2.102:0/1792424848 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v27) v1 ==== 99+0+10 (secure 0 0 0) 0x7fc21c160bd0 con 0x7fc21c0b2bc0 2021-02-12T17:16:34.786 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:34.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.786+0000 7fc2227bb700 1 -- 172.21.2.102:0/1792424848 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc200059d30 msgr2=0x7fc20005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.786+0000 7fc2227bb700 1 --2- 172.21.2.102:0/1792424848 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc200059d30 0x7fc20005c1f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fc21c13cfb0 tx=0x7fc2040077f0).stop 2021-02-12T17:16:34.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.786+0000 7fc2227bb700 1 -- 172.21.2.102:0/1792424848 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc21c0b2bc0 msgr2=0x7fc21c160e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.786+0000 7fc2227bb700 1 --2- 172.21.2.102:0/1792424848 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc21c0b2bc0 0x7fc21c160e90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fc21c062250 tx=0x7fc20c016000).stop 2021-02-12T17:16:34.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.786+0000 7fc2227bb700 1 -- 172.21.2.102:0/1792424848 shutdown_connections 2021-02-12T17:16:34.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.786+0000 7fc2227bb700 1 --2- 172.21.2.102:0/1792424848 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc21c0b2fa0 0x7fc21c161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.786+0000 7fc2227bb700 1 --2- 172.21.2.102:0/1792424848 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc21c0b2360 0x7fc21c13c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:34.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.786+0000 7fc2227bb700 1 --2- 172.21.2.102:0/1792424848 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc200059d30 0x7fc20005c1f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.786+0000 7fc2227bb700 1 --2- 172.21.2.102:0/1792424848 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc21c0b2bc0 0x7fc21c160e90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.786+0000 7fc2227bb700 1 -- 172.21.2.102:0/1792424848 >> 172.21.2.102:0/1792424848 conn(0x7fc21c060da0 msgr2=0x7fc21c148cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:34.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.786+0000 7fc2227bb700 1 -- 172.21.2.102:0/1792424848 shutdown_connections 2021-02-12T17:16:34.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.786+0000 7fc2227bb700 1 -- 172.21.2.102:0/1792424848 wait complete. 2021-02-12T17:16:34.796 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2021-02-12T17:16:34.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.885+0000 7fdc5b3fb700 1 Processor -- start 2021-02-12T17:16:34.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.885+0000 7fdc5b3fb700 1 -- start start 2021-02-12T17:16:34.888 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.885+0000 7fdc5b3fb700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fdc540b0940 0x7fdc5414e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.888 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.885+0000 7fdc5b3fb700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fdc5409ada0 0x7fdc54151830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.888 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.885+0000 7fdc5b3fb700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc54066b70 con 0x7fdc540bc2b0 2021-02-12T17:16:34.888 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.885+0000 7fdc5b3fb700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc540b27d0 con 0x7fdc5409ada0 2021-02-12T17:16:34.888 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.885+0000 7fdc5b3fb700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5414e550 con 0x7fdc540b0940 2021-02-12T17:16:34.888 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.886+0000 7fdc59998700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fdc5409ada0 0x7fdc54151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.888 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.886+0000 7fdc59197700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fdc540bc2b0 0x7fdc54151120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54418/0 (socket says 172.21.2.102:54418) 2021-02-12T17:16:34.888 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.886+0000 7fdc59197700 1 -- 172.21.2.102:0/3253147798 learned_addr learned my addr 172.21.2.102:0/3253147798 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:16:34.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.886+0000 7fdc58996700 1 --2- 172.21.2.102:0/3253147798 >> v2:172.21.2.104:3300/0 conn(0x7fdc540b0940 0x7fdc5414e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.886+0000 7fdc59998700 1 -- 172.21.2.102:0/3253147798 >> v2:172.21.2.104:3300/0 conn(0x7fdc540b0940 msgr2=0x7fdc5414e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:34.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.886+0000 7fdc59998700 1 --2- 172.21.2.102:0/3253147798 >> v2:172.21.2.104:3300/0 conn(0x7fdc540b0940 0x7fdc5414e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.886+0000 7fdc59998700 1 -- 172.21.2.102:0/3253147798 >> v1:172.21.2.102:6789/0 conn(0x7fdc540bc2b0 legacy=0x7fdc54151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.886+0000 7fdc59998700 1 -- 172.21.2.102:0/3253147798 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc540685b0 con 0x7fdc5409ada0 2021-02-12T17:16:34.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.886+0000 7fdc59998700 1 --2- 172.21.2.102:0/3253147798 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc5409ada0 0x7fdc54151830 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fdc540b6280 tx=0x7fdc4c0091d0).ready entity=mon.0 client_cookie=73dbdcce7f8d3e47 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:34.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.886+0000 7fdc43fff700 1 -- 172.21.2.102:0/3253147798 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c009e70 con 0x7fdc5409ada0 2021-02-12T17:16:34.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.886+0000 7fdc43fff700 1 -- 172.21.2.102:0/3253147798 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c00bbf0 con 0x7fdc5409ada0 2021-02-12T17:16:34.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.886+0000 7fdc43fff700 1 -- 172.21.2.102:0/3253147798 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c011400 con 0x7fdc5409ada0 2021-02-12T17:16:34.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.887+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/3253147798 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc5409ada0 msgr2=0x7fdc54151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:34.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.887+0000 7fdc5b3fb700 1 --2- 172.21.2.102:0/3253147798 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc5409ada0 0x7fdc54151830 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fdc540b6280 tx=0x7fdc4c0091d0).stop 2021-02-12T17:16:34.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.887+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/3253147798 shutdown_connections 2021-02-12T17:16:34.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.887+0000 7fdc5b3fb700 1 --2- 172.21.2.102:0/3253147798 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc5409ada0 0x7fdc54151830 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.890 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.887+0000 7fdc5b3fb700 1 --2- 172.21.2.102:0/3253147798 >> v2:172.21.2.104:3300/0 conn(0x7fdc540b0940 0x7fdc5414e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:34.890 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.887+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/3253147798 >> 172.21.2.102:0/3253147798 conn(0x7fdc54061830 msgr2=0x7fdc540bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:34.890 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.887+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/3253147798 shutdown_connections 2021-02-12T17:16:34.890 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.887+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/3253147798 wait complete. 2021-02-12T17:16:34.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc5b3fb700 1 Processor -- start 2021-02-12T17:16:34.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc5b3fb700 1 -- start start 2021-02-12T17:16:34.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc5b3fb700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdc5409ada0 0x7fdc5409f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc5b3fb700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdc540b0940 0x7fdc540b9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc5b3fb700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc540bc2b0 0x7fdc54160620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc5b3fb700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5409ff50 con 0x7fdc540bc2b0 2021-02-12T17:16:34.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc5b3fb700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5409eaf0 con 0x7fdc540b0940 2021-02-12T17:16:34.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc5b3fb700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5409ed90 con 0x7fdc5409ada0 2021-02-12T17:16:34.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc59998700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc540bc2b0 0x7fdc54160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc59998700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc540bc2b0 0x7fdc54160620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45782/0 (socket says 172.21.2.102:45782) 2021-02-12T17:16:34.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc59998700 1 -- 172.21.2.102:0/4270462372 learned_addr learned my addr 172.21.2.102:0/4270462372 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:34.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc59998700 1 -- 172.21.2.102:0/4270462372 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdc5409ada0 msgr2=0x7fdc5409f8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:34.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc59998700 1 --2- 172.21.2.102:0/4270462372 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdc5409ada0 0x7fdc5409f8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:34.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc59998700 1 -- 172.21.2.102:0/4270462372 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdc540b0940 msgr2=0x7fdc540b9d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:16:34.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc59998700 1 --2- 172.21.2.102:0/4270462372 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdc540b0940 0x7fdc540b9d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:34.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.888+0000 7fdc59998700 1 -- 172.21.2.102:0/4270462372 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5409f030 con 0x7fdc540bc2b0 2021-02-12T17:16:34.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.889+0000 7fdc59998700 1 --2- 172.21.2.102:0/4270462372 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc540bc2b0 0x7fdc54160620 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fdc4c00b750 tx=0x7fdc4c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:34.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.889+0000 7fdc417fa700 1 -- 172.21.2.102:0/4270462372 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c01b6f0 con 0x7fdc540bc2b0 2021-02-12T17:16:34.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.889+0000 7fdc417fa700 1 -- 172.21.2.102:0/4270462372 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c01b850 con 0x7fdc540bc2b0 2021-02-12T17:16:34.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.889+0000 7fdc417fa700 1 -- 172.21.2.102:0/4270462372 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c01b9e0 con 0x7fdc540bc2b0 2021-02-12T17:16:34.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.889+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/4270462372 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5414cd10 con 0x7fdc540bc2b0 2021-02-12T17:16:34.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.889+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/4270462372 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5409f4d0 con 0x7fdc540bc2b0 2021-02-12T17:16:34.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.889+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/4270462372 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc5409f6c0 con 0x7fdc540bc2b0 2021-02-12T17:16:34.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.890+0000 7fdc417fa700 1 -- 172.21.2.102:0/4270462372 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fdc4c00f070 con 0x7fdc540bc2b0 2021-02-12T17:16:34.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.890+0000 7fdc417fa700 1 --2- 172.21.2.102:0/4270462372 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdc34059d80 0x7fdc3405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:34.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.890+0000 7fdc417fa700 1 -- 172.21.2.102:0/4270462372 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fdc4c075d20 con 0x7fdc540bc2b0 2021-02-12T17:16:34.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.890+0000 7fdc59197700 1 --2- 172.21.2.102:0/4270462372 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdc34059d80 0x7fdc3405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:34.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.890+0000 7fdc59197700 1 --2- 172.21.2.102:0/4270462372 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdc34059d80 0x7fdc3405c240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fdc50005590 tx=0x7fdc500077a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:34.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:34.893+0000 7fdc417fa700 1 -- 172.21.2.102:0/4270462372 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fdc4c0495d0 con 0x7fdc540bc2b0 2021-02-12T17:16:35.024 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.022+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/4270462372 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7fdc54045460 con 0x7fdc540bc2b0 2021-02-12T17:16:35.024 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.023+0000 7fdc417fa700 1 -- 172.21.2.102:0/4270462372 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v27) v1 ==== 95+0+10 (secure 0 0 0) 0x7fdc4c04cbf0 con 0x7fdc540bc2b0 2021-02-12T17:16:35.025 INFO:teuthology.orchestra.run.gibba002.stdout:pg_num: 8 2021-02-12T17:16:35.025 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.024+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/4270462372 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdc34059d80 msgr2=0x7fdc3405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:35.025 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.024+0000 7fdc5b3fb700 1 --2- 172.21.2.102:0/4270462372 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdc34059d80 0x7fdc3405c240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fdc50005590 tx=0x7fdc500077a0).stop 2021-02-12T17:16:35.025 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.024+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/4270462372 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc540bc2b0 msgr2=0x7fdc54160620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:35.025 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.024+0000 7fdc5b3fb700 1 --2- 172.21.2.102:0/4270462372 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc540bc2b0 0x7fdc54160620 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fdc4c00b750 tx=0x7fdc4c017000).stop 2021-02-12T17:16:35.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.024+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/4270462372 shutdown_connections 2021-02-12T17:16:35.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.024+0000 7fdc5b3fb700 1 --2- 172.21.2.102:0/4270462372 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdc34059d80 0x7fdc3405c240 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.024+0000 7fdc5b3fb700 1 --2- 172.21.2.102:0/4270462372 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc540bc2b0 0x7fdc54160620 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.024+0000 7fdc5b3fb700 1 --2- 172.21.2.102:0/4270462372 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdc5409ada0 0x7fdc5409f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:35.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.024+0000 7fdc5b3fb700 1 --2- 172.21.2.102:0/4270462372 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdc540b0940 0x7fdc540b9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:35.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.024+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/4270462372 >> 172.21.2.102:0/4270462372 conn(0x7fdc54061830 msgr2=0x7fdc54063eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:35.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.024+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/4270462372 shutdown_connections 2021-02-12T17:16:35.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.024+0000 7fdc5b3fb700 1 -- 172.21.2.102:0/4270462372 wait complete. 2021-02-12T17:16:35.035 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:16:35.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.120+0000 7f3434041700 1 Processor -- start 2021-02-12T17:16:35.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.120+0000 7f3434041700 1 -- start start 2021-02-12T17:16:35.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.121+0000 7f3434041700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f342c068af0 0x7f342c0b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:35.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.121+0000 7f3434041700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f342c0b6350 0x7f342c0622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:35.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.121+0000 7f3434041700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342c0b7680 con 0x7f342c068710 2021-02-12T17:16:35.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.121+0000 7f3434041700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342c0b2360 con 0x7f342c068af0 2021-02-12T17:16:35.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.121+0000 7f3434041700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0b2600 con 0x7f342c0b6350 2021-02-12T17:16:35.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.121+0000 7f34315dc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f342c068af0 0x7f342c0b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:35.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.121+0000 7f34315dc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f342c068af0 0x7f342c0b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45788/0 (socket says 172.21.2.102:45788) 2021-02-12T17:16:35.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.121+0000 7f34315dc700 1 -- 172.21.2.102:0/1350958873 learned_addr learned my addr 172.21.2.102:0/1350958873 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:35.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.121+0000 7f34315dc700 1 -- 172.21.2.102:0/1350958873 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f342c0b6350 msgr2=0x7f342c0622a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:35.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.121+0000 7f34315dc700 1 --2- 172.21.2.102:0/1350958873 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f342c0b6350 0x7f342c0622a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:35.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.121+0000 7f34315dc700 1 -- 172.21.2.102:0/1350958873 >> v1:172.21.2.104:6789/0 conn(0x7f342c068710 legacy=0x7f342c14a020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:16:35.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.121+0000 7f34315dc700 1 -- 172.21.2.102:0/1350958873 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c1498e0 con 0x7f342c068af0 2021-02-12T17:16:35.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.122+0000 7f34315dc700 1 --2- 172.21.2.102:0/1350958873 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342c068af0 0x7f342c0b1440 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f342800b9e0 tx=0x7f3428006ea0).ready entity=mon.0 client_cookie=2718b41a714e4a90 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:35.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.122+0000 7f3430ddb700 1 -- 172.21.2.102:0/1350958873 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428009800 con 0x7f342c068af0 2021-02-12T17:16:35.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.122+0000 7f3430ddb700 1 -- 172.21.2.102:0/1350958873 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3428009960 con 0x7f342c068af0 2021-02-12T17:16:35.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.122+0000 7f3430ddb700 1 -- 172.21.2.102:0/1350958873 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428009ce0 con 0x7f342c068af0 2021-02-12T17:16:35.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.122+0000 7f3434041700 1 -- 172.21.2.102:0/1350958873 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342c068af0 msgr2=0x7f342c0b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:35.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.122+0000 7f3434041700 1 --2- 172.21.2.102:0/1350958873 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342c068af0 0x7f342c0b1440 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f342800b9e0 tx=0x7f3428006ea0).stop 2021-02-12T17:16:35.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.122+0000 7f3434041700 1 -- 172.21.2.102:0/1350958873 shutdown_connections 2021-02-12T17:16:35.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.122+0000 7f3434041700 1 --2- 172.21.2.102:0/1350958873 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f342c0b6350 0x7f342c0622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:16:35.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.122+0000 7f3434041700 1 --2- 172.21.2.102:0/1350958873 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342c068af0 0x7f342c0b1440 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.122+0000 7f3434041700 1 -- 172.21.2.102:0/1350958873 >> 172.21.2.102:0/1350958873 conn(0x7f342c0bc480 msgr2=0x7f342c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:35.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.122+0000 7f3434041700 1 -- 172.21.2.102:0/1350958873 shutdown_connections 2021-02-12T17:16:35.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.122+0000 7f3434041700 1 -- 172.21.2.102:0/1350958873 wait complete. 2021-02-12T17:16:35.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.123+0000 7f3434041700 1 Processor -- start 2021-02-12T17:16:35.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.123+0000 7f3434041700 1 -- start start 2021-02-12T17:16:35.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f3434041700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f342c068710 0x7f342c0b9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:35.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f3434041700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f342c068af0 0x7f342c141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:35.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f3434041700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342c0b6350 0x7f342c141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:35.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f3434041700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0b92e0 con 0x7f342c0b6350 2021-02-12T17:16:35.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f3434041700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c146b80 con 0x7f342c068af0 2021-02-12T17:16:35.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f3434041700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342c141d70 con 0x7f342c068710 2021-02-12T17:16:35.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f34325de700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342c0b6350 0x7f342c141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:35.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f34325de700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342c0b6350 0x7f342c141880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45796/0 (socket says 172.21.2.102:45796) 2021-02-12T17:16:35.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f34325de700 1 -- 172.21.2.102:0/2611698145 learned_addr learned my addr 172.21.2.102:0/2611698145 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:35.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f34315dc700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f342c068af0 0x7f342c141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:35.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f34325de700 1 -- 172.21.2.102:0/2611698145 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f342c068710 msgr2=0x7f342c0b9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:35.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f3431ddd700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f342c068710 0x7f342c0b9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:35.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f34325de700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f342c068710 0x7f342c0b9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f34325de700 1 -- 172.21.2.102:0/2611698145 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f342c068af0 msgr2=0x7f342c141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:35.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f34325de700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f342c068af0 0x7f342c141390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f34325de700 1 -- 172.21.2.102:0/2611698145 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c143340 con 0x7f342c0b6350 2021-02-12T17:16:35.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f34315dc700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f342c068af0 0x7f342c141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:35.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f3431ddd700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f342c068710 0x7f342c0b9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:16:35.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.124+0000 7f34325de700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342c0b6350 0x7f342c141880 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f342400bb10 tx=0x7f34240090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:35.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.125+0000 7f3419ffb700 1 -- 172.21.2.102:0/2611698145 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342400c7a0 con 0x7f342c0b6350 2021-02-12T17:16:35.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.125+0000 7f3419ffb700 1 -- 172.21.2.102:0/2611698145 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342400c920 con 0x7f342c0b6350 2021-02-12T17:16:35.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.125+0000 7f3434041700 1 -- 172.21.2.102:0/2611698145 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342c142280 con 0x7f342c0b6350 2021-02-12T17:16:35.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.125+0000 7f3419ffb700 1 -- 172.21.2.102:0/2611698145 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342400cad0 con 0x7f342c0b6350 2021-02-12T17:16:35.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.125+0000 7f3434041700 1 -- 172.21.2.102:0/2611698145 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342c0b8e00 con 0x7f342c0b6350 2021-02-12T17:16:35.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.125+0000 7f3434041700 1 -- 172.21.2.102:0/2611698145 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342c045460 con 0x7f342c0b6350 2021-02-12T17:16:35.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.125+0000 7f3419ffb700 1 -- 172.21.2.102:0/2611698145 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f342401c070 con 0x7f342c0b6350 2021-02-12T17:16:35.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.126+0000 7f3419ffb700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f340c059d30 0x7f340c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:35.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.126+0000 7f3419ffb700 1 -- 172.21.2.102:0/2611698145 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f3424073340 con 0x7f342c0b6350 2021-02-12T17:16:35.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.126+0000 7f3431ddd700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f340c059d30 0x7f340c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:35.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.126+0000 7f3431ddd700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f340c059d30 0x7f340c05c1f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f342c15a0f0 tx=0x7f341c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:35.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.129+0000 7f3419ffb700 1 -- 172.21.2.102:0/2611698145 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f3424046b70 con 0x7f342c0b6350 2021-02-12T17:16:35.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.285+0000 7f3434041700 1 -- 172.21.2.102:0/2611698145 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f342c063670 con 0x7f342c0b6350 2021-02-12T17:16:35.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.286+0000 7f3419ffb700 1 -- 172.21.2.102:0/2611698145 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7f342401a070 con 0x7f342c0b6350 2021-02-12T17:16:35.287 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:35.288 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:16:35.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.287+0000 7f3434041700 1 -- 172.21.2.102:0/2611698145 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f340c059d30 msgr2=0x7f340c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:35.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.287+0000 7f3434041700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f340c059d30 0x7f340c05c1f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f342c15a0f0 tx=0x7f341c008040).stop 2021-02-12T17:16:35.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.287+0000 7f3434041700 1 -- 172.21.2.102:0/2611698145 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342c0b6350 msgr2=0x7f342c141880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:35.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.287+0000 7f3434041700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342c0b6350 0x7f342c141880 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f342400bb10 tx=0x7f34240090f0).stop 2021-02-12T17:16:35.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.287+0000 7f3434041700 1 -- 172.21.2.102:0/2611698145 shutdown_connections 2021-02-12T17:16:35.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.287+0000 7f3434041700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f340c059d30 0x7f340c05c1f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.287+0000 7f3434041700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342c0b6350 0x7f342c141880 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.287+0000 7f3434041700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f342c068710 0x7f342c0b9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.287+0000 7f3434041700 1 --2- 172.21.2.102:0/2611698145 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f342c068af0 0x7f342c141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.287+0000 7f3434041700 1 -- 172.21.2.102:0/2611698145 >> 172.21.2.102:0/2611698145 conn(0x7f342c0bc480 msgr2=0x7f342c0676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:35.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.287+0000 7f3434041700 1 -- 172.21.2.102:0/2611698145 shutdown_connections 2021-02-12T17:16:35.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.287+0000 7f3434041700 1 -- 172.21.2.102:0/2611698145 wait complete. 2021-02-12T17:16:35.290 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:16:35.298 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-12T17:16:35.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.385+0000 7fe718283700 1 Processor -- start 2021-02-12T17:16:35.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.385+0000 7fe718283700 1 -- start start 2021-02-12T17:16:35.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.386+0000 7fe718283700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe7100b8ca0 0x7fe7100b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:35.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.386+0000 7fe718283700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fe710067900 0x7fe71014d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:35.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.386+0000 7fe718283700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7100b7d40 con 0x7fe7100b77d0 2021-02-12T17:16:35.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.386+0000 7fe718283700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7100b7fe0 con 0x7fe710067900 2021-02-12T17:16:35.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.386+0000 7fe718283700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe710066ab0 con 0x7fe7100b8ca0 2021-02-12T17:16:35.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.387+0000 7fe716820700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fe710067900 0x7fe71014d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:35.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.387+0000 7fe716820700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fe710067900 0x7fe71014d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:44164/0 (socket says 172.21.2.102:44164) 2021-02-12T17:16:35.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.387+0000 7fe716820700 1 -- 172.21.2.102:0/633513030 learned_addr learned my addr 172.21.2.102:0/633513030 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:35.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.387+0000 7fe71601f700 1 --2- 172.21.2.102:0/633513030 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe7100b8ca0 0x7fe7100b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:35.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.387+0000 7fe716820700 1 -- 172.21.2.102:0/633513030 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe7100b8ca0 msgr2=0x7fe7100b72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:16:35.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.387+0000 7fe716820700 1 --2- 172.21.2.102:0/633513030 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe7100b8ca0 0x7fe7100b72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.387+0000 7fe716820700 1 -- 172.21.2.102:0/633513030 >> v1:172.21.2.104:6789/0 conn(0x7fe7100b77d0 legacy=0x7fe7100671f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:35.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.387+0000 7fe716820700 1 -- 172.21.2.102:0/633513030 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe710066d50 con 0x7fe710067900 2021-02-12T17:16:35.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.387+0000 7fe716820700 1 --2- 172.21.2.102:0/633513030 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe710067900 0x7fe71014d9a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe708009d80 tx=0x7fe708009290).ready entity=mon.1 client_cookie=5551959769232268 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:35.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.388+0000 7fe71501d700 1 -- 172.21.2.102:0/633513030 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70800bc40 con 0x7fe710067900 2021-02-12T17:16:35.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.388+0000 7fe71501d700 1 -- 172.21.2.102:0/633513030 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70800bda0 con 0x7fe710067900 2021-02-12T17:16:35.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.388+0000 7fe71501d700 1 -- 172.21.2.102:0/633513030 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708011610 con 0x7fe710067900 2021-02-12T17:16:35.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.388+0000 7fe718283700 1 -- 172.21.2.102:0/633513030 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe710067900 msgr2=0x7fe71014d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:35.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.388+0000 7fe718283700 1 --2- 172.21.2.102:0/633513030 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe710067900 0x7fe71014d9a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe708009d80 tx=0x7fe708009290).stop 2021-02-12T17:16:35.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.388+0000 7fe718283700 1 -- 172.21.2.102:0/633513030 shutdown_connections 2021-02-12T17:16:35.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.388+0000 7fe718283700 1 --2- 172.21.2.102:0/633513030 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe710067900 0x7fe71014d9a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.388+0000 7fe718283700 1 --2- 172.21.2.102:0/633513030 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe7100b8ca0 0x7fe7100b72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.388+0000 7fe718283700 1 -- 172.21.2.102:0/633513030 >> 172.21.2.102:0/633513030 conn(0x7fe7100bc400 msgr2=0x7fe7100b83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:35.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.388+0000 7fe718283700 1 -- 172.21.2.102:0/633513030 shutdown_connections 2021-02-12T17:16:35.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.388+0000 7fe718283700 1 -- 172.21.2.102:0/633513030 wait complete. 2021-02-12T17:16:35.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.389+0000 7fe718283700 1 Processor -- start 2021-02-12T17:16:35.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.389+0000 7fe718283700 1 -- start start 2021-02-12T17:16:35.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.389+0000 7fe718283700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe710067900 0x7fe71009d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:35.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.389+0000 7fe718283700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe7100b77d0 0x7fe710062260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:35.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.389+0000 7fe718283700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe7100b8ca0 0x7fe710062750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:35.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.389+0000 7fe718283700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe710060fa0 con 0x7fe710067900 2021-02-12T17:16:35.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.389+0000 7fe718283700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71009e550 con 0x7fe7100b8ca0 2021-02-12T17:16:35.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.389+0000 7fe718283700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71009b660 con 0x7fe7100b77d0 2021-02-12T17:16:35.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.389+0000 7fe716820700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe7100b8ca0 0x7fe710062750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:35.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.389+0000 7fe716820700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe7100b8ca0 0x7fe710062750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:44166/0 (socket says 172.21.2.102:44166) 2021-02-12T17:16:35.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.389+0000 7fe716820700 1 -- 172.21.2.102:0/1222835700 learned_addr learned my addr 172.21.2.102:0/1222835700 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:16:35.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.389+0000 7fe71601f700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe710067900 0x7fe71009d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:35.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.390+0000 7fe71581e700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe7100b77d0 0x7fe710062260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:35.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.390+0000 7fe716820700 1 -- 172.21.2.102:0/1222835700 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe7100b77d0 msgr2=0x7fe710062260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:35.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.390+0000 7fe716820700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe7100b77d0 0x7fe710062260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.390+0000 7fe716820700 1 -- 172.21.2.102:0/1222835700 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe710067900 msgr2=0x7fe71009d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:35.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.390+0000 7fe716820700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe710067900 0x7fe71009d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.390+0000 7fe716820700 1 -- 172.21.2.102:0/1222835700 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe710062c40 con 0x7fe7100b8ca0 2021-02-12T17:16:35.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.390+0000 7fe71601f700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe710067900 0x7fe71009d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:16:35.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.390+0000 7fe716820700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe7100b8ca0 0x7fe710062750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fe71006a4f0 tx=0x7fe708017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:35.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.390+0000 7fe7027fc700 1 -- 172.21.2.102:0/1222835700 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70800bc40 con 0x7fe7100b8ca0 2021-02-12T17:16:35.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.390+0000 7fe7027fc700 1 -- 172.21.2.102:0/1222835700 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe708011e70 con 0x7fe7100b8ca0 2021-02-12T17:16:35.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.390+0000 7fe718283700 1 -- 172.21.2.102:0/1222835700 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71009bb30 con 0x7fe7100b8ca0 2021-02-12T17:16:35.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.390+0000 7fe7027fc700 1 -- 172.21.2.102:0/1222835700 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708010c90 con 0x7fe7100b8ca0 2021-02-12T17:16:35.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.390+0000 7fe718283700 1 -- 172.21.2.102:0/1222835700 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe710061f90 con 0x7fe7100b8ca0 2021-02-12T17:16:35.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.391+0000 7fe718283700 1 -- 172.21.2.102:0/1222835700 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71005c080 con 0x7fe7100b8ca0 2021-02-12T17:16:35.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.391+0000 7fe7027fc700 1 -- 172.21.2.102:0/1222835700 <== mon.1 v2:172.21.2.104:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fe70800f070 con 0x7fe7100b8ca0 2021-02-12T17:16:35.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.391+0000 7fe7027fc700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe6f0059d30 0x7fe6f005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:16:35.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.391+0000 7fe7027fc700 1 -- 172.21.2.102:0/1222835700 <== mon.1 v2:172.21.2.104:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fe7080757c0 con 0x7fe7100b8ca0 2021-02-12T17:16:35.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.392+0000 7fe71601f700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe6f0059d30 0x7fe6f005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:16:35.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.392+0000 7fe71601f700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe6f0059d30 0x7fe6f005c1f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fe70400c8f0 tx=0x7fe704008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:16:35.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.395+0000 7fe7027fc700 1 -- 172.21.2.102:0/1222835700 <== mon.1 v2:172.21.2.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fe708048ff0 con 0x7fe7100b8ca0 2021-02-12T17:16:35.525 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.523+0000 7fe718283700 1 -- 172.21.2.102:0/1222835700 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe710062c40 con 0x7fe7100b8ca0 2021-02-12T17:16:35.526 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.525+0000 7fe7027fc700 1 -- 172.21.2.102:0/1222835700 <== mon.1 v2:172.21.2.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19888 (secure 0 0 0) 0x7fe710062c40 con 0x7fe7100b8ca0 2021-02-12T17:16:35.526 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:16:35.527 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":27,"fsid":"84d6d175-2ea1-4991-ab6d-aa08bc640524","created":"2021-02-12T17:15:46.473615+0000","modified":"2021-02-12T17:16:09.532002+0000","last_up_change":"2021-02-12T17:15:54.595265+0000","last_in_change":"2021-02-12T17:15:54.595265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-12T17:15:54.614238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-12T17:15:56.701902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"a_metadata","create_time":"2021-02-12T17:15:59.832660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}}},{"pool":4,"pool_name":"a_data","create_time":"2021-02-12T17:16:00.965024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"a"}}},{"pool":5,"pool_name":"b_metadata","create_time":"2021-02-12T17:16:06.678651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}}},{"pool":6,"pool_name":"b_data","create_time":"2021-02-12T17:16:07.511756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"b"}}}],"osds":[{"osd":0,"uuid":"df884b24-e755-46a4-a472-82bc1a0d6c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6800","nonce":37580},{"type":"v1","addr":"172.21.2.102:6803","nonce":37580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6805","nonce":37580},{"type":"v1","addr":"172.21.2.102:6807","nonce":37580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6813","nonce":37580},{"type":"v1","addr":"172.21.2.102:6814","nonce":37580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6809","nonce":37580},{"type":"v1","addr":"172.21.2.102:6811","nonce":37580}]},"public_addr":"172.21.2.102:6803/37580","cluster_addr":"172.21.2.102:6807/37580","heartbeat_back_addr":"172.21.2.102:6814/37580","heartbeat_front_addr":"172.21.2.102:6811/37580","state":["exists","up"]},{"osd":1,"uuid":"5c783edf-71c2-41fb-8dae-c750fee7027b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6801","nonce":37581},{"type":"v1","addr":"172.21.2.102:6802","nonce":37581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6804","nonce":37581},{"type":"v1","addr":"172.21.2.102:6806","nonce":37581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6812","nonce":37581},{"type":"v1","addr":"172.21.2.102:6815","nonce":37581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6808","nonce":37581},{"type":"v1","addr":"172.21.2.102:6810","nonce":37581}]},"public_addr":"172.21.2.102:6802/37581","cluster_addr":"172.21.2.102:6806/37581","heartbeat_back_addr":"172.21.2.102:6815/37581","heartbeat_front_addr":"172.21.2.102:6810/37581","state":["exists","up"]},{"osd":2,"uuid":"f3a099b7-eb7f-411a-bb86-f9e93165e0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6816","nonce":37582},{"type":"v1","addr":"172.21.2.102:6818","nonce":37582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6820","nonce":37582},{"type":"v1","addr":"172.21.2.102:6822","nonce":37582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6828","nonce":37582},{"type":"v1","addr":"172.21.2.102:6830","nonce":37582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6824","nonce":37582},{"type":"v1","addr":"172.21.2.102:6826","nonce":37582}]},"public_addr":"172.21.2.102:6818/37582","cluster_addr":"172.21.2.102:6822/37582","heartbeat_back_addr":"172.21.2.102:6830/37582","heartbeat_front_addr":"172.21.2.102:6826/37582","state":["exists","up"]},{"osd":3,"uuid":"b059f336-ca68-49d9-868b-669c9019fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6817","nonce":37583},{"type":"v1","addr":"172.21.2.102:6819","nonce":37583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6821","nonce":37583},{"type":"v1","addr":"172.21.2.102:6823","nonce":37583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6829","nonce":37583},{"type":"v1","addr":"172.21.2.102:6831","nonce":37583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6825","nonce":37583},{"type":"v1","addr":"172.21.2.102:6827","nonce":37583}]},"public_addr":"172.21.2.102:6819/37583","cluster_addr":"172.21.2.102:6823/37583","heartbeat_back_addr":"172.21.2.102:6831/37583","heartbeat_front_addr":"172.21.2.102:6827/37583","state":["exists","up"]},{"osd":4,"uuid":"112296c9-c2ef-40ee-98a9-c781c7e7b217","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6801","nonce":37835},{"type":"v1","addr":"172.21.2.104:6803","nonce":37835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6805","nonce":37835},{"type":"v1","addr":"172.21.2.104:6807","nonce":37835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6813","nonce":37835},{"type":"v1","addr":"172.21.2.104:6815","nonce":37835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6809","nonce":37835},{"type":"v1","addr":"172.21.2.104:6811","nonce":37835}]},"public_addr":"172.21.2.104:6803/37835","cluster_addr":"172.21.2.104:6807/37835","heartbeat_back_addr":"172.21.2.104:6815/37835","heartbeat_front_addr":"172.21.2.104:6811/37835","state":["exists","up"]},{"osd":5,"uuid":"b57fba19-36f5-4046-b76c-a2a899f44246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6800","nonce":37836},{"type":"v1","addr":"172.21.2.104:6802","nonce":37836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6804","nonce":37836},{"type":"v1","addr":"172.21.2.104:6806","nonce":37836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6812","nonce":37836},{"type":"v1","addr":"172.21.2.104:6814","nonce":37836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6808","nonce":37836},{"type":"v1","addr":"172.21.2.104:6810","nonce":37836}]},"public_addr":"172.21.2.104:6802/37836","cluster_addr":"172.21.2.104:6806/37836","heartbeat_back_addr":"172.21.2.104:6814/37836","heartbeat_front_addr":"172.21.2.104:6810/37836","state":["exists","up"]},{"osd":6,"uuid":"011ced51-ce2a-4fdb-825f-cc739d5727d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6816","nonce":37837},{"type":"v1","addr":"172.21.2.104:6817","nonce":37837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6818","nonce":37837},{"type":"v1","addr":"172.21.2.104:6819","nonce":37837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6822","nonce":37837},{"type":"v1","addr":"172.21.2.104:6823","nonce":37837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6820","nonce":37837},{"type":"v1","addr":"172.21.2.104:6821","nonce":37837}]},"public_addr":"172.21.2.104:6817/37837","cluster_addr":"172.21.2.104:6819/37837","heartbeat_back_addr":"172.21.2.104:6823/37837","heartbeat_front_addr":"172.21.2.104:6821/37837","state":["exists","up"]},{"osd":7,"uuid":"95b9bfd6-a301-474d-be2f-32eecb7ec826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6824","nonce":37838},{"type":"v1","addr":"172.21.2.104:6825","nonce":37838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6826","nonce":37838},{"type":"v1","addr":"172.21.2.104:6827","nonce":37838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6830","nonce":37838},{"type":"v1","addr":"172.21.2.104:6831","nonce":37838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6828","nonce":37838},{"type":"v1","addr":"172.21.2.104:6829","nonce":37838}]},"public_addr":"172.21.2.104:6825/37838","cluster_addr":"172.21.2.104:6827/37838","heartbeat_back_addr":"172.21.2.104:6831/37838","heartbeat_front_addr":"172.21.2.104:6829/37838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.463877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.491757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.489988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.479496+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.484896+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.485691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.476697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-12T17:15:53.534857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-12T17:16:35.527 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.526+0000 7fe718283700 1 -- 172.21.2.102:0/1222835700 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe6f0059d30 msgr2=0x7fe6f005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:35.527 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.526+0000 7fe718283700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe6f0059d30 0x7fe6f005c1f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fe70400c8f0 tx=0x7fe704008040).stop 2021-02-12T17:16:35.527 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.526+0000 7fe718283700 1 -- 172.21.2.102:0/1222835700 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe7100b8ca0 msgr2=0x7fe710062750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:16:35.527 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.526+0000 7fe718283700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe7100b8ca0 0x7fe710062750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fe71006a4f0 tx=0x7fe708017000).stop 2021-02-12T17:16:35.527 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.526+0000 7fe718283700 1 -- 172.21.2.102:0/1222835700 shutdown_connections 2021-02-12T17:16:35.528 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.526+0000 7fe718283700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe7100b8ca0 0x7fe710062750 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.528 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.526+0000 7fe718283700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe6f0059d30 0x7fe6f005c1f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.528 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.526+0000 7fe718283700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe710067900 0x7fe71009d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.528 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.526+0000 7fe718283700 1 --2- 172.21.2.102:0/1222835700 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe7100b77d0 0x7fe710062260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:16:35.528 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.526+0000 7fe718283700 1 -- 172.21.2.102:0/1222835700 >> 172.21.2.102:0/1222835700 conn(0x7fe7100bc400 msgr2=0x7fe7100b9740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:16:35.528 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.526+0000 7fe718283700 1 -- 172.21.2.102:0/1222835700 shutdown_connections 2021-02-12T17:16:35.528 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:16:35.526+0000 7fe718283700 1 -- 172.21.2.102:0/1222835700 wait complete. 2021-02-12T17:16:35.537 DEBUG:tasks.mds_thrash:Yielding 2021-02-12T17:16:35.537 INFO:teuthology.run_tasks:Running task workunit... 2021-02-12T17:16:35.548 INFO:tasks.workunit:Pulling workunits from ref 3016de877106ce6671c889d12c3ef9513a2cf899 2021-02-12T17:16:35.549 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-02-12T17:16:35.549 INFO:tasks.workunit:timeout=3h 2021-02-12T17:16:35.549 INFO:tasks.workunit:cleanup=True 2021-02-12T17:16:35.550 DEBUG:teuthology.orchestra.run.gibba002:> stat -- /home/ubuntu/cephtest/mnt.0 2021-02-12T17:16:35.550 INFO:tasks.mds_thrash.fs.[b]:starting mds_do_thrash for fs b 2021-02-12T17:16:35.550 INFO:tasks.mds_thrash.fs.[b]:waiting for 93 secs before thrashing 2021-02-12T17:16:35.562 INFO:teuthology.orchestra.run.gibba002.stdout: File: /home/ubuntu/cephtest/mnt.0 2021-02-12T17:16:35.562 INFO:teuthology.orchestra.run.gibba002.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2021-02-12T17:16:35.562 INFO:teuthology.orchestra.run.gibba002.stdout:Device: 2fh/47d Inode: 1 Links: 2 2021-02-12T17:16:35.562 INFO:teuthology.orchestra.run.gibba002.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-12T17:16:35.563 INFO:teuthology.orchestra.run.gibba002.stdout:Context: system_u:object_r:fusefs_t:s0 2021-02-12T17:16:35.563 INFO:teuthology.orchestra.run.gibba002.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2021-02-12T17:16:35.563 INFO:teuthology.orchestra.run.gibba002.stdout:Modify: 2021-02-12 17:16:01.995058637 +0000 2021-02-12T17:16:35.563 INFO:teuthology.orchestra.run.gibba002.stdout:Change: 2021-02-12 17:16:26.810029614 +0000 2021-02-12T17:16:35.563 INFO:teuthology.orchestra.run.gibba002.stdout: Birth: - 2021-02-12T17:16:35.563 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2021-02-12T17:16:35.563 DEBUG:teuthology.orchestra.run.gibba002:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2021-02-12T17:16:35.626 DEBUG:teuthology.orchestra.run.gibba004:> stat -- /home/ubuntu/cephtest/mnt.1 2021-02-12T17:16:35.640 INFO:teuthology.orchestra.run.gibba004.stdout: File: /home/ubuntu/cephtest/mnt.1 2021-02-12T17:16:35.640 INFO:teuthology.orchestra.run.gibba004.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2021-02-12T17:16:35.641 INFO:teuthology.orchestra.run.gibba004.stdout:Device: 2fh/47d Inode: 1 Links: 2 2021-02-12T17:16:35.641 INFO:teuthology.orchestra.run.gibba004.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-12T17:16:35.641 INFO:teuthology.orchestra.run.gibba004.stdout:Context: system_u:object_r:fusefs_t:s0 2021-02-12T17:16:35.641 INFO:teuthology.orchestra.run.gibba004.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2021-02-12T17:16:35.641 INFO:teuthology.orchestra.run.gibba004.stdout:Modify: 2021-02-12 17:16:08.532501604 +0000 2021-02-12T17:16:35.641 INFO:teuthology.orchestra.run.gibba004.stdout:Change: 2021-02-12 17:16:26.884173947 +0000 2021-02-12T17:16:35.641 INFO:teuthology.orchestra.run.gibba004.stdout: Birth: - 2021-02-12T17:16:35.641 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2021-02-12T17:16:35.641 DEBUG:teuthology.orchestra.run.gibba004:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2021-02-12T17:16:35.707 DEBUG:teuthology.orchestra.run.gibba002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3016de877106ce6671c889d12c3ef9513a2cf899 2021-02-12T17:16:35.708 DEBUG:teuthology.orchestra.run.gibba004:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 3016de877106ce6671c889d12c3ef9513a2cf899 2021-02-12T17:16:35.732 INFO:tasks.workunit.client.0.gibba002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-02-12T17:16:35.759 INFO:tasks.workunit.client.1.gibba004.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2021-02-12T17:16:40.451 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:16:40.459 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:17:10.507 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:17:10.509 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:17:40.567 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:17:40.571 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:18:08.551 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:08.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.640+0000 7fac9d4cf700 1 Processor -- start 2021-02-12T17:18:08.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.640+0000 7fac9d4cf700 1 -- start start 2021-02-12T17:18:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.640+0000 7fac9d4cf700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fac980b8d20 0x7fac98068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.640+0000 7fac9d4cf700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac980b7960 con 0x7fac9814e530 2021-02-12T17:18:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.640+0000 7fac9d4cf700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac980622a0 con 0x7fac98062740 2021-02-12T17:18:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.640+0000 7fac9d4cf700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac98068d20 con 0x7fac980b8d20 2021-02-12T17:18:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.640+0000 7fac96ffd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fac980b8d20 0x7fac98068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.640+0000 7fac967fc700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fac9814e530 0x7fac980b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54502/0 (socket says 172.21.2.102:54502) 2021-02-12T17:18:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.640+0000 7fac967fc700 1 -- 172.21.2.102:0/391959796 learned_addr learned my addr 172.21.2.102:0/391959796 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.641+0000 7fac96ffd700 1 -- 172.21.2.102:0/391959796 >> v1:172.21.2.104:6789/0 conn(0x7fac98062740 legacy=0x7fac98062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:18:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.641+0000 7fac96ffd700 1 -- 172.21.2.102:0/391959796 >> v1:172.21.2.102:6789/0 conn(0x7fac9814e530 legacy=0x7fac980b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.641+0000 7fac96ffd700 1 -- 172.21.2.102:0/391959796 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9814ea10 con 0x7fac980b8d20 2021-02-12T17:18:08.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.641+0000 7fac96ffd700 1 --2- 172.21.2.102:0/391959796 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fac980b8d20 0x7fac98068830 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fac8800b980 tx=0x7fac88006de0).ready entity=mon.0 client_cookie=c8c3a3c0a55c3591 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:08.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.641+0000 7fac95ffb700 1 -- 172.21.2.102:0/391959796 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac880097a0 con 0x7fac980b8d20 2021-02-12T17:18:08.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.641+0000 7fac95ffb700 1 -- 172.21.2.102:0/391959796 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac88009900 con 0x7fac980b8d20 2021-02-12T17:18:08.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.641+0000 7fac95ffb700 1 -- 172.21.2.102:0/391959796 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88009c80 con 0x7fac980b8d20 2021-02-12T17:18:08.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.641+0000 7fac9d4cf700 1 -- 172.21.2.102:0/391959796 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fac980b8d20 msgr2=0x7fac98068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:08.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.641+0000 7fac9d4cf700 1 --2- 172.21.2.102:0/391959796 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fac980b8d20 0x7fac98068830 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fac8800b980 tx=0x7fac88006de0).stop 2021-02-12T17:18:08.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.641+0000 7fac9d4cf700 1 -- 172.21.2.102:0/391959796 shutdown_connections 2021-02-12T17:18:08.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.641+0000 7fac9d4cf700 1 --2- 172.21.2.102:0/391959796 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fac980b8d20 0x7fac98068830 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:08.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.641+0000 7fac9d4cf700 1 -- 172.21.2.102:0/391959796 >> 172.21.2.102:0/391959796 conn(0x7fac980bc480 msgr2=0x7fac980b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:08.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.641+0000 7fac9d4cf700 1 -- 172.21.2.102:0/391959796 shutdown_connections 2021-02-12T17:18:08.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.641+0000 7fac9d4cf700 1 -- 172.21.2.102:0/391959796 wait complete. 2021-02-12T17:18:08.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.642+0000 7fac9d4cf700 1 Processor -- start 2021-02-12T17:18:08.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.642+0000 7fac9d4cf700 1 -- start start 2021-02-12T17:18:08.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac9d4cf700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fac98062740 0x7fac98161aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:08.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac9d4cf700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fac980b8d20 0x7fac980b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:08.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac9d4cf700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fac9814e530 0x7fac980b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:08.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac9d4cf700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac980aeff0 con 0x7fac9814e530 2021-02-12T17:18:08.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac9d4cf700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac980af290 con 0x7fac98062740 2021-02-12T17:18:08.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac9d4cf700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac981610c0 con 0x7fac980b8d20 2021-02-12T17:18:08.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac977fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fac9814e530 0x7fac980b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:08.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac977fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fac9814e530 0x7fac980b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45868/0 (socket says 172.21.2.102:45868) 2021-02-12T17:18:08.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac977fe700 1 -- 172.21.2.102:0/2932614388 learned_addr learned my addr 172.21.2.102:0/2932614388 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:08.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac977fe700 1 -- 172.21.2.102:0/2932614388 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fac980b8d20 msgr2=0x7fac980b5220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:18:08.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac977fe700 1 --2- 172.21.2.102:0/2932614388 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fac980b8d20 0x7fac980b5220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:08.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac977fe700 1 -- 172.21.2.102:0/2932614388 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fac98062740 msgr2=0x7fac98161aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:18:08.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac977fe700 1 --2- 172.21.2.102:0/2932614388 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fac98062740 0x7fac98161aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:08.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac977fe700 1 -- 172.21.2.102:0/2932614388 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac98161360 con 0x7fac9814e530 2021-02-12T17:18:08.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac977fe700 1 --2- 172.21.2.102:0/2932614388 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fac9814e530 0x7fac980b0990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fac9000bae0 tx=0x7fac900091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:08.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.643+0000 7fac7effd700 1 -- 172.21.2.102:0/2932614388 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000c7f0 con 0x7fac9814e530 2021-02-12T17:18:08.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.644+0000 7fac7effd700 1 -- 172.21.2.102:0/2932614388 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9000c990 con 0x7fac9814e530 2021-02-12T17:18:08.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.644+0000 7fac7effd700 1 -- 172.21.2.102:0/2932614388 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000cb40 con 0x7fac9814e530 2021-02-12T17:18:08.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.644+0000 7fac9d4cf700 1 -- 172.21.2.102:0/2932614388 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac98161600 con 0x7fac9814e530 2021-02-12T17:18:08.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.644+0000 7fac9d4cf700 1 -- 172.21.2.102:0/2932614388 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac980b0e80 con 0x7fac9814e530 2021-02-12T17:18:08.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.644+0000 7fac9d4cf700 1 -- 172.21.2.102:0/2932614388 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac98065be0 con 0x7fac9814e530 2021-02-12T17:18:08.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.645+0000 7fac7effd700 1 -- 172.21.2.102:0/2932614388 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fac9001c070 con 0x7fac9814e530 2021-02-12T17:18:08.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.645+0000 7fac7effd700 1 --2- 172.21.2.102:0/2932614388 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fac78059d30 0x7fac7805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:08.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.645+0000 7fac7effd700 1 -- 172.21.2.102:0/2932614388 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fac90073420 con 0x7fac9814e530 2021-02-12T17:18:08.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.645+0000 7fac96ffd700 1 --2- 172.21.2.102:0/2932614388 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fac78059d30 0x7fac7805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:08.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.645+0000 7fac96ffd700 1 --2- 172.21.2.102:0/2932614388 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fac78059d30 0x7fac7805c1f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fac980b6020 tx=0x7fac88016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:08.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.648+0000 7fac7effd700 1 -- 172.21.2.102:0/2932614388 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fac90046c50 con 0x7fac9814e530 2021-02-12T17:18:08.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.806+0000 7fac9d4cf700 1 -- 172.21.2.102:0/2932614388 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac98045460 con 0x7fac9814e530 2021-02-12T17:18:08.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.806+0000 7fac7effd700 1 -- 172.21.2.102:0/2932614388 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7fac9001a070 con 0x7fac9814e530 2021-02-12T17:18:08.808 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:08.808 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:08.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.808+0000 7fac9d4cf700 1 -- 172.21.2.102:0/2932614388 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fac78059d30 msgr2=0x7fac7805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:08.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.808+0000 7fac9d4cf700 1 --2- 172.21.2.102:0/2932614388 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fac78059d30 0x7fac7805c1f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fac980b6020 tx=0x7fac88016000).stop 2021-02-12T17:18:08.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.808+0000 7fac9d4cf700 1 -- 172.21.2.102:0/2932614388 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fac9814e530 msgr2=0x7fac980b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:08.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.808+0000 7fac9d4cf700 1 --2- 172.21.2.102:0/2932614388 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fac9814e530 0x7fac980b0990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fac9000bae0 tx=0x7fac900091a0).stop 2021-02-12T17:18:08.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.808+0000 7fac9d4cf700 1 -- 172.21.2.102:0/2932614388 shutdown_connections 2021-02-12T17:18:08.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.808+0000 7fac9d4cf700 1 --2- 172.21.2.102:0/2932614388 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fac78059d30 0x7fac7805c1f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:08.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.808+0000 7fac9d4cf700 1 --2- 172.21.2.102:0/2932614388 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fac9814e530 0x7fac980b0990 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:08.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.808+0000 7fac9d4cf700 1 --2- 172.21.2.102:0/2932614388 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fac98062740 0x7fac98161aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:08.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.808+0000 7fac9d4cf700 1 --2- 172.21.2.102:0/2932614388 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fac980b8d20 0x7fac980b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:08.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.808+0000 7fac9d4cf700 1 -- 172.21.2.102:0/2932614388 >> 172.21.2.102:0/2932614388 conn(0x7fac980bc480 msgr2=0x7fac98062bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:08.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.808+0000 7fac9d4cf700 1 -- 172.21.2.102:0/2932614388 shutdown_connections 2021-02-12T17:18:08.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.808+0000 7fac9d4cf700 1 -- 172.21.2.102:0/2932614388 wait complete. 2021-02-12T17:18:08.810 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:18:08.818 INFO:tasks.mds_thrash.fs.[b]:kill mds.a (rank=0) 2021-02-12T17:18:08.818 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-12T17:18:08.818 INFO:teuthology.orchestra.run:waiting for 300 2021-02-12T17:18:08.825 INFO:tasks.ceph.mds.a:Stopped 2021-02-12T17:18:08.825 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:08.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.955+0000 7fb3f5d92700 1 Processor -- start 2021-02-12T17:18:08.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.955+0000 7fb3f5d92700 1 -- start start 2021-02-12T17:18:08.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.955+0000 7fb3f5d92700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb3f014e530 0x7fb3f0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:08.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.955+0000 7fb3f5d92700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f00b7960 con 0x7fb3f00b8d20 2021-02-12T17:18:08.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.955+0000 7fb3f5d92700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f00622a0 con 0x7fb3f0062740 2021-02-12T17:18:08.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.955+0000 7fb3f5d92700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f0068d20 con 0x7fb3f014e530 2021-02-12T17:18:08.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.956+0000 7fb3eeffd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb3f014e530 0x7fb3f0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:08.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.956+0000 7fb3eeffd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb3f014e530 0x7fb3f0068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45872/0 (socket says 172.21.2.102:45872) 2021-02-12T17:18:08.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.956+0000 7fb3eeffd700 1 -- 172.21.2.102:0/1937314105 learned_addr learned my addr 172.21.2.102:0/1937314105 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:08.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.956+0000 7fb3eeffd700 1 -- 172.21.2.102:0/1937314105 >> v1:172.21.2.104:6789/0 conn(0x7fb3f0062740 legacy=0x7fb3f0062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:18:08.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.956+0000 7fb3eeffd700 1 -- 172.21.2.102:0/1937314105 >> v1:172.21.2.102:6789/0 conn(0x7fb3f00b8d20 legacy=0x7fb3f00b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:08.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.956+0000 7fb3eeffd700 1 -- 172.21.2.102:0/1937314105 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f014ea10 con 0x7fb3f014e530 2021-02-12T17:18:08.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.956+0000 7fb3eeffd700 1 --2- 172.21.2.102:0/1937314105 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3f014e530 0x7fb3f0068830 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fb3d800b9e0 tx=0x7fb3d8006ea0).ready entity=mon.0 client_cookie=48c0175ed37d6e09 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:08.959 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.956+0000 7fb3ee7fc700 1 -- 172.21.2.102:0/1937314105 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8009800 con 0x7fb3f014e530 2021-02-12T17:18:08.959 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.956+0000 7fb3ee7fc700 1 -- 172.21.2.102:0/1937314105 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d8009960 con 0x7fb3f014e530 2021-02-12T17:18:08.959 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.956+0000 7fb3ee7fc700 1 -- 172.21.2.102:0/1937314105 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8009ce0 con 0x7fb3f014e530 2021-02-12T17:18:08.960 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.957+0000 7fb3f5d92700 1 -- 172.21.2.102:0/1937314105 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3f014e530 msgr2=0x7fb3f0068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:08.960 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.957+0000 7fb3f5d92700 1 --2- 172.21.2.102:0/1937314105 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3f014e530 0x7fb3f0068830 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fb3d800b9e0 tx=0x7fb3d8006ea0).stop 2021-02-12T17:18:08.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.957+0000 7fb3f5d92700 1 -- 172.21.2.102:0/1937314105 shutdown_connections 2021-02-12T17:18:08.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.957+0000 7fb3f5d92700 1 --2- 172.21.2.102:0/1937314105 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3f014e530 0x7fb3f0068830 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:08.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.957+0000 7fb3f5d92700 1 -- 172.21.2.102:0/1937314105 >> 172.21.2.102:0/1937314105 conn(0x7fb3f00bc480 msgr2=0x7fb3f00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:08.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.957+0000 7fb3f5d92700 1 -- 172.21.2.102:0/1937314105 shutdown_connections 2021-02-12T17:18:08.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.957+0000 7fb3f5d92700 1 -- 172.21.2.102:0/1937314105 wait complete. 2021-02-12T17:18:08.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3f5d92700 1 Processor -- start 2021-02-12T17:18:08.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3f5d92700 1 -- start start 2021-02-12T17:18:08.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3f5d92700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3f0062740 0x7fb3f0161b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:08.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3f5d92700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb3f00b8d20 0x7fb3f014cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:08.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3f5d92700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb3f014e530 0x7fb3f00ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:08.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3f5d92700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f00b1310 con 0x7fb3f0062740 2021-02-12T17:18:08.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3f5d92700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f00b57c0 con 0x7fb3f00b8d20 2021-02-12T17:18:08.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3f5d92700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f00b06e0 con 0x7fb3f014e530 2021-02-12T17:18:08.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3ef7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3f0062740 0x7fb3f0161b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:08.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3ef7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3f0062740 0x7fb3f0161b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45880/0 (socket says 172.21.2.102:45880) 2021-02-12T17:18:08.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3ef7fe700 1 -- 172.21.2.102:0/503996090 learned_addr learned my addr 172.21.2.102:0/503996090 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:08.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3ef7fe700 1 -- 172.21.2.102:0/503996090 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb3f014e530 msgr2=0x7fb3f00ae840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:18:08.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3ef7fe700 1 --2- 172.21.2.102:0/503996090 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb3f014e530 0x7fb3f00ae840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:08.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3ef7fe700 1 -- 172.21.2.102:0/503996090 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb3f00b8d20 msgr2=0x7fb3f014cd70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:18:08.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3ef7fe700 1 --2- 172.21.2.102:0/503996090 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb3f00b8d20 0x7fb3f014cd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:08.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.958+0000 7fb3ef7fe700 1 -- 172.21.2.102:0/503996090 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f00b08d0 con 0x7fb3f0062740 2021-02-12T17:18:08.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.959+0000 7fb3ef7fe700 1 --2- 172.21.2.102:0/503996090 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3f0062740 0x7fb3f0161b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fb3e000c740 tx=0x7fb3e0007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:08.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.959+0000 7fb3e77fe700 1 -- 172.21.2.102:0/503996090 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0007020 con 0x7fb3f0062740 2021-02-12T17:18:08.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.959+0000 7fb3e77fe700 1 -- 172.21.2.102:0/503996090 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e0007180 con 0x7fb3f0062740 2021-02-12T17:18:08.963 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.959+0000 7fb3f5d92700 1 -- 172.21.2.102:0/503996090 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f00b0b30 con 0x7fb3f0062740 2021-02-12T17:18:08.963 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.959+0000 7fb3f5d92700 1 -- 172.21.2.102:0/503996090 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f0162000 con 0x7fb3f0062740 2021-02-12T17:18:08.963 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.959+0000 7fb3e77fe700 1 -- 172.21.2.102:0/503996090 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0010510 con 0x7fb3f0062740 2021-02-12T17:18:08.963 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.959+0000 7fb3f5d92700 1 -- 172.21.2.102:0/503996090 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c8004f60 con 0x7fb3f0062740 2021-02-12T17:18:08.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.960+0000 7fb3e77fe700 1 -- 172.21.2.102:0/503996090 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fb3e0018020 con 0x7fb3f0062740 2021-02-12T17:18:08.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.960+0000 7fb3e77fe700 1 --2- 172.21.2.102:0/503996090 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb3d4059d80 0x7fb3d405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:08.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.960+0000 7fb3e77fe700 1 -- 172.21.2.102:0/503996090 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fb3e0073560 con 0x7fb3f0062740 2021-02-12T17:18:08.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.960+0000 7fb3eeffd700 1 --2- 172.21.2.102:0/503996090 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb3d4059d80 0x7fb3d405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:08.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.960+0000 7fb3eeffd700 1 --2- 172.21.2.102:0/503996090 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb3d4059d80 0x7fb3d405c240 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fb3f00b9560 tx=0x7fb3d8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:08.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:08.963+0000 7fb3e77fe700 1 -- 172.21.2.102:0/503996090 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fb3e0046d00 con 0x7fb3f0062740 2021-02-12T17:18:09.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:09.121+0000 7fb3f5d92700 1 -- 172.21.2.102:0/503996090 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3c8005790 con 0x7fb3f0062740 2021-02-12T17:18:09.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:09.122+0000 7fb3e77fe700 1 -- 172.21.2.102:0/503996090 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7fb3e0016070 con 0x7fb3f0062740 2021-02-12T17:18:09.123 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:09.123 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:09.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:09.123+0000 7fb3f5d92700 1 -- 172.21.2.102:0/503996090 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb3d4059d80 msgr2=0x7fb3d405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:09.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:09.123+0000 7fb3f5d92700 1 --2- 172.21.2.102:0/503996090 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb3d4059d80 0x7fb3d405c240 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fb3f00b9560 tx=0x7fb3d8016000).stop 2021-02-12T17:18:09.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:09.123+0000 7fb3f5d92700 1 -- 172.21.2.102:0/503996090 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3f0062740 msgr2=0x7fb3f0161b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:09.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:09.123+0000 7fb3f5d92700 1 --2- 172.21.2.102:0/503996090 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3f0062740 0x7fb3f0161b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fb3e000c740 tx=0x7fb3e0007c40).stop 2021-02-12T17:18:09.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:09.123+0000 7fb3f5d92700 1 -- 172.21.2.102:0/503996090 shutdown_connections 2021-02-12T17:18:09.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:09.123+0000 7fb3f5d92700 1 --2- 172.21.2.102:0/503996090 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb3f014e530 0x7fb3f00ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:09.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:09.123+0000 7fb3f5d92700 1 --2- 172.21.2.102:0/503996090 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb3d4059d80 0x7fb3d405c240 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:09.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:09.123+0000 7fb3f5d92700 1 --2- 172.21.2.102:0/503996090 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3f0062740 0x7fb3f0161b10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:09.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:09.123+0000 7fb3f5d92700 1 --2- 172.21.2.102:0/503996090 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb3f00b8d20 0x7fb3f014cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:09.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:09.123+0000 7fb3f5d92700 1 -- 172.21.2.102:0/503996090 >> 172.21.2.102:0/503996090 conn(0x7fb3f00bc480 msgr2=0x7fb3f0152370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:09.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:09.123+0000 7fb3f5d92700 1 -- 172.21.2.102:0/503996090 shutdown_connections 2021-02-12T17:18:09.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:09.123+0000 7fb3f5d92700 1 -- 172.21.2.102:0/503996090 wait complete. 2021-02-12T17:18:09.126 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:18:09.134 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:18:10.621 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:18:10.624 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:18:11.135 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:11.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.221+0000 7f36ee47c700 1 Processor -- start 2021-02-12T17:18:11.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.222+0000 7f36ee47c700 1 -- start start 2021-02-12T17:18:11.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.222+0000 7f36ee47c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f36e80b8d20 0x7f36e8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:11.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.222+0000 7f36ee47c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f36e814e530 0x7f36e80b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:11.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.222+0000 7f36ee47c700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e80622a0 con 0x7f36e8062740 2021-02-12T17:18:11.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.222+0000 7f36ee47c700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e8068d20 con 0x7f36e814e530 2021-02-12T17:18:11.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.222+0000 7f36ee47c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e814ea10 con 0x7f36e80b8d20 2021-02-12T17:18:11.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.222+0000 7f36e77fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f36e814e530 0x7f36e80b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:11.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.222+0000 7f36e77fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f36e814e530 0x7f36e80b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45890/0 (socket says 172.21.2.102:45890) 2021-02-12T17:18:11.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.222+0000 7f36e77fe700 1 -- 172.21.2.102:0/111565282 learned_addr learned my addr 172.21.2.102:0/111565282 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:11.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.223+0000 7f36e77fe700 1 -- 172.21.2.102:0/111565282 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f36e80b8d20 msgr2=0x7f36e8068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:11.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.223+0000 7f36e77fe700 1 --2- 172.21.2.102:0/111565282 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f36e80b8d20 0x7f36e8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:11.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.223+0000 7f36e77fe700 1 -- 172.21.2.102:0/111565282 >> v1:172.21.2.104:6789/0 conn(0x7f36e8062740 legacy=0x7f36e8062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:11.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.223+0000 7f36e77fe700 1 -- 172.21.2.102:0/111565282 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80b63f0 con 0x7f36e814e530 2021-02-12T17:18:11.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.223+0000 7f36e77fe700 1 --2- 172.21.2.102:0/111565282 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f36e814e530 0x7f36e80b7250 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f36d800b9e0 tx=0x7f36d8006ea0).ready entity=mon.0 client_cookie=595811fde4ab8faa server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:11.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.223+0000 7f36e6ffd700 1 -- 172.21.2.102:0/111565282 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8009800 con 0x7f36e814e530 2021-02-12T17:18:11.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.223+0000 7f36e6ffd700 1 -- 172.21.2.102:0/111565282 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d8009960 con 0x7f36e814e530 2021-02-12T17:18:11.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.223+0000 7f36e6ffd700 1 -- 172.21.2.102:0/111565282 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8009ce0 con 0x7f36e814e530 2021-02-12T17:18:11.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.224+0000 7f36ee47c700 1 -- 172.21.2.102:0/111565282 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f36e814e530 msgr2=0x7f36e80b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:11.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.224+0000 7f36ee47c700 1 --2- 172.21.2.102:0/111565282 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f36e814e530 0x7f36e80b7250 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f36d800b9e0 tx=0x7f36d8006ea0).stop 2021-02-12T17:18:11.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.224+0000 7f36ee47c700 1 -- 172.21.2.102:0/111565282 shutdown_connections 2021-02-12T17:18:11.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.224+0000 7f36ee47c700 1 --2- 172.21.2.102:0/111565282 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f36e80b8d20 0x7f36e8068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:11.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.224+0000 7f36ee47c700 1 --2- 172.21.2.102:0/111565282 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f36e814e530 0x7f36e80b7250 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:11.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.224+0000 7f36ee47c700 1 -- 172.21.2.102:0/111565282 >> 172.21.2.102:0/111565282 conn(0x7f36e80bc480 msgr2=0x7f36e80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:11.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.224+0000 7f36ee47c700 1 -- 172.21.2.102:0/111565282 shutdown_connections 2021-02-12T17:18:11.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.224+0000 7f36ee47c700 1 -- 172.21.2.102:0/111565282 wait complete. 2021-02-12T17:18:11.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.225+0000 7f36ee47c700 1 Processor -- start 2021-02-12T17:18:11.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.225+0000 7f36ee47c700 1 -- start start 2021-02-12T17:18:11.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36ee47c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f36e8062740 0x7f36e815e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:11.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36ee47c700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f36e80b8d20 0x7f36e80ba3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:11.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36ee47c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f36e814e530 0x7f36e814bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:11.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36ee47c700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e815da10 con 0x7f36e814e530 2021-02-12T17:18:11.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36ee47c700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80b5a00 con 0x7f36e80b8d20 2021-02-12T17:18:11.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36ee47c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e815dc00 con 0x7f36e8062740 2021-02-12T17:18:11.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36eca19700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f36e814e530 0x7f36e814bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:11.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36eca19700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f36e814e530 0x7f36e814bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45894/0 (socket says 172.21.2.102:45894) 2021-02-12T17:18:11.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36eca19700 1 -- 172.21.2.102:0/335599137 learned_addr learned my addr 172.21.2.102:0/335599137 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:11.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36e77fe700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f36e80b8d20 0x7f36e80ba3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:11.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36eca19700 1 -- 172.21.2.102:0/335599137 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f36e8062740 msgr2=0x7f36e815e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:11.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36e7fff700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f36e8062740 0x7f36e815e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:11.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36eca19700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f36e8062740 0x7f36e815e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:11.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36eca19700 1 -- 172.21.2.102:0/335599137 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f36e80b8d20 msgr2=0x7f36e80ba3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:11.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36eca19700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f36e80b8d20 0x7f36e80ba3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:11.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36eca19700 1 -- 172.21.2.102:0/335599137 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e815dea0 con 0x7f36e814e530 2021-02-12T17:18:11.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36e77fe700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f36e80b8d20 0x7f36e80ba3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:18:11.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36e7fff700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f36e8062740 0x7f36e815e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:18:11.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.226+0000 7f36eca19700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f36e814e530 0x7f36e814bac0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f36e000cae0 tx=0x7f36e00023b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:11.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.227+0000 7f36dffff700 1 -- 172.21.2.102:0/335599137 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e000a7f0 con 0x7f36e814e530 2021-02-12T17:18:11.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.227+0000 7f36dffff700 1 -- 172.21.2.102:0/335599137 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e000a970 con 0x7f36e814e530 2021-02-12T17:18:11.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.227+0000 7f36ee47c700 1 -- 172.21.2.102:0/335599137 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e815e140 con 0x7f36e814e530 2021-02-12T17:18:11.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.227+0000 7f36dffff700 1 -- 172.21.2.102:0/335599137 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e000ad30 con 0x7f36e814e530 2021-02-12T17:18:11.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.227+0000 7f36ee47c700 1 -- 172.21.2.102:0/335599137 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e80ba8a0 con 0x7f36e814e530 2021-02-12T17:18:11.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.227+0000 7f36ee47c700 1 -- 172.21.2.102:0/335599137 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e80b7250 con 0x7f36e814e530 2021-02-12T17:18:11.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.228+0000 7f36dffff700 1 -- 172.21.2.102:0/335599137 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f36e0019030 con 0x7f36e814e530 2021-02-12T17:18:11.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.228+0000 7f36dffff700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f36cc059d30 0x7f36cc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:11.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.228+0000 7f36dffff700 1 -- 172.21.2.102:0/335599137 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f36e00735f0 con 0x7f36e814e530 2021-02-12T17:18:11.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.228+0000 7f36e7fff700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f36cc059d30 0x7f36cc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:11.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.228+0000 7f36e7fff700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f36cc059d30 0x7f36cc05c1f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f36d000a7a0 tx=0x7f36d0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:11.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.231+0000 7f36dffff700 1 -- 172.21.2.102:0/335599137 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f36e0046ed0 con 0x7f36e814e530 2021-02-12T17:18:11.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.390+0000 7f36ee47c700 1 -- 172.21.2.102:0/335599137 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36e815e2d0 con 0x7f36e814e530 2021-02-12T17:18:11.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.390+0000 7f36dffff700 1 -- 172.21.2.102:0/335599137 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7f36e004a4f0 con 0x7f36e814e530 2021-02-12T17:18:11.392 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:11.392 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:11.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.391+0000 7f36ee47c700 1 -- 172.21.2.102:0/335599137 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f36cc059d30 msgr2=0x7f36cc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:11.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.391+0000 7f36ee47c700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f36cc059d30 0x7f36cc05c1f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f36d000a7a0 tx=0x7f36d0008040).stop 2021-02-12T17:18:11.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.391+0000 7f36ee47c700 1 -- 172.21.2.102:0/335599137 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f36e814e530 msgr2=0x7f36e814bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:11.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.391+0000 7f36ee47c700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f36e814e530 0x7f36e814bac0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f36e000cae0 tx=0x7f36e00023b0).stop 2021-02-12T17:18:11.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.391+0000 7f36ee47c700 1 -- 172.21.2.102:0/335599137 shutdown_connections 2021-02-12T17:18:11.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.391+0000 7f36ee47c700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f36cc059d30 0x7f36cc05c1f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:11.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.391+0000 7f36ee47c700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f36e814e530 0x7f36e814bac0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:11.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.391+0000 7f36ee47c700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f36e8062740 0x7f36e815e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:11.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.391+0000 7f36ee47c700 1 --2- 172.21.2.102:0/335599137 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f36e80b8d20 0x7f36e80ba3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.391+0000 7f36ee47c700 1 -- 172.21.2.102:0/335599137 >> 172.21.2.102:0/335599137 conn(0x7f36e80bc480 msgr2=0x7f36e814cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.392+0000 7f36ee47c700 1 -- 172.21.2.102:0/335599137 shutdown_connections 2021-02-12T17:18:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:11.392+0000 7f36ee47c700 1 -- 172.21.2.102:0/335599137 wait complete. 2021-02-12T17:18:11.394 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:18:11.401 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:18:13.402 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:13.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.488+0000 7f819b1cd700 1 Processor -- start 2021-02-12T17:18:13.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.489+0000 7f819b1cd700 1 -- start start 2021-02-12T17:18:13.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.489+0000 7f819b1cd700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f81940b2cb0 0x7f81940b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:13.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.489+0000 7f819b1cd700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f81940b8bd0 0x7f8194147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:13.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.489+0000 7f819b1cd700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81940b54d0 con 0x7f81940b3090 2021-02-12T17:18:13.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.489+0000 7f819b1cd700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81940b40f0 con 0x7f81940b8bd0 2021-02-12T17:18:13.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.489+0000 7f819b1cd700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81940b4d90 con 0x7f81940b2cb0 2021-02-12T17:18:13.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.489+0000 7f819976a700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f81940b3090 0x7f81940b4680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54548/0 (socket says 172.21.2.102:54548) 2021-02-12T17:18:13.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.489+0000 7f819976a700 1 -- 172.21.2.102:0/516942560 learned_addr learned my addr 172.21.2.102:0/516942560 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:13.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.490+0000 7f8193fff700 1 --2- 172.21.2.102:0/516942560 >> v2:172.21.2.104:3300/0 conn(0x7f81940b8bd0 0x7f8194147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:13.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.490+0000 7f8198f69700 1 --2- 172.21.2.102:0/516942560 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f81940b2cb0 0x7f81940b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:13.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.490+0000 7f81937fe700 1 -- 172.21.2.102:0/516942560 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308536510 0 0) 0x7f81940b54d0 con 0x7f81940b3090 2021-02-12T17:18:13.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.490+0000 7f81937fe700 1 -- 172.21.2.102:0/516942560 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8174007640 con 0x7f81940b3090 2021-02-12T17:18:13.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.490+0000 7f8198f69700 1 -- 172.21.2.102:0/516942560 >> v2:172.21.2.104:3300/0 conn(0x7f81940b8bd0 msgr2=0x7f8194147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:13.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.490+0000 7f8198f69700 1 --2- 172.21.2.102:0/516942560 >> v2:172.21.2.104:3300/0 conn(0x7f81940b8bd0 0x7f8194147cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:13.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.490+0000 7f8198f69700 1 -- 172.21.2.102:0/516942560 >> v1:172.21.2.102:6789/0 conn(0x7f81940b3090 legacy=0x7f81940b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:13.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.490+0000 7f8198f69700 1 -- 172.21.2.102:0/516942560 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81940b4f90 con 0x7f81940b2cb0 2021-02-12T17:18:13.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.490+0000 7f8198f69700 1 --2- 172.21.2.102:0/516942560 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f81940b2cb0 0x7f81940b7010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f817c00b980 tx=0x7f817c006de0).ready entity=mon.2 client_cookie=2e76df0cc2809212 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:13.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.491+0000 7f81937fe700 1 -- 172.21.2.102:0/516942560 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c0095c0 con 0x7f81940b2cb0 2021-02-12T17:18:13.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.491+0000 7f81937fe700 1 -- 172.21.2.102:0/516942560 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c009720 con 0x7f81940b2cb0 2021-02-12T17:18:13.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.491+0000 7f81937fe700 1 -- 172.21.2.102:0/516942560 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c009aa0 con 0x7f81940b2cb0 2021-02-12T17:18:13.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.491+0000 7f819b1cd700 1 -- 172.21.2.102:0/516942560 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f81940b2cb0 msgr2=0x7f81940b7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:13.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.491+0000 7f819b1cd700 1 --2- 172.21.2.102:0/516942560 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f81940b2cb0 0x7f81940b7010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f817c00b980 tx=0x7f817c006de0).stop 2021-02-12T17:18:13.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.491+0000 7f819b1cd700 1 -- 172.21.2.102:0/516942560 shutdown_connections 2021-02-12T17:18:13.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.491+0000 7f819b1cd700 1 --2- 172.21.2.102:0/516942560 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f81940b2cb0 0x7f81940b7010 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:13.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.491+0000 7f819b1cd700 1 --2- 172.21.2.102:0/516942560 >> v2:172.21.2.104:3300/0 conn(0x7f81940b8bd0 0x7f8194147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:13.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.491+0000 7f819b1cd700 1 -- 172.21.2.102:0/516942560 >> 172.21.2.102:0/516942560 conn(0x7f81940bc480 msgr2=0x7f81940b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:13.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.491+0000 7f819b1cd700 1 -- 172.21.2.102:0/516942560 shutdown_connections 2021-02-12T17:18:13.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.491+0000 7f819b1cd700 1 -- 172.21.2.102:0/516942560 wait complete. 2021-02-12T17:18:13.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.492+0000 7f819b1cd700 1 Processor -- start 2021-02-12T17:18:13.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.492+0000 7f819b1cd700 1 -- start start 2021-02-12T17:18:13.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819b1cd700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f81940b2cb0 0x7f8194158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:13.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819b1cd700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f81940b3090 0x7f8194067dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:13.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819b1cd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f81940b8bd0 0x7f8194154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:13.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819b1cd700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81940b22e0 con 0x7f81940b8bd0 2021-02-12T17:18:13.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819b1cd700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8194158190 con 0x7f81940b3090 2021-02-12T17:18:13.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819b1cd700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81940b0c10 con 0x7f81940b2cb0 2021-02-12T17:18:13.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819976a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f81940b8bd0 0x7f8194154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:13.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819976a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f81940b8bd0 0x7f8194154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45906/0 (socket says 172.21.2.102:45906) 2021-02-12T17:18:13.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819976a700 1 -- 172.21.2.102:0/4281379786 learned_addr learned my addr 172.21.2.102:0/4281379786 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:13.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819976a700 1 -- 172.21.2.102:0/4281379786 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f81940b2cb0 msgr2=0x7f8194158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:13.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819976a700 1 --2- 172.21.2.102:0/4281379786 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f81940b2cb0 0x7f8194158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:13.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819976a700 1 -- 172.21.2.102:0/4281379786 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f81940b3090 msgr2=0x7f8194067dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:13.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819976a700 1 --2- 172.21.2.102:0/4281379786 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f81940b3090 0x7f8194067dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:13.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819976a700 1 -- 172.21.2.102:0/4281379786 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81940b2510 con 0x7f81940b8bd0 2021-02-12T17:18:13.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819976a700 1 --2- 172.21.2.102:0/4281379786 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f81940b8bd0 0x7f8194154b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f81840010a0 tx=0x7f8184007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:13.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f8190ff9700 1 -- 172.21.2.102:0/4281379786 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184007320 con 0x7f81940b8bd0 2021-02-12T17:18:13.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f8190ff9700 1 -- 172.21.2.102:0/4281379786 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8184007480 con 0x7f81940b8bd0 2021-02-12T17:18:13.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f8190ff9700 1 -- 172.21.2.102:0/4281379786 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840057f0 con 0x7f81940b8bd0 2021-02-12T17:18:13.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819b1cd700 1 -- 172.21.2.102:0/4281379786 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81940b27b0 con 0x7f81940b8bd0 2021-02-12T17:18:13.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.493+0000 7f819b1cd700 1 -- 172.21.2.102:0/4281379786 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8194158ff0 con 0x7f81940b8bd0 2021-02-12T17:18:13.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.494+0000 7f819b1cd700 1 -- 172.21.2.102:0/4281379786 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8194147040 con 0x7f81940b8bd0 2021-02-12T17:18:13.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.494+0000 7f8190ff9700 1 -- 172.21.2.102:0/4281379786 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f8184010030 con 0x7f81940b8bd0 2021-02-12T17:18:13.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.495+0000 7f8190ff9700 1 --2- 172.21.2.102:0/4281379786 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8178059d30 0x7f817805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:13.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.495+0000 7f8190ff9700 1 -- 172.21.2.102:0/4281379786 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f81840737b0 con 0x7f81940b8bd0 2021-02-12T17:18:13.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.495+0000 7f8198f69700 1 --2- 172.21.2.102:0/4281379786 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8178059d30 0x7f817805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:13.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.495+0000 7f8198f69700 1 --2- 172.21.2.102:0/4281379786 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8178059d30 0x7f817805c1f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f817c006e20 tx=0x7f817c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:13.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.498+0000 7f8190ff9700 1 -- 172.21.2.102:0/4281379786 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f8184046f80 con 0x7f81940b8bd0 2021-02-12T17:18:13.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.658+0000 7f819b1cd700 1 -- 172.21.2.102:0/4281379786 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8194158820 con 0x7f81940b8bd0 2021-02-12T17:18:13.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.658+0000 7f8190ff9700 1 -- 172.21.2.102:0/4281379786 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7f818404a5a0 con 0x7f81940b8bd0 2021-02-12T17:18:13.660 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:13.660 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:13.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.659+0000 7f819b1cd700 1 -- 172.21.2.102:0/4281379786 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8178059d30 msgr2=0x7f817805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:13.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.659+0000 7f819b1cd700 1 --2- 172.21.2.102:0/4281379786 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8178059d30 0x7f817805c1f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f817c006e20 tx=0x7f817c016000).stop 2021-02-12T17:18:13.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.659+0000 7f819b1cd700 1 -- 172.21.2.102:0/4281379786 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f81940b8bd0 msgr2=0x7f8194154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:13.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.659+0000 7f819b1cd700 1 --2- 172.21.2.102:0/4281379786 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f81940b8bd0 0x7f8194154b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f81840010a0 tx=0x7f8184007a30).stop 2021-02-12T17:18:13.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.659+0000 7f819b1cd700 1 -- 172.21.2.102:0/4281379786 shutdown_connections 2021-02-12T17:18:13.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.659+0000 7f819b1cd700 1 --2- 172.21.2.102:0/4281379786 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8178059d30 0x7f817805c1f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:13.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.659+0000 7f819b1cd700 1 --2- 172.21.2.102:0/4281379786 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f81940b8bd0 0x7f8194154b90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:13.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.659+0000 7f819b1cd700 1 --2- 172.21.2.102:0/4281379786 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f81940b2cb0 0x7f8194158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:13.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.659+0000 7f819b1cd700 1 --2- 172.21.2.102:0/4281379786 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f81940b3090 0x7f8194067dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:13.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.659+0000 7f819b1cd700 1 -- 172.21.2.102:0/4281379786 >> 172.21.2.102:0/4281379786 conn(0x7f81940bc480 msgr2=0x7f81940ba960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:13.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.659+0000 7f819b1cd700 1 -- 172.21.2.102:0/4281379786 shutdown_connections 2021-02-12T17:18:13.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:13.659+0000 7f819b1cd700 1 -- 172.21.2.102:0/4281379786 wait complete. 2021-02-12T17:18:13.662 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:18:13.670 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:18:15.671 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:15.760 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.759+0000 7fd49137b700 1 Processor -- start 2021-02-12T17:18:15.760 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.759+0000 7fd49137b700 1 -- start start 2021-02-12T17:18:15.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.759+0000 7fd49137b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd48c14e530 0x7fd48c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:15.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.759+0000 7fd49137b700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0b7960 con 0x7fd48c062740 2021-02-12T17:18:15.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.759+0000 7fd49137b700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0622a0 con 0x7fd48c0b8d20 2021-02-12T17:18:15.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.759+0000 7fd49137b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c068d20 con 0x7fd48c14e530 2021-02-12T17:18:15.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.760+0000 7fd48b7fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fd48c062740 0x7fd48c062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54558/0 (socket says 172.21.2.102:54558) 2021-02-12T17:18:15.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.760+0000 7fd48b7fe700 1 -- 172.21.2.102:0/1914101931 learned_addr learned my addr 172.21.2.102:0/1914101931 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:15.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.760+0000 7fd489ffb700 1 -- 172.21.2.102:0/1914101931 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395654412 0 0) 0x7fd48c0b7960 con 0x7fd48c062740 2021-02-12T17:18:15.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.760+0000 7fd489ffb700 1 -- 172.21.2.102:0/1914101931 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd46c003230 con 0x7fd48c062740 2021-02-12T17:18:15.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.760+0000 7fd48a7fc700 1 --2- 172.21.2.102:0/1914101931 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd48c14e530 0x7fd48c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:15.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.760+0000 7fd489ffb700 1 -- 172.21.2.102:0/1914101931 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2178190175 0 0) 0x7fd46c003230 con 0x7fd48c062740 2021-02-12T17:18:15.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.760+0000 7fd489ffb700 1 -- 172.21.2.102:0/1914101931 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd48c14e530 msgr2=0x7fd48c068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:15.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.760+0000 7fd489ffb700 1 --2- 172.21.2.102:0/1914101931 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd48c14e530 0x7fd48c068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:15.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.760+0000 7fd489ffb700 1 -- 172.21.2.102:0/1914101931 >> v1:172.21.2.104:6789/0 conn(0x7fd48c0b8d20 legacy=0x7fd48c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:15.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.760+0000 7fd489ffb700 1 -- 172.21.2.102:0/1914101931 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c14ea10 con 0x7fd48c062740 2021-02-12T17:18:15.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.760+0000 7fd489ffb700 1 -- 172.21.2.102:0/1914101931 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fd484001860 con 0x7fd48c062740 2021-02-12T17:18:15.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.760+0000 7fd489ffb700 1 -- 172.21.2.102:0/1914101931 >> v1:172.21.2.102:6789/0 conn(0x7fd48c062740 legacy=0x7fd48c062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:15.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd489ffb700 1 --2- 172.21.2.102:0/1914101931 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd48c14e530 0x7fd46c003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:15.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd489ffb700 1 --2- 172.21.2.102:0/1914101931 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd46c003cb0 0x7fd46c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:15.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd489ffb700 1 --2- 172.21.2.102:0/1914101931 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd46c0049c0 0x7fd46c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:15.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd489ffb700 1 -- 172.21.2.102:0/1914101931 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c068d20 con 0x7fd46c0049c0 2021-02-12T17:18:15.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd489ffb700 1 -- 172.21.2.102:0/1914101931 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c004240 con 0x7fd46c003cb0 2021-02-12T17:18:15.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd489ffb700 1 -- 172.21.2.102:0/1914101931 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c00b720 con 0x7fd48c14e530 2021-02-12T17:18:15.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd48b7fe700 1 --2- 172.21.2.102:0/1914101931 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd46c0049c0 0x7fd46c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:15.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd48a7fc700 1 --2- 172.21.2.102:0/1914101931 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd46c003cb0 0x7fd46c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:15.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd48affd700 1 --2- 172.21.2.102:0/1914101931 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd48c14e530 0x7fd46c003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:15.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd48b7fe700 1 -- 172.21.2.102:0/1914101931 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd48c14e530 msgr2=0x7fd46c003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:15.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd48b7fe700 1 --2- 172.21.2.102:0/1914101931 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd48c14e530 0x7fd46c003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:15.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd48b7fe700 1 -- 172.21.2.102:0/1914101931 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd46c003cb0 msgr2=0x7fd46c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:15.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd48b7fe700 1 --2- 172.21.2.102:0/1914101931 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd46c003cb0 0x7fd46c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:15.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd48b7fe700 1 -- 172.21.2.102:0/1914101931 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c003230 con 0x7fd46c0049c0 2021-02-12T17:18:15.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd48b7fe700 1 --2- 172.21.2.102:0/1914101931 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd46c0049c0 0x7fd46c004e40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fd48400c600 tx=0x7fd48c14eba0).ready entity=mon.0 client_cookie=a7aa82c5b83796c3 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:15.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd489ffb700 1 -- 172.21.2.102:0/1914101931 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484005b70 con 0x7fd46c0049c0 2021-02-12T17:18:15.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd489ffb700 1 -- 172.21.2.102:0/1914101931 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd484005cd0 con 0x7fd46c0049c0 2021-02-12T17:18:15.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd489ffb700 1 -- 172.21.2.102:0/1914101931 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484007300 con 0x7fd46c0049c0 2021-02-12T17:18:15.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd49137b700 1 -- 172.21.2.102:0/1914101931 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd46c0049c0 msgr2=0x7fd46c004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:15.767 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd49137b700 1 --2- 172.21.2.102:0/1914101931 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd46c0049c0 0x7fd46c004e40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fd48400c600 tx=0x7fd48c14eba0).stop 2021-02-12T17:18:15.767 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.761+0000 7fd48b7fe700 1 -- 172.21.2.102:0/1914101931 reap_dead start 2021-02-12T17:18:15.767 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.762+0000 7fd49137b700 1 -- 172.21.2.102:0/1914101931 shutdown_connections 2021-02-12T17:18:15.767 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.762+0000 7fd49137b700 1 -- 172.21.2.102:0/1914101931 >> 172.21.2.102:0/1914101931 conn(0x7fd48c0bc480 msgr2=0x7fd48c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:15.767 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.762+0000 7fd49137b700 1 -- 172.21.2.102:0/1914101931 shutdown_connections 2021-02-12T17:18:15.767 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.762+0000 7fd49137b700 1 -- 172.21.2.102:0/1914101931 wait complete. 2021-02-12T17:18:15.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd49137b700 1 Processor -- start 2021-02-12T17:18:15.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd49137b700 1 -- start start 2021-02-12T17:18:15.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd49137b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd46c0049c0 0x7fd48c150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:15.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd49137b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd48c161170 0x7fd48c1615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:15.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd49137b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd48c14aa50 0x7fd48c14aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:15.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd49137b700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0aeda0 con 0x7fd48c14aa50 2021-02-12T17:18:15.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd49137b700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0afe20 con 0x7fd46c0049c0 2021-02-12T17:18:15.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd49137b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c160d10 con 0x7fd48c161170 2021-02-12T17:18:15.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd48b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd48c14aa50 0x7fd48c14aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:15.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd48b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd48c14aa50 0x7fd48c14aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45928/0 (socket says 172.21.2.102:45928) 2021-02-12T17:18:15.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd48b7fe700 1 -- 172.21.2.102:0/3814316679 learned_addr learned my addr 172.21.2.102:0/3814316679 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:15.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd48b7fe700 1 -- 172.21.2.102:0/3814316679 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd48c161170 msgr2=0x7fd48c1615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:15.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd48b7fe700 1 --2- 172.21.2.102:0/3814316679 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd48c161170 0x7fd48c1615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:15.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd48b7fe700 1 -- 172.21.2.102:0/3814316679 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd46c0049c0 msgr2=0x7fd48c150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:15.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd48b7fe700 1 --2- 172.21.2.102:0/3814316679 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd46c0049c0 0x7fd48c150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:15.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.763+0000 7fd48b7fe700 1 -- 172.21.2.102:0/3814316679 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c0b4920 con 0x7fd48c14aa50 2021-02-12T17:18:15.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.764+0000 7fd48b7fe700 1 --2- 172.21.2.102:0/3814316679 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd48c14aa50 0x7fd48c14aed0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fd46c005450 tx=0x7fd484010000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:15.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.764+0000 7fd482ffd700 1 -- 172.21.2.102:0/3814316679 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48401a030 con 0x7fd48c14aa50 2021-02-12T17:18:15.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.764+0000 7fd482ffd700 1 -- 172.21.2.102:0/3814316679 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48401b040 con 0x7fd48c14aa50 2021-02-12T17:18:15.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.764+0000 7fd482ffd700 1 -- 172.21.2.102:0/3814316679 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4840078a0 con 0x7fd48c14aa50 2021-02-12T17:18:15.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.764+0000 7fd49137b700 1 -- 172.21.2.102:0/3814316679 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48c0b43e0 con 0x7fd48c14aa50 2021-02-12T17:18:15.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.764+0000 7fd49137b700 1 -- 172.21.2.102:0/3814316679 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48c161ae0 con 0x7fd48c14aa50 2021-02-12T17:18:15.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.764+0000 7fd49137b700 1 -- 172.21.2.102:0/3814316679 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48c045460 con 0x7fd48c14aa50 2021-02-12T17:18:15.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.765+0000 7fd482ffd700 1 -- 172.21.2.102:0/3814316679 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fd484010070 con 0x7fd48c14aa50 2021-02-12T17:18:15.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.765+0000 7fd482ffd700 1 --2- 172.21.2.102:0/3814316679 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd470059d30 0x7fd47005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:15.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.765+0000 7fd482ffd700 1 -- 172.21.2.102:0/3814316679 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fd484074b20 con 0x7fd48c14aa50 2021-02-12T17:18:15.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.765+0000 7fd48affd700 1 --2- 172.21.2.102:0/3814316679 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd470059d30 0x7fd47005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:15.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.765+0000 7fd48affd700 1 --2- 172.21.2.102:0/3814316679 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd470059d30 0x7fd47005c1f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fd474000f20 tx=0x7fd474009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:15.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.768+0000 7fd482ffd700 1 -- 172.21.2.102:0/3814316679 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fd484048350 con 0x7fd48c14aa50 2021-02-12T17:18:15.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.928+0000 7fd49137b700 1 -- 172.21.2.102:0/3814316679 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd48c0676c0 con 0x7fd48c14aa50 2021-02-12T17:18:15.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.928+0000 7fd482ffd700 1 -- 172.21.2.102:0/3814316679 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7fd48404b970 con 0x7fd48c14aa50 2021-02-12T17:18:15.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.929+0000 7fd49137b700 1 -- 172.21.2.102:0/3814316679 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd470059d30 msgr2=0x7fd47005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:15.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.929+0000 7fd49137b700 1 --2- 172.21.2.102:0/3814316679 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd470059d30 0x7fd47005c1f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fd474000f20 tx=0x7fd474009040).stop 2021-02-12T17:18:15.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.929+0000 7fd49137b700 1 -- 172.21.2.102:0/3814316679 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd48c14aa50 msgr2=0x7fd48c14aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:15.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.929+0000 7fd49137b700 1 --2- 172.21.2.102:0/3814316679 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd48c14aa50 0x7fd48c14aed0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fd46c005450 tx=0x7fd484010000).stop 2021-02-12T17:18:15.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.929+0000 7fd49137b700 1 -- 172.21.2.102:0/3814316679 shutdown_connections 2021-02-12T17:18:15.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.929+0000 7fd49137b700 1 --2- 172.21.2.102:0/3814316679 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd470059d30 0x7fd47005c1f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:15.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.929+0000 7fd49137b700 1 --2- 172.21.2.102:0/3814316679 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd48c14aa50 0x7fd48c14aed0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:15.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.929+0000 7fd49137b700 1 --2- 172.21.2.102:0/3814316679 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd46c0049c0 0x7fd48c150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:15.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.929+0000 7fd49137b700 1 --2- 172.21.2.102:0/3814316679 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd48c161170 0x7fd48c1615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:15.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.929+0000 7fd49137b700 1 -- 172.21.2.102:0/3814316679 >> 172.21.2.102:0/3814316679 conn(0x7fd48c0bc480 msgr2=0x7fd48c14cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:15.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.930+0000 7fd49137b700 1 -- 172.21.2.102:0/3814316679 shutdown_connections 2021-02-12T17:18:15.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:15.930+0000 7fd49137b700 1 -- 172.21.2.102:0/3814316679 wait complete. 2021-02-12T17:18:15.933 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:15.933 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:15.934 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:18:15.940 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:18:17.941 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:18.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.029+0000 7f7b79e3a700 1 Processor -- start 2021-02-12T17:18:18.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.029+0000 7f7b79e3a700 1 -- start start 2021-02-12T17:18:18.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.029+0000 7f7b79e3a700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f7b740b8d20 0x7f7b74068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:18.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.029+0000 7f7b79e3a700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f7b7414e530 0x7f7b740b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:18.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.029+0000 7f7b79e3a700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b740622a0 con 0x7f7b74062740 2021-02-12T17:18:18.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.029+0000 7f7b79e3a700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b74068d20 con 0x7f7b740b8d20 2021-02-12T17:18:18.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.029+0000 7f7b79e3a700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7414ea10 con 0x7f7b7414e530 2021-02-12T17:18:18.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.029+0000 7f7b737fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f7b740b8d20 0x7f7b74068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:18.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.029+0000 7f7b737fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f7b740b8d20 0x7f7b74068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45932/0 (socket says 172.21.2.102:45932) 2021-02-12T17:18:18.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.029+0000 7f7b73fff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f7b74062740 0x7f7b74062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54576/0 (socket says 172.21.2.102:54576) 2021-02-12T17:18:18.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.029+0000 7f7b737fe700 1 -- 172.21.2.102:0/2529936975 learned_addr learned my addr 172.21.2.102:0/2529936975 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:18.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b737fe700 1 -- 172.21.2.102:0/2529936975 >> v2:172.21.2.104:3300/0 conn(0x7f7b7414e530 msgr2=0x7f7b740b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:18:18.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b737fe700 1 --2- 172.21.2.102:0/2529936975 >> v2:172.21.2.104:3300/0 conn(0x7f7b7414e530 0x7f7b740b7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:18.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b737fe700 1 -- 172.21.2.102:0/2529936975 >> v1:172.21.2.102:6789/0 conn(0x7f7b74062740 legacy=0x7f7b74062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:18.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b737fe700 1 -- 172.21.2.102:0/2529936975 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b740b63f0 con 0x7f7b740b8d20 2021-02-12T17:18:18.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b737fe700 1 --2- 172.21.2.102:0/2529936975 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b740b8d20 0x7f7b74068830 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f7b740654b0 tx=0x7f7b5c006ea0).ready entity=mon.0 client_cookie=90de360a95e55ead server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:18.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b727fc700 1 -- 172.21.2.102:0/2529936975 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c009740 con 0x7f7b740b8d20 2021-02-12T17:18:18.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b727fc700 1 -- 172.21.2.102:0/2529936975 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c0098a0 con 0x7f7b740b8d20 2021-02-12T17:18:18.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b727fc700 1 -- 172.21.2.102:0/2529936975 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c009c20 con 0x7f7b740b8d20 2021-02-12T17:18:18.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2529936975 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b740b8d20 msgr2=0x7f7b74068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:18.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b79e3a700 1 --2- 172.21.2.102:0/2529936975 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b740b8d20 0x7f7b74068830 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f7b740654b0 tx=0x7f7b5c006ea0).stop 2021-02-12T17:18:18.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2529936975 shutdown_connections 2021-02-12T17:18:18.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b79e3a700 1 --2- 172.21.2.102:0/2529936975 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b740b8d20 0x7f7b74068830 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:18.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b79e3a700 1 --2- 172.21.2.102:0/2529936975 >> v2:172.21.2.104:3300/0 conn(0x7f7b7414e530 0x7f7b740b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:18.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2529936975 >> 172.21.2.102:0/2529936975 conn(0x7f7b740bc480 msgr2=0x7f7b740b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:18.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2529936975 shutdown_connections 2021-02-12T17:18:18.034 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.030+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2529936975 wait complete. 2021-02-12T17:18:18.036 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.031+0000 7f7b79e3a700 1 Processor -- start 2021-02-12T17:18:18.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.031+0000 7f7b79e3a700 1 -- start start 2021-02-12T17:18:18.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.032+0000 7f7b79e3a700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7b74062740 0x7f7b74141320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:18.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.032+0000 7f7b79e3a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b740b8d20 0x7f7b740ba3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:18.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.032+0000 7f7b79e3a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b7414e530 0x7f7b7414ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:18.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.032+0000 7f7b79e3a700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b741407a0 con 0x7f7b7414e530 2021-02-12T17:18:18.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.032+0000 7f7b79e3a700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74141810 con 0x7f7b74062740 2021-02-12T17:18:18.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.032+0000 7f7b79e3a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b740afe30 con 0x7f7b740b8d20 2021-02-12T17:18:18.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.032+0000 7f7b73fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b7414e530 0x7f7b7414ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:18.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.032+0000 7f7b73fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b7414e530 0x7f7b7414ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45940/0 (socket says 172.21.2.102:45940) 2021-02-12T17:18:18.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.032+0000 7f7b73fff700 1 -- 172.21.2.102:0/2856247191 learned_addr learned my addr 172.21.2.102:0/2856247191 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:18.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.032+0000 7f7b73fff700 1 -- 172.21.2.102:0/2856247191 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b740b8d20 msgr2=0x7f7b740ba3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:18.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.032+0000 7f7b73fff700 1 --2- 172.21.2.102:0/2856247191 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b740b8d20 0x7f7b740ba3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:18.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.032+0000 7f7b73fff700 1 -- 172.21.2.102:0/2856247191 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7b74062740 msgr2=0x7f7b74141320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:18.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.032+0000 7f7b73fff700 1 --2- 172.21.2.102:0/2856247191 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7b74062740 0x7f7b74141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:18.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.032+0000 7f7b73fff700 1 -- 172.21.2.102:0/2856247191 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b740b00d0 con 0x7f7b7414e530 2021-02-12T17:18:18.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.033+0000 7f7b73fff700 1 --2- 172.21.2.102:0/2856247191 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b7414e530 0x7f7b7414ad70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f7b6c00cb10 tx=0x7f7b6c007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:18.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.033+0000 7f7b6b7fe700 1 -- 172.21.2.102:0/2856247191 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c005ab0 con 0x7f7b7414e530 2021-02-12T17:18:18.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.033+0000 7f7b6b7fe700 1 -- 172.21.2.102:0/2856247191 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c005c10 con 0x7f7b7414e530 2021-02-12T17:18:18.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.033+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2856247191 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b740b0370 con 0x7f7b7414e530 2021-02-12T17:18:18.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.033+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2856247191 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b740afb20 con 0x7f7b7414e530 2021-02-12T17:18:18.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.033+0000 7f7b6b7fe700 1 -- 172.21.2.102:0/2856247191 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c007110 con 0x7f7b7414e530 2021-02-12T17:18:18.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.034+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2856247191 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4c004f60 con 0x7f7b7414e530 2021-02-12T17:18:18.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.034+0000 7f7b6b7fe700 1 -- 172.21.2.102:0/2856247191 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f7b6c010030 con 0x7f7b7414e530 2021-02-12T17:18:18.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.034+0000 7f7b6b7fe700 1 --2- 172.21.2.102:0/2856247191 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b58059d80 0x7f7b5805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:18.039 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.034+0000 7f7b6b7fe700 1 -- 172.21.2.102:0/2856247191 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f7b6c073cc0 con 0x7f7b7414e530 2021-02-12T17:18:18.039 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.034+0000 7f7b737fe700 1 --2- 172.21.2.102:0/2856247191 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b58059d80 0x7f7b5805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:18.039 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.035+0000 7f7b737fe700 1 --2- 172.21.2.102:0/2856247191 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b58059d80 0x7f7b5805c240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f7b5c00a010 tx=0x7f7b5c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:18.039 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.037+0000 7f7b6b7fe700 1 -- 172.21.2.102:0/2856247191 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f7b6c047510 con 0x7f7b7414e530 2021-02-12T17:18:18.198 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.196+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2856247191 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b4c005790 con 0x7f7b7414e530 2021-02-12T17:18:18.198 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.196+0000 7f7b6b7fe700 1 -- 172.21.2.102:0/2856247191 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7f7b6c04ab30 con 0x7f7b7414e530 2021-02-12T17:18:18.198 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:18.198 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:18.200 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.197+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2856247191 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b58059d80 msgr2=0x7f7b5805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:18.200 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.197+0000 7f7b79e3a700 1 --2- 172.21.2.102:0/2856247191 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b58059d80 0x7f7b5805c240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f7b5c00a010 tx=0x7f7b5c016000).stop 2021-02-12T17:18:18.200 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.197+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2856247191 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b7414e530 msgr2=0x7f7b7414ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:18.200 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.197+0000 7f7b79e3a700 1 --2- 172.21.2.102:0/2856247191 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b7414e530 0x7f7b7414ad70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f7b6c00cb10 tx=0x7f7b6c007ef0).stop 2021-02-12T17:18:18.201 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.198+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2856247191 shutdown_connections 2021-02-12T17:18:18.201 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.198+0000 7f7b79e3a700 1 --2- 172.21.2.102:0/2856247191 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b58059d80 0x7f7b5805c240 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:18.201 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.198+0000 7f7b79e3a700 1 --2- 172.21.2.102:0/2856247191 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b7414e530 0x7f7b7414ad70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:18.201 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.198+0000 7f7b79e3a700 1 --2- 172.21.2.102:0/2856247191 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7b74062740 0x7f7b74141320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:18.201 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.198+0000 7f7b79e3a700 1 --2- 172.21.2.102:0/2856247191 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b740b8d20 0x7f7b740ba3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:18.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.198+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2856247191 >> 172.21.2.102:0/2856247191 conn(0x7f7b740bc480 msgr2=0x7f7b740b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:18.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.198+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2856247191 shutdown_connections 2021-02-12T17:18:18.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:18.198+0000 7f7b79e3a700 1 -- 172.21.2.102:0/2856247191 wait complete. 2021-02-12T17:18:18.202 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:18:18.208 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:18:20.209 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:20.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.296+0000 7f643f3a7700 1 Processor -- start 2021-02-12T17:18:20.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.297+0000 7f643f3a7700 1 -- start start 2021-02-12T17:18:20.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.297+0000 7f643f3a7700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f64380b8d20 0x7f6438068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:20.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.297+0000 7f643f3a7700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64380b7960 con 0x7f6438062740 2021-02-12T17:18:20.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.297+0000 7f643f3a7700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64380622a0 con 0x7f643814e530 2021-02-12T17:18:20.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.297+0000 7f643f3a7700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6438068d20 con 0x7f64380b8d20 2021-02-12T17:18:20.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.297+0000 7f643d944700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f6438062740 0x7f6438062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54592/0 (socket says 172.21.2.102:54592) 2021-02-12T17:18:20.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.297+0000 7f643d944700 1 -- 172.21.2.102:0/338870881 learned_addr learned my addr 172.21.2.102:0/338870881 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:20.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 -- 172.21.2.102:0/338870881 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902149264 0 0) 0x7f64380b7960 con 0x7f6438062740 2021-02-12T17:18:20.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 -- 172.21.2.102:0/338870881 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6420003230 con 0x7f6438062740 2021-02-12T17:18:20.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f643d143700 1 --2- 172.21.2.102:0/338870881 >> v2:172.21.2.104:3300/0 conn(0x7f64380b8d20 0x7f6438068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:20.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 -- 172.21.2.102:0/338870881 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 842796058 0 0) 0x7f6420003230 con 0x7f6438062740 2021-02-12T17:18:20.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 -- 172.21.2.102:0/338870881 >> v2:172.21.2.104:3300/0 conn(0x7f64380b8d20 msgr2=0x7f6438068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:20.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 --2- 172.21.2.102:0/338870881 >> v2:172.21.2.104:3300/0 conn(0x7f64380b8d20 0x7f6438068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:20.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 -- 172.21.2.102:0/338870881 >> v1:172.21.2.104:6789/0 conn(0x7f643814e530 legacy=0x7f64380b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:20.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 -- 172.21.2.102:0/338870881 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643814ea10 con 0x7f6438062740 2021-02-12T17:18:20.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 -- 172.21.2.102:0/338870881 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f6430001860 con 0x7f6438062740 2021-02-12T17:18:20.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 -- 172.21.2.102:0/338870881 >> v1:172.21.2.102:6789/0 conn(0x7f6438062740 legacy=0x7f6438062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:20.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 --2- 172.21.2.102:0/338870881 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f64200037f0 0x7f6420003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:20.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 --2- 172.21.2.102:0/338870881 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f64200044d0 0x7f6420004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:20.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 --2- 172.21.2.102:0/338870881 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6420004e40 0x7f642000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:20.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 -- 172.21.2.102:0/338870881 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6438068d20 con 0x7f64200044d0 2021-02-12T17:18:20.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 -- 172.21.2.102:0/338870881 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64200053a0 con 0x7f6420004e40 2021-02-12T17:18:20.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f642bfff700 1 -- 172.21.2.102:0/338870881 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642000bc60 con 0x7f64200037f0 2021-02-12T17:18:20.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.298+0000 7f643c942700 1 --2- 172.21.2.102:0/338870881 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f64200044d0 0x7f6420004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:20.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643d944700 1 --2- 172.21.2.102:0/338870881 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6420004e40 0x7f642000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:20.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643d143700 1 --2- 172.21.2.102:0/338870881 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f64200037f0 0x7f6420003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:20.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643c942700 1 -- 172.21.2.102:0/338870881 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f64200037f0 msgr2=0x7f6420003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:20.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643c942700 1 --2- 172.21.2.102:0/338870881 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f64200037f0 0x7f6420003bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:20.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643c942700 1 -- 172.21.2.102:0/338870881 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6420004e40 msgr2=0x7f642000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:20.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643c942700 1 --2- 172.21.2.102:0/338870881 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6420004e40 0x7f642000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:20.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643d944700 1 -- 172.21.2.102:0/338870881 reap_dead start 2021-02-12T17:18:20.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643c942700 1 -- 172.21.2.102:0/338870881 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6420003230 con 0x7f64200044d0 2021-02-12T17:18:20.303 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643c942700 1 --2- 172.21.2.102:0/338870881 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f64200044d0 0x7f6420004950 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f6434001800 tx=0x7f6434007b60).ready entity=mon.0 client_cookie=69d98e2a6ca48c9b server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:20.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f642bfff700 1 -- 172.21.2.102:0/338870881 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400c820 con 0x7f64200044d0 2021-02-12T17:18:20.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f642bfff700 1 -- 172.21.2.102:0/338870881 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643400c9c0 con 0x7f64200044d0 2021-02-12T17:18:20.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f642bfff700 1 -- 172.21.2.102:0/338870881 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400cd80 con 0x7f64200044d0 2021-02-12T17:18:20.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643f3a7700 1 -- 172.21.2.102:0/338870881 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f64200044d0 msgr2=0x7f6420004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:20.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643f3a7700 1 --2- 172.21.2.102:0/338870881 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f64200044d0 0x7f6420004950 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f6434001800 tx=0x7f6434007b60).stop 2021-02-12T17:18:20.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643f3a7700 1 -- 172.21.2.102:0/338870881 shutdown_connections 2021-02-12T17:18:20.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643f3a7700 1 --2- 172.21.2.102:0/338870881 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f64200044d0 0x7f6420004950 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:20.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643f3a7700 1 -- 172.21.2.102:0/338870881 >> 172.21.2.102:0/338870881 conn(0x7f64380bc480 msgr2=0x7f64380b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:20.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643f3a7700 1 -- 172.21.2.102:0/338870881 shutdown_connections 2021-02-12T17:18:20.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.299+0000 7f643f3a7700 1 -- 172.21.2.102:0/338870881 wait complete. 2021-02-12T17:18:20.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.300+0000 7f643f3a7700 1 Processor -- start 2021-02-12T17:18:20.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.300+0000 7f643f3a7700 1 -- start start 2021-02-12T17:18:20.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643f3a7700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f64200044d0 0x7f64381536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:20.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643f3a7700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f64380b0350 0x7f64380b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:20.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643f3a7700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6438160ab0 0x7f6438160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:20.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643f3a7700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64381519a0 con 0x7f64200044d0 2021-02-12T17:18:20.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643f3a7700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6438151c40 con 0x7f64380b0350 2021-02-12T17:18:20.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643f3a7700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6438151ee0 con 0x7f6438160ab0 2021-02-12T17:18:20.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643d143700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f64200044d0 0x7f64381536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:20.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643d143700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f64200044d0 0x7f64381536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45958/0 (socket says 172.21.2.102:45958) 2021-02-12T17:18:20.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643d143700 1 -- 172.21.2.102:0/1679601874 learned_addr learned my addr 172.21.2.102:0/1679601874 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:20.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643d944700 1 --2- 172.21.2.102:0/1679601874 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6438160ab0 0x7f6438160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:20.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643c942700 1 --2- 172.21.2.102:0/1679601874 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f64380b0350 0x7f64380b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:20.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643d143700 1 -- 172.21.2.102:0/1679601874 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6438160ab0 msgr2=0x7f6438160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:20.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643d143700 1 --2- 172.21.2.102:0/1679601874 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6438160ab0 0x7f6438160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:20.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643d143700 1 -- 172.21.2.102:0/1679601874 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f64380b0350 msgr2=0x7f64380b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:20.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643d143700 1 --2- 172.21.2.102:0/1679601874 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f64380b0350 0x7f64380b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:20.307 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643d143700 1 -- 172.21.2.102:0/1679601874 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6438152180 con 0x7f64200044d0 2021-02-12T17:18:20.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.301+0000 7f643d143700 1 --2- 172.21.2.102:0/1679601874 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f64200044d0 0x7f64381536d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f642c00e7a0 tx=0x7f642c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:20.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.302+0000 7f64297fa700 1 -- 172.21.2.102:0/1679601874 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c017070 con 0x7f64200044d0 2021-02-12T17:18:20.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.302+0000 7f64297fa700 1 -- 172.21.2.102:0/1679601874 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c013430 con 0x7f64200044d0 2021-02-12T17:18:20.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.302+0000 7f64297fa700 1 -- 172.21.2.102:0/1679601874 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0137b0 con 0x7f64200044d0 2021-02-12T17:18:20.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.302+0000 7f643f3a7700 1 -- 172.21.2.102:0/1679601874 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6438153bc0 con 0x7f64200044d0 2021-02-12T17:18:20.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.302+0000 7f643f3a7700 1 -- 172.21.2.102:0/1679601874 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6438152620 con 0x7f64200044d0 2021-02-12T17:18:20.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.302+0000 7f643f3a7700 1 -- 172.21.2.102:0/1679601874 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6438065840 con 0x7f64200044d0 2021-02-12T17:18:20.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.303+0000 7f64297fa700 1 -- 172.21.2.102:0/1679601874 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f642c013b60 con 0x7f64200044d0 2021-02-12T17:18:20.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.303+0000 7f64297fa700 1 --2- 172.21.2.102:0/1679601874 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6418059d30 0x7f641805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:20.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.303+0000 7f64297fa700 1 -- 172.21.2.102:0/1679601874 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f642c073720 con 0x7f64200044d0 2021-02-12T17:18:20.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.303+0000 7f643c942700 1 --2- 172.21.2.102:0/1679601874 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6418059d30 0x7f641805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:20.308 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.303+0000 7f643c942700 1 --2- 172.21.2.102:0/1679601874 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6418059d30 0x7f641805c1f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f64380b80f0 tx=0x7f6434015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:20.309 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.306+0000 7f64297fa700 1 -- 172.21.2.102:0/1679601874 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f642c046e40 con 0x7f64200044d0 2021-02-12T17:18:20.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.463+0000 7f643f3a7700 1 -- 172.21.2.102:0/1679601874 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64380ba960 con 0x7f64200044d0 2021-02-12T17:18:20.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.464+0000 7f64297fa700 1 -- 172.21.2.102:0/1679601874 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7f642c04a460 con 0x7f64200044d0 2021-02-12T17:18:20.465 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:20.465 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:20.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.465+0000 7f643f3a7700 1 -- 172.21.2.102:0/1679601874 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6418059d30 msgr2=0x7f641805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:20.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.465+0000 7f643f3a7700 1 --2- 172.21.2.102:0/1679601874 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6418059d30 0x7f641805c1f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f64380b80f0 tx=0x7f6434015000).stop 2021-02-12T17:18:20.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.465+0000 7f643f3a7700 1 -- 172.21.2.102:0/1679601874 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f64200044d0 msgr2=0x7f64381536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:20.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.465+0000 7f643f3a7700 1 --2- 172.21.2.102:0/1679601874 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f64200044d0 0x7f64381536d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f642c00e7a0 tx=0x7f642c008040).stop 2021-02-12T17:18:20.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.465+0000 7f643f3a7700 1 -- 172.21.2.102:0/1679601874 shutdown_connections 2021-02-12T17:18:20.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.465+0000 7f643f3a7700 1 --2- 172.21.2.102:0/1679601874 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6438160ab0 0x7f6438160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:20.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.465+0000 7f643f3a7700 1 --2- 172.21.2.102:0/1679601874 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6418059d30 0x7f641805c1f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:20.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.465+0000 7f643f3a7700 1 --2- 172.21.2.102:0/1679601874 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f64200044d0 0x7f64381536d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:20.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.465+0000 7f643f3a7700 1 --2- 172.21.2.102:0/1679601874 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f64380b0350 0x7f64380b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:20.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.465+0000 7f643f3a7700 1 -- 172.21.2.102:0/1679601874 >> 172.21.2.102:0/1679601874 conn(0x7f64380bc480 msgr2=0x7f643814cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:20.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.466+0000 7f643f3a7700 1 -- 172.21.2.102:0/1679601874 shutdown_connections 2021-02-12T17:18:20.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:20.466+0000 7f643f3a7700 1 -- 172.21.2.102:0/1679601874 wait complete. 2021-02-12T17:18:20.468 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:18:20.476 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:18:22.368 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:22.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.457+0000 7f856496e700 1 Processor -- start 2021-02-12T17:18:22.459 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.457+0000 7f856496e700 1 -- start start 2021-02-12T17:18:22.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.458+0000 7f856496e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f856014e530 0x7f8560068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.458+0000 7f856496e700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f8560062740 0x7f8560062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.458+0000 7f856496e700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85600b7960 con 0x7f85600b8d20 2021-02-12T17:18:22.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.458+0000 7f856496e700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8560068d20 con 0x7f8560062740 2021-02-12T17:18:22.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.458+0000 7f856496e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85600622a0 con 0x7f856014e530 2021-02-12T17:18:22.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.458+0000 7f855ed9d700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f8560062740 0x7f8560062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:22.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.458+0000 7f855ed9d700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f8560062740 0x7f8560062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45970/0 (socket says 172.21.2.102:45970) 2021-02-12T17:18:22.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.458+0000 7f855ed9d700 1 -- 172.21.2.102:0/1674187427 learned_addr learned my addr 172.21.2.102:0/1674187427 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:22.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.458+0000 7f855ed9d700 1 -- 172.21.2.102:0/1674187427 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f856014e530 msgr2=0x7f8560068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:22.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.459+0000 7f855ed9d700 1 --2- 172.21.2.102:0/1674187427 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f856014e530 0x7f8560068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:22.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.459+0000 7f855ed9d700 1 -- 172.21.2.102:0/1674187427 >> v1:172.21.2.104:6789/0 conn(0x7f85600b8d20 legacy=0x7f85600b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:22.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.459+0000 7f855ed9d700 1 -- 172.21.2.102:0/1674187427 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856014ea10 con 0x7f8560062740 2021-02-12T17:18:22.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.459+0000 7f855ed9d700 1 --2- 172.21.2.102:0/1674187427 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8560062740 0x7f8560062bf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f8558009d50 tx=0x7f8558009290).ready entity=mon.0 client_cookie=95e1258f894faf43 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:22.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.459+0000 7f855d59a700 1 -- 172.21.2.102:0/1674187427 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855800bbb0 con 0x7f8560062740 2021-02-12T17:18:22.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.459+0000 7f855d59a700 1 -- 172.21.2.102:0/1674187427 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855800bd10 con 0x7f8560062740 2021-02-12T17:18:22.461 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.459+0000 7f855d59a700 1 -- 172.21.2.102:0/1674187427 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558011610 con 0x7f8560062740 2021-02-12T17:18:22.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.459+0000 7f856496e700 1 -- 172.21.2.102:0/1674187427 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8560062740 msgr2=0x7f8560062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.459+0000 7f856496e700 1 --2- 172.21.2.102:0/1674187427 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8560062740 0x7f8560062bf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f8558009d50 tx=0x7f8558009290).stop 2021-02-12T17:18:22.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.459+0000 7f856496e700 1 -- 172.21.2.102:0/1674187427 shutdown_connections 2021-02-12T17:18:22.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.459+0000 7f856496e700 1 --2- 172.21.2.102:0/1674187427 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8560062740 0x7f8560062bf0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.459+0000 7f856496e700 1 --2- 172.21.2.102:0/1674187427 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f856014e530 0x7f8560068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:22.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.459+0000 7f856496e700 1 -- 172.21.2.102:0/1674187427 >> 172.21.2.102:0/1674187427 conn(0x7f85600bc480 msgr2=0x7f85600b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:22.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.459+0000 7f856496e700 1 -- 172.21.2.102:0/1674187427 shutdown_connections 2021-02-12T17:18:22.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.460+0000 7f856496e700 1 -- 172.21.2.102:0/1674187427 wait complete. 2021-02-12T17:18:22.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.460+0000 7f856496e700 1 Processor -- start 2021-02-12T17:18:22.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.460+0000 7f856496e700 1 -- start start 2021-02-12T17:18:22.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f856496e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8560062740 0x7f85600ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f856496e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f85600b8d20 0x7f856015dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f856496e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f856014e530 0x7f856015e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f856496e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856015e640 con 0x7f8560062740 2021-02-12T17:18:22.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f856496e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85601515c0 con 0x7f85600b8d20 2021-02-12T17:18:22.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f856496e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8560151860 con 0x7f856014e530 2021-02-12T17:18:22.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f855e59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8560062740 0x7f85600ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:22.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f855e59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8560062740 0x7f85600ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45974/0 (socket says 172.21.2.102:45974) 2021-02-12T17:18:22.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f855e59c700 1 -- 172.21.2.102:0/1425085332 learned_addr learned my addr 172.21.2.102:0/1425085332 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:22.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f855ed9d700 1 --2- 172.21.2.102:0/1425085332 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f856014e530 0x7f856015e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:22.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f855e59c700 1 -- 172.21.2.102:0/1425085332 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f856014e530 msgr2=0x7f856015e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f855e59c700 1 --2- 172.21.2.102:0/1425085332 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f856014e530 0x7f856015e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f855e59c700 1 -- 172.21.2.102:0/1425085332 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f85600b8d20 msgr2=0x7f856015dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f855e59c700 1 --2- 172.21.2.102:0/1425085332 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f85600b8d20 0x7f856015dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:22.465 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.461+0000 7f855e59c700 1 -- 172.21.2.102:0/1425085332 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8560151b00 con 0x7f8560062740 2021-02-12T17:18:22.466 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.462+0000 7f855e59c700 1 --2- 172.21.2.102:0/1425085332 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8560062740 0x7f85600ae760 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f85500096b0 tx=0x7f8550006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:22.466 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.462+0000 7f85567fc700 1 -- 172.21.2.102:0/1425085332 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855000d590 con 0x7f8560062740 2021-02-12T17:18:22.466 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.462+0000 7f85567fc700 1 -- 172.21.2.102:0/1425085332 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855000d710 con 0x7f8560062740 2021-02-12T17:18:22.466 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.462+0000 7f85567fc700 1 -- 172.21.2.102:0/1425085332 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855000dad0 con 0x7f8560062740 2021-02-12T17:18:22.466 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.462+0000 7f856496e700 1 -- 172.21.2.102:0/1425085332 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8560151da0 con 0x7f8560062740 2021-02-12T17:18:22.466 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.462+0000 7f856496e700 1 -- 172.21.2.102:0/1425085332 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85601512b0 con 0x7f8560062740 2021-02-12T17:18:22.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.463+0000 7f856496e700 1 -- 172.21.2.102:0/1425085332 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8560063340 con 0x7f8560062740 2021-02-12T17:18:22.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.463+0000 7f85567fc700 1 -- 172.21.2.102:0/1425085332 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f8550017030 con 0x7f8560062740 2021-02-12T17:18:22.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.463+0000 7f85567fc700 1 --2- 172.21.2.102:0/1425085332 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8544059d80 0x7f854405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.463+0000 7f85567fc700 1 -- 172.21.2.102:0/1425085332 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f8550073010 con 0x7f8560062740 2021-02-12T17:18:22.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.463+0000 7f855dd9b700 1 --2- 172.21.2.102:0/1425085332 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8544059d80 0x7f854405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:22.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.464+0000 7f855dd9b700 1 --2- 172.21.2.102:0/1425085332 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8544059d80 0x7f854405c240 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f8560152130 tx=0x7f85480069d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:22.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.466+0000 7f85567fc700 1 -- 172.21.2.102:0/1425085332 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f8550046860 con 0x7f8560062740 2021-02-12T17:18:22.476 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:22.566 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.565+0000 7f4114194700 1 Processor -- start 2021-02-12T17:18:22.566 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.565+0000 7f4114194700 1 -- start start 2021-02-12T17:18:22.567 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.565+0000 7f4114194700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f410c14e530 0x7f410c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.567 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.565+0000 7f4114194700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f410c062740 0x7f410c062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.567 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.565+0000 7f4114194700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410c0b7960 con 0x7f410c0b8d20 2021-02-12T17:18:22.567 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.565+0000 7f4114194700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410c068d20 con 0x7f410c14e530 2021-02-12T17:18:22.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.565+0000 7f4114194700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c0622a0 con 0x7f410c062740 2021-02-12T17:18:22.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.565+0000 7f4111f30700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f410c0b8d20 0x7f410c0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54628/0 (socket says 172.21.2.102:54628) 2021-02-12T17:18:22.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.565+0000 7f4111f30700 1 -- 172.21.2.102:0/227202741 learned_addr learned my addr 172.21.2.102:0/227202741 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:22.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.566+0000 7f4112731700 1 --2- 172.21.2.102:0/227202741 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f410c062740 0x7f410c062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:22.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.566+0000 7f411172f700 1 --2- 172.21.2.102:0/227202741 >> v2:172.21.2.104:3300/0 conn(0x7f410c14e530 0x7f410c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:22.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.566+0000 7f4110f2e700 1 -- 172.21.2.102:0/227202741 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987124465 0 0) 0x7f410c0b7960 con 0x7f410c0b8d20 2021-02-12T17:18:22.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.566+0000 7f4110f2e700 1 -- 172.21.2.102:0/227202741 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40f4003230 con 0x7f410c0b8d20 2021-02-12T17:18:22.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.566+0000 7f411172f700 1 -- 172.21.2.102:0/227202741 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f410c062740 msgr2=0x7f410c062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:22.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.566+0000 7f411172f700 1 --2- 172.21.2.102:0/227202741 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f410c062740 0x7f410c062bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.566+0000 7f411172f700 1 -- 172.21.2.102:0/227202741 >> v1:172.21.2.102:6789/0 conn(0x7f410c0b8d20 legacy=0x7f410c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.566+0000 7f411172f700 1 -- 172.21.2.102:0/227202741 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c14ea10 con 0x7f410c14e530 2021-02-12T17:18:22.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.566+0000 7f4112731700 1 --2- 172.21.2.102:0/227202741 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f410c062740 0x7f410c062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:18:22.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.567+0000 7f411172f700 1 --2- 172.21.2.102:0/227202741 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f410c14e530 0x7f410c068830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f410800b980 tx=0x7f4108006de0).ready entity=mon.1 client_cookie=58755ba11fd18285 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:22.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.567+0000 7f4110f2e700 1 -- 172.21.2.102:0/227202741 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41080095c0 con 0x7f410c14e530 2021-02-12T17:18:22.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.567+0000 7f4110f2e700 1 -- 172.21.2.102:0/227202741 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4108009720 con 0x7f410c14e530 2021-02-12T17:18:22.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.567+0000 7f4110f2e700 1 -- 172.21.2.102:0/227202741 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108009aa0 con 0x7f410c14e530 2021-02-12T17:18:22.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.567+0000 7f4114194700 1 -- 172.21.2.102:0/227202741 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f410c14e530 msgr2=0x7f410c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.567+0000 7f4114194700 1 --2- 172.21.2.102:0/227202741 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f410c14e530 0x7f410c068830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f410800b980 tx=0x7f4108006de0).stop 2021-02-12T17:18:22.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.567+0000 7f4114194700 1 -- 172.21.2.102:0/227202741 shutdown_connections 2021-02-12T17:18:22.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.567+0000 7f4114194700 1 --2- 172.21.2.102:0/227202741 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f410c062740 0x7f410c062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.567+0000 7f4114194700 1 --2- 172.21.2.102:0/227202741 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f410c14e530 0x7f410c068830 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.567+0000 7f4114194700 1 -- 172.21.2.102:0/227202741 >> 172.21.2.102:0/227202741 conn(0x7f410c0bc480 msgr2=0x7f410c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:22.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.567+0000 7f4114194700 1 -- 172.21.2.102:0/227202741 shutdown_connections 2021-02-12T17:18:22.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.567+0000 7f4114194700 1 -- 172.21.2.102:0/227202741 wait complete. 2021-02-12T17:18:22.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.568+0000 7f4114194700 1 Processor -- start 2021-02-12T17:18:22.571 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.568+0000 7f4114194700 1 -- start start 2021-02-12T17:18:22.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4114194700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f410c062740 0x7f410c14cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4114194700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f410c0b8d20 0x7f410c0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4114194700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f410c14e530 0x7f410c0acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4114194700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c15cfe0 con 0x7f410c14e530 2021-02-12T17:18:22.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4114194700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c15d210 con 0x7f410c0b8d20 2021-02-12T17:18:22.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4114194700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c15d4b0 con 0x7f410c062740 2021-02-12T17:18:22.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4112731700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f410c14e530 0x7f410c0acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:22.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4112731700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f410c14e530 0x7f410c0acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:45990/0 (socket says 172.21.2.102:45990) 2021-02-12T17:18:22.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4112731700 1 -- 172.21.2.102:0/3829538348 learned_addr learned my addr 172.21.2.102:0/3829538348 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:22.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4111f30700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f410c062740 0x7f410c14cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:22.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f411172f700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f410c0b8d20 0x7f410c0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:22.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4112731700 1 -- 172.21.2.102:0/3829538348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f410c062740 msgr2=0x7f410c14cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4112731700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f410c062740 0x7f410c14cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4112731700 1 -- 172.21.2.102:0/3829538348 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f410c0b8d20 msgr2=0x7f410c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4112731700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f410c0b8d20 0x7f410c0ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4112731700 1 -- 172.21.2.102:0/3829538348 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c15d750 con 0x7f410c14e530 2021-02-12T17:18:22.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f411172f700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f410c0b8d20 0x7f410c0ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:18:22.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4111f30700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f410c062740 0x7f410c14cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:18:22.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4112731700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f410c14e530 0x7f410c0acf10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f410400ef20 tx=0x7f41040091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:22.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f40fdffb700 1 -- 172.21.2.102:0/3829538348 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104009820 con 0x7f410c14e530 2021-02-12T17:18:22.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f40fdffb700 1 -- 172.21.2.102:0/3829538348 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410400cda0 con 0x7f410c14e530 2021-02-12T17:18:22.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f4114194700 1 -- 172.21.2.102:0/3829538348 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410c15d9f0 con 0x7f410c14e530 2021-02-12T17:18:22.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.569+0000 7f40fdffb700 1 -- 172.21.2.102:0/3829538348 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104012640 con 0x7f410c14e530 2021-02-12T17:18:22.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.570+0000 7f4114194700 1 -- 172.21.2.102:0/3829538348 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c14d1f0 con 0x7f410c14e530 2021-02-12T17:18:22.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.570+0000 7f4114194700 1 -- 172.21.2.102:0/3829538348 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410c15db80 con 0x7f410c14e530 2021-02-12T17:18:22.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.570+0000 7f40fdffb700 1 -- 172.21.2.102:0/3829538348 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f4104022070 con 0x7f410c14e530 2021-02-12T17:18:22.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.570+0000 7f40fdffb700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f40ec059d30 0x7f40ec05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.571+0000 7f40fdffb700 1 -- 172.21.2.102:0/3829538348 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f4104074670 con 0x7f410c14e530 2021-02-12T17:18:22.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.571+0000 7f4111f30700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f40ec059d30 0x7f40ec05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:22.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.571+0000 7f4111f30700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f40ec059d30 0x7f40ec05c1f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f4100005590 tx=0x7f4100009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:22.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.574+0000 7f40fdffb700 1 -- 172.21.2.102:0/3829538348 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f4104047ea0 con 0x7f410c14e530 2021-02-12T17:18:22.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.633+0000 7f856496e700 1 -- 172.21.2.102:0/1425085332 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85600aed10 con 0x7f8560062740 2021-02-12T17:18:22.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.633+0000 7f85567fc700 1 -- 172.21.2.102:0/1425085332 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7f8550049e80 con 0x7f8560062740 2021-02-12T17:18:22.635 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:22.635 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:22.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.634+0000 7f856496e700 1 -- 172.21.2.102:0/1425085332 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8544059d80 msgr2=0x7f854405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.634+0000 7f856496e700 1 --2- 172.21.2.102:0/1425085332 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8544059d80 0x7f854405c240 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f8560152130 tx=0x7f85480069d0).stop 2021-02-12T17:18:22.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.634+0000 7f856496e700 1 -- 172.21.2.102:0/1425085332 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8560062740 msgr2=0x7f85600ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.634+0000 7f856496e700 1 --2- 172.21.2.102:0/1425085332 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8560062740 0x7f85600ae760 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f85500096b0 tx=0x7f8550006de0).stop 2021-02-12T17:18:22.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.635+0000 7f856496e700 1 -- 172.21.2.102:0/1425085332 shutdown_connections 2021-02-12T17:18:22.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.635+0000 7f856496e700 1 --2- 172.21.2.102:0/1425085332 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f856014e530 0x7f856015e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.635+0000 7f856496e700 1 --2- 172.21.2.102:0/1425085332 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8544059d80 0x7f854405c240 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.635+0000 7f856496e700 1 --2- 172.21.2.102:0/1425085332 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8560062740 0x7f85600ae760 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.635+0000 7f856496e700 1 --2- 172.21.2.102:0/1425085332 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f85600b8d20 0x7f856015dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:22.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.635+0000 7f856496e700 1 -- 172.21.2.102:0/1425085332 >> 172.21.2.102:0/1425085332 conn(0x7f85600bc480 msgr2=0x7f856014cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:22.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.635+0000 7f856496e700 1 -- 172.21.2.102:0/1425085332 shutdown_connections 2021-02-12T17:18:22.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.635+0000 7f856496e700 1 -- 172.21.2.102:0/1425085332 wait complete. 2021-02-12T17:18:22.638 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:18:22.645 INFO:tasks.mds_thrash.fs.[a]:kill mds.c (rank=0) 2021-02-12T17:18:22.645 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-02-12T17:18:22.645 INFO:teuthology.orchestra.run:waiting for 300 2021-02-12T17:18:22.651 INFO:tasks.ceph.mds.c:Stopped 2021-02-12T17:18:22.651 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:22.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.738+0000 7f4114194700 1 -- 172.21.2.102:0/3829538348 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f410c045460 con 0x7f410c14e530 2021-02-12T17:18:22.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.739+0000 7f40fdffb700 1 -- 172.21.2.102:0/3829538348 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7f4104016020 con 0x7f410c14e530 2021-02-12T17:18:22.741 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:22.741 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:22.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.740+0000 7f4114194700 1 -- 172.21.2.102:0/3829538348 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f40ec059d30 msgr2=0x7f40ec05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.740+0000 7f4114194700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f40ec059d30 0x7f40ec05c1f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f4100005590 tx=0x7f4100009040).stop 2021-02-12T17:18:22.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.740+0000 7f4114194700 1 -- 172.21.2.102:0/3829538348 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f410c14e530 msgr2=0x7f410c0acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.740+0000 7f4114194700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f410c14e530 0x7f410c0acf10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f410400ef20 tx=0x7f41040091d0).stop 2021-02-12T17:18:22.743 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.740+0000 7f4114194700 1 -- 172.21.2.102:0/3829538348 shutdown_connections 2021-02-12T17:18:22.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.740+0000 7f4114194700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f40ec059d30 0x7f40ec05c1f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.740+0000 7f4114194700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f410c14e530 0x7f410c0acf10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.740+0000 7f4114194700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f410c062740 0x7f410c14cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.740+0000 7f4114194700 1 --2- 172.21.2.102:0/3829538348 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f410c0b8d20 0x7f410c0ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.740+0000 7f4114194700 1 -- 172.21.2.102:0/3829538348 >> 172.21.2.102:0/3829538348 conn(0x7f410c0bc480 msgr2=0x7f410c1519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:22.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.740+0000 7f4114194700 1 -- 172.21.2.102:0/3829538348 shutdown_connections 2021-02-12T17:18:22.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.740+0000 7f4114194700 1 -- 172.21.2.102:0/3829538348 wait complete. 2021-02-12T17:18:22.745 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:18:22.750 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:18:22.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.777+0000 7f52265c8700 1 Processor -- start 2021-02-12T17:18:22.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.777+0000 7f52265c8700 1 -- start start 2021-02-12T17:18:22.781 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f52265c8700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f52200b8d20 0x7f5220068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f52265c8700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f522014e530 0x7f52200b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f52265c8700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52200622a0 con 0x7f5220062740 2021-02-12T17:18:22.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f52265c8700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5220068d20 con 0x7f52200b8d20 2021-02-12T17:18:22.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f52265c8700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522014ea10 con 0x7f522014e530 2021-02-12T17:18:22.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f5224b65700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f5220062740 0x7f5220062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54640/0 (socket says 172.21.2.102:54640) 2021-02-12T17:18:22.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f5224b65700 1 -- 172.21.2.102:0/3097662105 learned_addr learned my addr 172.21.2.102:0/3097662105 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:22.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f521effd700 1 -- 172.21.2.102:0/3097662105 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545131630 0 0) 0x7f52200622a0 con 0x7f5220062740 2021-02-12T17:18:22.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f521effd700 1 -- 172.21.2.102:0/3097662105 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f520c003230 con 0x7f5220062740 2021-02-12T17:18:22.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f521ffff700 1 --2- 172.21.2.102:0/3097662105 >> v2:172.21.2.104:3300/0 conn(0x7f52200b8d20 0x7f5220068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:22.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f521effd700 1 -- 172.21.2.102:0/3097662105 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 803389921 0 0) 0x7f520c003230 con 0x7f5220062740 2021-02-12T17:18:22.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f521effd700 1 -- 172.21.2.102:0/3097662105 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f522014e530 msgr2=0x7f52200b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:22.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f521effd700 1 --2- 172.21.2.102:0/3097662105 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f522014e530 0x7f52200b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:22.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f521effd700 1 -- 172.21.2.102:0/3097662105 >> v2:172.21.2.104:3300/0 conn(0x7f52200b8d20 msgr2=0x7f5220068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:22.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f521effd700 1 --2- 172.21.2.102:0/3097662105 >> v2:172.21.2.104:3300/0 conn(0x7f52200b8d20 0x7f5220068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f521effd700 1 -- 172.21.2.102:0/3097662105 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200b63f0 con 0x7f5220062740 2021-02-12T17:18:22.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f521effd700 1 -- 172.21.2.102:0/3097662105 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f5218001860 con 0x7f5220062740 2021-02-12T17:18:22.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f521effd700 1 -- 172.21.2.102:0/3097662105 >> v1:172.21.2.102:6789/0 conn(0x7f5220062740 legacy=0x7f5220062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.778+0000 7f521effd700 1 --2- 172.21.2.102:0/3097662105 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f520c003720 0x7f520c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f521effd700 1 --2- 172.21.2.102:0/3097662105 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f522014e530 0x7f520c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f521effd700 1 --2- 172.21.2.102:0/3097662105 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f520c0049c0 0x7f520c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f521effd700 1 -- 172.21.2.102:0/3097662105 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5220068d20 con 0x7f520c0049c0 2021-02-12T17:18:22.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f521effd700 1 -- 172.21.2.102:0/3097662105 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522014ea10 con 0x7f520c003720 2021-02-12T17:18:22.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f521effd700 1 -- 172.21.2.102:0/3097662105 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0041c0 con 0x7f522014e530 2021-02-12T17:18:22.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f5224b65700 1 --2- 172.21.2.102:0/3097662105 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f520c0049c0 0x7f520c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:22.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f5224b65700 1 -- 172.21.2.102:0/3097662105 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f522014e530 msgr2=0x7f520c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:22.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f5224b65700 1 --2- 172.21.2.102:0/3097662105 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f522014e530 0x7f520c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:22.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f5224b65700 1 -- 172.21.2.102:0/3097662105 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f520c003720 msgr2=0x7f520c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:22.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f5224b65700 1 --2- 172.21.2.102:0/3097662105 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f520c003720 0x7f520c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:22.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f5224b65700 1 -- 172.21.2.102:0/3097662105 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c003230 con 0x7f520c0049c0 2021-02-12T17:18:22.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f5224b65700 1 --2- 172.21.2.102:0/3097662105 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f520c0049c0 0x7f520c004e40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f521800c840 tx=0x7f52200b6580).ready entity=mon.0 client_cookie=f6fd019cdcf99dde server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:22.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f521effd700 1 -- 172.21.2.102:0/3097662105 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218005b70 con 0x7f520c0049c0 2021-02-12T17:18:22.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f521effd700 1 -- 172.21.2.102:0/3097662105 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5218005cd0 con 0x7f520c0049c0 2021-02-12T17:18:22.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f521effd700 1 -- 172.21.2.102:0/3097662105 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218007320 con 0x7f520c0049c0 2021-02-12T17:18:22.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f52265c8700 1 -- 172.21.2.102:0/3097662105 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f520c0049c0 msgr2=0x7f520c004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f52265c8700 1 --2- 172.21.2.102:0/3097662105 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f520c0049c0 0x7f520c004e40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f521800c840 tx=0x7f52200b6580).stop 2021-02-12T17:18:22.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f5224b65700 1 -- 172.21.2.102:0/3097662105 reap_dead start 2021-02-12T17:18:22.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f52265c8700 1 -- 172.21.2.102:0/3097662105 shutdown_connections 2021-02-12T17:18:22.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f52265c8700 1 -- 172.21.2.102:0/3097662105 >> 172.21.2.102:0/3097662105 conn(0x7f52200bc480 msgr2=0x7f52200b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:22.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.779+0000 7f52265c8700 1 -- 172.21.2.102:0/3097662105 shutdown_connections 2021-02-12T17:18:22.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.780+0000 7f52265c8700 1 -- 172.21.2.102:0/3097662105 wait complete. 2021-02-12T17:18:22.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.780+0000 7f52265c8700 1 Processor -- start 2021-02-12T17:18:22.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.780+0000 7f52265c8700 1 -- start start 2021-02-12T17:18:22.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f52265c8700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f52201524b0 0x7f52200ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f52265c8700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f52200ada30 0x7f522014abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f52265c8700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f522014b0a0 0x7f5220160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f52265c8700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52200b4510 con 0x7f52200ada30 2021-02-12T17:18:22.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f52265c8700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52200b53d0 con 0x7f52201524b0 2021-02-12T17:18:22.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f52265c8700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52200adeb0 con 0x7f522014b0a0 2021-02-12T17:18:22.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f521f7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f52200ada30 0x7f522014abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:22.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f521f7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f52200ada30 0x7f522014abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46010/0 (socket says 172.21.2.102:46010) 2021-02-12T17:18:22.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f521f7fe700 1 -- 172.21.2.102:0/786489941 learned_addr learned my addr 172.21.2.102:0/786489941 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:22.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f521f7fe700 1 -- 172.21.2.102:0/786489941 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f522014b0a0 msgr2=0x7f5220160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f521f7fe700 1 --2- 172.21.2.102:0/786489941 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f522014b0a0 0x7f5220160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:22.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f521f7fe700 1 -- 172.21.2.102:0/786489941 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f52201524b0 msgr2=0x7f52200ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f521f7fe700 1 --2- 172.21.2.102:0/786489941 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f52201524b0 0x7f52200ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:22.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f521f7fe700 1 -- 172.21.2.102:0/786489941 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200afdb0 con 0x7f52200ada30 2021-02-12T17:18:22.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f521f7fe700 1 --2- 172.21.2.102:0/786489941 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f52200ada30 0x7f522014abb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f5210009740 tx=0x7f5210006e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:22.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f5207fff700 1 -- 172.21.2.102:0/786489941 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521000d580 con 0x7f52200ada30 2021-02-12T17:18:22.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f5207fff700 1 -- 172.21.2.102:0/786489941 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521000d6e0 con 0x7f52200ada30 2021-02-12T17:18:22.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f52265c8700 1 -- 172.21.2.102:0/786489941 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52200b4d40 con 0x7f52200ada30 2021-02-12T17:18:22.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.781+0000 7f5207fff700 1 -- 172.21.2.102:0/786489941 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521000da80 con 0x7f52200ada30 2021-02-12T17:18:22.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.782+0000 7f52265c8700 1 -- 172.21.2.102:0/786489941 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52200b5130 con 0x7f52200ada30 2021-02-12T17:18:22.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.782+0000 7f52265c8700 1 -- 172.21.2.102:0/786489941 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5220045460 con 0x7f52200ada30 2021-02-12T17:18:22.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.782+0000 7f5207fff700 1 -- 172.21.2.102:0/786489941 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f5210010440 con 0x7f52200ada30 2021-02-12T17:18:22.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.782+0000 7f5207fff700 1 --2- 172.21.2.102:0/786489941 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5200059d30 0x7f520005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:22.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.783+0000 7f5207fff700 1 -- 172.21.2.102:0/786489941 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f5210073ab0 con 0x7f52200ada30 2021-02-12T17:18:22.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.783+0000 7f521ffff700 1 --2- 172.21.2.102:0/786489941 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5200059d30 0x7f520005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:22.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.783+0000 7f521ffff700 1 --2- 172.21.2.102:0/786489941 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5200059d30 0x7f520005c1f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f5214006fd0 tx=0x7f5214008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:22.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.785+0000 7f5207fff700 1 -- 172.21.2.102:0/786489941 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f5210047330 con 0x7f52200ada30 2021-02-12T17:18:22.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.944+0000 7f52265c8700 1 -- 172.21.2.102:0/786489941 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5220068b00 con 0x7f52200ada30 2021-02-12T17:18:22.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.944+0000 7f5207fff700 1 -- 172.21.2.102:0/786489941 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7f521004a950 con 0x7f52200ada30 2021-02-12T17:18:22.946 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:22.946 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:22.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.945+0000 7f52265c8700 1 -- 172.21.2.102:0/786489941 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5200059d30 msgr2=0x7f520005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.945+0000 7f52265c8700 1 --2- 172.21.2.102:0/786489941 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5200059d30 0x7f520005c1f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f5214006fd0 tx=0x7f5214008040).stop 2021-02-12T17:18:22.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.945+0000 7f52265c8700 1 -- 172.21.2.102:0/786489941 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f52200ada30 msgr2=0x7f522014abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:22.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.945+0000 7f52265c8700 1 --2- 172.21.2.102:0/786489941 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f52200ada30 0x7f522014abb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f5210009740 tx=0x7f5210006e60).stop 2021-02-12T17:18:22.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.945+0000 7f52265c8700 1 -- 172.21.2.102:0/786489941 shutdown_connections 2021-02-12T17:18:22.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.945+0000 7f52265c8700 1 --2- 172.21.2.102:0/786489941 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f522014b0a0 0x7f5220160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:22.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.945+0000 7f52265c8700 1 --2- 172.21.2.102:0/786489941 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f52201524b0 0x7f52200ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:22.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.945+0000 7f52265c8700 1 --2- 172.21.2.102:0/786489941 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5200059d30 0x7f520005c1f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.945+0000 7f52265c8700 1 --2- 172.21.2.102:0/786489941 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f52200ada30 0x7f522014abb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:22.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.945+0000 7f52265c8700 1 -- 172.21.2.102:0/786489941 >> 172.21.2.102:0/786489941 conn(0x7f52200bc480 msgr2=0x7f522014d070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:22.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.945+0000 7f52265c8700 1 -- 172.21.2.102:0/786489941 shutdown_connections 2021-02-12T17:18:22.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:22.946+0000 7f52265c8700 1 -- 172.21.2.102:0/786489941 wait complete. 2021-02-12T17:18:22.948 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:18:22.956 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:18:24.752 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:24.841 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.840+0000 7f0bf974c700 1 Processor -- start 2021-02-12T17:18:24.842 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.840+0000 7f0bf974c700 1 -- start start 2021-02-12T17:18:24.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.841+0000 7f0bf974c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0bf414e530 0x7f0bf4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:24.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.841+0000 7f0bf974c700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f0bf4062740 0x7f0bf4062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:24.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.841+0000 7f0bf974c700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf40b7960 con 0x7f0bf40b8d20 2021-02-12T17:18:24.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.841+0000 7f0bf974c700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf4068d20 con 0x7f0bf4062740 2021-02-12T17:18:24.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.841+0000 7f0bf974c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf40622a0 con 0x7f0bf414e530 2021-02-12T17:18:24.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.841+0000 7f0bf2ffd700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f0bf40b8d20 0x7f0bf40b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54666/0 (socket says 172.21.2.102:54666) 2021-02-12T17:18:24.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.841+0000 7f0bf2ffd700 1 -- 172.21.2.102:0/3971546837 learned_addr learned my addr 172.21.2.102:0/3971546837 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:24.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.841+0000 7f0bf1ffb700 1 -- 172.21.2.102:0/3971546837 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187630122 0 0) 0x7f0bf40b7960 con 0x7f0bf40b8d20 2021-02-12T17:18:24.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.841+0000 7f0bf1ffb700 1 -- 172.21.2.102:0/3971546837 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bd4003230 con 0x7f0bf40b8d20 2021-02-12T17:18:24.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.841+0000 7f0bf27fc700 1 --2- 172.21.2.102:0/3971546837 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0bf414e530 0x7f0bf4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:24.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.841+0000 7f0bf37fe700 1 --2- 172.21.2.102:0/3971546837 >> v2:172.21.2.104:3300/0 conn(0x7f0bf4062740 0x7f0bf4062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:24.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 -- 172.21.2.102:0/3971546837 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 489949339 0 0) 0x7f0bd4003230 con 0x7f0bf40b8d20 2021-02-12T17:18:24.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 -- 172.21.2.102:0/3971546837 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0bf414e530 msgr2=0x7f0bf4068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:24.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 --2- 172.21.2.102:0/3971546837 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0bf414e530 0x7f0bf4068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:24.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 -- 172.21.2.102:0/3971546837 >> v2:172.21.2.104:3300/0 conn(0x7f0bf4062740 msgr2=0x7f0bf4062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:24.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 --2- 172.21.2.102:0/3971546837 >> v2:172.21.2.104:3300/0 conn(0x7f0bf4062740 0x7f0bf4062bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:24.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 -- 172.21.2.102:0/3971546837 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf414ea10 con 0x7f0bf40b8d20 2021-02-12T17:18:24.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 -- 172.21.2.102:0/3971546837 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f0be40014e0 con 0x7f0bf40b8d20 2021-02-12T17:18:24.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 -- 172.21.2.102:0/3971546837 >> v1:172.21.2.102:6789/0 conn(0x7f0bf40b8d20 legacy=0x7f0bf40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:24.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 --2- 172.21.2.102:0/3971546837 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0bd4003720 0x7f0bd4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:24.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 --2- 172.21.2.102:0/3971546837 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0bd40044d0 0x7f0bd4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:24.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 --2- 172.21.2.102:0/3971546837 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0bf414e530 0x7f0bd4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:24.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 -- 172.21.2.102:0/3971546837 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf4068d20 con 0x7f0bd4003720 2021-02-12T17:18:24.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 -- 172.21.2.102:0/3971546837 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf40622a0 con 0x7f0bd40044d0 2021-02-12T17:18:24.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 -- 172.21.2.102:0/3971546837 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd4004260 con 0x7f0bf414e530 2021-02-12T17:18:24.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf2ffd700 1 --2- 172.21.2.102:0/3971546837 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0bd4003720 0x7f0bd4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:24.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf27fc700 1 --2- 172.21.2.102:0/3971546837 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0bd40044d0 0x7f0bd4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:24.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf37fe700 1 --2- 172.21.2.102:0/3971546837 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0bf414e530 0x7f0bd4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:24.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf2ffd700 1 -- 172.21.2.102:0/3971546837 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0bf414e530 msgr2=0x7f0bd4004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:24.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf2ffd700 1 --2- 172.21.2.102:0/3971546837 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0bf414e530 0x7f0bd4004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:24.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf2ffd700 1 -- 172.21.2.102:0/3971546837 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0bd40044d0 msgr2=0x7f0bd4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:24.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf2ffd700 1 --2- 172.21.2.102:0/3971546837 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0bd40044d0 0x7f0bd4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:24.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf2ffd700 1 -- 172.21.2.102:0/3971546837 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd4003230 con 0x7f0bd4003720 2021-02-12T17:18:24.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf27fc700 1 --2- 172.21.2.102:0/3971546837 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0bd40044d0 0x7f0bd4004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:18:24.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf2ffd700 1 --2- 172.21.2.102:0/3971546837 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0bd4003720 0x7f0bd4003b40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f0be400c440 tx=0x7f0bf414eba0).ready entity=mon.0 client_cookie=3256b5a86c067324 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:24.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 -- 172.21.2.102:0/3971546837 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400ce20 con 0x7f0bd4003720 2021-02-12T17:18:24.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 -- 172.21.2.102:0/3971546837 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be40072e0 con 0x7f0bd4003720 2021-02-12T17:18:24.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.842+0000 7f0bf1ffb700 1 -- 172.21.2.102:0/3971546837 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4005810 con 0x7f0bd4003720 2021-02-12T17:18:24.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.843+0000 7f0bf974c700 1 -- 172.21.2.102:0/3971546837 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0bd4003720 msgr2=0x7f0bd4003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:24.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.843+0000 7f0bf974c700 1 --2- 172.21.2.102:0/3971546837 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0bd4003720 0x7f0bd4003b40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f0be400c440 tx=0x7f0bf414eba0).stop 2021-02-12T17:18:24.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.843+0000 7f0bf37fe700 1 -- 172.21.2.102:0/3971546837 reap_dead start 2021-02-12T17:18:24.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.843+0000 7f0bf974c700 1 -- 172.21.2.102:0/3971546837 shutdown_connections 2021-02-12T17:18:24.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.843+0000 7f0bf974c700 1 -- 172.21.2.102:0/3971546837 >> 172.21.2.102:0/3971546837 conn(0x7f0bf40bc480 msgr2=0x7f0bf40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:24.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.843+0000 7f0bf974c700 1 -- 172.21.2.102:0/3971546837 shutdown_connections 2021-02-12T17:18:24.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.843+0000 7f0bf974c700 1 -- 172.21.2.102:0/3971546837 wait complete. 2021-02-12T17:18:24.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.844+0000 7f0bf974c700 1 Processor -- start 2021-02-12T17:18:24.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.844+0000 7f0bf974c700 1 -- start start 2021-02-12T17:18:24.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf974c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0bd4003720 0x7f0bf4150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:24.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf974c700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0bf415dc80 0x7f0bf4160830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:24.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf974c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0bf414b8a0 0x7f0bf414bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:24.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf974c700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf414f770 con 0x7f0bd4003720 2021-02-12T17:18:24.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf974c700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf414fa10 con 0x7f0bf415dc80 2021-02-12T17:18:24.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf974c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf415d540 con 0x7f0bf414b8a0 2021-02-12T17:18:24.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf2ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0bd4003720 0x7f0bf4150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:24.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf2ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0bd4003720 0x7f0bf4150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46036/0 (socket says 172.21.2.102:46036) 2021-02-12T17:18:24.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf2ffd700 1 -- 172.21.2.102:0/2351092709 learned_addr learned my addr 172.21.2.102:0/2351092709 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:24.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf27fc700 1 --2- 172.21.2.102:0/2351092709 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0bf415dc80 0x7f0bf4160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:24.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf37fe700 1 --2- 172.21.2.102:0/2351092709 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0bf414b8a0 0x7f0bf414bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:24.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf2ffd700 1 -- 172.21.2.102:0/2351092709 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0bf414b8a0 msgr2=0x7f0bf414bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:24.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf2ffd700 1 --2- 172.21.2.102:0/2351092709 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0bf414b8a0 0x7f0bf414bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:24.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf2ffd700 1 -- 172.21.2.102:0/2351092709 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0bf415dc80 msgr2=0x7f0bf4160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:24.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf2ffd700 1 --2- 172.21.2.102:0/2351092709 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0bf415dc80 0x7f0bf4160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:24.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf2ffd700 1 -- 172.21.2.102:0/2351092709 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf415d7e0 con 0x7f0bd4003720 2021-02-12T17:18:24.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf2ffd700 1 --2- 172.21.2.102:0/2351092709 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0bd4003720 0x7f0bf4150680 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f0bd4005350 tx=0x7f0be4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:24.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0beaffd700 1 -- 172.21.2.102:0/2351092709 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40015f0 con 0x7f0bd4003720 2021-02-12T17:18:24.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0beaffd700 1 -- 172.21.2.102:0/2351092709 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be4001750 con 0x7f0bd4003720 2021-02-12T17:18:24.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf974c700 1 -- 172.21.2.102:0/2351092709 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf40b0170 con 0x7f0bd4003720 2021-02-12T17:18:24.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0beaffd700 1 -- 172.21.2.102:0/2351092709 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4013680 con 0x7f0bd4003720 2021-02-12T17:18:24.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.845+0000 7f0bf974c700 1 -- 172.21.2.102:0/2351092709 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf414f460 con 0x7f0bd4003720 2021-02-12T17:18:24.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.846+0000 7f0bf974c700 1 -- 172.21.2.102:0/2351092709 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf4045460 con 0x7f0bd4003720 2021-02-12T17:18:24.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.846+0000 7f0beaffd700 1 -- 172.21.2.102:0/2351092709 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f0be401d070 con 0x7f0bd4003720 2021-02-12T17:18:24.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.847+0000 7f0beaffd700 1 --2- 172.21.2.102:0/2351092709 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0bd8059d30 0x7f0bd805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:24.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.847+0000 7f0beaffd700 1 -- 172.21.2.102:0/2351092709 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f0be4074cc0 con 0x7f0bd4003720 2021-02-12T17:18:24.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.847+0000 7f0bf27fc700 1 --2- 172.21.2.102:0/2351092709 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0bd8059d30 0x7f0bd805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:24.854 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.847+0000 7f0bf27fc700 1 --2- 172.21.2.102:0/2351092709 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0bd8059d30 0x7f0bd805c1f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0bf4150da0 tx=0x7f0bdc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:24.854 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:24.850+0000 7f0beaffd700 1 -- 172.21.2.102:0/2351092709 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f0be40484f0 con 0x7f0bd4003720 2021-02-12T17:18:24.957 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:25.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.015+0000 7f0bf974c700 1 -- 172.21.2.102:0/2351092709 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bf4064100 con 0x7f0bd4003720 2021-02-12T17:18:25.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.015+0000 7f0beaffd700 1 -- 172.21.2.102:0/2351092709 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7f0be401a030 con 0x7f0bd4003720 2021-02-12T17:18:25.017 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:25.017 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:25.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.017+0000 7f0bf974c700 1 -- 172.21.2.102:0/2351092709 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0bd8059d30 msgr2=0x7f0bd805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:25.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.017+0000 7f0bf974c700 1 --2- 172.21.2.102:0/2351092709 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0bd8059d30 0x7f0bd805c1f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0bf4150da0 tx=0x7f0bdc008040).stop 2021-02-12T17:18:25.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.017+0000 7f0bf974c700 1 -- 172.21.2.102:0/2351092709 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0bd4003720 msgr2=0x7f0bf4150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:25.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.017+0000 7f0bf974c700 1 --2- 172.21.2.102:0/2351092709 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0bd4003720 0x7f0bf4150680 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f0bd4005350 tx=0x7f0be4015000).stop 2021-02-12T17:18:25.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.017+0000 7f0bf974c700 1 -- 172.21.2.102:0/2351092709 shutdown_connections 2021-02-12T17:18:25.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.017+0000 7f0bf974c700 1 --2- 172.21.2.102:0/2351092709 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0bf414b8a0 0x7f0bf414bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:25.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.017+0000 7f0bf974c700 1 --2- 172.21.2.102:0/2351092709 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0bd8059d30 0x7f0bd805c1f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:25.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.017+0000 7f0bf974c700 1 --2- 172.21.2.102:0/2351092709 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0bd4003720 0x7f0bf4150680 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:25.019 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.017+0000 7f0bf974c700 1 --2- 172.21.2.102:0/2351092709 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0bf415dc80 0x7f0bf4160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:25.019 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.017+0000 7f0bf974c700 1 -- 172.21.2.102:0/2351092709 >> 172.21.2.102:0/2351092709 conn(0x7f0bf40bc480 msgr2=0x7f0bf40b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:25.019 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.017+0000 7f0bf974c700 1 -- 172.21.2.102:0/2351092709 shutdown_connections 2021-02-12T17:18:25.019 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.017+0000 7f0bf974c700 1 -- 172.21.2.102:0/2351092709 wait complete. 2021-02-12T17:18:25.019 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:18:25.027 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:18:25.047 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.046+0000 7fe8b9ab4700 1 Processor -- start 2021-02-12T17:18:25.047 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.046+0000 7fe8b9ab4700 1 -- start start 2021-02-12T17:18:25.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.046+0000 7fe8b9ab4700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe8b414e530 0x7fe8b4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:25.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.046+0000 7fe8b9ab4700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b4062740 0x7fe8b4062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:25.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.046+0000 7fe8b9ab4700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b40b7960 con 0x7fe8b40b8d20 2021-02-12T17:18:25.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.046+0000 7fe8b9ab4700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b4068d20 con 0x7fe8b414e530 2021-02-12T17:18:25.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.046+0000 7fe8b9ab4700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b40622a0 con 0x7fe8b4062740 2021-02-12T17:18:25.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.047+0000 7fe8b2ffd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe8b414e530 0x7fe8b4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:25.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.047+0000 7fe8b2ffd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe8b414e530 0x7fe8b4068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46046/0 (socket says 172.21.2.102:46046) 2021-02-12T17:18:25.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.047+0000 7fe8b2ffd700 1 -- 172.21.2.102:0/3952229640 learned_addr learned my addr 172.21.2.102:0/3952229640 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:25.049 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.047+0000 7fe8b2ffd700 1 -- 172.21.2.102:0/3952229640 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b4062740 msgr2=0x7fe8b4062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:25.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.047+0000 7fe8b2ffd700 1 --2- 172.21.2.102:0/3952229640 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b4062740 0x7fe8b4062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:25.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.047+0000 7fe8b2ffd700 1 -- 172.21.2.102:0/3952229640 >> v1:172.21.2.104:6789/0 conn(0x7fe8b40b8d20 legacy=0x7fe8b40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:25.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.047+0000 7fe8b2ffd700 1 -- 172.21.2.102:0/3952229640 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b414ea10 con 0x7fe8b414e530 2021-02-12T17:18:25.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.047+0000 7fe8b2ffd700 1 --2- 172.21.2.102:0/3952229640 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b414e530 0x7fe8b4068830 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fe8a400b9e0 tx=0x7fe8a4006ea0).ready entity=mon.0 client_cookie=c6bcc15609824134 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:25.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.047+0000 7fe8b27fc700 1 -- 172.21.2.102:0/3952229640 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4009800 con 0x7fe8b414e530 2021-02-12T17:18:25.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.047+0000 7fe8b27fc700 1 -- 172.21.2.102:0/3952229640 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a4009960 con 0x7fe8b414e530 2021-02-12T17:18:25.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.047+0000 7fe8b27fc700 1 -- 172.21.2.102:0/3952229640 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4009ce0 con 0x7fe8b414e530 2021-02-12T17:18:25.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.048+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3952229640 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b414e530 msgr2=0x7fe8b4068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:25.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.048+0000 7fe8b9ab4700 1 --2- 172.21.2.102:0/3952229640 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b414e530 0x7fe8b4068830 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fe8a400b9e0 tx=0x7fe8a4006ea0).stop 2021-02-12T17:18:25.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.048+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3952229640 shutdown_connections 2021-02-12T17:18:25.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.048+0000 7fe8b9ab4700 1 --2- 172.21.2.102:0/3952229640 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b4062740 0x7fe8b4062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:25.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.048+0000 7fe8b9ab4700 1 --2- 172.21.2.102:0/3952229640 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b414e530 0x7fe8b4068830 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:25.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.048+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3952229640 >> 172.21.2.102:0/3952229640 conn(0x7fe8b40bc480 msgr2=0x7fe8b40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:25.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.048+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3952229640 shutdown_connections 2021-02-12T17:18:25.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.048+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3952229640 wait complete. 2021-02-12T17:18:25.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.049+0000 7fe8b9ab4700 1 Processor -- start 2021-02-12T17:18:25.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.049+0000 7fe8b9ab4700 1 -- start start 2021-02-12T17:18:25.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.049+0000 7fe8b9ab4700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b4062740 0x7fe8b4151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:25.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.049+0000 7fe8b9ab4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b40b8d20 0x7fe8b40ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:25.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b9ab4700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 0x7fe8b40ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:25.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b9ab4700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b40b1c70 con 0x7fe8b40b8d20 2021-02-12T17:18:25.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b9ab4700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b40aee90 con 0x7fe8b4062740 2021-02-12T17:18:25.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b9ab4700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b4160cd0 con 0x7fe8b414e530 2021-02-12T17:18:25.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b2ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b40b8d20 0x7fe8b40ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:25.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b2ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b40b8d20 0x7fe8b40ae4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46050/0 (socket says 172.21.2.102:46050) 2021-02-12T17:18:25.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b2ffd700 1 -- 172.21.2.102:0/3218087777 learned_addr learned my addr 172.21.2.102:0/3218087777 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:25.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b2ffd700 1 -- 172.21.2.102:0/3218087777 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 msgr2=0x7fe8b40ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:25.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b2ffd700 1 --2- 172.21.2.102:0/3218087777 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 0x7fe8b40ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:25.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b2ffd700 1 -- 172.21.2.102:0/3218087777 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b4062740 msgr2=0x7fe8b4151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:25.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b37fe700 1 --2- 172.21.2.102:0/3218087777 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b4062740 0x7fe8b4151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:25.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b2ffd700 1 --2- 172.21.2.102:0/3218087777 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b4062740 0x7fe8b4151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:25.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b2ffd700 1 -- 172.21.2.102:0/3218087777 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4160f30 con 0x7fe8b40b8d20 2021-02-12T17:18:25.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b37fe700 1 --2- 172.21.2.102:0/3218087777 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b4062740 0x7fe8b4151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:18:25.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b2ffd700 1 --2- 172.21.2.102:0/3218087777 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b40b8d20 0x7fe8b40ae4b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fe8a4007fd0 tx=0x7fe8a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:25.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8ab7fe700 1 -- 172.21.2.102:0/3218087777 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4011e30 con 0x7fe8b40b8d20 2021-02-12T17:18:25.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8ab7fe700 1 -- 172.21.2.102:0/3218087777 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a401c420 con 0x7fe8b40b8d20 2021-02-12T17:18:25.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3218087777 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b41611d0 con 0x7fe8b40b8d20 2021-02-12T17:18:25.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8ab7fe700 1 -- 172.21.2.102:0/3218087777 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a401c7a0 con 0x7fe8b40b8d20 2021-02-12T17:18:25.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.050+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3218087777 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b4151b00 con 0x7fe8b40b8d20 2021-02-12T17:18:25.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.051+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3218087777 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b4161ad0 con 0x7fe8b40b8d20 2021-02-12T17:18:25.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.051+0000 7fe8ab7fe700 1 -- 172.21.2.102:0/3218087777 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fe8a400f070 con 0x7fe8b40b8d20 2021-02-12T17:18:25.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.051+0000 7fe8ab7fe700 1 --2- 172.21.2.102:0/3218087777 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe898059d30 0x7fe89805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:25.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.051+0000 7fe8ab7fe700 1 -- 172.21.2.102:0/3218087777 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fe8a4075510 con 0x7fe8b40b8d20 2021-02-12T17:18:25.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.052+0000 7fe8b37fe700 1 --2- 172.21.2.102:0/3218087777 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe898059d30 0x7fe89805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:25.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.052+0000 7fe8b37fe700 1 --2- 172.21.2.102:0/3218087777 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe898059d30 0x7fe89805c1f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe89c00a6d0 tx=0x7fe89c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:25.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.054+0000 7fe8ab7fe700 1 -- 172.21.2.102:0/3218087777 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fe8a4048c30 con 0x7fe8b40b8d20 2021-02-12T17:18:25.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.211+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3218087777 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8b41618d0 con 0x7fe8b40b8d20 2021-02-12T17:18:25.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.212+0000 7fe8ab7fe700 1 -- 172.21.2.102:0/3218087777 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+3749 (secure 0 0 0) 0x7fe8a404c250 con 0x7fe8b40b8d20 2021-02-12T17:18:25.213 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:25.214 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:16:10.537197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.2.102:6836/958899114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":958899114},{"type":"v1","addr":"172.21.2.102:6836","nonce":958899114}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:25.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.213+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3218087777 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe898059d30 msgr2=0x7fe89805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:25.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.213+0000 7fe8b9ab4700 1 --2- 172.21.2.102:0/3218087777 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe898059d30 0x7fe89805c1f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe89c00a6d0 tx=0x7fe89c008040).stop 2021-02-12T17:18:25.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.213+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3218087777 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b40b8d20 msgr2=0x7fe8b40ae4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:25.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.213+0000 7fe8b9ab4700 1 --2- 172.21.2.102:0/3218087777 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b40b8d20 0x7fe8b40ae4b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fe8a4007fd0 tx=0x7fe8a4016000).stop 2021-02-12T17:18:25.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.213+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3218087777 shutdown_connections 2021-02-12T17:18:25.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.213+0000 7fe8b9ab4700 1 --2- 172.21.2.102:0/3218087777 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 0x7fe8b40ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:25.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.213+0000 7fe8b9ab4700 1 --2- 172.21.2.102:0/3218087777 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b4062740 0x7fe8b4151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:25.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.213+0000 7fe8b9ab4700 1 --2- 172.21.2.102:0/3218087777 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe898059d30 0x7fe89805c1f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:25.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.213+0000 7fe8b9ab4700 1 --2- 172.21.2.102:0/3218087777 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b40b8d20 0x7fe8b40ae4b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:25.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.213+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3218087777 >> 172.21.2.102:0/3218087777 conn(0x7fe8b40bc480 msgr2=0x7fe8b414faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:25.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.214+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3218087777 shutdown_connections 2021-02-12T17:18:25.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:25.214+0000 7fe8b9ab4700 1 -- 172.21.2.102:0/3218087777 wait complete. 2021-02-12T17:18:25.216 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 10 2021-02-12T17:18:25.223 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:18:27.027 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:27.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.116+0000 7f7e1a872700 1 Processor -- start 2021-02-12T17:18:27.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.116+0000 7f7e1a872700 1 -- start start 2021-02-12T17:18:27.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.116+0000 7f7e1a872700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f7e140b8d20 0x7f7e14068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.116+0000 7f7e1a872700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e140b7960 con 0x7f7e14062740 2021-02-12T17:18:27.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.116+0000 7f7e1a872700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e140622a0 con 0x7f7e1414e530 2021-02-12T17:18:27.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.116+0000 7f7e1a872700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e14068d20 con 0x7f7e140b8d20 2021-02-12T17:18:27.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.117+0000 7f7e18e0f700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f7e14062740 0x7f7e14062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54702/0 (socket says 172.21.2.102:54702) 2021-02-12T17:18:27.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.117+0000 7f7e18e0f700 1 -- 172.21.2.102:0/1710429421 learned_addr learned my addr 172.21.2.102:0/1710429421 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:27.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.117+0000 7f7e13fff700 1 --2- 172.21.2.102:0/1710429421 >> v2:172.21.2.104:3300/0 conn(0x7f7e140b8d20 0x7f7e14068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.117+0000 7f7e12ffd700 1 -- 172.21.2.102:0/1710429421 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489667128 0 0) 0x7f7e140b7960 con 0x7f7e14062740 2021-02-12T17:18:27.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.117+0000 7f7e12ffd700 1 -- 172.21.2.102:0/1710429421 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df4003230 con 0x7f7e14062740 2021-02-12T17:18:27.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.117+0000 7f7e12ffd700 1 -- 172.21.2.102:0/1710429421 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 345023609 0 0) 0x7f7df4003230 con 0x7f7e14062740 2021-02-12T17:18:27.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.117+0000 7f7e12ffd700 1 -- 172.21.2.102:0/1710429421 >> v2:172.21.2.104:3300/0 conn(0x7f7e140b8d20 msgr2=0x7f7e14068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:27.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.117+0000 7f7e12ffd700 1 --2- 172.21.2.102:0/1710429421 >> v2:172.21.2.104:3300/0 conn(0x7f7e140b8d20 0x7f7e14068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.117+0000 7f7e12ffd700 1 -- 172.21.2.102:0/1710429421 >> v1:172.21.2.104:6789/0 conn(0x7f7e1414e530 legacy=0x7f7e140b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.117+0000 7f7e12ffd700 1 -- 172.21.2.102:0/1710429421 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1414ea10 con 0x7f7e14062740 2021-02-12T17:18:27.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.117+0000 7f7e12ffd700 1 -- 172.21.2.102:0/1710429421 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f7e0c001860 con 0x7f7e14062740 2021-02-12T17:18:27.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.117+0000 7f7e12ffd700 1 -- 172.21.2.102:0/1710429421 >> v1:172.21.2.102:6789/0 conn(0x7f7e14062740 legacy=0x7f7e14062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.117+0000 7f7e12ffd700 1 --2- 172.21.2.102:0/1710429421 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7df4003770 0x7f7df4003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e12ffd700 1 --2- 172.21.2.102:0/1710429421 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7df40044d0 0x7f7df4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e12ffd700 1 --2- 172.21.2.102:0/1710429421 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7df4004e40 0x7f7df400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.121 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e12ffd700 1 -- 172.21.2.102:0/1710429421 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14068d20 con 0x7f7df4003770 2021-02-12T17:18:27.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e12ffd700 1 -- 172.21.2.102:0/1710429421 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df4005320 con 0x7f7df4004e40 2021-02-12T17:18:27.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e12ffd700 1 -- 172.21.2.102:0/1710429421 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df400bc10 con 0x7f7df40044d0 2021-02-12T17:18:27.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e13fff700 1 --2- 172.21.2.102:0/1710429421 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7df4003770 0x7f7df4003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e18e0f700 1 --2- 172.21.2.102:0/1710429421 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7df4004e40 0x7f7df400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e137fe700 1 --2- 172.21.2.102:0/1710429421 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7df40044d0 0x7f7df4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e13fff700 1 -- 172.21.2.102:0/1710429421 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7df40044d0 msgr2=0x7f7df4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:27.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e13fff700 1 --2- 172.21.2.102:0/1710429421 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7df40044d0 0x7f7df4004950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e13fff700 1 -- 172.21.2.102:0/1710429421 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7df4004e40 msgr2=0x7f7df400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:27.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e13fff700 1 --2- 172.21.2.102:0/1710429421 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7df4004e40 0x7f7df400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e18e0f700 1 -- 172.21.2.102:0/1710429421 reap_dead start 2021-02-12T17:18:27.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e13fff700 1 -- 172.21.2.102:0/1710429421 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df4003230 con 0x7f7df4003770 2021-02-12T17:18:27.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e13fff700 1 --2- 172.21.2.102:0/1710429421 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7df4003770 0x7f7df4003b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f7e0400bb90 tx=0x7f7e04008040).ready entity=mon.0 client_cookie=11252cb57aa02034 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:27.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e12ffd700 1 -- 172.21.2.102:0/1710429421 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400b2b0 con 0x7f7df4003770 2021-02-12T17:18:27.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e12ffd700 1 -- 172.21.2.102:0/1710429421 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0400ea00 con 0x7f7df4003770 2021-02-12T17:18:27.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.118+0000 7f7e12ffd700 1 -- 172.21.2.102:0/1710429421 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400eda0 con 0x7f7df4003770 2021-02-12T17:18:27.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.119+0000 7f7e1a872700 1 -- 172.21.2.102:0/1710429421 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7df4003770 msgr2=0x7f7df4003b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.119+0000 7f7e1a872700 1 --2- 172.21.2.102:0/1710429421 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7df4003770 0x7f7df4003b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f7e0400bb90 tx=0x7f7e04008040).stop 2021-02-12T17:18:27.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.119+0000 7f7e1a872700 1 -- 172.21.2.102:0/1710429421 shutdown_connections 2021-02-12T17:18:27.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.119+0000 7f7e1a872700 1 --2- 172.21.2.102:0/1710429421 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7df4003770 0x7f7df4003b90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.119+0000 7f7e1a872700 1 -- 172.21.2.102:0/1710429421 >> 172.21.2.102:0/1710429421 conn(0x7f7e140bc480 msgr2=0x7f7e140b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:27.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.119+0000 7f7e1a872700 1 -- 172.21.2.102:0/1710429421 shutdown_connections 2021-02-12T17:18:27.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.119+0000 7f7e1a872700 1 -- 172.21.2.102:0/1710429421 wait complete. 2021-02-12T17:18:27.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.120+0000 7f7e1a872700 1 Processor -- start 2021-02-12T17:18:27.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.120+0000 7f7e1a872700 1 -- start start 2021-02-12T17:18:27.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.120+0000 7f7e1a872700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7df4003770 0x7f7e141506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.120+0000 7f7e1a872700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7e140acf10 0x7f7e140b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.120+0000 7f7e1a872700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7e140b5b90 0x7f7e141612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.120+0000 7f7e1a872700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140b41b0 con 0x7f7e140acf10 2021-02-12T17:18:27.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.120+0000 7f7e1a872700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140b4450 con 0x7f7df4003770 2021-02-12T17:18:27.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.120+0000 7f7e1a872700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140b46f0 con 0x7f7e140b5b90 2021-02-12T17:18:27.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.120+0000 7f7e137fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7e140acf10 0x7f7e140b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.120+0000 7f7e137fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7e140acf10 0x7f7e140b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46070/0 (socket says 172.21.2.102:46070) 2021-02-12T17:18:27.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.121+0000 7f7e137fe700 1 -- 172.21.2.102:0/2604762806 learned_addr learned my addr 172.21.2.102:0/2604762806 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:27.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.121+0000 7f7e13fff700 1 --2- 172.21.2.102:0/2604762806 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7df4003770 0x7f7e141506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.121+0000 7f7e137fe700 1 -- 172.21.2.102:0/2604762806 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7e140b5b90 msgr2=0x7f7e141612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.121+0000 7f7e137fe700 1 --2- 172.21.2.102:0/2604762806 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7e140b5b90 0x7f7e141612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:27.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.121+0000 7f7e137fe700 1 -- 172.21.2.102:0/2604762806 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7df4003770 msgr2=0x7f7e141506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.121+0000 7f7e137fe700 1 --2- 172.21.2.102:0/2604762806 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7df4003770 0x7f7e141506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.121+0000 7f7e137fe700 1 -- 172.21.2.102:0/2604762806 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e14160e20 con 0x7f7e140acf10 2021-02-12T17:18:27.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.121+0000 7f7e13fff700 1 --2- 172.21.2.102:0/2604762806 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7df4003770 0x7f7e141506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:18:27.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.121+0000 7f7e137fe700 1 --2- 172.21.2.102:0/2604762806 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7e140acf10 0x7f7e140b4cd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f7dfc00d750 tx=0x7f7dfc009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:27.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.121+0000 7f7e0bfff700 1 -- 172.21.2.102:0/2604762806 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc007020 con 0x7f7e140acf10 2021-02-12T17:18:27.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.121+0000 7f7e0bfff700 1 -- 172.21.2.102:0/2604762806 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc007180 con 0x7f7e140acf10 2021-02-12T17:18:27.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.121+0000 7f7e0bfff700 1 -- 172.21.2.102:0/2604762806 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc00f510 con 0x7f7e140acf10 2021-02-12T17:18:27.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.121+0000 7f7e1a872700 1 -- 172.21.2.102:0/2604762806 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e14150bb0 con 0x7f7e140acf10 2021-02-12T17:18:27.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.121+0000 7f7e1a872700 1 -- 172.21.2.102:0/2604762806 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e141617b0 con 0x7f7e140acf10 2021-02-12T17:18:27.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.122+0000 7f7e1a872700 1 -- 172.21.2.102:0/2604762806 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e140b48b0 con 0x7f7e140acf10 2021-02-12T17:18:27.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.122+0000 7f7e0bfff700 1 -- 172.21.2.102:0/2604762806 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f7dfc00f8c0 con 0x7f7e140acf10 2021-02-12T17:18:27.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.122+0000 7f7e0bfff700 1 --2- 172.21.2.102:0/2604762806 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7df8059d30 0x7f7df805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.122+0000 7f7e0bfff700 1 -- 172.21.2.102:0/2604762806 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6935+0+0 (secure 0 0 0) 0x7f7dfc0738e0 con 0x7f7e140acf10 2021-02-12T17:18:27.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.122+0000 7f7e13fff700 1 --2- 172.21.2.102:0/2604762806 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7df8059d30 0x7f7df805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.123+0000 7f7e13fff700 1 --2- 172.21.2.102:0/2604762806 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7df8059d30 0x7f7df805c1f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f7e04006cf0 tx=0x7f7e0401a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:27.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.125+0000 7f7e0bfff700 1 -- 172.21.2.102:0/2604762806 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f7dfc0470c0 con 0x7f7e140acf10 2021-02-12T17:18:27.224 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:27.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.285+0000 7f7e1a872700 1 -- 172.21.2.102:0/2604762806 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e140b7d90 con 0x7f7e140acf10 2021-02-12T17:18:27.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.286+0000 7f7e0bfff700 1 -- 172.21.2.102:0/2604762806 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+3402 (secure 0 0 0) 0x7f7dfc017090 con 0x7f7e140acf10 2021-02-12T17:18:27.287 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:27.288 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:26.280344+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:replay","state_seq":2,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:27.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.287+0000 7f7e1a872700 1 -- 172.21.2.102:0/2604762806 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7df8059d30 msgr2=0x7f7df805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.287+0000 7f7e1a872700 1 --2- 172.21.2.102:0/2604762806 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7df8059d30 0x7f7df805c1f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f7e04006cf0 tx=0x7f7e0401a000).stop 2021-02-12T17:18:27.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.287+0000 7f7e1a872700 1 -- 172.21.2.102:0/2604762806 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7e140acf10 msgr2=0x7f7e140b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.287+0000 7f7e1a872700 1 --2- 172.21.2.102:0/2604762806 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7e140acf10 0x7f7e140b4cd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f7dfc00d750 tx=0x7f7dfc009040).stop 2021-02-12T17:18:27.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.287+0000 7f7e1a872700 1 -- 172.21.2.102:0/2604762806 shutdown_connections 2021-02-12T17:18:27.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.287+0000 7f7e1a872700 1 --2- 172.21.2.102:0/2604762806 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7e140b5b90 0x7f7e141612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:27.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.287+0000 7f7e1a872700 1 --2- 172.21.2.102:0/2604762806 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7df4003770 0x7f7e141506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.287+0000 7f7e1a872700 1 --2- 172.21.2.102:0/2604762806 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7df8059d30 0x7f7df805c1f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.287+0000 7f7e1a872700 1 --2- 172.21.2.102:0/2604762806 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7e140acf10 0x7f7e140b4cd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.287+0000 7f7e1a872700 1 -- 172.21.2.102:0/2604762806 >> 172.21.2.102:0/2604762806 conn(0x7f7e140bc480 msgr2=0x7f7e14062bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:27.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.288+0000 7f7e1a872700 1 -- 172.21.2.102:0/2604762806 shutdown_connections 2021-02-12T17:18:27.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.288+0000 7f7e1a872700 1 -- 172.21.2.102:0/2604762806 wait complete. 2021-02-12T17:18:27.290 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 11 2021-02-12T17:18:27.297 INFO:tasks.mds_thrash.fs.[b]:mds.a down, removed from mdsmap 2021-02-12T17:18:27.297 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2021-02-12T17:18:27.298 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:27.313 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.312+0000 7f8f0298d700 1 Processor -- start 2021-02-12T17:18:27.314 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.312+0000 7f8f0298d700 1 -- start start 2021-02-12T17:18:27.314 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.313+0000 7f8f0298d700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f8efc0b6350 0x7f8efc1463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.314 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.313+0000 7f8f0298d700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8efc144ea0 0x7f8efc145330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.314 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.313+0000 7f8f0298d700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc0b2930 con 0x7f8efc067720 2021-02-12T17:18:27.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.313+0000 7f8f0298d700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8efc068980 con 0x7f8efc0b6350 2021-02-12T17:18:27.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.313+0000 7f8f0298d700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc0b67b0 con 0x7f8efc144ea0 2021-02-12T17:18:27.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.314+0000 7f8efbfff700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f8efc067720 0x7f8efc062580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:37090/0 (socket says 172.21.2.102:37090) 2021-02-12T17:18:27.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.314+0000 7f8efbfff700 1 -- 172.21.2.102:0/2600547955 learned_addr learned my addr 172.21.2.102:0/2600547955 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:27.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.314+0000 7f8f00f2a700 1 --2- 172.21.2.102:0/2600547955 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8efc144ea0 0x7f8efc145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.314+0000 7f8efb7fe700 1 --2- 172.21.2.102:0/2600547955 >> v2:172.21.2.104:3300/0 conn(0x7f8efc0b6350 0x7f8efc1463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.314+0000 7f8f00f2a700 1 -- 172.21.2.102:0/2600547955 >> v2:172.21.2.104:3300/0 conn(0x7f8efc0b6350 msgr2=0x7f8efc1463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:27.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.314+0000 7f8f00f2a700 1 --2- 172.21.2.102:0/2600547955 >> v2:172.21.2.104:3300/0 conn(0x7f8efc0b6350 0x7f8efc1463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.314+0000 7f8f00f2a700 1 -- 172.21.2.102:0/2600547955 >> v1:172.21.2.104:6789/0 conn(0x7f8efc067720 legacy=0x7f8efc062580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.314+0000 7f8f00f2a700 1 -- 172.21.2.102:0/2600547955 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc066db0 con 0x7f8efc144ea0 2021-02-12T17:18:27.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.314+0000 7f8f00f2a700 1 --2- 172.21.2.102:0/2600547955 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8efc144ea0 0x7f8efc145330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8ef4009c90 tx=0x7f8ef40091d0).ready entity=mon.2 client_cookie=17a30925c2cf70e2 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:27.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.314+0000 7f8efaffd700 1 -- 172.21.2.102:0/2600547955 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400ba70 con 0x7f8efc144ea0 2021-02-12T17:18:27.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.315+0000 7f8efaffd700 1 -- 172.21.2.102:0/2600547955 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef400bbd0 con 0x7f8efc144ea0 2021-02-12T17:18:27.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.315+0000 7f8efaffd700 1 -- 172.21.2.102:0/2600547955 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4011400 con 0x7f8efc144ea0 2021-02-12T17:18:27.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.315+0000 7f8f0298d700 1 -- 172.21.2.102:0/2600547955 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8efc144ea0 msgr2=0x7f8efc145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.315+0000 7f8f0298d700 1 --2- 172.21.2.102:0/2600547955 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8efc144ea0 0x7f8efc145330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8ef4009c90 tx=0x7f8ef40091d0).stop 2021-02-12T17:18:27.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.315+0000 7f8f0298d700 1 -- 172.21.2.102:0/2600547955 shutdown_connections 2021-02-12T17:18:27.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.315+0000 7f8f0298d700 1 --2- 172.21.2.102:0/2600547955 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8efc144ea0 0x7f8efc145330 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.315+0000 7f8f0298d700 1 --2- 172.21.2.102:0/2600547955 >> v2:172.21.2.104:3300/0 conn(0x7f8efc0b6350 0x7f8efc1463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.315+0000 7f8f0298d700 1 -- 172.21.2.102:0/2600547955 >> 172.21.2.102:0/2600547955 conn(0x7f8efc0bc480 msgr2=0x7f8efc0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:27.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.315+0000 7f8f0298d700 1 -- 172.21.2.102:0/2600547955 shutdown_connections 2021-02-12T17:18:27.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.315+0000 7f8f0298d700 1 -- 172.21.2.102:0/2600547955 wait complete. 2021-02-12T17:18:27.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.316+0000 7f8f0298d700 1 Processor -- start 2021-02-12T17:18:27.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.316+0000 7f8f0298d700 1 -- start start 2021-02-12T17:18:27.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8f0298d700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8efc067720 0x7f8efc14d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8f0298d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8efc0b6350 0x7f8efc14f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8f0298d700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8efc144ea0 0x7f8efc14ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8f0298d700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc14fc40 con 0x7f8efc0b6350 2021-02-12T17:18:27.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8f0298d700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc158fc0 con 0x7f8efc067720 2021-02-12T17:18:27.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8f0298d700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc159260 con 0x7f8efc144ea0 2021-02-12T17:18:27.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8efb7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8efc0b6350 0x7f8efc14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8efb7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8efc0b6350 0x7f8efc14f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46084/0 (socket says 172.21.2.102:46084) 2021-02-12T17:18:27.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8efb7fe700 1 -- 172.21.2.102:0/712373187 learned_addr learned my addr 172.21.2.102:0/712373187 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:27.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8f00f2a700 1 --2- 172.21.2.102:0/712373187 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8efc144ea0 0x7f8efc14ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8efbfff700 1 --2- 172.21.2.102:0/712373187 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8efc067720 0x7f8efc14d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8efb7fe700 1 -- 172.21.2.102:0/712373187 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8efc144ea0 msgr2=0x7f8efc14ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8efb7fe700 1 --2- 172.21.2.102:0/712373187 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8efc144ea0 0x7f8efc14ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8efb7fe700 1 -- 172.21.2.102:0/712373187 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8efc067720 msgr2=0x7f8efc14d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8efb7fe700 1 --2- 172.21.2.102:0/712373187 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8efc067720 0x7f8efc14d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8efb7fe700 1 -- 172.21.2.102:0/712373187 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc159500 con 0x7f8efc0b6350 2021-02-12T17:18:27.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8efb7fe700 1 --2- 172.21.2.102:0/712373187 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8efc0b6350 0x7f8efc14f250 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f8eec00eb20 tx=0x7f8eec006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:27.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8ee3fff700 1 -- 172.21.2.102:0/712373187 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00c9b0 con 0x7f8efc0b6350 2021-02-12T17:18:27.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8ee3fff700 1 -- 172.21.2.102:0/712373187 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec00cb10 con 0x7f8efc0b6350 2021-02-12T17:18:27.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8ee3fff700 1 -- 172.21.2.102:0/712373187 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00ce90 con 0x7f8efc0b6350 2021-02-12T17:18:27.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8f0298d700 1 -- 172.21.2.102:0/712373187 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8efc158cf0 con 0x7f8efc0b6350 2021-02-12T17:18:27.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.317+0000 7f8f0298d700 1 -- 172.21.2.102:0/712373187 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc149bc0 con 0x7f8efc0b6350 2021-02-12T17:18:27.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.318+0000 7f8f0298d700 1 -- 172.21.2.102:0/712373187 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8efc149e10 con 0x7f8efc0b6350 2021-02-12T17:18:27.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.318+0000 7f8ee3fff700 1 -- 172.21.2.102:0/712373187 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f8eec012600 con 0x7f8efc0b6350 2021-02-12T17:18:27.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.318+0000 7f8ee3fff700 1 --2- 172.21.2.102:0/712373187 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8edc059d30 0x7f8edc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.319+0000 7f8ee3fff700 1 -- 172.21.2.102:0/712373187 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6935+0+0 (secure 0 0 0) 0x7f8eec074180 con 0x7f8efc0b6350 2021-02-12T17:18:27.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.319+0000 7f8efbfff700 1 --2- 172.21.2.102:0/712373187 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8edc059d30 0x7f8edc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.319+0000 7f8efbfff700 1 --2- 172.21.2.102:0/712373187 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8edc059d30 0x7f8edc05c1f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f8ef00014b0 tx=0x7f8ef0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:27.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.321+0000 7f8ee3fff700 1 -- 172.21.2.102:0/712373187 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f8eec047960 con 0x7f8efc0b6350 2021-02-12T17:18:27.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.386+0000 7fbade405700 1 Processor -- start 2021-02-12T17:18:27.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.386+0000 7fbade405700 1 -- start start 2021-02-12T17:18:27.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.386+0000 7fbade405700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fbad80b8d20 0x7fbad8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbade405700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad80b7960 con 0x7fbad8062740 2021-02-12T17:18:27.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbade405700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad80622a0 con 0x7fbad814e530 2021-02-12T17:18:27.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbade405700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad8068d20 con 0x7fbad80b8d20 2021-02-12T17:18:27.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbadc9a2700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fbad8062740 0x7fbad8062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54734/0 (socket says 172.21.2.102:54734) 2021-02-12T17:18:27.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbadc9a2700 1 -- 172.21.2.102:0/1618459259 learned_addr learned my addr 172.21.2.102:0/1618459259 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:27.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 -- 172.21.2.102:0/1618459259 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789339212 0 0) 0x7fbad80b7960 con 0x7fbad8062740 2021-02-12T17:18:27.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 -- 172.21.2.102:0/1618459259 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbac4003230 con 0x7fbad8062740 2021-02-12T17:18:27.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad7fff700 1 --2- 172.21.2.102:0/1618459259 >> v2:172.21.2.104:3300/0 conn(0x7fbad80b8d20 0x7fbad8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 -- 172.21.2.102:0/1618459259 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1682724804 0 0) 0x7fbac4003230 con 0x7fbad8062740 2021-02-12T17:18:27.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 -- 172.21.2.102:0/1618459259 >> v2:172.21.2.104:3300/0 conn(0x7fbad80b8d20 msgr2=0x7fbad8068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:27.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 --2- 172.21.2.102:0/1618459259 >> v2:172.21.2.104:3300/0 conn(0x7fbad80b8d20 0x7fbad8068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 -- 172.21.2.102:0/1618459259 >> v1:172.21.2.104:6789/0 conn(0x7fbad814e530 legacy=0x7fbad80b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:27.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 -- 172.21.2.102:0/1618459259 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad814ea10 con 0x7fbad8062740 2021-02-12T17:18:27.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 -- 172.21.2.102:0/1618459259 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fbad00014e0 con 0x7fbad8062740 2021-02-12T17:18:27.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 -- 172.21.2.102:0/1618459259 >> v1:172.21.2.102:6789/0 conn(0x7fbad8062740 legacy=0x7fbad8062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 --2- 172.21.2.102:0/1618459259 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbac40037f0 0x7fbac4003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 --2- 172.21.2.102:0/1618459259 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbac40044d0 0x7fbac4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 --2- 172.21.2.102:0/1618459259 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbac4004e40 0x7fbac400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 -- 172.21.2.102:0/1618459259 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad8068d20 con 0x7fbac4004e40 2021-02-12T17:18:27.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 -- 172.21.2.102:0/1618459259 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40053a0 con 0x7fbac40037f0 2021-02-12T17:18:27.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbad6ffd700 1 -- 172.21.2.102:0/1618459259 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac400bc60 con 0x7fbac40044d0 2021-02-12T17:18:27.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.387+0000 7fbadc9a2700 1 --2- 172.21.2.102:0/1618459259 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbac4004e40 0x7fbac400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbadc9a2700 1 -- 172.21.2.102:0/1618459259 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbac40044d0 msgr2=0x7fbac4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:27.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbadc9a2700 1 --2- 172.21.2.102:0/1618459259 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbac40044d0 0x7fbac4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:27.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbadc9a2700 1 -- 172.21.2.102:0/1618459259 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbac40037f0 msgr2=0x7fbac4003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:27.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbadc9a2700 1 --2- 172.21.2.102:0/1618459259 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbac40037f0 0x7fbac4003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:27.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbadc9a2700 1 -- 172.21.2.102:0/1618459259 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac4003230 con 0x7fbac4004e40 2021-02-12T17:18:27.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbadc9a2700 1 -- 172.21.2.102:0/1618459259 reap_dead start 2021-02-12T17:18:27.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbadc9a2700 1 --2- 172.21.2.102:0/1618459259 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbac4004e40 0x7fbac400b720 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fbad000c260 tx=0x7fbad814eba0).ready entity=mon.0 client_cookie=f8f79d80ad305bce server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:27.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbad6ffd700 1 -- 172.21.2.102:0/1618459259 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad00070d0 con 0x7fbac4004e40 2021-02-12T17:18:27.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbad6ffd700 1 -- 172.21.2.102:0/1618459259 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad0007230 con 0x7fbac4004e40 2021-02-12T17:18:27.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbad6ffd700 1 -- 172.21.2.102:0/1618459259 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad00055e0 con 0x7fbac4004e40 2021-02-12T17:18:27.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbade405700 1 -- 172.21.2.102:0/1618459259 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbac4004e40 msgr2=0x7fbac400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbade405700 1 --2- 172.21.2.102:0/1618459259 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbac4004e40 0x7fbac400b720 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fbad000c260 tx=0x7fbad814eba0).stop 2021-02-12T17:18:27.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbade405700 1 -- 172.21.2.102:0/1618459259 shutdown_connections 2021-02-12T17:18:27.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbade405700 1 --2- 172.21.2.102:0/1618459259 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbac4004e40 0x7fbac400b720 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbade405700 1 -- 172.21.2.102:0/1618459259 >> 172.21.2.102:0/1618459259 conn(0x7fbad80bc480 msgr2=0x7fbad80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:27.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbade405700 1 -- 172.21.2.102:0/1618459259 shutdown_connections 2021-02-12T17:18:27.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.388+0000 7fbade405700 1 -- 172.21.2.102:0/1618459259 wait complete. 2021-02-12T17:18:27.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.389+0000 7fbade405700 1 Processor -- start 2021-02-12T17:18:27.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.389+0000 7fbade405700 1 -- start start 2021-02-12T17:18:27.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.389+0000 7fbade405700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbac4004e40 0x7fbad80b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.389+0000 7fbade405700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbad8153780 0x7fbad8142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.389+0000 7fbade405700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbad8152e70 0x7fbad8143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.389+0000 7fbade405700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad80afea0 con 0x7fbad8152e70 2021-02-12T17:18:27.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.389+0000 7fbade405700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad80b0140 con 0x7fbad8153780 2021-02-12T17:18:27.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.389+0000 7fbade405700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad80b03e0 con 0x7fbac4004e40 2021-02-12T17:18:27.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbadc9a2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbad8152e70 0x7fbad8143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbadc9a2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbad8152e70 0x7fbad8143410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46106/0 (socket says 172.21.2.102:46106) 2021-02-12T17:18:27.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbadc9a2700 1 -- 172.21.2.102:0/2840257144 learned_addr learned my addr 172.21.2.102:0/2840257144 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:27.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbad7fff700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbac4004e40 0x7fbad80b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbad77fe700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbad8153780 0x7fbad8142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbadc9a2700 1 -- 172.21.2.102:0/2840257144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbac4004e40 msgr2=0x7fbad80b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbadc9a2700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbac4004e40 0x7fbad80b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbadc9a2700 1 -- 172.21.2.102:0/2840257144 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbad8153780 msgr2=0x7fbad8142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbadc9a2700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbad8153780 0x7fbad8142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.396 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbadc9a2700 1 -- 172.21.2.102:0/2840257144 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad8143900 con 0x7fbad8152e70 2021-02-12T17:18:27.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbad7fff700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbac4004e40 0x7fbad80b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:18:27.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbad77fe700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbad8153780 0x7fbad8142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:18:27.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbadc9a2700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbad8152e70 0x7fbad8143410 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fbad0000bc0 tx=0x7fbad0013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:27.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbabffff700 1 -- 172.21.2.102:0/2840257144 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad000ce70 con 0x7fbad8152e70 2021-02-12T17:18:27.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbabffff700 1 -- 172.21.2.102:0/2840257144 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad0018030 con 0x7fbad8152e70 2021-02-12T17:18:27.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbabffff700 1 -- 172.21.2.102:0/2840257144 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad001e680 con 0x7fbad8152e70 2021-02-12T17:18:27.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbade405700 1 -- 172.21.2.102:0/2840257144 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad80afb90 con 0x7fbad8152e70 2021-02-12T17:18:27.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.390+0000 7fbade405700 1 -- 172.21.2.102:0/2840257144 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad80b74e0 con 0x7fbad8152e70 2021-02-12T17:18:27.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.391+0000 7fbade405700 1 -- 172.21.2.102:0/2840257144 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad8045460 con 0x7fbad8152e70 2021-02-12T17:18:27.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.391+0000 7fbabffff700 1 -- 172.21.2.102:0/2840257144 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fbad0010070 con 0x7fbad8152e70 2021-02-12T17:18:27.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.391+0000 7fbabffff700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbab8059d30 0x7fbab805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:27.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.391+0000 7fbabffff700 1 -- 172.21.2.102:0/2840257144 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6935+0+0 (secure 0 0 0) 0x7fbad0074b20 con 0x7fbad8152e70 2021-02-12T17:18:27.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.391+0000 7fbad7fff700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbab8059d30 0x7fbab805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:27.398 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.392+0000 7fbad7fff700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbab8059d30 0x7fbab805c1f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fbac8009ac0 tx=0x7fbac800b040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:27.398 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.394+0000 7fbabffff700 1 -- 172.21.2.102:0/2840257144 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fbad0048300 con 0x7fbad8152e70 2021-02-12T17:18:27.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.483+0000 7f8f0298d700 1 -- 172.21.2.102:0/712373187 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8efc159690 con 0x7f8efc0b6350 2021-02-12T17:18:27.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.483+0000 7f8ee3fff700 1 -- 172.21.2.102:0/712373187 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+3406 (secure 0 0 0) 0x7f8eec04af80 con 0x7f8efc0b6350 2021-02-12T17:18:27.485 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:27.485 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:27.285425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:reconnect","state_seq":38,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:27.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.485+0000 7f8f0298d700 1 -- 172.21.2.102:0/712373187 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8edc059d30 msgr2=0x7f8edc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.485+0000 7f8f0298d700 1 --2- 172.21.2.102:0/712373187 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8edc059d30 0x7f8edc05c1f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f8ef00014b0 tx=0x7f8ef0009040).stop 2021-02-12T17:18:27.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.485+0000 7f8f0298d700 1 -- 172.21.2.102:0/712373187 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8efc0b6350 msgr2=0x7f8efc14f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.485+0000 7f8f0298d700 1 --2- 172.21.2.102:0/712373187 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8efc0b6350 0x7f8efc14f250 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f8eec00eb20 tx=0x7f8eec006de0).stop 2021-02-12T17:18:27.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.485+0000 7f8f0298d700 1 -- 172.21.2.102:0/712373187 shutdown_connections 2021-02-12T17:18:27.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.485+0000 7f8f0298d700 1 --2- 172.21.2.102:0/712373187 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8efc144ea0 0x7f8efc14ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.485+0000 7f8f0298d700 1 --2- 172.21.2.102:0/712373187 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8efc067720 0x7f8efc14d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.485+0000 7f8f0298d700 1 --2- 172.21.2.102:0/712373187 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8edc059d30 0x7f8edc05c1f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.485+0000 7f8f0298d700 1 --2- 172.21.2.102:0/712373187 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8efc0b6350 0x7f8efc14f250 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.485+0000 7f8f0298d700 1 -- 172.21.2.102:0/712373187 >> 172.21.2.102:0/712373187 conn(0x7f8efc0bc480 msgr2=0x7f8efc0b8430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:27.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.485+0000 7f8f0298d700 1 -- 172.21.2.102:0/712373187 shutdown_connections 2021-02-12T17:18:27.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.485+0000 7f8f0298d700 1 -- 172.21.2.102:0/712373187 wait complete. 2021-02-12T17:18:27.487 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 12 2021-02-12T17:18:27.494 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:18:27.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.558+0000 7fbade405700 1 -- 172.21.2.102:0/2840257144 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbad8063670 con 0x7fbad8152e70 2021-02-12T17:18:27.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.559+0000 7fbabffff700 1 -- 172.21.2.102:0/2840257144 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+3406 (secure 0 0 0) 0x7fbad0023070 con 0x7fbad8152e70 2021-02-12T17:18:27.560 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:27.560 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:27.285425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:reconnect","state_seq":38,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:27.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.560+0000 7fbade405700 1 -- 172.21.2.102:0/2840257144 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbab8059d30 msgr2=0x7fbab805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.560+0000 7fbade405700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbab8059d30 0x7fbab805c1f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fbac8009ac0 tx=0x7fbac800b040).stop 2021-02-12T17:18:27.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.560+0000 7fbade405700 1 -- 172.21.2.102:0/2840257144 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbad8152e70 msgr2=0x7fbad8143410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:27.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.560+0000 7fbade405700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbad8152e70 0x7fbad8143410 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fbad0000bc0 tx=0x7fbad0013000).stop 2021-02-12T17:18:27.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.560+0000 7fbade405700 1 -- 172.21.2.102:0/2840257144 shutdown_connections 2021-02-12T17:18:27.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.560+0000 7fbade405700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbab8059d30 0x7fbab805c1f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.560+0000 7fbade405700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbad8152e70 0x7fbad8143410 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.560+0000 7fbade405700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbac4004e40 0x7fbad80b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.560+0000 7fbade405700 1 --2- 172.21.2.102:0/2840257144 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbad8153780 0x7fbad8142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:27.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.560+0000 7fbade405700 1 -- 172.21.2.102:0/2840257144 >> 172.21.2.102:0/2840257144 conn(0x7fbad80bc480 msgr2=0x7fbad814cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:27.563 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.560+0000 7fbade405700 1 -- 172.21.2.102:0/2840257144 shutdown_connections 2021-02-12T17:18:27.563 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:27.560+0000 7fbade405700 1 -- 172.21.2.102:0/2840257144 wait complete. 2021-02-12T17:18:27.563 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 12 2021-02-12T17:18:27.570 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 12, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:01.991560+0000", "damaged": [], "data_pools": [ 4 ], "enabled": true, "epoch": 6, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "a", "in": [ 0 ], "info": { "gid_4272": { "addr": "172.21.2.102:6837/1917299206", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6835", "nonce": 1917299206, "type": "v2" }, { "addr": "172.21.2.102:6837", "nonce": 1917299206, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4272, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 2 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2021-02-12T17:16:03.999381+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4272 } } }, { "id": 2, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:08.529588+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 12, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "b", "in": [ 0 ], "info": { "gid_4246": { "addr": "172.21.2.104:6835/3140564541", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6833", "nonce": 3140564541, "type": "v2" }, { "addr": "172.21.2.104:6835", "nonce": 3140564541, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4246, "incarnation": 11, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:reconnect", "state_seq": 38 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 5, "modified": "2021-02-12T17:18:27.285425+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4246 } } } ], "standbys": [ { "addr": "172.21.2.104:6834/3149030842", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6832", "nonce": 3149030842, "type": "v2" }, { "addr": "172.21.2.104:6834", "nonce": 3149030842, "type": "v1" } ] }, "epoch": 5, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4243, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 2 } ] } 2021-02-12T17:18:29.496 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:29.571 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:29.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.584+0000 7fc421536700 1 Processor -- start 2021-02-12T17:18:29.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.584+0000 7fc421536700 1 -- start start 2021-02-12T17:18:29.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.584+0000 7fc421536700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc41c0b8d20 0x7fc41c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:29.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.584+0000 7fc421536700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c0b7960 con 0x7fc41c14e530 2021-02-12T17:18:29.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.584+0000 7fc421536700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c0622a0 con 0x7fc41c062740 2021-02-12T17:18:29.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.584+0000 7fc421536700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c068d20 con 0x7fc41c0b8d20 2021-02-12T17:18:29.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc41a7fc700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fc41c14e530 0x7fc41c0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54760/0 (socket says 172.21.2.102:54760) 2021-02-12T17:18:29.586 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc41a7fc700 1 -- 172.21.2.102:0/1759145068 learned_addr learned my addr 172.21.2.102:0/1759145068 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:29.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 -- 172.21.2.102:0/1759145068 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915379966 0 0) 0x7fc41c0b7960 con 0x7fc41c14e530 2021-02-12T17:18:29.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 -- 172.21.2.102:0/1759145068 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3fc003230 con 0x7fc41c14e530 2021-02-12T17:18:29.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc41affd700 1 --2- 172.21.2.102:0/1759145068 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc41c0b8d20 0x7fc41c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:29.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 -- 172.21.2.102:0/1759145068 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3387803326 0 0) 0x7fc3fc003230 con 0x7fc41c14e530 2021-02-12T17:18:29.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 -- 172.21.2.102:0/1759145068 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc41c0b8d20 msgr2=0x7fc41c068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:29.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 --2- 172.21.2.102:0/1759145068 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc41c0b8d20 0x7fc41c068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:29.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 -- 172.21.2.102:0/1759145068 >> v1:172.21.2.104:6789/0 conn(0x7fc41c062740 legacy=0x7fc41c062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:29.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 -- 172.21.2.102:0/1759145068 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c14ea10 con 0x7fc41c14e530 2021-02-12T17:18:29.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 -- 172.21.2.102:0/1759145068 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fc4040014e0 con 0x7fc41c14e530 2021-02-12T17:18:29.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 -- 172.21.2.102:0/1759145068 >> v1:172.21.2.102:6789/0 conn(0x7fc41c14e530 legacy=0x7fc41c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:29.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 --2- 172.21.2.102:0/1759145068 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc3fc003750 0x7fc3fc003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:29.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 --2- 172.21.2.102:0/1759145068 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc3fc0044d0 0x7fc3fc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:29.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 --2- 172.21.2.102:0/1759145068 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc41c0b8d20 0x7fc3fc004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:29.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 -- 172.21.2.102:0/1759145068 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c068d20 con 0x7fc3fc003750 2021-02-12T17:18:29.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 -- 172.21.2.102:0/1759145068 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc005380 con 0x7fc3fc0044d0 2021-02-12T17:18:29.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc419ffb700 1 -- 172.21.2.102:0/1759145068 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc0042f0 con 0x7fc41c0b8d20 2021-02-12T17:18:29.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.585+0000 7fc41affd700 1 --2- 172.21.2.102:0/1759145068 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc3fc003750 0x7fc3fc003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:29.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc41affd700 1 -- 172.21.2.102:0/1759145068 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc41c0b8d20 msgr2=0x7fc3fc004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:29.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc41affd700 1 --2- 172.21.2.102:0/1759145068 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc41c0b8d20 0x7fc3fc004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:29.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc41affd700 1 -- 172.21.2.102:0/1759145068 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc3fc0044d0 msgr2=0x7fc3fc004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:29.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc41affd700 1 --2- 172.21.2.102:0/1759145068 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc3fc0044d0 0x7fc3fc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:29.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc41affd700 1 -- 172.21.2.102:0/1759145068 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc003230 con 0x7fc3fc003750 2021-02-12T17:18:29.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc41affd700 1 --2- 172.21.2.102:0/1759145068 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc3fc003750 0x7fc3fc003b50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fc40c00ba70 tx=0x7fc40c008040).ready entity=mon.0 client_cookie=831bb4dd13916f5 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:29.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc419ffb700 1 -- 172.21.2.102:0/1759145068 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c00d930 con 0x7fc3fc003750 2021-02-12T17:18:29.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc419ffb700 1 -- 172.21.2.102:0/1759145068 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40c00da90 con 0x7fc3fc003750 2021-02-12T17:18:29.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc419ffb700 1 -- 172.21.2.102:0/1759145068 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c00de10 con 0x7fc3fc003750 2021-02-12T17:18:29.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc421536700 1 -- 172.21.2.102:0/1759145068 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc3fc003750 msgr2=0x7fc3fc003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:29.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc421536700 1 --2- 172.21.2.102:0/1759145068 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc3fc003750 0x7fc3fc003b50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fc40c00ba70 tx=0x7fc40c008040).stop 2021-02-12T17:18:29.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc41b7fe700 1 -- 172.21.2.102:0/1759145068 reap_dead start 2021-02-12T17:18:29.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc421536700 1 -- 172.21.2.102:0/1759145068 shutdown_connections 2021-02-12T17:18:29.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc421536700 1 -- 172.21.2.102:0/1759145068 >> 172.21.2.102:0/1759145068 conn(0x7fc41c0bc480 msgr2=0x7fc41c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:29.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc421536700 1 -- 172.21.2.102:0/1759145068 shutdown_connections 2021-02-12T17:18:29.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.586+0000 7fc421536700 1 -- 172.21.2.102:0/1759145068 wait complete. 2021-02-12T17:18:29.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.587+0000 7fc421536700 1 Processor -- start 2021-02-12T17:18:29.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.587+0000 7fc421536700 1 -- start start 2021-02-12T17:18:29.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc421536700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc41c14ba60 0x7fc41c0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:29.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc421536700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc41c0b55f0 0x7fc41c15d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:29.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc421536700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc41c15d800 0x7fc41c1608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:29.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc421536700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c14c7a0 con 0x7fc41c0b55f0 2021-02-12T17:18:29.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc421536700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c0ad250 con 0x7fc41c15d800 2021-02-12T17:18:29.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc421536700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c0ad4f0 con 0x7fc41c14ba60 2021-02-12T17:18:29.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc41a7fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc41c0b55f0 0x7fc41c15d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:29.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc41a7fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc41c0b55f0 0x7fc41c15d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46124/0 (socket says 172.21.2.102:46124) 2021-02-12T17:18:29.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc41affd700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc41c14ba60 0x7fc41c0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:29.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc41a7fc700 1 -- 172.21.2.102:0/2921247144 learned_addr learned my addr 172.21.2.102:0/2921247144 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:29.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc41b7fe700 1 --2- 172.21.2.102:0/2921247144 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc41c15d800 0x7fc41c1608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:29.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc41a7fc700 1 -- 172.21.2.102:0/2921247144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc41c14ba60 msgr2=0x7fc41c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:29.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc41a7fc700 1 --2- 172.21.2.102:0/2921247144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc41c14ba60 0x7fc41c0aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:29.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc41a7fc700 1 -- 172.21.2.102:0/2921247144 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc41c15d800 msgr2=0x7fc41c1608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:29.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc41a7fc700 1 --2- 172.21.2.102:0/2921247144 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc41c15d800 0x7fc41c1608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:29.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc41a7fc700 1 -- 172.21.2.102:0/2921247144 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c0ad790 con 0x7fc41c0b55f0 2021-02-12T17:18:29.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc41affd700 1 --2- 172.21.2.102:0/2921247144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc41c14ba60 0x7fc41c0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:18:29.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc41a7fc700 1 --2- 172.21.2.102:0/2921247144 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc41c0b55f0 0x7fc41c15d310 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fc40400cbb0 tx=0x7fc41c14eba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:29.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc412ffd700 1 -- 172.21.2.102:0/2921247144 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404007170 con 0x7fc41c0b55f0 2021-02-12T17:18:29.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.588+0000 7fc412ffd700 1 -- 172.21.2.102:0/2921247144 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4040072d0 con 0x7fc41c0b55f0 2021-02-12T17:18:29.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.589+0000 7fc421536700 1 -- 172.21.2.102:0/2921247144 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41c0afa70 con 0x7fc41c0b55f0 2021-02-12T17:18:29.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.589+0000 7fc412ffd700 1 -- 172.21.2.102:0/2921247144 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404004ae0 con 0x7fc41c0b55f0 2021-02-12T17:18:29.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.589+0000 7fc421536700 1 -- 172.21.2.102:0/2921247144 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41c0acf10 con 0x7fc41c0b55f0 2021-02-12T17:18:29.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.589+0000 7fc421536700 1 -- 172.21.2.102:0/2921247144 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41c0afc00 con 0x7fc41c0b55f0 2021-02-12T17:18:29.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.589+0000 7fc412ffd700 1 -- 172.21.2.102:0/2921247144 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fc404010070 con 0x7fc41c0b55f0 2021-02-12T17:18:29.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.590+0000 7fc412ffd700 1 --2- 172.21.2.102:0/2921247144 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc400059d30 0x7fc40005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:29.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.590+0000 7fc412ffd700 1 -- 172.21.2.102:0/2921247144 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6935+0+0 (secure 0 0 0) 0x7fc4040736c0 con 0x7fc41c0b55f0 2021-02-12T17:18:29.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.590+0000 7fc41affd700 1 --2- 172.21.2.102:0/2921247144 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc400059d30 0x7fc40005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:29.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.590+0000 7fc41affd700 1 --2- 172.21.2.102:0/2921247144 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc400059d30 0x7fc40005c1f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fc40c008010 tx=0x7fc40c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:29.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.593+0000 7fc412ffd700 1 -- 172.21.2.102:0/2921247144 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fc40404a870 con 0x7fc41c0b55f0 2021-02-12T17:18:29.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.660+0000 7f0f86b10700 1 Processor -- start 2021-02-12T17:18:29.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.660+0000 7f0f86b10700 1 -- start start 2021-02-12T17:18:29.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.661+0000 7f0f86b10700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0f800b3090 0x7f0f800b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:29.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.661+0000 7f0f86b10700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f800b54d0 con 0x7f0f800b8bd0 2021-02-12T17:18:29.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.661+0000 7f0f86b10700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f800b4f90 con 0x7f0f800b2cb0 2021-02-12T17:18:29.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.661+0000 7f0f86b10700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f800b40f0 con 0x7f0f800b3090 2021-02-12T17:18:29.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.661+0000 7f0f850ad700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0f800b3090 0x7f0f800b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:29.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.661+0000 7f0f850ad700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0f800b3090 0x7f0f800b7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46132/0 (socket says 172.21.2.102:46132) 2021-02-12T17:18:29.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.661+0000 7f0f850ad700 1 -- 172.21.2.102:0/3537363730 learned_addr learned my addr 172.21.2.102:0/3537363730 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.661+0000 7f0f850ad700 1 -- 172.21.2.102:0/3537363730 >> v1:172.21.2.104:6789/0 conn(0x7f0f800b2cb0 legacy=0x7f0f80147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.661+0000 7f0f850ad700 1 -- 172.21.2.102:0/3537363730 >> v1:172.21.2.102:6789/0 conn(0x7f0f800b8bd0 legacy=0x7f0f800b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.661+0000 7f0f850ad700 1 -- 172.21.2.102:0/3537363730 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f800b5230 con 0x7f0f800b3090 2021-02-12T17:18:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.662+0000 7f0f850ad700 1 --2- 172.21.2.102:0/3537363730 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0f800b3090 0x7f0f800b7010 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f0f78009d50 tx=0x7f0f78009290).ready entity=mon.0 client_cookie=c46180d4a91f54da server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.662+0000 7f0f7f7fe700 1 -- 172.21.2.102:0/3537363730 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7800bbb0 con 0x7f0f800b3090 2021-02-12T17:18:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.662+0000 7f0f7f7fe700 1 -- 172.21.2.102:0/3537363730 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7800bd10 con 0x7f0f800b3090 2021-02-12T17:18:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.662+0000 7f0f7f7fe700 1 -- 172.21.2.102:0/3537363730 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78011610 con 0x7f0f800b3090 2021-02-12T17:18:29.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.662+0000 7f0f86b10700 1 -- 172.21.2.102:0/3537363730 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0f800b3090 msgr2=0x7f0f800b7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:29.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.662+0000 7f0f86b10700 1 --2- 172.21.2.102:0/3537363730 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0f800b3090 0x7f0f800b7010 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f0f78009d50 tx=0x7f0f78009290).stop 2021-02-12T17:18:29.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.662+0000 7f0f86b10700 1 -- 172.21.2.102:0/3537363730 shutdown_connections 2021-02-12T17:18:29.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.662+0000 7f0f86b10700 1 --2- 172.21.2.102:0/3537363730 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0f800b3090 0x7f0f800b7010 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:29.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.662+0000 7f0f86b10700 1 -- 172.21.2.102:0/3537363730 >> 172.21.2.102:0/3537363730 conn(0x7f0f800bc480 msgr2=0x7f0f800b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:29.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.662+0000 7f0f86b10700 1 -- 172.21.2.102:0/3537363730 shutdown_connections 2021-02-12T17:18:29.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.662+0000 7f0f86b10700 1 -- 172.21.2.102:0/3537363730 wait complete. 2021-02-12T17:18:29.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.663+0000 7f0f86b10700 1 Processor -- start 2021-02-12T17:18:29.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.663+0000 7f0f86b10700 1 -- start start 2021-02-12T17:18:29.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f86b10700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0f800b2cb0 0x7f0f80067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:29.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f86b10700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0f800b3090 0x7f0f80145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:29.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f86b10700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0f800b8bd0 0x7f0f80145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:29.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f86b10700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800ade30 con 0x7f0f800b8bd0 2021-02-12T17:18:29.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f86b10700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f80144c90 con 0x7f0f800b2cb0 2021-02-12T17:18:29.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f86b10700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f80145a10 con 0x7f0f800b3090 2021-02-12T17:18:29.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f850ad700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0f800b8bd0 0x7f0f80145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:29.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f850ad700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0f800b8bd0 0x7f0f80145520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46140/0 (socket says 172.21.2.102:46140) 2021-02-12T17:18:29.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f850ad700 1 -- 172.21.2.102:0/1419182948 learned_addr learned my addr 172.21.2.102:0/1419182948 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:29.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f848ac700 1 --2- 172.21.2.102:0/1419182948 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0f800b2cb0 0x7f0f80067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:29.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f850ad700 1 -- 172.21.2.102:0/1419182948 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0f800b3090 msgr2=0x7f0f80145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:29.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f850ad700 1 --2- 172.21.2.102:0/1419182948 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0f800b3090 0x7f0f80145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:29.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f850ad700 1 -- 172.21.2.102:0/1419182948 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0f800b2cb0 msgr2=0x7f0f80067c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:29.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f850ad700 1 --2- 172.21.2.102:0/1419182948 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0f800b2cb0 0x7f0f80067c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:29.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f850ad700 1 -- 172.21.2.102:0/1419182948 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8015c570 con 0x7f0f800b8bd0 2021-02-12T17:18:29.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f850ad700 1 --2- 172.21.2.102:0/1419182948 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0f800b8bd0 0x7f0f80145520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f0f800653c0 tx=0x7f0f78017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:29.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f7cff9700 1 -- 172.21.2.102:0/1419182948 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7800be80 con 0x7f0f800b8bd0 2021-02-12T17:18:29.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f7cff9700 1 -- 172.21.2.102:0/1419182948 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f78011e20 con 0x7f0f800b8bd0 2021-02-12T17:18:29.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f7cff9700 1 -- 172.21.2.102:0/1419182948 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78010df0 con 0x7f0f800b8bd0 2021-02-12T17:18:29.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f86b10700 1 -- 172.21.2.102:0/1419182948 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8015c810 con 0x7f0f800b8bd0 2021-02-12T17:18:29.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.664+0000 7f0f86b10700 1 -- 172.21.2.102:0/1419182948 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8015cd50 con 0x7f0f800b8bd0 2021-02-12T17:18:29.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.665+0000 7f0f86b10700 1 -- 172.21.2.102:0/1419182948 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f80045460 con 0x7f0f800b8bd0 2021-02-12T17:18:29.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.665+0000 7f0f7cff9700 1 -- 172.21.2.102:0/1419182948 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f0f7800f070 con 0x7f0f800b8bd0 2021-02-12T17:18:29.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.666+0000 7f0f7cff9700 1 --2- 172.21.2.102:0/1419182948 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0f64059d30 0x7f0f6405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:29.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.666+0000 7f0f7cff9700 1 -- 172.21.2.102:0/1419182948 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6935+0+0 (secure 0 0 0) 0x7f0f78075830 con 0x7f0f800b8bd0 2021-02-12T17:18:29.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.666+0000 7f0f848ac700 1 --2- 172.21.2.102:0/1419182948 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0f64059d30 0x7f0f6405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:29.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.666+0000 7f0f848ac700 1 --2- 172.21.2.102:0/1419182948 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0f64059d30 0x7f0f6405c1f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f0f680034e0 tx=0x7f0f68009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:29.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.668+0000 7f0f7cff9700 1 -- 172.21.2.102:0/1419182948 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f0f78049010 con 0x7f0f800b8bd0 2021-02-12T17:18:29.759 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.758+0000 7fc421536700 1 -- 172.21.2.102:0/2921247144 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc41c045460 con 0x7fc41c0b55f0 2021-02-12T17:18:29.760 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.758+0000 7fc412ffd700 1 -- 172.21.2.102:0/2921247144 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3403 (secure 0 0 0) 0x7fc404019030 con 0x7fc41c0b55f0 2021-02-12T17:18:29.760 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:29.760 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:29.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.760+0000 7fc421536700 1 -- 172.21.2.102:0/2921247144 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc400059d30 msgr2=0x7fc40005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:29.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.760+0000 7fc421536700 1 --2- 172.21.2.102:0/2921247144 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc400059d30 0x7fc40005c1f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fc40c008010 tx=0x7fc40c008040).stop 2021-02-12T17:18:29.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.760+0000 7fc421536700 1 -- 172.21.2.102:0/2921247144 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc41c0b55f0 msgr2=0x7fc41c15d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:29.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.760+0000 7fc421536700 1 --2- 172.21.2.102:0/2921247144 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc41c0b55f0 0x7fc41c15d310 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fc40400cbb0 tx=0x7fc41c14eba0).stop 2021-02-12T17:18:29.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.760+0000 7fc421536700 1 -- 172.21.2.102:0/2921247144 shutdown_connections 2021-02-12T17:18:29.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.760+0000 7fc421536700 1 --2- 172.21.2.102:0/2921247144 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc41c15d800 0x7fc41c1608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:29.762 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.760+0000 7fc421536700 1 --2- 172.21.2.102:0/2921247144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc41c14ba60 0x7fc41c0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:29.762 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.760+0000 7fc421536700 1 --2- 172.21.2.102:0/2921247144 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc400059d30 0x7fc40005c1f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:29.762 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.760+0000 7fc421536700 1 --2- 172.21.2.102:0/2921247144 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc41c0b55f0 0x7fc41c15d310 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:29.762 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.760+0000 7fc421536700 1 -- 172.21.2.102:0/2921247144 >> 172.21.2.102:0/2921247144 conn(0x7fc41c0bc480 msgr2=0x7fc41c0b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:29.762 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.760+0000 7fc421536700 1 -- 172.21.2.102:0/2921247144 shutdown_connections 2021-02-12T17:18:29.762 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.760+0000 7fc421536700 1 -- 172.21.2.102:0/2921247144 wait complete. 2021-02-12T17:18:29.762 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 14 2021-02-12T17:18:29.770 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:18:29.830 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.829+0000 7f0f86b10700 1 -- 172.21.2.102:0/1419182948 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f80068d00 con 0x7f0f800b8bd0 2021-02-12T17:18:29.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.830+0000 7f0f7cff9700 1 -- 172.21.2.102:0/1419182948 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3403 (secure 0 0 0) 0x7f0f7804c630 con 0x7f0f800b8bd0 2021-02-12T17:18:29.831 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:29.831 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:29.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.831+0000 7f0f86b10700 1 -- 172.21.2.102:0/1419182948 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0f64059d30 msgr2=0x7f0f6405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:29.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.831+0000 7f0f86b10700 1 --2- 172.21.2.102:0/1419182948 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0f64059d30 0x7f0f6405c1f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f0f680034e0 tx=0x7f0f68009040).stop 2021-02-12T17:18:29.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.831+0000 7f0f86b10700 1 -- 172.21.2.102:0/1419182948 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0f800b8bd0 msgr2=0x7f0f80145520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:29.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.831+0000 7f0f86b10700 1 --2- 172.21.2.102:0/1419182948 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0f800b8bd0 0x7f0f80145520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f0f800653c0 tx=0x7f0f78017000).stop 2021-02-12T17:18:29.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.831+0000 7f0f86b10700 1 -- 172.21.2.102:0/1419182948 shutdown_connections 2021-02-12T17:18:29.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.831+0000 7f0f86b10700 1 --2- 172.21.2.102:0/1419182948 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0f64059d30 0x7f0f6405c1f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:29.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.831+0000 7f0f86b10700 1 --2- 172.21.2.102:0/1419182948 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0f800b8bd0 0x7f0f80145520 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:29.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.831+0000 7f0f86b10700 1 --2- 172.21.2.102:0/1419182948 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0f800b2cb0 0x7f0f80067c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:29.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.831+0000 7f0f86b10700 1 --2- 172.21.2.102:0/1419182948 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0f800b3090 0x7f0f80145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:29.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.831+0000 7f0f86b10700 1 -- 172.21.2.102:0/1419182948 >> 172.21.2.102:0/1419182948 conn(0x7f0f800bc480 msgr2=0x7f0f800b84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:29.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.831+0000 7f0f86b10700 1 -- 172.21.2.102:0/1419182948 shutdown_connections 2021-02-12T17:18:29.833 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:29.831+0000 7f0f86b10700 1 -- 172.21.2.102:0/1419182948 wait complete. 2021-02-12T17:18:29.834 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 14 2021-02-12T17:18:29.841 INFO:tasks.mds_thrash.fs.[b]:mds.d has gained rank=0, replacing gid=4269 2021-02-12T17:18:29.841 INFO:tasks.mds_thrash.fs.[b]:waiting for 4 secs before reviving mds.a 2021-02-12T17:18:31.771 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:31.859 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.857+0000 7fad6b7d5700 1 Processor -- start 2021-02-12T17:18:31.859 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.858+0000 7fad6b7d5700 1 -- start start 2021-02-12T17:18:31.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.858+0000 7fad6b7d5700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fad640b8d20 0x7fad64068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:31.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.858+0000 7fad6b7d5700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fad64062740 0x7fad64062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:31.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.858+0000 7fad6b7d5700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad640b7960 con 0x7fad6414e530 2021-02-12T17:18:31.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.858+0000 7fad6b7d5700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad64068d20 con 0x7fad640b8d20 2021-02-12T17:18:31.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.858+0000 7fad6b7d5700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad640622a0 con 0x7fad64062740 2021-02-12T17:18:31.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.858+0000 7fad68d70700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fad6414e530 0x7fad640b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54790/0 (socket says 172.21.2.102:54790) 2021-02-12T17:18:31.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.858+0000 7fad68d70700 1 -- 172.21.2.102:0/3399761613 learned_addr learned my addr 172.21.2.102:0/3399761613 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:31.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.858+0000 7fad69571700 1 --2- 172.21.2.102:0/3399761613 >> v2:172.21.2.102:3300/0 conn(0x7fad640b8d20 0x7fad64068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:31.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.859+0000 7fad57fff700 1 -- 172.21.2.102:0/3399761613 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029600884 0 0) 0x7fad640b7960 con 0x7fad6414e530 2021-02-12T17:18:31.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.859+0000 7fad57fff700 1 -- 172.21.2.102:0/3399761613 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad4c003230 con 0x7fad6414e530 2021-02-12T17:18:31.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.859+0000 7fad69571700 1 -- 172.21.2.102:0/3399761613 >> v2:172.21.2.104:3300/0 conn(0x7fad64062740 msgr2=0x7fad64062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:31.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.859+0000 7fad69571700 1 --2- 172.21.2.102:0/3399761613 >> v2:172.21.2.104:3300/0 conn(0x7fad64062740 0x7fad64062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:31.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.859+0000 7fad69571700 1 -- 172.21.2.102:0/3399761613 >> v1:172.21.2.102:6789/0 conn(0x7fad6414e530 legacy=0x7fad640b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:31.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.859+0000 7fad69571700 1 -- 172.21.2.102:0/3399761613 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6414ea10 con 0x7fad640b8d20 2021-02-12T17:18:31.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.859+0000 7fad69571700 1 --2- 172.21.2.102:0/3399761613 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fad640b8d20 0x7fad64068830 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fad64068710 tx=0x7fad60006de0).ready entity=mon.0 client_cookie=1e8b952941adbb7b server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:31.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.859+0000 7fad57fff700 1 -- 172.21.2.102:0/3399761613 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60009630 con 0x7fad640b8d20 2021-02-12T17:18:31.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.859+0000 7fad57fff700 1 -- 172.21.2.102:0/3399761613 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad60009790 con 0x7fad640b8d20 2021-02-12T17:18:31.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.859+0000 7fad57fff700 1 -- 172.21.2.102:0/3399761613 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60009b10 con 0x7fad640b8d20 2021-02-12T17:18:31.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.860+0000 7fad6b7d5700 1 -- 172.21.2.102:0/3399761613 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fad640b8d20 msgr2=0x7fad64068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:31.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.860+0000 7fad6b7d5700 1 --2- 172.21.2.102:0/3399761613 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fad640b8d20 0x7fad64068830 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fad64068710 tx=0x7fad60006de0).stop 2021-02-12T17:18:31.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.860+0000 7fad6b7d5700 1 -- 172.21.2.102:0/3399761613 shutdown_connections 2021-02-12T17:18:31.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.860+0000 7fad6b7d5700 1 --2- 172.21.2.102:0/3399761613 >> v2:172.21.2.104:3300/0 conn(0x7fad64062740 0x7fad64062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:31.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.860+0000 7fad6b7d5700 1 --2- 172.21.2.102:0/3399761613 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fad640b8d20 0x7fad64068830 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:31.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.860+0000 7fad6b7d5700 1 -- 172.21.2.102:0/3399761613 >> 172.21.2.102:0/3399761613 conn(0x7fad640bc480 msgr2=0x7fad640b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:31.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.860+0000 7fad6b7d5700 1 -- 172.21.2.102:0/3399761613 shutdown_connections 2021-02-12T17:18:31.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.860+0000 7fad6b7d5700 1 -- 172.21.2.102:0/3399761613 wait complete. 2021-02-12T17:18:31.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.861+0000 7fad6b7d5700 1 Processor -- start 2021-02-12T17:18:31.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.861+0000 7fad6b7d5700 1 -- start start 2021-02-12T17:18:31.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad6b7d5700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fad64062740 0x7fad6415de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:31.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad6b7d5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fad640b8d20 0x7fad640b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:31.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad6b7d5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fad6414e530 0x7fad64153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:31.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad6b7d5700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad640b0a30 con 0x7fad6414e530 2021-02-12T17:18:31.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad6b7d5700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad640acf10 con 0x7fad64062740 2021-02-12T17:18:31.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad6b7d5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad640ad1b0 con 0x7fad640b8d20 2021-02-12T17:18:31.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad69d72700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fad6414e530 0x7fad64153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:31.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad69d72700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fad6414e530 0x7fad64153710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46152/0 (socket says 172.21.2.102:46152) 2021-02-12T17:18:31.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad69d72700 1 -- 172.21.2.102:0/1197245255 learned_addr learned my addr 172.21.2.102:0/1197245255 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:31.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad69571700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fad64062740 0x7fad6415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:31.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad68d70700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fad640b8d20 0x7fad640b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:31.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad69d72700 1 -- 172.21.2.102:0/1197245255 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fad640b8d20 msgr2=0x7fad640b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:31.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad69d72700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fad640b8d20 0x7fad640b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:31.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad69d72700 1 -- 172.21.2.102:0/1197245255 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fad64062740 msgr2=0x7fad6415de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:31.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad69d72700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fad64062740 0x7fad6415de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:31.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad69d72700 1 -- 172.21.2.102:0/1197245255 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6415d470 con 0x7fad6414e530 2021-02-12T17:18:31.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad68d70700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fad640b8d20 0x7fad640b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:18:31.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.862+0000 7fad69d72700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fad6414e530 0x7fad64153710 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fad5c00bae0 tx=0x7fad5c009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:31.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.863+0000 7fad557fa700 1 -- 172.21.2.102:0/1197245255 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00c8d0 con 0x7fad6414e530 2021-02-12T17:18:31.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.863+0000 7fad557fa700 1 -- 172.21.2.102:0/1197245255 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c00ca30 con 0x7fad6414e530 2021-02-12T17:18:31.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.863+0000 7fad557fa700 1 -- 172.21.2.102:0/1197245255 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00cbe0 con 0x7fad6414e530 2021-02-12T17:18:31.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.863+0000 7fad6b7d5700 1 -- 172.21.2.102:0/1197245255 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6415d710 con 0x7fad6414e530 2021-02-12T17:18:31.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.863+0000 7fad6b7d5700 1 -- 172.21.2.102:0/1197245255 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad64153c00 con 0x7fad6414e530 2021-02-12T17:18:31.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.863+0000 7fad6b7d5700 1 -- 172.21.2.102:0/1197245255 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6415db70 con 0x7fad6414e530 2021-02-12T17:18:31.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.864+0000 7fad557fa700 1 -- 172.21.2.102:0/1197245255 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fad5c01c070 con 0x7fad6414e530 2021-02-12T17:18:31.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.864+0000 7fad557fa700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fad44059d30 0x7fad4405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:31.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.864+0000 7fad557fa700 1 -- 172.21.2.102:0/1197245255 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6935+0+0 (secure 0 0 0) 0x7fad5c0734b0 con 0x7fad6414e530 2021-02-12T17:18:31.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.864+0000 7fad69571700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fad44059d30 0x7fad4405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:31.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.864+0000 7fad69571700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fad44059d30 0x7fad4405c1f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fad60006e20 tx=0x7fad60016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:31.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:31.867+0000 7fad557fa700 1 -- 172.21.2.102:0/1197245255 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fad5c046c90 con 0x7fad6414e530 2021-02-12T17:18:32.025 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:32.024+0000 7fad6b7d5700 1 -- 172.21.2.102:0/1197245255 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad64045460 con 0x7fad6414e530 2021-02-12T17:18:32.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:32.025+0000 7fad557fa700 1 -- 172.21.2.102:0/1197245255 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3403 (secure 0 0 0) 0x7fad5c01a070 con 0x7fad6414e530 2021-02-12T17:18:32.026 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:32.026 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:32.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:32.026+0000 7fad6b7d5700 1 -- 172.21.2.102:0/1197245255 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fad44059d30 msgr2=0x7fad4405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:32.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:32.026+0000 7fad6b7d5700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fad44059d30 0x7fad4405c1f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fad60006e20 tx=0x7fad60016000).stop 2021-02-12T17:18:32.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:32.026+0000 7fad6b7d5700 1 -- 172.21.2.102:0/1197245255 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fad6414e530 msgr2=0x7fad64153710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:32.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:32.026+0000 7fad6b7d5700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fad6414e530 0x7fad64153710 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fad5c00bae0 tx=0x7fad5c009220).stop 2021-02-12T17:18:32.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:32.026+0000 7fad6b7d5700 1 -- 172.21.2.102:0/1197245255 shutdown_connections 2021-02-12T17:18:32.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:32.026+0000 7fad6b7d5700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fad44059d30 0x7fad4405c1f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:32.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:32.026+0000 7fad6b7d5700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fad6414e530 0x7fad64153710 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:32.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:32.026+0000 7fad6b7d5700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fad64062740 0x7fad6415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:32.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:32.026+0000 7fad6b7d5700 1 --2- 172.21.2.102:0/1197245255 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fad640b8d20 0x7fad640b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:32.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:32.026+0000 7fad6b7d5700 1 -- 172.21.2.102:0/1197245255 >> 172.21.2.102:0/1197245255 conn(0x7fad640bc480 msgr2=0x7fad64062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:32.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:32.027+0000 7fad6b7d5700 1 -- 172.21.2.102:0/1197245255 shutdown_connections 2021-02-12T17:18:32.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:32.027+0000 7fad6b7d5700 1 -- 172.21.2.102:0/1197245255 wait complete. 2021-02-12T17:18:32.029 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 14 2021-02-12T17:18:32.037 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:18:33.010 INFO:tasks.ceph.mds.d.gibba004.stderr:2021-02-12T17:18:33.009+0000 7f39b437a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-02-12T17:18:33.842 INFO:tasks.mds_thrash.fs.[b]:reviving mds.a 2021-02-12T17:18:33.842 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-12T17:18:33.842 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-12T17:18:33.845 INFO:tasks.ceph.mds.a:Started 2021-02-12T17:18:33.846 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:33.901 INFO:tasks.ceph.mds.a.gibba002.stdout:starting mds.a at 2021-02-12T17:18:33.935 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.934+0000 7f7400ab3700 1 Processor -- start 2021-02-12T17:18:33.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.934+0000 7f7400ab3700 1 -- start start 2021-02-12T17:18:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.935+0000 7f7400ab3700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f73fc0b8d20 0x7f73fc068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.935+0000 7f7400ab3700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73fc0b7960 con 0x7f73fc14e530 2021-02-12T17:18:33.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.935+0000 7f7400ab3700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73fc0622a0 con 0x7f73fc062740 2021-02-12T17:18:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.935+0000 7f7400ab3700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73fc068d20 con 0x7f73fc0b8d20 2021-02-12T17:18:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.935+0000 7f73fa59c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f73fc0b8d20 0x7f73fc068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.935+0000 7f73fa59c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f73fc0b8d20 0x7f73fc068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46170/0 (socket says 172.21.2.102:46170) 2021-02-12T17:18:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.935+0000 7f73fa59c700 1 -- 172.21.2.102:0/302420945 learned_addr learned my addr 172.21.2.102:0/302420945 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.935+0000 7f73f959a700 1 -- 172.21.2.102:0/302420945 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299616494 0 0) 0x7f73fc0b7960 con 0x7f73fc14e530 2021-02-12T17:18:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.935+0000 7f73fa59c700 1 -- 172.21.2.102:0/302420945 >> v1:172.21.2.104:6789/0 conn(0x7f73fc062740 legacy=0x7f73fc062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:18:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.935+0000 7f73fa59c700 1 -- 172.21.2.102:0/302420945 >> v1:172.21.2.102:6789/0 conn(0x7f73fc14e530 legacy=0x7f73fc0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.935+0000 7f73fa59c700 1 -- 172.21.2.102:0/302420945 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc14ea10 con 0x7f73fc0b8d20 2021-02-12T17:18:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.935+0000 7f73fa59c700 1 --2- 172.21.2.102:0/302420945 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73fc0b8d20 0x7f73fc068830 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f73ec00b9e0 tx=0x7f73ec006ea0).ready entity=mon.0 client_cookie=f63918c764330ede server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.936+0000 7f73f959a700 1 -- 172.21.2.102:0/302420945 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec009800 con 0x7f73fc0b8d20 2021-02-12T17:18:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.936+0000 7f73f959a700 1 -- 172.21.2.102:0/302420945 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec009960 con 0x7f73fc0b8d20 2021-02-12T17:18:33.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.936+0000 7f73f959a700 1 -- 172.21.2.102:0/302420945 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec009ce0 con 0x7f73fc0b8d20 2021-02-12T17:18:33.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.936+0000 7f7400ab3700 1 -- 172.21.2.102:0/302420945 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73fc0b8d20 msgr2=0x7f73fc068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:33.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.936+0000 7f7400ab3700 1 --2- 172.21.2.102:0/302420945 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73fc0b8d20 0x7f73fc068830 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f73ec00b9e0 tx=0x7f73ec006ea0).stop 2021-02-12T17:18:33.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.936+0000 7f7400ab3700 1 -- 172.21.2.102:0/302420945 shutdown_connections 2021-02-12T17:18:33.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.936+0000 7f7400ab3700 1 --2- 172.21.2.102:0/302420945 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73fc0b8d20 0x7f73fc068830 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:33.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.936+0000 7f7400ab3700 1 -- 172.21.2.102:0/302420945 >> 172.21.2.102:0/302420945 conn(0x7f73fc0bc480 msgr2=0x7f73fc0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:33.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.936+0000 7f7400ab3700 1 -- 172.21.2.102:0/302420945 shutdown_connections 2021-02-12T17:18:33.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.936+0000 7f7400ab3700 1 -- 172.21.2.102:0/302420945 wait complete. 2021-02-12T17:18:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.937+0000 7f7400ab3700 1 Processor -- start 2021-02-12T17:18:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.937+0000 7f7400ab3700 1 -- start start 2021-02-12T17:18:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.937+0000 7f7400ab3700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73fc062740 0x7f73fc161410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.937+0000 7f7400ab3700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73fc0b8d20 0x7f73fc1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.937+0000 7f7400ab3700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f73fc14e530 0x7f73fc15d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.937+0000 7f7400ab3700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc0b26e0 con 0x7f73fc062740 2021-02-12T17:18:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.937+0000 7f7400ab3700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc161900 con 0x7f73fc0b8d20 2021-02-12T17:18:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.937+0000 7f7400ab3700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc0b4e70 con 0x7f73fc14e530 2021-02-12T17:18:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.938+0000 7f73fa59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73fc062740 0x7f73fc161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:33.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.938+0000 7f73fa59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73fc062740 0x7f73fc161410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46178/0 (socket says 172.21.2.102:46178) 2021-02-12T17:18:33.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.938+0000 7f73fa59c700 1 -- 172.21.2.102:0/2162036962 learned_addr learned my addr 172.21.2.102:0/2162036962 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:33.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.938+0000 7f73fa59c700 1 -- 172.21.2.102:0/2162036962 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f73fc14e530 msgr2=0x7f73fc15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:33.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.938+0000 7f73fa59c700 1 --2- 172.21.2.102:0/2162036962 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f73fc14e530 0x7f73fc15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:33.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.938+0000 7f73fa59c700 1 -- 172.21.2.102:0/2162036962 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73fc0b8d20 msgr2=0x7f73fc1536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:33.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.938+0000 7f73fa59c700 1 --2- 172.21.2.102:0/2162036962 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73fc0b8d20 0x7f73fc1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:33.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.938+0000 7f73fa59c700 1 -- 172.21.2.102:0/2162036962 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc0b5110 con 0x7f73fc062740 2021-02-12T17:18:33.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.938+0000 7f73fa59c700 1 --2- 172.21.2.102:0/2162036962 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73fc062740 0x7f73fc161410 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f73fc0653c0 tx=0x7f73ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:33.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.938+0000 7f73ea7fc700 1 -- 172.21.2.102:0/2162036962 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec011e70 con 0x7f73fc062740 2021-02-12T17:18:33.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.938+0000 7f73ea7fc700 1 -- 172.21.2.102:0/2162036962 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec01d430 con 0x7f73fc062740 2021-02-12T17:18:33.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.938+0000 7f7400ab3700 1 -- 172.21.2.102:0/2162036962 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73fc160a30 con 0x7f73fc062740 2021-02-12T17:18:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.938+0000 7f73ea7fc700 1 -- 172.21.2.102:0/2162036962 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec01d7d0 con 0x7f73fc062740 2021-02-12T17:18:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.938+0000 7f7400ab3700 1 -- 172.21.2.102:0/2162036962 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73fc160f70 con 0x7f73fc062740 2021-02-12T17:18:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.939+0000 7f7400ab3700 1 -- 172.21.2.102:0/2162036962 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73fc045460 con 0x7f73fc062740 2021-02-12T17:18:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.939+0000 7f73ea7fc700 1 -- 172.21.2.102:0/2162036962 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f73ec00f070 con 0x7f73fc062740 2021-02-12T17:18:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.939+0000 7f73ea7fc700 1 --2- 172.21.2.102:0/2162036962 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f73d8059d30 0x7f73d805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.939+0000 7f73ea7fc700 1 -- 172.21.2.102:0/2162036962 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6935+0+0 (secure 0 0 0) 0x7f73ec075760 con 0x7f73fc062740 2021-02-12T17:18:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.940+0000 7f73f9d9b700 1 --2- 172.21.2.102:0/2162036962 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f73d8059d30 0x7f73d805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:33.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.940+0000 7f73f9d9b700 1 --2- 172.21.2.102:0/2162036962 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f73d8059d30 0x7f73d805c1f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f73fc0b5530 tx=0x7f73f0007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:33.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:33.942+0000 7f73ea7fc700 1 -- 172.21.2.102:0/2162036962 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f73ec048f40 con 0x7f73fc062740 2021-02-12T17:18:34.037 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:34.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.106+0000 7f7400ab3700 1 -- 172.21.2.102:0/2162036962 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73fc067e40 con 0x7f73fc062740 2021-02-12T17:18:34.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.107+0000 7f73ea7fc700 1 -- 172.21.2.102:0/2162036962 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3403 (secure 0 0 0) 0x7f73ec04c560 con 0x7f73fc062740 2021-02-12T17:18:34.108 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:34.109 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:34.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.108+0000 7f7400ab3700 1 -- 172.21.2.102:0/2162036962 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f73d8059d30 msgr2=0x7f73d805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:34.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.108+0000 7f7400ab3700 1 --2- 172.21.2.102:0/2162036962 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f73d8059d30 0x7f73d805c1f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f73fc0b5530 tx=0x7f73f0007800).stop 2021-02-12T17:18:34.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.108+0000 7f7400ab3700 1 -- 172.21.2.102:0/2162036962 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73fc062740 msgr2=0x7f73fc161410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:34.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.108+0000 7f7400ab3700 1 --2- 172.21.2.102:0/2162036962 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73fc062740 0x7f73fc161410 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f73fc0653c0 tx=0x7f73ec016000).stop 2021-02-12T17:18:34.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.108+0000 7f7400ab3700 1 -- 172.21.2.102:0/2162036962 shutdown_connections 2021-02-12T17:18:34.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.108+0000 7f7400ab3700 1 --2- 172.21.2.102:0/2162036962 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f73fc14e530 0x7f73fc15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:34.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.108+0000 7f7400ab3700 1 --2- 172.21.2.102:0/2162036962 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f73d8059d30 0x7f73d805c1f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:34.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.108+0000 7f7400ab3700 1 --2- 172.21.2.102:0/2162036962 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f73fc062740 0x7f73fc161410 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:34.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.108+0000 7f7400ab3700 1 --2- 172.21.2.102:0/2162036962 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73fc0b8d20 0x7f73fc1536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:34.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.108+0000 7f7400ab3700 1 -- 172.21.2.102:0/2162036962 >> 172.21.2.102:0/2162036962 conn(0x7f73fc0bc480 msgr2=0x7f73fc14cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:34.110 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.108+0000 7f7400ab3700 1 -- 172.21.2.102:0/2162036962 shutdown_connections 2021-02-12T17:18:34.111 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.108+0000 7f7400ab3700 1 -- 172.21.2.102:0/2162036962 wait complete. 2021-02-12T17:18:34.111 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 14 2021-02-12T17:18:34.118 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-02-12T17:18:34.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.127+0000 7f3dd10a0700 1 Processor -- start 2021-02-12T17:18:34.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.127+0000 7f3dd10a0700 1 -- start start 2021-02-12T17:18:34.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.128+0000 7f3dd10a0700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3dcc14e530 0x7f3dcc068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:34.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.128+0000 7f3dd10a0700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f3dcc062740 0x7f3dcc062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:34.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.128+0000 7f3dd10a0700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dcc0b7960 con 0x7f3dcc0b8d20 2021-02-12T17:18:34.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.128+0000 7f3dd10a0700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dcc068d20 con 0x7f3dcc062740 2021-02-12T17:18:34.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.128+0000 7f3dd10a0700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc0622a0 con 0x7f3dcc14e530 2021-02-12T17:18:34.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.128+0000 7f3dcad9d700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f3dcc0b8d20 0x7f3dcc0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54828/0 (socket says 172.21.2.102:54828) 2021-02-12T17:18:34.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.128+0000 7f3dcad9d700 1 -- 172.21.2.102:0/2569134352 learned_addr learned my addr 172.21.2.102:0/2569134352 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:34.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.128+0000 7f3dc9d9b700 1 -- 172.21.2.102:0/2569134352 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525116818 0 0) 0x7f3dcc0b7960 con 0x7f3dcc0b8d20 2021-02-12T17:18:34.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.128+0000 7f3dc9d9b700 1 -- 172.21.2.102:0/2569134352 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dac003230 con 0x7f3dcc0b8d20 2021-02-12T17:18:34.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 -- 172.21.2.102:0/2569134352 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1948288852 0 0) 0x7f3dac003230 con 0x7f3dcc0b8d20 2021-02-12T17:18:34.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dcb59e700 1 --2- 172.21.2.102:0/2569134352 >> v2:172.21.2.104:3300/0 conn(0x7f3dcc062740 0x7f3dcc062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:34.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 -- 172.21.2.102:0/2569134352 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3dcc14e530 msgr2=0x7f3dcc068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:34.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 --2- 172.21.2.102:0/2569134352 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3dcc14e530 0x7f3dcc068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:34.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 -- 172.21.2.102:0/2569134352 >> v2:172.21.2.104:3300/0 conn(0x7f3dcc062740 msgr2=0x7f3dcc062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:34.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 --2- 172.21.2.102:0/2569134352 >> v2:172.21.2.104:3300/0 conn(0x7f3dcc062740 0x7f3dcc062bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:34.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 -- 172.21.2.102:0/2569134352 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc14ea10 con 0x7f3dcc0b8d20 2021-02-12T17:18:34.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 -- 172.21.2.102:0/2569134352 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f3dbc0014e0 con 0x7f3dcc0b8d20 2021-02-12T17:18:34.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dcb59e700 1 --2- 172.21.2.102:0/2569134352 >> v2:172.21.2.104:3300/0 conn(0x7f3dcc062740 0x7f3dcc062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:18:34.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 -- 172.21.2.102:0/2569134352 >> v1:172.21.2.102:6789/0 conn(0x7f3dcc0b8d20 legacy=0x7f3dcc0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:34.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 --2- 172.21.2.102:0/2569134352 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3dcc14e530 0x7f3dac0037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:34.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 --2- 172.21.2.102:0/2569134352 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3dac003d00 0x7f3dac0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:34.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 --2- 172.21.2.102:0/2569134352 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3dac0049c0 0x7f3dac004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:34.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 -- 172.21.2.102:0/2569134352 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc068d20 con 0x7f3dac003d00 2021-02-12T17:18:34.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 -- 172.21.2.102:0/2569134352 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc0622a0 con 0x7f3dac0049c0 2021-02-12T17:18:34.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 -- 172.21.2.102:0/2569134352 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac0042c0 con 0x7f3dcc14e530 2021-02-12T17:18:34.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dca59c700 1 --2- 172.21.2.102:0/2569134352 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3dac003d00 0x7f3dac0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:34.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dcad9d700 1 --2- 172.21.2.102:0/2569134352 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3dcc14e530 0x7f3dac0037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:34.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dcb59e700 1 --2- 172.21.2.102:0/2569134352 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3dac0049c0 0x7f3dac004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:34.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dca59c700 1 -- 172.21.2.102:0/2569134352 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3dcc14e530 msgr2=0x7f3dac0037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:34.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dca59c700 1 --2- 172.21.2.102:0/2569134352 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3dcc14e530 0x7f3dac0037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:34.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dca59c700 1 -- 172.21.2.102:0/2569134352 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3dac0049c0 msgr2=0x7f3dac004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:34.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dca59c700 1 --2- 172.21.2.102:0/2569134352 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3dac0049c0 0x7f3dac004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:34.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dca59c700 1 -- 172.21.2.102:0/2569134352 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac003230 con 0x7f3dac003d00 2021-02-12T17:18:34.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dca59c700 1 --2- 172.21.2.102:0/2569134352 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3dac003d00 0x7f3dac0044d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f3db400b950 tx=0x7f3db4006e20).ready entity=mon.0 client_cookie=31f1baa122610c11 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:34.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 -- 172.21.2.102:0/2569134352 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4009780 con 0x7f3dac003d00 2021-02-12T17:18:34.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 -- 172.21.2.102:0/2569134352 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db4000e90 con 0x7f3dac003d00 2021-02-12T17:18:34.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.129+0000 7f3dc9d9b700 1 -- 172.21.2.102:0/2569134352 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4009b30 con 0x7f3dac003d00 2021-02-12T17:18:34.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.130+0000 7f3dd10a0700 1 -- 172.21.2.102:0/2569134352 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3dac003d00 msgr2=0x7f3dac0044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:34.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.130+0000 7f3dd10a0700 1 --2- 172.21.2.102:0/2569134352 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3dac003d00 0x7f3dac0044d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f3db400b950 tx=0x7f3db4006e20).stop 2021-02-12T17:18:34.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.130+0000 7f3dcb59e700 1 -- 172.21.2.102:0/2569134352 reap_dead start 2021-02-12T17:18:34.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.130+0000 7f3dd10a0700 1 -- 172.21.2.102:0/2569134352 shutdown_connections 2021-02-12T17:18:34.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.130+0000 7f3dd10a0700 1 -- 172.21.2.102:0/2569134352 >> 172.21.2.102:0/2569134352 conn(0x7f3dcc0bc480 msgr2=0x7f3dcc0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:34.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.130+0000 7f3dd10a0700 1 -- 172.21.2.102:0/2569134352 shutdown_connections 2021-02-12T17:18:34.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.130+0000 7f3dd10a0700 1 -- 172.21.2.102:0/2569134352 wait complete. 2021-02-12T17:18:34.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.131+0000 7f3dd10a0700 1 Processor -- start 2021-02-12T17:18:34.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.131+0000 7f3dd10a0700 1 -- start start 2021-02-12T17:18:34.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.131+0000 7f3dd10a0700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3dac003d00 0x7f3dcc14b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:34.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.131+0000 7f3dd10a0700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3dcc151c90 0x7f3dcc0b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:34.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.131+0000 7f3dd10a0700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3dcc149e60 0x7f3dcc14a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:34.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.131+0000 7f3dd10a0700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc14a860 con 0x7f3dcc151c90 2021-02-12T17:18:34.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.131+0000 7f3dd10a0700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc0ad340 con 0x7f3dcc149e60 2021-02-12T17:18:34.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.131+0000 7f3dd10a0700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc0ad5e0 con 0x7f3dac003d00 2021-02-12T17:18:34.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.131+0000 7f3dca59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3dcc151c90 0x7f3dcc0b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:34.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.131+0000 7f3dca59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3dcc151c90 0x7f3dcc0b6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46194/0 (socket says 172.21.2.102:46194) 2021-02-12T17:18:34.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.131+0000 7f3dca59c700 1 -- 172.21.2.102:0/3207544636 learned_addr learned my addr 172.21.2.102:0/3207544636 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:34.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.132+0000 7f3dcb59e700 1 --2- 172.21.2.102:0/3207544636 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3dcc149e60 0x7f3dcc14a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:34.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.132+0000 7f3dca59c700 1 -- 172.21.2.102:0/3207544636 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3dac003d00 msgr2=0x7f3dcc14b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:34.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.132+0000 7f3dca59c700 1 --2- 172.21.2.102:0/3207544636 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3dac003d00 0x7f3dcc14b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:34.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.132+0000 7f3dca59c700 1 -- 172.21.2.102:0/3207544636 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3dcc149e60 msgr2=0x7f3dcc14a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:34.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.132+0000 7f3dca59c700 1 --2- 172.21.2.102:0/3207544636 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3dcc149e60 0x7f3dcc14a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:34.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.132+0000 7f3dca59c700 1 -- 172.21.2.102:0/3207544636 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc14aa90 con 0x7f3dcc151c90 2021-02-12T17:18:34.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.132+0000 7f3dcb59e700 1 --2- 172.21.2.102:0/3207544636 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3dcc149e60 0x7f3dcc14a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:18:34.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.132+0000 7f3dca59c700 1 --2- 172.21.2.102:0/3207544636 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3dcc151c90 0x7f3dcc0b6ff0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f3dac005450 tx=0x7f3db4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:34.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.132+0000 7f3dc2ffd700 1 -- 172.21.2.102:0/3207544636 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db40067d0 con 0x7f3dcc151c90 2021-02-12T17:18:34.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.132+0000 7f3dc2ffd700 1 -- 172.21.2.102:0/3207544636 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db4014bb0 con 0x7f3dcc151c90 2021-02-12T17:18:34.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.132+0000 7f3dc2ffd700 1 -- 172.21.2.102:0/3207544636 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4020440 con 0x7f3dcc151c90 2021-02-12T17:18:34.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.132+0000 7f3dd10a0700 1 -- 172.21.2.102:0/3207544636 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dcc14ad30 con 0x7f3dcc151c90 2021-02-12T17:18:34.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.132+0000 7f3dd10a0700 1 -- 172.21.2.102:0/3207544636 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dcc14b6c0 con 0x7f3dcc151c90 2021-02-12T17:18:34.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.133+0000 7f3dd10a0700 1 -- 172.21.2.102:0/3207544636 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dcc0ad7a0 con 0x7f3dcc151c90 2021-02-12T17:18:34.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.133+0000 7f3dc2ffd700 1 -- 172.21.2.102:0/3207544636 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f3db4026020 con 0x7f3dcc151c90 2021-02-12T17:18:34.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.133+0000 7f3dc2ffd700 1 --2- 172.21.2.102:0/3207544636 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3db0059db0 0x7f3db005c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:34.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.133+0000 7f3dc2ffd700 1 -- 172.21.2.102:0/3207544636 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6935+0+0 (secure 0 0 0) 0x7f3db40751b0 con 0x7f3dcc151c90 2021-02-12T17:18:34.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.133+0000 7f3dcad9d700 1 --2- 172.21.2.102:0/3207544636 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3db0059db0 0x7f3db005c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:34.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.133+0000 7f3dcad9d700 1 --2- 172.21.2.102:0/3207544636 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3db0059db0 0x7f3db005c270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f3dbc001e90 tx=0x7f3dcc14eba0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:34.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.136+0000 7f3dc2ffd700 1 -- 172.21.2.102:0/3207544636 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f3db4048880 con 0x7f3dcc151c90 2021-02-12T17:18:34.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.295+0000 7f3dd10a0700 1 -- 172.21.2.102:0/3207544636 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3dcc14aec0 con 0x7f3dcc151c90 2021-02-12T17:18:34.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.295+0000 7f3dc2ffd700 1 -- 172.21.2.102:0/3207544636 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3403 (secure 0 0 0) 0x7f3db404bea0 con 0x7f3dcc151c90 2021-02-12T17:18:34.297 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:34.297 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:34.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.296+0000 7f3dd10a0700 1 -- 172.21.2.102:0/3207544636 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3db0059db0 msgr2=0x7f3db005c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:34.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.296+0000 7f3dd10a0700 1 --2- 172.21.2.102:0/3207544636 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3db0059db0 0x7f3db005c270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f3dbc001e90 tx=0x7f3dcc14eba0).stop 2021-02-12T17:18:34.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.296+0000 7f3dd10a0700 1 -- 172.21.2.102:0/3207544636 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3dcc151c90 msgr2=0x7f3dcc0b6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:34.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.296+0000 7f3dd10a0700 1 --2- 172.21.2.102:0/3207544636 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3dcc151c90 0x7f3dcc0b6ff0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f3dac005450 tx=0x7f3db4015000).stop 2021-02-12T17:18:34.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.296+0000 7f3dd10a0700 1 -- 172.21.2.102:0/3207544636 shutdown_connections 2021-02-12T17:18:34.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.296+0000 7f3dd10a0700 1 --2- 172.21.2.102:0/3207544636 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3dcc149e60 0x7f3dcc14a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:34.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.296+0000 7f3dd10a0700 1 --2- 172.21.2.102:0/3207544636 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3dac003d00 0x7f3dcc14b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:34.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.296+0000 7f3dd10a0700 1 --2- 172.21.2.102:0/3207544636 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3db0059db0 0x7f3db005c270 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:34.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.296+0000 7f3dd10a0700 1 --2- 172.21.2.102:0/3207544636 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3dcc151c90 0x7f3dcc0b6ff0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:34.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.296+0000 7f3dd10a0700 1 -- 172.21.2.102:0/3207544636 >> 172.21.2.102:0/3207544636 conn(0x7f3dcc0bc480 msgr2=0x7f3dcc14d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:34.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.296+0000 7f3dd10a0700 1 -- 172.21.2.102:0/3207544636 shutdown_connections 2021-02-12T17:18:34.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:34.296+0000 7f3dd10a0700 1 -- 172.21.2.102:0/3207544636 wait complete. 2021-02-12T17:18:34.299 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 14 2021-02-12T17:18:34.306 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:18:35.262 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba002.stderr:2021-02-12T17:18:35.261+0000 7fbaf2ebc700 -1 --2- 192.168.0.1:0/4086178760 >> [v2:172.21.2.102:6835/1917299206,v1:172.21.2.102:6837/1917299206] conn(0x5653511a1460 0x5653511a3850 unknown :-1 s=BANNER_CONNECTING pgs=10 cs=9 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner peer [v2:172.21.2.102:6835/1917299206,v1:172.21.2.102:6837/1917299206] is using msgr V1 protocol 2021-02-12T17:18:36.120 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:36.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.209+0000 7f12d8d91700 1 Processor -- start 2021-02-12T17:18:36.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.209+0000 7f12d8d91700 1 -- start start 2021-02-12T17:18:36.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.210+0000 7f12d8d91700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f12d40b8d20 0x7f12d4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.210+0000 7f12d8d91700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f12d4062740 0x7f12d4062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.210+0000 7f12d8d91700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d40b7960 con 0x7f12d414e530 2021-02-12T17:18:36.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.210+0000 7f12d8d91700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d4068d20 con 0x7f12d4062740 2021-02-12T17:18:36.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.210+0000 7f12d8d91700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40622a0 con 0x7f12d40b8d20 2021-02-12T17:18:36.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.210+0000 7f12d1d9b700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f12d414e530 0x7f12d40b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54852/0 (socket says 172.21.2.102:54852) 2021-02-12T17:18:36.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.210+0000 7f12d1d9b700 1 -- 172.21.2.102:0/8713019 learned_addr learned my addr 172.21.2.102:0/8713019 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:36.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.210+0000 7f12d159a700 1 -- 172.21.2.102:0/8713019 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726738646 0 0) 0x7f12d40b7960 con 0x7f12d414e530 2021-02-12T17:18:36.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.210+0000 7f12d159a700 1 -- 172.21.2.102:0/8713019 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12b4003230 con 0x7f12d414e530 2021-02-12T17:18:36.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d159a700 1 -- 172.21.2.102:0/8713019 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1451026477 0 0) 0x7f12b4003230 con 0x7f12d414e530 2021-02-12T17:18:36.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d159a700 1 -- 172.21.2.102:0/8713019 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f12d40b8d20 msgr2=0x7f12d4068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:36.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d159a700 1 --2- 172.21.2.102:0/8713019 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f12d40b8d20 0x7f12d4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:36.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d159a700 1 -- 172.21.2.102:0/8713019 >> v2:172.21.2.104:3300/0 conn(0x7f12d4062740 msgr2=0x7f12d4062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:36.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d159a700 1 --2- 172.21.2.102:0/8713019 >> v2:172.21.2.104:3300/0 conn(0x7f12d4062740 0x7f12d4062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:36.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d159a700 1 -- 172.21.2.102:0/8713019 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d414ea10 con 0x7f12d414e530 2021-02-12T17:18:36.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d159a700 1 -- 172.21.2.102:0/8713019 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f12c40014e0 con 0x7f12d414e530 2021-02-12T17:18:36.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d159a700 1 -- 172.21.2.102:0/8713019 >> v1:172.21.2.102:6789/0 conn(0x7f12d414e530 legacy=0x7f12d40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:36.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d159a700 1 --2- 172.21.2.102:0/8713019 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f12d40b8d20 0x7f12b40037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d159a700 1 --2- 172.21.2.102:0/8713019 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f12b4003d00 0x7f12b40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d159a700 1 --2- 172.21.2.102:0/8713019 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f12b40049c0 0x7f12b4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d159a700 1 -- 172.21.2.102:0/8713019 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4068d20 con 0x7f12b4003d00 2021-02-12T17:18:36.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d159a700 1 -- 172.21.2.102:0/8713019 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40622a0 con 0x7f12b40049c0 2021-02-12T17:18:36.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d159a700 1 -- 172.21.2.102:0/8713019 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b40042c0 con 0x7f12d40b8d20 2021-02-12T17:18:36.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d1d9b700 1 --2- 172.21.2.102:0/8713019 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f12b4003d00 0x7f12b40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:36.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d2d9d700 1 --2- 172.21.2.102:0/8713019 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f12b40049c0 0x7f12b4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:36.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d259c700 1 --2- 172.21.2.102:0/8713019 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f12d40b8d20 0x7f12b40037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:36.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d1d9b700 1 -- 172.21.2.102:0/8713019 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f12d40b8d20 msgr2=0x7f12b40037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:36.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d1d9b700 1 --2- 172.21.2.102:0/8713019 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f12d40b8d20 0x7f12b40037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d1d9b700 1 -- 172.21.2.102:0/8713019 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f12b40049c0 msgr2=0x7f12b4004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:36.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d1d9b700 1 --2- 172.21.2.102:0/8713019 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f12b40049c0 0x7f12b4004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d1d9b700 1 -- 172.21.2.102:0/8713019 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b4003230 con 0x7f12b4003d00 2021-02-12T17:18:36.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.211+0000 7f12d1d9b700 1 --2- 172.21.2.102:0/8713019 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f12b4003d00 0x7f12b40044d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f12d406ac60 tx=0x7f12d414eba0).ready entity=mon.0 client_cookie=fe68316adb6be106 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:36.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.212+0000 7f12d159a700 1 -- 172.21.2.102:0/8713019 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c400ce40 con 0x7f12b4003d00 2021-02-12T17:18:36.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.212+0000 7f12d159a700 1 -- 172.21.2.102:0/8713019 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c40070d0 con 0x7f12b4003d00 2021-02-12T17:18:36.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.212+0000 7f12d159a700 1 -- 172.21.2.102:0/8713019 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4007470 con 0x7f12b4003d00 2021-02-12T17:18:36.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.212+0000 7f12d8d91700 1 -- 172.21.2.102:0/8713019 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f12b4003d00 msgr2=0x7f12b40044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:36.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.212+0000 7f12d8d91700 1 --2- 172.21.2.102:0/8713019 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f12b4003d00 0x7f12b40044d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f12d406ac60 tx=0x7f12d414eba0).stop 2021-02-12T17:18:36.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.212+0000 7f12d2d9d700 1 -- 172.21.2.102:0/8713019 reap_dead start 2021-02-12T17:18:36.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.212+0000 7f12d8d91700 1 -- 172.21.2.102:0/8713019 shutdown_connections 2021-02-12T17:18:36.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.212+0000 7f12d8d91700 1 -- 172.21.2.102:0/8713019 >> 172.21.2.102:0/8713019 conn(0x7f12d40bc480 msgr2=0x7f12d40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:36.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.212+0000 7f12d8d91700 1 -- 172.21.2.102:0/8713019 shutdown_connections 2021-02-12T17:18:36.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.212+0000 7f12d8d91700 1 -- 172.21.2.102:0/8713019 wait complete. 2021-02-12T17:18:36.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.213+0000 7f12d8d91700 1 Processor -- start 2021-02-12T17:18:36.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.213+0000 7f12d8d91700 1 -- start start 2021-02-12T17:18:36.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.213+0000 7f12d8d91700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f12b4003d00 0x7f12d40b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.213+0000 7f12d8d91700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f12d4152450 0x7f12d40b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.213+0000 7f12d8d91700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f12d40ad140 0x7f12d414aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.213+0000 7f12d8d91700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d41529c0 con 0x7f12b4003d00 2021-02-12T17:18:36.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.213+0000 7f12d8d91700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4152c60 con 0x7f12d4152450 2021-02-12T17:18:36.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.213+0000 7f12d8d91700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d415e100 con 0x7f12d40ad140 2021-02-12T17:18:36.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.213+0000 7f12d259c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f12b4003d00 0x7f12d40b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:36.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.213+0000 7f12d259c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f12b4003d00 0x7f12d40b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46216/0 (socket says 172.21.2.102:46216) 2021-02-12T17:18:36.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.213+0000 7f12d259c700 1 -- 172.21.2.102:0/37743760 learned_addr learned my addr 172.21.2.102:0/37743760 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:36.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.214+0000 7f12d2d9d700 1 --2- 172.21.2.102:0/37743760 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f12d40ad140 0x7f12d414aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:36.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.214+0000 7f12d1d9b700 1 --2- 172.21.2.102:0/37743760 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f12d4152450 0x7f12d40b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:36.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.214+0000 7f12d259c700 1 -- 172.21.2.102:0/37743760 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f12d40ad140 msgr2=0x7f12d414aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:36.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.214+0000 7f12d259c700 1 --2- 172.21.2.102:0/37743760 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f12d40ad140 0x7f12d414aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.214+0000 7f12d259c700 1 -- 172.21.2.102:0/37743760 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f12d4152450 msgr2=0x7f12d40b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:36.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.214+0000 7f12d259c700 1 --2- 172.21.2.102:0/37743760 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f12d4152450 0x7f12d40b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.214+0000 7f12d259c700 1 -- 172.21.2.102:0/37743760 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d415e3a0 con 0x7f12b4003d00 2021-02-12T17:18:36.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.214+0000 7f12d259c700 1 --2- 172.21.2.102:0/37743760 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f12b4003d00 0x7f12d40b0810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f12bc00d8b0 tx=0x7f12bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:36.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.214+0000 7f12ca7fc700 1 -- 172.21.2.102:0/37743760 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00f520 con 0x7f12b4003d00 2021-02-12T17:18:36.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.214+0000 7f12ca7fc700 1 -- 172.21.2.102:0/37743760 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc000e90 con 0x7f12b4003d00 2021-02-12T17:18:36.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.214+0000 7f12ca7fc700 1 -- 172.21.2.102:0/37743760 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00f890 con 0x7f12b4003d00 2021-02-12T17:18:36.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.214+0000 7f12d8d91700 1 -- 172.21.2.102:0/37743760 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d414afb0 con 0x7f12b4003d00 2021-02-12T17:18:36.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.214+0000 7f12d8d91700 1 -- 172.21.2.102:0/37743760 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d414b420 con 0x7f12b4003d00 2021-02-12T17:18:36.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.215+0000 7f12d8d91700 1 -- 172.21.2.102:0/37743760 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d415e530 con 0x7f12b4003d00 2021-02-12T17:18:36.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.215+0000 7f12ca7fc700 1 -- 172.21.2.102:0/37743760 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f12bc00fc00 con 0x7f12b4003d00 2021-02-12T17:18:36.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.215+0000 7f12ca7fc700 1 --2- 172.21.2.102:0/37743760 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f12b8059d30 0x7f12b805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.215+0000 7f12ca7fc700 1 -- 172.21.2.102:0/37743760 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6935+0+0 (secure 0 0 0) 0x7f12bc073880 con 0x7f12b4003d00 2021-02-12T17:18:36.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.215+0000 7f12d1d9b700 1 --2- 172.21.2.102:0/37743760 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f12b8059d30 0x7f12b805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:36.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.216+0000 7f12d1d9b700 1 --2- 172.21.2.102:0/37743760 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f12b8059d30 0x7f12b805c1f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f12d406ac60 tx=0x7f12c4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:36.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.218+0000 7f12ca7fc700 1 -- 172.21.2.102:0/37743760 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f12bc047060 con 0x7f12b4003d00 2021-02-12T17:18:36.307 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:36.379 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.378+0000 7f12d8d91700 1 -- 172.21.2.102:0/37743760 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12d4045460 con 0x7f12b4003d00 2021-02-12T17:18:36.380 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.379+0000 7f12ca7fc700 1 -- 172.21.2.102:0/37743760 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3403 (secure 0 0 0) 0x7f12bc04a680 con 0x7f12b4003d00 2021-02-12T17:18:36.380 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:36.380 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:36.383 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.380+0000 7f12d8d91700 1 -- 172.21.2.102:0/37743760 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f12b8059d30 msgr2=0x7f12b805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:36.383 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.380+0000 7f12d8d91700 1 --2- 172.21.2.102:0/37743760 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f12b8059d30 0x7f12b805c1f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f12d406ac60 tx=0x7f12c4015000).stop 2021-02-12T17:18:36.383 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.380+0000 7f12d8d91700 1 -- 172.21.2.102:0/37743760 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f12b4003d00 msgr2=0x7f12d40b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:36.383 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.380+0000 7f12d8d91700 1 --2- 172.21.2.102:0/37743760 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f12b4003d00 0x7f12d40b0810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f12bc00d8b0 tx=0x7f12bc008040).stop 2021-02-12T17:18:36.383 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.380+0000 7f12d8d91700 1 -- 172.21.2.102:0/37743760 shutdown_connections 2021-02-12T17:18:36.383 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.380+0000 7f12d8d91700 1 --2- 172.21.2.102:0/37743760 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f12d40ad140 0x7f12d414aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.383 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.380+0000 7f12d8d91700 1 --2- 172.21.2.102:0/37743760 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f12b8059d30 0x7f12b805c1f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.383 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.380+0000 7f12d8d91700 1 --2- 172.21.2.102:0/37743760 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f12b4003d00 0x7f12d40b0810 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.383 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.380+0000 7f12d8d91700 1 --2- 172.21.2.102:0/37743760 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f12d4152450 0x7f12d40b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.383 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.380+0000 7f12d8d91700 1 -- 172.21.2.102:0/37743760 >> 172.21.2.102:0/37743760 conn(0x7f12d40bc480 msgr2=0x7f12d414cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:36.383 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.380+0000 7f12d8d91700 1 -- 172.21.2.102:0/37743760 shutdown_connections 2021-02-12T17:18:36.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.380+0000 7f12d8d91700 1 -- 172.21.2.102:0/37743760 wait complete. 2021-02-12T17:18:36.384 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 14 2021-02-12T17:18:36.390 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-02-12T17:18:36.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.396+0000 7ff7f7b3e700 1 Processor -- start 2021-02-12T17:18:36.397 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.396+0000 7ff7f7b3e700 1 -- start start 2021-02-12T17:18:36.398 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.396+0000 7ff7f7b3e700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7ff7f0062e50 0x7ff7f0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.398 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.396+0000 7ff7f7b3e700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f00b7960 con 0x7ff7f00b8d20 2021-02-12T17:18:36.398 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.396+0000 7ff7f7b3e700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f00622a0 con 0x7ff7f014e530 2021-02-12T17:18:36.398 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.396+0000 7ff7f7b3e700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f0068d20 con 0x7ff7f0062e50 2021-02-12T17:18:36.398 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f58da700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7ff7f00b8d20 0x7ff7f00b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54868/0 (socket says 172.21.2.102:54868) 2021-02-12T17:18:36.398 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f58da700 1 -- 172.21.2.102:0/3771935501 learned_addr learned my addr 172.21.2.102:0/3771935501 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:36.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 -- 172.21.2.102:0/3771935501 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101059726 0 0) 0x7ff7f00b7960 con 0x7ff7f00b8d20 2021-02-12T17:18:36.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 -- 172.21.2.102:0/3771935501 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7dc003230 con 0x7ff7f00b8d20 2021-02-12T17:18:36.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f60db700 1 --2- 172.21.2.102:0/3771935501 >> v2:172.21.2.104:3300/0 conn(0x7ff7f0062e50 0x7ff7f0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:36.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 -- 172.21.2.102:0/3771935501 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3545558975 0 0) 0x7ff7dc003230 con 0x7ff7f00b8d20 2021-02-12T17:18:36.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 -- 172.21.2.102:0/3771935501 >> v2:172.21.2.104:3300/0 conn(0x7ff7f0062e50 msgr2=0x7ff7f0068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:36.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 --2- 172.21.2.102:0/3771935501 >> v2:172.21.2.104:3300/0 conn(0x7ff7f0062e50 0x7ff7f0068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 -- 172.21.2.102:0/3771935501 >> v1:172.21.2.104:6789/0 conn(0x7ff7f014e530 legacy=0x7ff7f0062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:36.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 -- 172.21.2.102:0/3771935501 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f014ea10 con 0x7ff7f00b8d20 2021-02-12T17:18:36.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 -- 172.21.2.102:0/3771935501 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7ff7e8001860 con 0x7ff7f00b8d20 2021-02-12T17:18:36.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 -- 172.21.2.102:0/3771935501 >> v1:172.21.2.102:6789/0 conn(0x7ff7f00b8d20 legacy=0x7ff7f00b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:36.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 --2- 172.21.2.102:0/3771935501 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7dc0037f0 0x7ff7dc003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 --2- 172.21.2.102:0/3771935501 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff7dc0044d0 0x7ff7dc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 --2- 172.21.2.102:0/3771935501 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff7dc004e40 0x7ff7dc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 -- 172.21.2.102:0/3771935501 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f0068d20 con 0x7ff7dc004e40 2021-02-12T17:18:36.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 -- 172.21.2.102:0/3771935501 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc0053a0 con 0x7ff7dc0037f0 2021-02-12T17:18:36.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.397+0000 7ff7f48d8700 1 -- 172.21.2.102:0/3771935501 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc00bc60 con 0x7ff7dc0044d0 2021-02-12T17:18:36.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f60db700 1 --2- 172.21.2.102:0/3771935501 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff7dc004e40 0x7ff7dc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:36.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f58da700 1 --2- 172.21.2.102:0/3771935501 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7dc0037f0 0x7ff7dc003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:36.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f60db700 1 -- 172.21.2.102:0/3771935501 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff7dc0044d0 msgr2=0x7ff7dc004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:36.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f60db700 1 --2- 172.21.2.102:0/3771935501 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff7dc0044d0 0x7ff7dc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:36.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f60db700 1 -- 172.21.2.102:0/3771935501 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7dc0037f0 msgr2=0x7ff7dc003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:36.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f60db700 1 --2- 172.21.2.102:0/3771935501 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7dc0037f0 0x7ff7dc003bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f60db700 1 -- 172.21.2.102:0/3771935501 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc003230 con 0x7ff7dc004e40 2021-02-12T17:18:36.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f60db700 1 -- 172.21.2.102:0/3771935501 reap_dead start 2021-02-12T17:18:36.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f60db700 1 --2- 172.21.2.102:0/3771935501 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff7dc004e40 0x7ff7dc00b720 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7ff7e400baa0 tx=0x7ff7e4008040).ready entity=mon.0 client_cookie=c01936316e0812b2 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:36.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f48d8700 1 -- 172.21.2.102:0/3771935501 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e400d930 con 0x7ff7dc004e40 2021-02-12T17:18:36.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f48d8700 1 -- 172.21.2.102:0/3771935501 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e400da90 con 0x7ff7dc004e40 2021-02-12T17:18:36.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f48d8700 1 -- 172.21.2.102:0/3771935501 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e400de30 con 0x7ff7dc004e40 2021-02-12T17:18:36.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/3771935501 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff7dc004e40 msgr2=0x7ff7dc00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:36.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f7b3e700 1 --2- 172.21.2.102:0/3771935501 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff7dc004e40 0x7ff7dc00b720 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7ff7e400baa0 tx=0x7ff7e4008040).stop 2021-02-12T17:18:36.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/3771935501 shutdown_connections 2021-02-12T17:18:36.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f7b3e700 1 --2- 172.21.2.102:0/3771935501 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff7dc004e40 0x7ff7dc00b720 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/3771935501 >> 172.21.2.102:0/3771935501 conn(0x7ff7f00bc480 msgr2=0x7ff7f00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:36.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/3771935501 shutdown_connections 2021-02-12T17:18:36.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.398+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/3771935501 wait complete. 2021-02-12T17:18:36.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.399+0000 7ff7f7b3e700 1 Processor -- start 2021-02-12T17:18:36.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.399+0000 7ff7f7b3e700 1 -- start start 2021-02-12T17:18:36.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f7b3e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7dc004e40 0x7ff7f00ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f7b3e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff7f00b4b70 0x7ff7f00b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f7b3e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff7f00ad920 0x7ff7f00add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f7b3e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f014fff0 con 0x7ff7f00b4b70 2021-02-12T17:18:36.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f7b3e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00acff0 con 0x7ff7dc004e40 2021-02-12T17:18:36.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f7b3e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f0150220 con 0x7ff7f00ad920 2021-02-12T17:18:36.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f50d9700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff7f00b4b70 0x7ff7f00b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:36.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f50d9700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff7f00b4b70 0x7ff7f00b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46238/0 (socket says 172.21.2.102:46238) 2021-02-12T17:18:36.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f50d9700 1 -- 172.21.2.102:0/2047656941 learned_addr learned my addr 172.21.2.102:0/2047656941 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:36.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f60db700 1 --2- 172.21.2.102:0/2047656941 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff7f00ad920 0x7ff7f00add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:36.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f58da700 1 --2- 172.21.2.102:0/2047656941 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7dc004e40 0x7ff7f00ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:36.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f50d9700 1 -- 172.21.2.102:0/2047656941 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff7f00ad920 msgr2=0x7ff7f00add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:36.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f50d9700 1 --2- 172.21.2.102:0/2047656941 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff7f00ad920 0x7ff7f00add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f50d9700 1 -- 172.21.2.102:0/2047656941 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7dc004e40 msgr2=0x7ff7f00ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:36.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f50d9700 1 --2- 172.21.2.102:0/2047656941 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7dc004e40 0x7ff7f00ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f50d9700 1 -- 172.21.2.102:0/2047656941 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f01504c0 con 0x7ff7f00b4b70 2021-02-12T17:18:36.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f50d9700 1 --2- 172.21.2.102:0/2047656941 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff7f00b4b70 0x7ff7f00b4ff0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7ff7e000c760 tx=0x7ff7e0007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:36.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7edffb700 1 -- 172.21.2.102:0/2047656941 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0010510 con 0x7ff7f00b4b70 2021-02-12T17:18:36.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7edffb700 1 -- 172.21.2.102:0/2047656941 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e0010690 con 0x7ff7f00b4b70 2021-02-12T17:18:36.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7edffb700 1 -- 172.21.2.102:0/2047656941 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0010a50 con 0x7ff7f00b4b70 2021-02-12T17:18:36.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.400+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/2047656941 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f0150760 con 0x7ff7f00b4b70 2021-02-12T17:18:36.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.401+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/2047656941 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f00ae250 con 0x7ff7f00b4b70 2021-02-12T17:18:36.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.401+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/2047656941 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f00ad760 con 0x7ff7f00b4b70 2021-02-12T17:18:36.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.401+0000 7ff7edffb700 1 -- 172.21.2.102:0/2047656941 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7ff7e0010070 con 0x7ff7f00b4b70 2021-02-12T17:18:36.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.401+0000 7ff7edffb700 1 --2- 172.21.2.102:0/2047656941 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff7d0059d30 0x7ff7d005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:36.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.402+0000 7ff7edffb700 1 -- 172.21.2.102:0/2047656941 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6935+0+0 (secure 0 0 0) 0x7ff7e0073860 con 0x7ff7f00b4b70 2021-02-12T17:18:36.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.402+0000 7ff7f58da700 1 --2- 172.21.2.102:0/2047656941 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff7d0059d30 0x7ff7d005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:36.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.402+0000 7ff7f58da700 1 --2- 172.21.2.102:0/2047656941 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff7d0059d30 0x7ff7d005c1f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff7e8001540 tx=0x7ff7e8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:36.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.404+0000 7ff7edffb700 1 -- 172.21.2.102:0/2047656941 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7ff7e0047040 con 0x7ff7f00b4b70 2021-02-12T17:18:36.567 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.565+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/2047656941 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7f0045460 con 0x7ff7f00b4b70 2021-02-12T17:18:36.567 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.566+0000 7ff7edffb700 1 -- 172.21.2.102:0/2047656941 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3403 (secure 0 0 0) 0x7ff7e004a660 con 0x7ff7f00b4b70 2021-02-12T17:18:36.567 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:36.568 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:16:03.999381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.2.102:6837/1917299206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6835","nonce":1917299206},{"type":"v1","addr":"172.21.2.102:6837","nonce":1917299206}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:36.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.567+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/2047656941 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff7d0059d30 msgr2=0x7ff7d005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:36.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.567+0000 7ff7f7b3e700 1 --2- 172.21.2.102:0/2047656941 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff7d0059d30 0x7ff7d005c1f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff7e8001540 tx=0x7ff7e8009040).stop 2021-02-12T17:18:36.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.567+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/2047656941 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff7f00b4b70 msgr2=0x7ff7f00b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:36.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.567+0000 7ff7f7b3e700 1 --2- 172.21.2.102:0/2047656941 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff7f00b4b70 0x7ff7f00b4ff0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7ff7e000c760 tx=0x7ff7e0007c20).stop 2021-02-12T17:18:36.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.567+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/2047656941 shutdown_connections 2021-02-12T17:18:36.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.567+0000 7ff7f7b3e700 1 --2- 172.21.2.102:0/2047656941 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff7f00ad920 0x7ff7f00add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.567+0000 7ff7f7b3e700 1 --2- 172.21.2.102:0/2047656941 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff7dc004e40 0x7ff7f00ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.567+0000 7ff7f7b3e700 1 --2- 172.21.2.102:0/2047656941 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff7d0059d30 0x7ff7d005c1f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.567+0000 7ff7f7b3e700 1 --2- 172.21.2.102:0/2047656941 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff7f00b4b70 0x7ff7f00b4ff0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:36.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.567+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/2047656941 >> 172.21.2.102:0/2047656941 conn(0x7ff7f00bc480 msgr2=0x7ff7f00b80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:36.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.567+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/2047656941 shutdown_connections 2021-02-12T17:18:36.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:36.567+0000 7ff7f7b3e700 1 -- 172.21.2.102:0/2047656941 wait complete. 2021-02-12T17:18:36.570 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 14 2021-02-12T17:18:36.577 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:18:38.391 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:38.481 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.479+0000 7f50af9f7700 1 Processor -- start 2021-02-12T17:18:38.481 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.479+0000 7f50af9f7700 1 -- start start 2021-02-12T17:18:38.482 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f50af9f7700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f50a80b8d20 0x7f50a8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.482 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f50af9f7700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a80b7960 con 0x7f50a814e530 2021-02-12T17:18:38.482 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f50af9f7700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a80622a0 con 0x7f50a8062740 2021-02-12T17:18:38.482 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f50af9f7700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a8068d20 con 0x7f50a80b8d20 2021-02-12T17:18:38.483 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f50ad793700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f50a80b8d20 0x7f50a8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:38.483 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f50ad793700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f50a80b8d20 0x7f50a8068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46256/0 (socket says 172.21.2.102:46256) 2021-02-12T17:18:38.483 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f50ad793700 1 -- 172.21.2.102:0/354316039 learned_addr learned my addr 172.21.2.102:0/354316039 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:38.483 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f50acf92700 1 --1- 172.21.2.102:0/354316039 >> v1:172.21.2.102:6789/0 conn(0x7f50a814e530 0x7f50a80b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54900/0 (socket says 172.21.2.102:54900) 2021-02-12T17:18:38.483 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f50ad793700 1 -- 172.21.2.102:0/354316039 >> v1:172.21.2.104:6789/0 conn(0x7f50a8062740 legacy=0x7f50a8062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:18:38.483 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f50ad793700 1 -- 172.21.2.102:0/354316039 >> v1:172.21.2.102:6789/0 conn(0x7f50a814e530 legacy=0x7f50a80b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:38.483 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f50ad793700 1 -- 172.21.2.102:0/354316039 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a814ea10 con 0x7f50a80b8d20 2021-02-12T17:18:38.483 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f50ad793700 1 --2- 172.21.2.102:0/354316039 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f50a80b8d20 0x7f50a8068830 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f50a400b9e0 tx=0x7f50a4006ea0).ready entity=mon.0 client_cookie=2f1c5b69a0fa1c9e server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:38.483 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f509bfff700 1 -- 172.21.2.102:0/354316039 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a4009800 con 0x7f50a80b8d20 2021-02-12T17:18:38.483 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f509bfff700 1 -- 172.21.2.102:0/354316039 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a4009960 con 0x7f50a80b8d20 2021-02-12T17:18:38.483 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.480+0000 7f509bfff700 1 -- 172.21.2.102:0/354316039 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a4009ce0 con 0x7f50a80b8d20 2021-02-12T17:18:38.483 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.481+0000 7f50af9f7700 1 -- 172.21.2.102:0/354316039 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f50a80b8d20 msgr2=0x7f50a8068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:38.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.481+0000 7f50af9f7700 1 --2- 172.21.2.102:0/354316039 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f50a80b8d20 0x7f50a8068830 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f50a400b9e0 tx=0x7f50a4006ea0).stop 2021-02-12T17:18:38.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.481+0000 7f50af9f7700 1 -- 172.21.2.102:0/354316039 shutdown_connections 2021-02-12T17:18:38.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.481+0000 7f50af9f7700 1 --2- 172.21.2.102:0/354316039 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f50a80b8d20 0x7f50a8068830 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:38.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.481+0000 7f50af9f7700 1 -- 172.21.2.102:0/354316039 >> 172.21.2.102:0/354316039 conn(0x7f50a80bc480 msgr2=0x7f50a80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:38.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.481+0000 7f50af9f7700 1 -- 172.21.2.102:0/354316039 shutdown_connections 2021-02-12T17:18:38.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.481+0000 7f50af9f7700 1 -- 172.21.2.102:0/354316039 wait complete. 2021-02-12T17:18:38.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50af9f7700 1 Processor -- start 2021-02-12T17:18:38.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50af9f7700 1 -- start start 2021-02-12T17:18:38.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50af9f7700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f50a8062740 0x7f50a8161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50af9f7700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f50a80b8d20 0x7f50a8149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50af9f7700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f50a814e530 0x7f50a8149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50af9f7700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80ae0c0 con 0x7f50a8062740 2021-02-12T17:18:38.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50af9f7700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80ad9c0 con 0x7f50a814e530 2021-02-12T17:18:38.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50af9f7700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8161b60 con 0x7f50a80b8d20 2021-02-12T17:18:38.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50ad793700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f50a8062740 0x7f50a8161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:38.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50ad793700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f50a8062740 0x7f50a8161070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46262/0 (socket says 172.21.2.102:46262) 2021-02-12T17:18:38.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50ad793700 1 -- 172.21.2.102:0/2210697732 learned_addr learned my addr 172.21.2.102:0/2210697732 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:38.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50ad793700 1 -- 172.21.2.102:0/2210697732 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f50a80b8d20 msgr2=0x7f50a8149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:38.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50ad793700 1 --2- 172.21.2.102:0/2210697732 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f50a80b8d20 0x7f50a8149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:38.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50ad793700 1 -- 172.21.2.102:0/2210697732 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f50a814e530 msgr2=0x7f50a8149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:38.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.482+0000 7f50ad793700 1 --2- 172.21.2.102:0/2210697732 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f50a814e530 0x7f50a8149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:38.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.483+0000 7f50ad793700 1 -- 172.21.2.102:0/2210697732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a80b4f40 con 0x7f50a8062740 2021-02-12T17:18:38.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.483+0000 7f50ad793700 1 --2- 172.21.2.102:0/2210697732 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f50a8062740 0x7f50a8161070 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f50a40093a0 tx=0x7f50a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:38.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.483+0000 7f50997fa700 1 -- 172.21.2.102:0/2210697732 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a4011e60 con 0x7f50a8062740 2021-02-12T17:18:38.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.483+0000 7f50997fa700 1 -- 172.21.2.102:0/2210697732 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a401d430 con 0x7f50a8062740 2021-02-12T17:18:38.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.483+0000 7f50af9f7700 1 -- 172.21.2.102:0/2210697732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a81618c0 con 0x7f50a8062740 2021-02-12T17:18:38.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.483+0000 7f50af9f7700 1 -- 172.21.2.102:0/2210697732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a814a330 con 0x7f50a8062740 2021-02-12T17:18:38.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.483+0000 7f50997fa700 1 -- 172.21.2.102:0/2210697732 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a401d7b0 con 0x7f50a8062740 2021-02-12T17:18:38.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.483+0000 7f50af9f7700 1 -- 172.21.2.102:0/2210697732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5080004f60 con 0x7f50a8062740 2021-02-12T17:18:38.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.483+0000 7f50997fa700 1 -- 172.21.2.102:0/2210697732 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f50a4024030 con 0x7f50a8062740 2021-02-12T17:18:38.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.484+0000 7f50997fa700 1 --2- 172.21.2.102:0/2210697732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5088059db0 0x7f508805c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.484+0000 7f50997fa700 1 -- 172.21.2.102:0/2210697732 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f50a4074c90 con 0x7f50a8062740 2021-02-12T17:18:38.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.484+0000 7f50acf92700 1 --2- 172.21.2.102:0/2210697732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5088059db0 0x7f508805c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:38.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.484+0000 7f50acf92700 1 --2- 172.21.2.102:0/2210697732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5088059db0 0x7f508805c270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f50a8065ba0 tx=0x7f509c0077f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:38.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.487+0000 7f50997fa700 1 -- 172.21.2.102:0/2210697732 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f50a4048550 con 0x7f50a8062740 2021-02-12T17:18:38.578 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:38.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.645+0000 7f50af9f7700 1 -- 172.21.2.102:0/2210697732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5080005790 con 0x7f50a8062740 2021-02-12T17:18:38.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.646+0000 7f50997fa700 1 -- 172.21.2.102:0/2210697732 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3406 (secure 0 0 0) 0x7f50a4022020 con 0x7f50a8062740 2021-02-12T17:18:38.647 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:38.647 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:38.293217+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:replay","state_seq":2,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:38.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.647+0000 7f50af9f7700 1 -- 172.21.2.102:0/2210697732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5088059db0 msgr2=0x7f508805c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:38.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.647+0000 7f50af9f7700 1 --2- 172.21.2.102:0/2210697732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5088059db0 0x7f508805c270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f50a8065ba0 tx=0x7f509c0077f0).stop 2021-02-12T17:18:38.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.647+0000 7f50af9f7700 1 -- 172.21.2.102:0/2210697732 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f50a8062740 msgr2=0x7f50a8161070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:38.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.647+0000 7f50af9f7700 1 --2- 172.21.2.102:0/2210697732 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f50a8062740 0x7f50a8161070 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f50a40093a0 tx=0x7f50a4016000).stop 2021-02-12T17:18:38.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.647+0000 7f50af9f7700 1 -- 172.21.2.102:0/2210697732 shutdown_connections 2021-02-12T17:18:38.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.647+0000 7f50af9f7700 1 --2- 172.21.2.102:0/2210697732 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f50a814e530 0x7f50a8149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:38.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.647+0000 7f50af9f7700 1 --2- 172.21.2.102:0/2210697732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5088059db0 0x7f508805c270 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:38.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.647+0000 7f50af9f7700 1 --2- 172.21.2.102:0/2210697732 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f50a8062740 0x7f50a8161070 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:38.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.647+0000 7f50af9f7700 1 --2- 172.21.2.102:0/2210697732 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f50a80b8d20 0x7f50a8149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:38.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.647+0000 7f50af9f7700 1 -- 172.21.2.102:0/2210697732 >> 172.21.2.102:0/2210697732 conn(0x7f50a80bc480 msgr2=0x7f50a8152370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:38.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.647+0000 7f50af9f7700 1 -- 172.21.2.102:0/2210697732 shutdown_connections 2021-02-12T17:18:38.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.647+0000 7f50af9f7700 1 -- 172.21.2.102:0/2210697732 wait complete. 2021-02-12T17:18:38.650 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 16 2021-02-12T17:18:38.657 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-02-12T17:18:38.666 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.664+0000 7f77a0fa8700 1 Processor -- start 2021-02-12T17:18:38.666 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.664+0000 7f77a0fa8700 1 -- start start 2021-02-12T17:18:38.666 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.665+0000 7f77a0fa8700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f779c068710 0x7f779c0b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.666 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.665+0000 7f77a0fa8700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f779c068af0 0x7f779c0622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.665+0000 7f77a0fa8700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f779c0b6350 0x7f779c14a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.665+0000 7f77a0fa8700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779c0b7680 con 0x7f779c068710 2021-02-12T17:18:38.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.665+0000 7f77a0fa8700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779c0b2360 con 0x7f779c068af0 2021-02-12T17:18:38.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.665+0000 7f77a0fa8700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0b2600 con 0x7f779c0b6350 2021-02-12T17:18:38.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.665+0000 7f779a59c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f779c068710 0x7f779c0b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:38.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.665+0000 7f779a59c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f779c068710 0x7f779c0b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46270/0 (socket says 172.21.2.102:46270) 2021-02-12T17:18:38.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.665+0000 7f779a59c700 1 -- 172.21.2.102:0/224979540 learned_addr learned my addr 172.21.2.102:0/224979540 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:38.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f779a59c700 1 -- 172.21.2.102:0/224979540 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f779c0b6350 msgr2=0x7f779c14a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:38.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f779a59c700 1 --2- 172.21.2.102:0/224979540 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f779c0b6350 0x7f779c14a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:38.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f779a59c700 1 -- 172.21.2.102:0/224979540 >> v2:172.21.2.104:3300/0 conn(0x7f779c068af0 msgr2=0x7f779c0622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:38.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f779a59c700 1 --2- 172.21.2.102:0/224979540 >> v2:172.21.2.104:3300/0 conn(0x7f779c068af0 0x7f779c0622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:38.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f779a59c700 1 -- 172.21.2.102:0/224979540 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c1498e0 con 0x7f779c068710 2021-02-12T17:18:38.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f779a59c700 1 --2- 172.21.2.102:0/224979540 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f779c068710 0x7f779c0b1440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f779c065d70 tx=0x7f7784006ea0).ready entity=mon.0 client_cookie=44fc8198a74fccf1 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:38.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f779959a700 1 -- 172.21.2.102:0/224979540 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784009840 con 0x7f779c068710 2021-02-12T17:18:38.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f779959a700 1 -- 172.21.2.102:0/224979540 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77840099a0 con 0x7f779c068710 2021-02-12T17:18:38.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f779959a700 1 -- 172.21.2.102:0/224979540 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784009d20 con 0x7f779c068710 2021-02-12T17:18:38.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f77a0fa8700 1 -- 172.21.2.102:0/224979540 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f779c068710 msgr2=0x7f779c0b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:38.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f77a0fa8700 1 --2- 172.21.2.102:0/224979540 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f779c068710 0x7f779c0b1440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f779c065d70 tx=0x7f7784006ea0).stop 2021-02-12T17:18:38.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f77a0fa8700 1 -- 172.21.2.102:0/224979540 shutdown_connections 2021-02-12T17:18:38.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f77a0fa8700 1 --2- 172.21.2.102:0/224979540 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f779c0b6350 0x7f779c14a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:38.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f77a0fa8700 1 --2- 172.21.2.102:0/224979540 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f779c068710 0x7f779c0b1440 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:38.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f77a0fa8700 1 --2- 172.21.2.102:0/224979540 >> v2:172.21.2.104:3300/0 conn(0x7f779c068af0 0x7f779c0622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:38.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f77a0fa8700 1 -- 172.21.2.102:0/224979540 >> 172.21.2.102:0/224979540 conn(0x7f779c0bc480 msgr2=0x7f779c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:38.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f77a0fa8700 1 -- 172.21.2.102:0/224979540 shutdown_connections 2021-02-12T17:18:38.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.666+0000 7f77a0fa8700 1 -- 172.21.2.102:0/224979540 wait complete. 2021-02-12T17:18:38.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.667+0000 7f77a0fa8700 1 Processor -- start 2021-02-12T17:18:38.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.667+0000 7f77a0fa8700 1 -- start start 2021-02-12T17:18:38.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f77a0fa8700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f779c068710 0x7f779c158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f77a0fa8700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f779c068af0 0x7f779c146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f77a0fa8700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f779c0b6350 0x7f779c15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f77a0fa8700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c143bc0 con 0x7f779c0b6350 2021-02-12T17:18:38.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f77a0fa8700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c15c4b0 con 0x7f779c068af0 2021-02-12T17:18:38.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f77a0fa8700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c143430 con 0x7f779c068710 2021-02-12T17:18:38.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f779ad9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f779c0b6350 0x7f779c15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:38.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f779ad9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f779c0b6350 0x7f779c15cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46278/0 (socket says 172.21.2.102:46278) 2021-02-12T17:18:38.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f779ad9d700 1 -- 172.21.2.102:0/4265162760 learned_addr learned my addr 172.21.2.102:0/4265162760 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:38.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f7799d9b700 1 --2- 172.21.2.102:0/4265162760 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f779c068af0 0x7f779c146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:38.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f779ad9d700 1 -- 172.21.2.102:0/4265162760 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f779c068710 msgr2=0x7f779c158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:38.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f779ad9d700 1 --2- 172.21.2.102:0/4265162760 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f779c068710 0x7f779c158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:38.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f779ad9d700 1 -- 172.21.2.102:0/4265162760 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f779c068af0 msgr2=0x7f779c146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:38.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f779ad9d700 1 --2- 172.21.2.102:0/4265162760 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f779c068af0 0x7f779c146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:38.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f779ad9d700 1 -- 172.21.2.102:0/4265162760 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c0b4490 con 0x7f779c0b6350 2021-02-12T17:18:38.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f7799d9b700 1 --2- 172.21.2.102:0/4265162760 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f779c068af0 0x7f779c146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:18:38.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f779ad9d700 1 --2- 172.21.2.102:0/4265162760 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f779c0b6350 0x7f779c15cbb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f779400bab0 tx=0x7f77940090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:38.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f77927fc700 1 -- 172.21.2.102:0/4265162760 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400c740 con 0x7f779c0b6350 2021-02-12T17:18:38.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f77927fc700 1 -- 172.21.2.102:0/4265162760 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779400c8c0 con 0x7f779c0b6350 2021-02-12T17:18:38.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.668+0000 7f77927fc700 1 -- 172.21.2.102:0/4265162760 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400ca70 con 0x7f779c0b6350 2021-02-12T17:18:38.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.669+0000 7f77a0fa8700 1 -- 172.21.2.102:0/4265162760 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779c143df0 con 0x7f779c0b6350 2021-02-12T17:18:38.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.669+0000 7f77a0fa8700 1 -- 172.21.2.102:0/4265162760 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c0bb220 con 0x7f779c0b6350 2021-02-12T17:18:38.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.669+0000 7f77a0fa8700 1 -- 172.21.2.102:0/4265162760 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779c045460 con 0x7f779c0b6350 2021-02-12T17:18:38.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.669+0000 7f77927fc700 1 -- 172.21.2.102:0/4265162760 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f779401c070 con 0x7f779c0b6350 2021-02-12T17:18:38.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.670+0000 7f77927fc700 1 --2- 172.21.2.102:0/4265162760 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7780059d30 0x7f778005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.670+0000 7f77927fc700 1 -- 172.21.2.102:0/4265162760 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f7794073440 con 0x7f779c0b6350 2021-02-12T17:18:38.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.670+0000 7f779a59c700 1 --2- 172.21.2.102:0/4265162760 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7780059d30 0x7f778005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:38.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.670+0000 7f779a59c700 1 --2- 172.21.2.102:0/4265162760 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7780059d30 0x7f778005c1f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f778400b190 tx=0x7f7784016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:38.675 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.673+0000 7f77927fc700 1 -- 172.21.2.102:0/4265162760 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f7794046ac0 con 0x7f779c0b6350 2021-02-12T17:18:38.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.830+0000 7f77a0fa8700 1 -- 172.21.2.102:0/4265162760 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f779c063670 con 0x7f779c0b6350 2021-02-12T17:18:38.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.830+0000 7f77927fc700 1 -- 172.21.2.102:0/4265162760 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3406 (secure 0 0 0) 0x7f779404a0e0 con 0x7f779c0b6350 2021-02-12T17:18:38.833 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:38.833 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:38.293217+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:replay","state_seq":2,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:38.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.831+0000 7f77a0fa8700 1 -- 172.21.2.102:0/4265162760 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7780059d30 msgr2=0x7f778005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:38.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.831+0000 7f77a0fa8700 1 --2- 172.21.2.102:0/4265162760 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7780059d30 0x7f778005c1f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f778400b190 tx=0x7f7784016000).stop 2021-02-12T17:18:38.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.831+0000 7f77a0fa8700 1 -- 172.21.2.102:0/4265162760 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f779c0b6350 msgr2=0x7f779c15cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:38.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.831+0000 7f77a0fa8700 1 --2- 172.21.2.102:0/4265162760 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f779c0b6350 0x7f779c15cbb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f779400bab0 tx=0x7f77940090f0).stop 2021-02-12T17:18:38.835 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.831+0000 7f77a0fa8700 1 -- 172.21.2.102:0/4265162760 shutdown_connections 2021-02-12T17:18:38.836 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.831+0000 7f77a0fa8700 1 --2- 172.21.2.102:0/4265162760 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7780059d30 0x7f778005c1f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:38.836 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.831+0000 7f77a0fa8700 1 --2- 172.21.2.102:0/4265162760 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f779c0b6350 0x7f779c15cbb0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:38.836 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.831+0000 7f77a0fa8700 1 --2- 172.21.2.102:0/4265162760 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f779c068710 0x7f779c158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:38.836 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.831+0000 7f77a0fa8700 1 --2- 172.21.2.102:0/4265162760 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f779c068af0 0x7f779c146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:38.836 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.831+0000 7f77a0fa8700 1 -- 172.21.2.102:0/4265162760 >> 172.21.2.102:0/4265162760 conn(0x7f779c0bc480 msgr2=0x7f779c145e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:38.836 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.832+0000 7f77a0fa8700 1 -- 172.21.2.102:0/4265162760 shutdown_connections 2021-02-12T17:18:38.839 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.832+0000 7f77a0fa8700 1 -- 172.21.2.102:0/4265162760 wait complete. 2021-02-12T17:18:38.839 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 16 2021-02-12T17:18:38.842 INFO:tasks.mds_thrash.fs.[a]:mds.c down, removed from mdsmap 2021-02-12T17:18:38.842 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2021-02-12T17:18:38.842 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:38.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.970+0000 7fb115c39700 1 Processor -- start 2021-02-12T17:18:38.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.970+0000 7fb115c39700 1 -- start start 2021-02-12T17:18:38.973 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.971+0000 7fb115c39700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fb1100b8d20 0x7fb110068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.973 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.971+0000 7fb115c39700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb11014e530 0x7fb1100b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.973 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.971+0000 7fb115c39700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1100622a0 con 0x7fb110062740 2021-02-12T17:18:38.973 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.971+0000 7fb115c39700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb110068d20 con 0x7fb11014e530 2021-02-12T17:18:38.973 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.971+0000 7fb115c39700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11014ea10 con 0x7fb1100b8d20 2021-02-12T17:18:38.973 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.971+0000 7fb10effd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb11014e530 0x7fb1100b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:38.973 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.971+0000 7fb10effd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb11014e530 0x7fb1100b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46282/0 (socket says 172.21.2.102:46282) 2021-02-12T17:18:38.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.971+0000 7fb10effd700 1 -- 172.21.2.102:0/518681143 learned_addr learned my addr 172.21.2.102:0/518681143 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:38.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.971+0000 7fb10f7fe700 1 --2- 172.21.2.102:0/518681143 >> v2:172.21.2.104:3300/0 conn(0x7fb1100b8d20 0x7fb110068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:38.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.971+0000 7fb10effd700 1 -- 172.21.2.102:0/518681143 >> v2:172.21.2.104:3300/0 conn(0x7fb1100b8d20 msgr2=0x7fb110068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:38.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.971+0000 7fb10effd700 1 --2- 172.21.2.102:0/518681143 >> v2:172.21.2.104:3300/0 conn(0x7fb1100b8d20 0x7fb110068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:38.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.971+0000 7fb10effd700 1 -- 172.21.2.102:0/518681143 >> v1:172.21.2.104:6789/0 conn(0x7fb110062740 legacy=0x7fb110062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:38.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.971+0000 7fb10effd700 1 -- 172.21.2.102:0/518681143 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1100b63f0 con 0x7fb11014e530 2021-02-12T17:18:38.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.972+0000 7fb10effd700 1 --2- 172.21.2.102:0/518681143 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb11014e530 0x7fb1100b7250 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fb11006abc0 tx=0x7fb0f8006ea0).ready entity=mon.0 client_cookie=b45d6a90708b8578 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:38.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.972+0000 7fb10e7fc700 1 -- 172.21.2.102:0/518681143 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8009800 con 0x7fb11014e530 2021-02-12T17:18:38.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.972+0000 7fb10e7fc700 1 -- 172.21.2.102:0/518681143 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f8009960 con 0x7fb11014e530 2021-02-12T17:18:38.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.972+0000 7fb10e7fc700 1 -- 172.21.2.102:0/518681143 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8009ce0 con 0x7fb11014e530 2021-02-12T17:18:38.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.972+0000 7fb115c39700 1 -- 172.21.2.102:0/518681143 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb11014e530 msgr2=0x7fb1100b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:38.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.972+0000 7fb115c39700 1 --2- 172.21.2.102:0/518681143 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb11014e530 0x7fb1100b7250 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fb11006abc0 tx=0x7fb0f8006ea0).stop 2021-02-12T17:18:38.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.972+0000 7fb115c39700 1 -- 172.21.2.102:0/518681143 shutdown_connections 2021-02-12T17:18:38.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.972+0000 7fb115c39700 1 --2- 172.21.2.102:0/518681143 >> v2:172.21.2.104:3300/0 conn(0x7fb1100b8d20 0x7fb110068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:38.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.972+0000 7fb115c39700 1 --2- 172.21.2.102:0/518681143 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb11014e530 0x7fb1100b7250 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:38.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.972+0000 7fb115c39700 1 -- 172.21.2.102:0/518681143 >> 172.21.2.102:0/518681143 conn(0x7fb1100bc480 msgr2=0x7fb1100b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:38.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.972+0000 7fb115c39700 1 -- 172.21.2.102:0/518681143 shutdown_connections 2021-02-12T17:18:38.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.972+0000 7fb115c39700 1 -- 172.21.2.102:0/518681143 wait complete. 2021-02-12T17:18:38.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.973+0000 7fb115c39700 1 Processor -- start 2021-02-12T17:18:38.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.973+0000 7fb115c39700 1 -- start start 2021-02-12T17:18:38.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb115c39700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb110062740 0x7fb11015df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb115c39700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb1100b8d20 0x7fb11014cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb115c39700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb11014e530 0x7fb11014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb115c39700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11015e3f0 con 0x7fb1100b8d20 2021-02-12T17:18:38.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb115c39700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100afb80 con 0x7fb110062740 2021-02-12T17:18:38.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb115c39700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100afe20 con 0x7fb11014e530 2021-02-12T17:18:38.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb10effd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb1100b8d20 0x7fb11014cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:38.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb10effd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb1100b8d20 0x7fb11014cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46288/0 (socket says 172.21.2.102:46288) 2021-02-12T17:18:38.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb10effd700 1 -- 172.21.2.102:0/1849723366 learned_addr learned my addr 172.21.2.102:0/1849723366 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:38.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb10f7fe700 1 --2- 172.21.2.102:0/1849723366 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb110062740 0x7fb11015df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:38.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb10effd700 1 -- 172.21.2.102:0/1849723366 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb11014e530 msgr2=0x7fb11014aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:38.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb10effd700 1 --2- 172.21.2.102:0/1849723366 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb11014e530 0x7fb11014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:38.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb10effd700 1 -- 172.21.2.102:0/1849723366 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb110062740 msgr2=0x7fb11015df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:38.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb10effd700 1 --2- 172.21.2.102:0/1849723366 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb110062740 0x7fb11015df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:38.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb10effd700 1 -- 172.21.2.102:0/1849723366 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1100b00c0 con 0x7fb1100b8d20 2021-02-12T17:18:38.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.974+0000 7fb10effd700 1 --2- 172.21.2.102:0/1849723366 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb1100b8d20 0x7fb11014cdd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fb1100653c0 tx=0x7fb0f8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:38.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.975+0000 7fb1077fe700 1 -- 172.21.2.102:0/1849723366 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8012e40 con 0x7fb1100b8d20 2021-02-12T17:18:38.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.975+0000 7fb1077fe700 1 -- 172.21.2.102:0/1849723366 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f801c420 con 0x7fb1100b8d20 2021-02-12T17:18:38.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.975+0000 7fb1077fe700 1 -- 172.21.2.102:0/1849723366 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f801c7e0 con 0x7fb1100b8d20 2021-02-12T17:18:38.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.975+0000 7fb115c39700 1 -- 172.21.2.102:0/1849723366 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1100b0360 con 0x7fb1100b8d20 2021-02-12T17:18:38.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.975+0000 7fb115c39700 1 -- 172.21.2.102:0/1849723366 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1100af840 con 0x7fb1100b8d20 2021-02-12T17:18:38.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.975+0000 7fb115c39700 1 -- 172.21.2.102:0/1849723366 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1100b0810 con 0x7fb1100b8d20 2021-02-12T17:18:38.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.976+0000 7fb1077fe700 1 -- 172.21.2.102:0/1849723366 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fb0f800f070 con 0x7fb1100b8d20 2021-02-12T17:18:38.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.976+0000 7fb1077fe700 1 --2- 172.21.2.102:0/1849723366 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb0f4059d30 0x7fb0f405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:38.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.976+0000 7fb1077fe700 1 -- 172.21.2.102:0/1849723366 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7fb0f8075490 con 0x7fb1100b8d20 2021-02-12T17:18:38.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.976+0000 7fb10f7fe700 1 --2- 172.21.2.102:0/1849723366 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb0f4059d30 0x7fb0f405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:38.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.976+0000 7fb10f7fe700 1 --2- 172.21.2.102:0/1849723366 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb0f4059d30 0x7fb0f405c1f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fb100006fd0 tx=0x7fb100008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:38.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:38.979+0000 7fb1077fe700 1 -- 172.21.2.102:0/1849723366 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fb0f804c540 con 0x7fb1100b8d20 2021-02-12T17:18:39.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:39.138+0000 7fb115c39700 1 -- 172.21.2.102:0/1849723366 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb110045460 con 0x7fb1100b8d20 2021-02-12T17:18:39.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:39.139+0000 7fb1077fe700 1 -- 172.21.2.102:0/1849723366 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3406 (secure 0 0 0) 0x7fb0f804c130 con 0x7fb1100b8d20 2021-02-12T17:18:39.140 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:39.141 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:38.293217+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:replay","state_seq":2,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:39.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:39.140+0000 7fb115c39700 1 -- 172.21.2.102:0/1849723366 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb0f4059d30 msgr2=0x7fb0f405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:39.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:39.140+0000 7fb115c39700 1 --2- 172.21.2.102:0/1849723366 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb0f4059d30 0x7fb0f405c1f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fb100006fd0 tx=0x7fb100008040).stop 2021-02-12T17:18:39.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:39.140+0000 7fb115c39700 1 -- 172.21.2.102:0/1849723366 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb1100b8d20 msgr2=0x7fb11014cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:39.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:39.140+0000 7fb115c39700 1 --2- 172.21.2.102:0/1849723366 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb1100b8d20 0x7fb11014cdd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fb1100653c0 tx=0x7fb0f8016000).stop 2021-02-12T17:18:39.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:39.140+0000 7fb115c39700 1 -- 172.21.2.102:0/1849723366 shutdown_connections 2021-02-12T17:18:39.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:39.140+0000 7fb115c39700 1 --2- 172.21.2.102:0/1849723366 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb11014e530 0x7fb11014aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:39.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:39.140+0000 7fb115c39700 1 --2- 172.21.2.102:0/1849723366 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb110062740 0x7fb11015df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:39.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:39.140+0000 7fb115c39700 1 --2- 172.21.2.102:0/1849723366 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb0f4059d30 0x7fb0f405c1f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:39.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:39.140+0000 7fb115c39700 1 --2- 172.21.2.102:0/1849723366 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb1100b8d20 0x7fb11014cdd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:39.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:39.140+0000 7fb115c39700 1 -- 172.21.2.102:0/1849723366 >> 172.21.2.102:0/1849723366 conn(0x7fb1100bc480 msgr2=0x7fb1100b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:39.143 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:39.140+0000 7fb115c39700 1 -- 172.21.2.102:0/1849723366 shutdown_connections 2021-02-12T17:18:39.143 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:39.140+0000 7fb115c39700 1 -- 172.21.2.102:0/1849723366 wait complete. 2021-02-12T17:18:39.143 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 16 2021-02-12T17:18:39.151 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 16, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:01.991560+0000", "damaged": [], "data_pools": [ 4 ], "enabled": true, "epoch": 16, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "a", "in": [ 0 ], "info": { "gid_5082": { "addr": "172.21.2.102:6835/2191389758", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6834", "nonce": 2191389758, "type": "v2" }, { "addr": "172.21.2.102:6835", "nonce": 2191389758, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5082, "incarnation": 16, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 2 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2021-02-12T17:18:38.293217+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5082 } } }, { "id": 2, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:08.529588+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 14, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "b", "in": [ 0 ], "info": { "gid_4246": { "addr": "172.21.2.104:6835/3140564541", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6833", "nonce": 3140564541, "type": "v2" }, { "addr": "172.21.2.104:6835", "nonce": 3140564541, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4246, "incarnation": 11, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:active", "state_seq": 40 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 5, "modified": "2021-02-12T17:18:29.290637+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4246 } } } ], "standbys": [ { "addr": "172.21.2.104:6834/3149030842", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6832", "nonce": 3149030842, "type": "v2" }, { "addr": "172.21.2.104:6834", "nonce": 3149030842, "type": "v1" } ] }, "epoch": 5, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4243, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 2 } ] } 2021-02-12T17:18:40.658 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:40.680 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:18:40.703 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:18:40.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.745+0000 7f68fae27700 1 Processor -- start 2021-02-12T17:18:40.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.745+0000 7f68fae27700 1 -- start start 2021-02-12T17:18:40.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.745+0000 7f68fae27700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f68f40b8d20 0x7f68f4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:40.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.745+0000 7f68fae27700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f68f414e530 0x7f68f40b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:40.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.745+0000 7f68fae27700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f40622a0 con 0x7f68f4062740 2021-02-12T17:18:40.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.745+0000 7f68fae27700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f4068d20 con 0x7f68f40b8d20 2021-02-12T17:18:40.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.745+0000 7f68fae27700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f414ea10 con 0x7f68f414e530 2021-02-12T17:18:40.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.746+0000 7f68f8bc3700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f68f40b8d20 0x7f68f4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:40.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.746+0000 7f68f8bc3700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f68f40b8d20 0x7f68f4068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46300/0 (socket says 172.21.2.102:46300) 2021-02-12T17:18:40.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.746+0000 7f68f8bc3700 1 -- 172.21.2.102:0/3661332535 learned_addr learned my addr 172.21.2.102:0/3661332535 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:40.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.746+0000 7f68f93c4700 1 --1- 172.21.2.102:0/3661332535 >> v1:172.21.2.102:6789/0 conn(0x7f68f4062740 0x7f68f4062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54942/0 (socket says 172.21.2.102:54942) 2021-02-12T17:18:40.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.746+0000 7f68f3fff700 1 --2- 172.21.2.102:0/3661332535 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f68f414e530 0x7f68f40b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:40.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.746+0000 7f68f8bc3700 1 -- 172.21.2.102:0/3661332535 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f68f414e530 msgr2=0x7f68f40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:40.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.746+0000 7f68f8bc3700 1 --2- 172.21.2.102:0/3661332535 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f68f414e530 0x7f68f40b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:40.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.746+0000 7f68f8bc3700 1 -- 172.21.2.102:0/3661332535 >> v1:172.21.2.102:6789/0 conn(0x7f68f4062740 legacy=0x7f68f4062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:40.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.746+0000 7f68f8bc3700 1 -- 172.21.2.102:0/3661332535 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f40b63f0 con 0x7f68f40b8d20 2021-02-12T17:18:40.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.746+0000 7f68f8bc3700 1 --2- 172.21.2.102:0/3661332535 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68f40b8d20 0x7f68f4068830 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f68dc00b9e0 tx=0x7f68dc006ea0).ready entity=mon.0 client_cookie=c5d864186bc8d403 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:40.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.746+0000 7f68f37fe700 1 -- 172.21.2.102:0/3661332535 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc009840 con 0x7f68f40b8d20 2021-02-12T17:18:40.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.746+0000 7f68f37fe700 1 -- 172.21.2.102:0/3661332535 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc0099a0 con 0x7f68f40b8d20 2021-02-12T17:18:40.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.746+0000 7f68f37fe700 1 -- 172.21.2.102:0/3661332535 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc009d20 con 0x7f68f40b8d20 2021-02-12T17:18:40.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.747+0000 7f68fae27700 1 -- 172.21.2.102:0/3661332535 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68f40b8d20 msgr2=0x7f68f4068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:40.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.747+0000 7f68fae27700 1 --2- 172.21.2.102:0/3661332535 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68f40b8d20 0x7f68f4068830 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f68dc00b9e0 tx=0x7f68dc006ea0).stop 2021-02-12T17:18:40.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.747+0000 7f68fae27700 1 -- 172.21.2.102:0/3661332535 shutdown_connections 2021-02-12T17:18:40.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.747+0000 7f68fae27700 1 --2- 172.21.2.102:0/3661332535 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68f40b8d20 0x7f68f4068830 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:40.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.747+0000 7f68fae27700 1 --2- 172.21.2.102:0/3661332535 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f68f414e530 0x7f68f40b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:40.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.747+0000 7f68fae27700 1 -- 172.21.2.102:0/3661332535 >> 172.21.2.102:0/3661332535 conn(0x7f68f40bc480 msgr2=0x7f68f40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:40.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.747+0000 7f68fae27700 1 -- 172.21.2.102:0/3661332535 shutdown_connections 2021-02-12T17:18:40.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.747+0000 7f68fae27700 1 -- 172.21.2.102:0/3661332535 wait complete. 2021-02-12T17:18:40.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.748+0000 7f68fae27700 1 Processor -- start 2021-02-12T17:18:40.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.748+0000 7f68fae27700 1 -- start start 2021-02-12T17:18:40.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.748+0000 7f68fae27700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68f4062740 0x7f68f40b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:40.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.748+0000 7f68fae27700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f68f40b8d20 0x7f68f4152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:40.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.748+0000 7f68fae27700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f68f414e530 0x7f68f415da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:40.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.748+0000 7f68fae27700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f415d380 con 0x7f68f4062740 2021-02-12T17:18:40.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.748+0000 7f68fae27700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f40af8e0 con 0x7f68f40b8d20 2021-02-12T17:18:40.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.748+0000 7f68fae27700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f40ba5b0 con 0x7f68f414e530 2021-02-12T17:18:40.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.749+0000 7f68f8bc3700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68f4062740 0x7f68f40b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:40.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.749+0000 7f68f8bc3700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68f4062740 0x7f68f40b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46306/0 (socket says 172.21.2.102:46306) 2021-02-12T17:18:40.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.749+0000 7f68f8bc3700 1 -- 172.21.2.102:0/3612384510 learned_addr learned my addr 172.21.2.102:0/3612384510 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:40.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.749+0000 7f68f8bc3700 1 -- 172.21.2.102:0/3612384510 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f68f414e530 msgr2=0x7f68f415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:40.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.749+0000 7f68f8bc3700 1 --2- 172.21.2.102:0/3612384510 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f68f414e530 0x7f68f415da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:40.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.749+0000 7f68f8bc3700 1 -- 172.21.2.102:0/3612384510 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f68f40b8d20 msgr2=0x7f68f4152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:40.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.749+0000 7f68f8bc3700 1 --2- 172.21.2.102:0/3612384510 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f68f40b8d20 0x7f68f4152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:40.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.749+0000 7f68f8bc3700 1 -- 172.21.2.102:0/3612384510 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f40b01f0 con 0x7f68f4062740 2021-02-12T17:18:40.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.749+0000 7f68f8bc3700 1 --2- 172.21.2.102:0/3612384510 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68f4062740 0x7f68f40b1fc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f68dc0093a0 tx=0x7f68dc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:40.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.749+0000 7f68f0ff9700 1 -- 172.21.2.102:0/3612384510 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc006880 con 0x7f68f4062740 2021-02-12T17:18:40.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.749+0000 7f68f0ff9700 1 -- 172.21.2.102:0/3612384510 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc012e70 con 0x7f68f4062740 2021-02-12T17:18:40.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.749+0000 7f68fae27700 1 -- 172.21.2.102:0/3612384510 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f40b0490 con 0x7f68f4062740 2021-02-12T17:18:40.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.749+0000 7f68f0ff9700 1 -- 172.21.2.102:0/3612384510 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc01c630 con 0x7f68f4062740 2021-02-12T17:18:40.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.749+0000 7f68fae27700 1 -- 172.21.2.102:0/3612384510 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f40b0780 con 0x7f68f4062740 2021-02-12T17:18:40.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.750+0000 7f68fae27700 1 -- 172.21.2.102:0/3612384510 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f415d770 con 0x7f68f4062740 2021-02-12T17:18:40.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.750+0000 7f68f0ff9700 1 -- 172.21.2.102:0/3612384510 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f68dc00f070 con 0x7f68f4062740 2021-02-12T17:18:40.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.750+0000 7f68f0ff9700 1 --2- 172.21.2.102:0/3612384510 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f68d8059d30 0x7f68d805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:40.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.750+0000 7f68f0ff9700 1 -- 172.21.2.102:0/3612384510 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f68dc075340 con 0x7f68f4062740 2021-02-12T17:18:40.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.750+0000 7f68f3fff700 1 --2- 172.21.2.102:0/3612384510 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f68d8059d30 0x7f68d805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:40.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.751+0000 7f68f3fff700 1 --2- 172.21.2.102:0/3612384510 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f68d8059d30 0x7f68d805c1f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f68e4006fd0 tx=0x7f68e4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:40.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.753+0000 7f68f0ff9700 1 -- 172.21.2.102:0/3612384510 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f68f415d770 con 0x7f68f4062740 2021-02-12T17:18:40.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.911+0000 7f68fae27700 1 -- 172.21.2.102:0/3612384510 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68f40b0910 con 0x7f68f4062740 2021-02-12T17:18:40.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.912+0000 7f68f0ff9700 1 -- 172.21.2.102:0/3612384510 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3406 (secure 0 0 0) 0x7f68dc048ad0 con 0x7f68f4062740 2021-02-12T17:18:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.913+0000 7f68fae27700 1 -- 172.21.2.102:0/3612384510 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f68d8059d30 msgr2=0x7f68d805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.913+0000 7f68fae27700 1 --2- 172.21.2.102:0/3612384510 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f68d8059d30 0x7f68d805c1f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f68e4006fd0 tx=0x7f68e4008040).stop 2021-02-12T17:18:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.913+0000 7f68fae27700 1 -- 172.21.2.102:0/3612384510 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68f4062740 msgr2=0x7f68f40b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.913+0000 7f68fae27700 1 --2- 172.21.2.102:0/3612384510 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68f4062740 0x7f68f40b1fc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f68dc0093a0 tx=0x7f68dc016000).stop 2021-02-12T17:18:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.913+0000 7f68fae27700 1 -- 172.21.2.102:0/3612384510 shutdown_connections 2021-02-12T17:18:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.913+0000 7f68fae27700 1 --2- 172.21.2.102:0/3612384510 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f68f414e530 0x7f68f415da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.913+0000 7f68fae27700 1 --2- 172.21.2.102:0/3612384510 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f68d8059d30 0x7f68d805c1f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.913+0000 7f68fae27700 1 --2- 172.21.2.102:0/3612384510 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68f4062740 0x7f68f40b1fc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.913+0000 7f68fae27700 1 --2- 172.21.2.102:0/3612384510 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f68f40b8d20 0x7f68f4152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.913+0000 7f68fae27700 1 -- 172.21.2.102:0/3612384510 >> 172.21.2.102:0/3612384510 conn(0x7f68f40bc480 msgr2=0x7f68f4062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.913+0000 7f68fae27700 1 -- 172.21.2.102:0/3612384510 shutdown_connections 2021-02-12T17:18:40.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:40.913+0000 7f68fae27700 1 -- 172.21.2.102:0/3612384510 wait complete. 2021-02-12T17:18:40.957 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 18 2021-02-12T17:18:40.957 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:40.957 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:40.299300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:rejoin","state_seq":4,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:40.957 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-02-12T17:18:41.152 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:41.240 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.238+0000 7f7491804700 1 Processor -- start 2021-02-12T17:18:41.240 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.239+0000 7f7491804700 1 -- start start 2021-02-12T17:18:41.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.239+0000 7f7491804700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f748c0b8d20 0x7f748c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:41.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.239+0000 7f7491804700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f748c14e530 0x7f748c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:41.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.239+0000 7f7491804700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c0622a0 con 0x7f748c062740 2021-02-12T17:18:41.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.239+0000 7f7491804700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c068d20 con 0x7f748c0b8d20 2021-02-12T17:18:41.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.239+0000 7f7491804700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c14ea10 con 0x7f748c14e530 2021-02-12T17:18:41.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.239+0000 7f748affd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f748c0b8d20 0x7f748c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:41.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.239+0000 7f748b7fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f748c062740 0x7f748c062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54958/0 (socket says 172.21.2.102:54958) 2021-02-12T17:18:41.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.239+0000 7f748b7fe700 1 -- 172.21.2.102:0/1854146285 learned_addr learned my addr 172.21.2.102:0/1854146285 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:41.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.239+0000 7f748affd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f748c0b8d20 0x7f748c068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46314/0 (socket says 172.21.2.102:46314) 2021-02-12T17:18:41.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.240+0000 7f748affd700 1 -- 172.21.2.102:0/1854146285 >> v2:172.21.2.104:3300/0 conn(0x7f748c14e530 msgr2=0x7f748c0b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:18:41.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.240+0000 7f748affd700 1 --2- 172.21.2.102:0/1854146285 >> v2:172.21.2.104:3300/0 conn(0x7f748c14e530 0x7f748c0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:41.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.240+0000 7f748affd700 1 -- 172.21.2.102:0/1854146285 >> v1:172.21.2.102:6789/0 conn(0x7f748c062740 legacy=0x7f748c062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:41.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.240+0000 7f7489ffb700 1 -- 172.21.2.102:0/1854146285 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874404882 0 0) 0x7f748c0622a0 con 0x7f748c062740 2021-02-12T17:18:41.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.240+0000 7f748affd700 1 -- 172.21.2.102:0/1854146285 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0b63f0 con 0x7f748c0b8d20 2021-02-12T17:18:41.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.240+0000 7f748affd700 1 --2- 172.21.2.102:0/1854146285 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f748c0b8d20 0x7f748c068830 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f748c0654b0 tx=0x7f7474006de0).ready entity=mon.0 client_cookie=b92ede86836df185 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:41.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.240+0000 7f7489ffb700 1 -- 172.21.2.102:0/1854146285 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740097e0 con 0x7f748c0b8d20 2021-02-12T17:18:41.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.240+0000 7f7489ffb700 1 -- 172.21.2.102:0/1854146285 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7474009940 con 0x7f748c0b8d20 2021-02-12T17:18:41.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.240+0000 7f7489ffb700 1 -- 172.21.2.102:0/1854146285 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7474009cc0 con 0x7f748c0b8d20 2021-02-12T17:18:41.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.240+0000 7f7491804700 1 -- 172.21.2.102:0/1854146285 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f748c0b8d20 msgr2=0x7f748c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:41.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.240+0000 7f7491804700 1 --2- 172.21.2.102:0/1854146285 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f748c0b8d20 0x7f748c068830 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f748c0654b0 tx=0x7f7474006de0).stop 2021-02-12T17:18:41.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.241+0000 7f7491804700 1 -- 172.21.2.102:0/1854146285 shutdown_connections 2021-02-12T17:18:41.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.241+0000 7f7491804700 1 --2- 172.21.2.102:0/1854146285 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f748c0b8d20 0x7f748c068830 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:41.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.241+0000 7f7491804700 1 --2- 172.21.2.102:0/1854146285 >> v2:172.21.2.104:3300/0 conn(0x7f748c14e530 0x7f748c0b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:41.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.241+0000 7f7491804700 1 -- 172.21.2.102:0/1854146285 >> 172.21.2.102:0/1854146285 conn(0x7f748c0bc480 msgr2=0x7f748c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:41.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.241+0000 7f7491804700 1 -- 172.21.2.102:0/1854146285 shutdown_connections 2021-02-12T17:18:41.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.241+0000 7f7491804700 1 -- 172.21.2.102:0/1854146285 wait complete. 2021-02-12T17:18:41.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.241+0000 7f7491804700 1 Processor -- start 2021-02-12T17:18:41.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f7491804700 1 -- start start 2021-02-12T17:18:41.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f7491804700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f748c062740 0x7f748c0b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:41.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f7491804700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f748c0b8d20 0x7f748c0b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:41.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f7491804700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f748c14e530 0x7f748c0b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:41.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f7491804700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c15e220 con 0x7f748c14e530 2021-02-12T17:18:41.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f7491804700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0b4f90 con 0x7f748c062740 2021-02-12T17:18:41.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f7491804700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0b5230 con 0x7f748c0b8d20 2021-02-12T17:18:41.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f748b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f748c14e530 0x7f748c0b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:41.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f748b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f748c14e530 0x7f748c0b3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46320/0 (socket says 172.21.2.102:46320) 2021-02-12T17:18:41.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f748b7fe700 1 -- 172.21.2.102:0/55787359 learned_addr learned my addr 172.21.2.102:0/55787359 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:41.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f748affd700 1 --2- 172.21.2.102:0/55787359 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f748c062740 0x7f748c0b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:41.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f748b7fe700 1 -- 172.21.2.102:0/55787359 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f748c0b8d20 msgr2=0x7f748c0b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:41.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f748b7fe700 1 --2- 172.21.2.102:0/55787359 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f748c0b8d20 0x7f748c0b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:41.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f748b7fe700 1 -- 172.21.2.102:0/55787359 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f748c062740 msgr2=0x7f748c0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:41.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f748b7fe700 1 --2- 172.21.2.102:0/55787359 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f748c062740 0x7f748c0b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:41.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f748b7fe700 1 -- 172.21.2.102:0/55787359 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0b0d00 con 0x7f748c14e530 2021-02-12T17:18:41.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.242+0000 7f748affd700 1 --2- 172.21.2.102:0/55787359 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f748c062740 0x7f748c0b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:18:41.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.243+0000 7f748b7fe700 1 --2- 172.21.2.102:0/55787359 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f748c14e530 0x7f748c0b3d80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f748400cab0 tx=0x7f7484007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:41.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.243+0000 7f7482ffd700 1 -- 172.21.2.102:0/55787359 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484005c40 con 0x7f748c14e530 2021-02-12T17:18:41.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.243+0000 7f7482ffd700 1 -- 172.21.2.102:0/55787359 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7484005da0 con 0x7f748c14e530 2021-02-12T17:18:41.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.243+0000 7f7482ffd700 1 -- 172.21.2.102:0/55787359 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484007340 con 0x7f748c14e530 2021-02-12T17:18:41.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.243+0000 7f7491804700 1 -- 172.21.2.102:0/55787359 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c15ded0 con 0x7f748c14e530 2021-02-12T17:18:41.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.243+0000 7f7491804700 1 -- 172.21.2.102:0/55787359 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c0b22e0 con 0x7f748c14e530 2021-02-12T17:18:41.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.244+0000 7f7491804700 1 -- 172.21.2.102:0/55787359 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c0bb820 con 0x7f748c14e530 2021-02-12T17:18:41.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.244+0000 7f7482ffd700 1 -- 172.21.2.102:0/55787359 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f7484010030 con 0x7f748c14e530 2021-02-12T17:18:41.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.244+0000 7f7482ffd700 1 --2- 172.21.2.102:0/55787359 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7470059d30 0x7f747005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:41.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.244+0000 7f7482ffd700 1 -- 172.21.2.102:0/55787359 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f7484073e00 con 0x7f748c14e530 2021-02-12T17:18:41.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.244+0000 7f748affd700 1 --2- 172.21.2.102:0/55787359 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7470059d30 0x7f747005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:41.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.244+0000 7f748affd700 1 --2- 172.21.2.102:0/55787359 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7470059d30 0x7f747005c1f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f747400b130 tx=0x7f7474016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:41.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.247+0000 7f7482ffd700 1 -- 172.21.2.102:0/55787359 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f7484047530 con 0x7f748c14e530 2021-02-12T17:18:41.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.410+0000 7f7491804700 1 -- 172.21.2.102:0/55787359 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f748c0b53f0 con 0x7f748c14e530 2021-02-12T17:18:41.412 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.410+0000 7f7482ffd700 1 -- 172.21.2.102:0/55787359 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3406 (secure 0 0 0) 0x7f748404ab50 con 0x7f748c14e530 2021-02-12T17:18:41.412 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:41.412 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:41.303332+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":5,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:41.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.411+0000 7f7491804700 1 -- 172.21.2.102:0/55787359 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7470059d30 msgr2=0x7f747005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:41.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.411+0000 7f7491804700 1 --2- 172.21.2.102:0/55787359 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7470059d30 0x7f747005c1f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f747400b130 tx=0x7f7474016000).stop 2021-02-12T17:18:41.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.411+0000 7f7491804700 1 -- 172.21.2.102:0/55787359 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f748c14e530 msgr2=0x7f748c0b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:41.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.411+0000 7f7491804700 1 --2- 172.21.2.102:0/55787359 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f748c14e530 0x7f748c0b3d80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f748400cab0 tx=0x7f7484007dd0).stop 2021-02-12T17:18:41.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.412+0000 7f7491804700 1 -- 172.21.2.102:0/55787359 shutdown_connections 2021-02-12T17:18:41.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.412+0000 7f7491804700 1 --2- 172.21.2.102:0/55787359 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7470059d30 0x7f747005c1f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:41.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.412+0000 7f7491804700 1 --2- 172.21.2.102:0/55787359 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f748c14e530 0x7f748c0b3d80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:41.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.412+0000 7f7491804700 1 --2- 172.21.2.102:0/55787359 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f748c062740 0x7f748c0b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:41.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.412+0000 7f7491804700 1 --2- 172.21.2.102:0/55787359 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f748c0b8d20 0x7f748c0b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:41.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.412+0000 7f7491804700 1 -- 172.21.2.102:0/55787359 >> 172.21.2.102:0/55787359 conn(0x7f748c0bc480 msgr2=0x7f748c0bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:41.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.412+0000 7f7491804700 1 -- 172.21.2.102:0/55787359 shutdown_connections 2021-02-12T17:18:41.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:41.412+0000 7f7491804700 1 -- 172.21.2.102:0/55787359 wait complete. 2021-02-12T17:18:41.414 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 19 2021-02-12T17:18:41.422 INFO:tasks.mds_thrash.fs.[a]:mds.a has gained rank=0, replacing gid=4272 2021-02-12T17:18:41.422 INFO:tasks.mds_thrash.fs.[a]:waiting for 4 secs before reviving mds.c 2021-02-12T17:18:42.958 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:43.047 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.045+0000 7f2c15517700 1 Processor -- start 2021-02-12T17:18:43.047 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.045+0000 7f2c15517700 1 -- start start 2021-02-12T17:18:43.047 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.046+0000 7f2c15517700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f2c10068710 0x7f2c100b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:43.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.046+0000 7f2c15517700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c100b7680 con 0x7f2c10068af0 2021-02-12T17:18:43.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.046+0000 7f2c15517700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c100b2360 con 0x7f2c100b6350 2021-02-12T17:18:43.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.046+0000 7f2c15517700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c100b2600 con 0x7f2c10068710 2021-02-12T17:18:43.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.046+0000 7f2c0e7fc700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f2c10068af0 0x7f2c1014a020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:54970/0 (socket says 172.21.2.102:54970) 2021-02-12T17:18:43.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.046+0000 7f2c0e7fc700 1 -- 172.21.2.102:0/1176245744 learned_addr learned my addr 172.21.2.102:0/1176245744 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:43.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 -- 172.21.2.102:0/1176245744 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751920246 0 0) 0x7f2c100b7680 con 0x7f2c10068af0 2021-02-12T17:18:43.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 -- 172.21.2.102:0/1176245744 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf0003230 con 0x7f2c10068af0 2021-02-12T17:18:43.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0effd700 1 --2- 172.21.2.102:0/1176245744 >> v2:172.21.2.104:3300/0 conn(0x7f2c10068710 0x7f2c100b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:43.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 -- 172.21.2.102:0/1176245744 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3066470117 0 0) 0x7f2bf0003230 con 0x7f2c10068af0 2021-02-12T17:18:43.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 -- 172.21.2.102:0/1176245744 >> v2:172.21.2.104:3300/0 conn(0x7f2c10068710 msgr2=0x7f2c100b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:43.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 --2- 172.21.2.102:0/1176245744 >> v2:172.21.2.104:3300/0 conn(0x7f2c10068710 0x7f2c100b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:43.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 -- 172.21.2.102:0/1176245744 >> v1:172.21.2.104:6789/0 conn(0x7f2c100b6350 legacy=0x7f2c100b8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:43.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 -- 172.21.2.102:0/1176245744 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c101498e0 con 0x7f2c10068af0 2021-02-12T17:18:43.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 -- 172.21.2.102:0/1176245744 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f2bf80014e0 con 0x7f2c10068af0 2021-02-12T17:18:43.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 -- 172.21.2.102:0/1176245744 >> v1:172.21.2.102:6789/0 conn(0x7f2c10068af0 legacy=0x7f2c1014a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:43.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 --2- 172.21.2.102:0/1176245744 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2bf00037f0 0x7f2bf0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:43.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 --2- 172.21.2.102:0/1176245744 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bf00044d0 0x7f2bf0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:43.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 --2- 172.21.2.102:0/1176245744 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2bf0004e40 0x7f2bf000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:43.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 -- 172.21.2.102:0/1176245744 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100b2600 con 0x7f2bf0004e40 2021-02-12T17:18:43.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 -- 172.21.2.102:0/1176245744 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf00052f0 con 0x7f2bf00037f0 2021-02-12T17:18:43.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0dffb700 1 -- 172.21.2.102:0/1176245744 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf000bc10 con 0x7f2bf00044d0 2021-02-12T17:18:43.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0f7fe700 1 --2- 172.21.2.102:0/1176245744 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2bf0004e40 0x7f2bf000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:43.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0effd700 1 --2- 172.21.2.102:0/1176245744 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2bf00037f0 0x7f2bf0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:43.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0f7fe700 1 -- 172.21.2.102:0/1176245744 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bf00044d0 msgr2=0x7f2bf0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:43.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0f7fe700 1 --2- 172.21.2.102:0/1176245744 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bf00044d0 0x7f2bf0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:43.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0f7fe700 1 -- 172.21.2.102:0/1176245744 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2bf00037f0 msgr2=0x7f2bf0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:18:43.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0f7fe700 1 --2- 172.21.2.102:0/1176245744 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2bf00037f0 0x7f2bf0003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:43.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.047+0000 7f2c0f7fe700 1 -- 172.21.2.102:0/1176245744 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf0003230 con 0x7f2bf0004e40 2021-02-12T17:18:43.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.048+0000 7f2c0f7fe700 1 -- 172.21.2.102:0/1176245744 reap_dead start 2021-02-12T17:18:43.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.048+0000 7f2c0f7fe700 1 --2- 172.21.2.102:0/1176245744 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2bf0004e40 0x7f2bf000b720 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f2c08002db0 tx=0x7f2c08007f00).ready entity=mon.0 client_cookie=e182f6a83416fe04 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:43.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.048+0000 7f2c0dffb700 1 -- 172.21.2.102:0/1176245744 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08002430 con 0x7f2bf0004e40 2021-02-12T17:18:43.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.048+0000 7f2c0dffb700 1 -- 172.21.2.102:0/1176245744 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0800c900 con 0x7f2bf0004e40 2021-02-12T17:18:43.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.048+0000 7f2c0dffb700 1 -- 172.21.2.102:0/1176245744 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0800ccc0 con 0x7f2bf0004e40 2021-02-12T17:18:43.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.048+0000 7f2c15517700 1 -- 172.21.2.102:0/1176245744 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2bf0004e40 msgr2=0x7f2bf000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:43.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.048+0000 7f2c15517700 1 --2- 172.21.2.102:0/1176245744 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2bf0004e40 0x7f2bf000b720 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f2c08002db0 tx=0x7f2c08007f00).stop 2021-02-12T17:18:43.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.048+0000 7f2c15517700 1 -- 172.21.2.102:0/1176245744 shutdown_connections 2021-02-12T17:18:43.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.048+0000 7f2c15517700 1 --2- 172.21.2.102:0/1176245744 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2bf0004e40 0x7f2bf000b720 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:43.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.048+0000 7f2c15517700 1 -- 172.21.2.102:0/1176245744 >> 172.21.2.102:0/1176245744 conn(0x7f2c100bc480 msgr2=0x7f2c100b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:43.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.048+0000 7f2c15517700 1 -- 172.21.2.102:0/1176245744 shutdown_connections 2021-02-12T17:18:43.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.048+0000 7f2c15517700 1 -- 172.21.2.102:0/1176245744 wait complete. 2021-02-12T17:18:43.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.049+0000 7f2c15517700 1 Processor -- start 2021-02-12T17:18:43.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.049+0000 7f2c15517700 1 -- start start 2021-02-12T17:18:43.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c15517700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bf0004e40 0x7f2c100b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:43.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c15517700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2c10161300 0x7f2c100b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:43.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c15517700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2c1015d0c0 0x7f2c1015d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:43.055 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c15517700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1015d9f0 con 0x7f2c1015d0c0 2021-02-12T17:18:43.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c15517700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c101606f0 con 0x7f2c10161300 2021-02-12T17:18:43.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c15517700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100b0950 con 0x7f2bf0004e40 2021-02-12T17:18:43.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c0f7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2c1015d0c0 0x7f2c1015d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:43.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c0f7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2c1015d0c0 0x7f2c1015d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46340/0 (socket says 172.21.2.102:46340) 2021-02-12T17:18:43.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c0f7fe700 1 -- 172.21.2.102:0/1045497643 learned_addr learned my addr 172.21.2.102:0/1045497643 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:43.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c0effd700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bf0004e40 0x7f2c100b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:43.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c0e7fc700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2c10161300 0x7f2c100b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:43.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c0f7fe700 1 -- 172.21.2.102:0/1045497643 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bf0004e40 msgr2=0x7f2c100b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:43.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c0f7fe700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bf0004e40 0x7f2c100b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:43.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c0f7fe700 1 -- 172.21.2.102:0/1045497643 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2c10161300 msgr2=0x7f2c100b8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:43.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c0f7fe700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2c10161300 0x7f2c100b8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:43.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c0f7fe700 1 -- 172.21.2.102:0/1045497643 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c10160920 con 0x7f2c1015d0c0 2021-02-12T17:18:43.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c0e7fc700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2c10161300 0x7f2c100b8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:18:43.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.050+0000 7f2c0f7fe700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2c1015d0c0 0x7f2c1015d500 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f2c100657f0 tx=0x7f2c08014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:43.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.051+0000 7f2c06ffd700 1 -- 172.21.2.102:0/1045497643 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08012a70 con 0x7f2c1015d0c0 2021-02-12T17:18:43.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.051+0000 7f2c06ffd700 1 -- 172.21.2.102:0/1045497643 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c08012bd0 con 0x7f2c1015d0c0 2021-02-12T17:18:43.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.051+0000 7f2c15517700 1 -- 172.21.2.102:0/1045497643 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c10160bc0 con 0x7f2c1015d0c0 2021-02-12T17:18:43.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.051+0000 7f2c06ffd700 1 -- 172.21.2.102:0/1045497643 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0801e440 con 0x7f2c1015d0c0 2021-02-12T17:18:43.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.051+0000 7f2c15517700 1 -- 172.21.2.102:0/1045497643 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c100b0650 con 0x7f2c1015d0c0 2021-02-12T17:18:43.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.051+0000 7f2c15517700 1 -- 172.21.2.102:0/1045497643 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c100658c0 con 0x7f2c1015d0c0 2021-02-12T17:18:43.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.052+0000 7f2c06ffd700 1 -- 172.21.2.102:0/1045497643 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f2c08025030 con 0x7f2c1015d0c0 2021-02-12T17:18:43.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.052+0000 7f2c06ffd700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2bf4059d80 0x7f2bf405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:43.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.052+0000 7f2c06ffd700 1 -- 172.21.2.102:0/1045497643 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f2c08074d70 con 0x7f2c1015d0c0 2021-02-12T17:18:43.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.052+0000 7f2c0effd700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2bf4059d80 0x7f2bf405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:43.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.052+0000 7f2c0effd700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2bf4059d80 0x7f2bf405c240 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f2c0000f9d0 tx=0x7f2c00008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:43.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.055+0000 7f2c06ffd700 1 -- 172.21.2.102:0/1045497643 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f2c08048470 con 0x7f2c1015d0c0 2021-02-12T17:18:43.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.211+0000 7f2c15517700 1 -- 172.21.2.102:0/1045497643 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c10161020 con 0x7f2c1015d0c0 2021-02-12T17:18:43.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.212+0000 7f2c06ffd700 1 -- 172.21.2.102:0/1045497643 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3406 (secure 0 0 0) 0x7f2c08023090 con 0x7f2c1015d0c0 2021-02-12T17:18:43.213 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:43.213 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:41.303332+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":5,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:43.214 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.213+0000 7f2c15517700 1 -- 172.21.2.102:0/1045497643 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2bf4059d80 msgr2=0x7f2bf405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:43.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.213+0000 7f2c15517700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2bf4059d80 0x7f2bf405c240 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f2c0000f9d0 tx=0x7f2c00008040).stop 2021-02-12T17:18:43.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.213+0000 7f2c15517700 1 -- 172.21.2.102:0/1045497643 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2c1015d0c0 msgr2=0x7f2c1015d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:43.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.213+0000 7f2c15517700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2c1015d0c0 0x7f2c1015d500 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f2c100657f0 tx=0x7f2c08014000).stop 2021-02-12T17:18:43.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.213+0000 7f2c15517700 1 -- 172.21.2.102:0/1045497643 shutdown_connections 2021-02-12T17:18:43.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.213+0000 7f2c15517700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2bf4059d80 0x7f2bf405c240 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:43.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.213+0000 7f2c15517700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2c1015d0c0 0x7f2c1015d500 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:43.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.213+0000 7f2c15517700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2bf0004e40 0x7f2c100b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:43.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.213+0000 7f2c15517700 1 --2- 172.21.2.102:0/1045497643 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2c10161300 0x7f2c100b8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:43.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.213+0000 7f2c15517700 1 -- 172.21.2.102:0/1045497643 >> 172.21.2.102:0/1045497643 conn(0x7f2c100bc480 msgr2=0x7f2c100675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:43.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.213+0000 7f2c15517700 1 -- 172.21.2.102:0/1045497643 shutdown_connections 2021-02-12T17:18:43.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:43.213+0000 7f2c15517700 1 -- 172.21.2.102:0/1045497643 wait complete. 2021-02-12T17:18:43.216 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 19 2021-02-12T17:18:43.223 INFO:tasks.mds_thrash.fs.[b]:mds.a reported in up:active state 2021-02-12T17:18:43.223 INFO:tasks.mds_thrash.fs.[b]:waiting for 65 secs before thrashing 2021-02-12T17:18:43.297 INFO:tasks.ceph.mds.a.gibba002.stderr:2021-02-12T17:18:43.296+0000 7f81607b7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-02-12T17:18:45.422 INFO:tasks.mds_thrash.fs.[a]:reviving mds.c 2021-02-12T17:18:45.423 INFO:tasks.ceph.mds.c:Restarting daemon 2021-02-12T17:18:45.423 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-02-12T17:18:45.426 INFO:tasks.ceph.mds.c:Started 2021-02-12T17:18:45.426 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:45.483 INFO:tasks.ceph.mds.c.gibba002.stdout:starting mds.c at 2021-02-12T17:18:45.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.516+0000 7f5d7361e700 1 Processor -- start 2021-02-12T17:18:45.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.516+0000 7f5d7361e700 1 -- start start 2021-02-12T17:18:45.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d7361e700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f5d6c0b8d20 0x7f5d6c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:45.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d7361e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d6c14e530 0x7f5d6c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:45.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d7361e700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f5d6c062740 0x7f5d6c062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:45.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d7361e700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6c068d20 con 0x7f5d6c0b8d20 2021-02-12T17:18:45.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d7361e700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6c0622a0 con 0x7f5d6c062740 2021-02-12T17:18:45.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d7361e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c14ea10 con 0x7f5d6c14e530 2021-02-12T17:18:45.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d713ba700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f5d6c0b8d20 0x7f5d6c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:45.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d713ba700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f5d6c0b8d20 0x7f5d6c068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46356/0 (socket says 172.21.2.102:46356) 2021-02-12T17:18:45.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d713ba700 1 -- 172.21.2.102:0/2254171266 learned_addr learned my addr 172.21.2.102:0/2254171266 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:45.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d713ba700 1 -- 172.21.2.102:0/2254171266 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d6c14e530 msgr2=0x7f5d6c0b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:18:45.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d713ba700 1 --2- 172.21.2.102:0/2254171266 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d6c14e530 0x7f5d6c0b7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:45.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d713ba700 1 -- 172.21.2.102:0/2254171266 >> v2:172.21.2.104:3300/0 conn(0x7f5d6c062740 msgr2=0x7f5d6c062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:18:45.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d713ba700 1 --2- 172.21.2.102:0/2254171266 >> v2:172.21.2.104:3300/0 conn(0x7f5d6c062740 0x7f5d6c062bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:45.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d713ba700 1 -- 172.21.2.102:0/2254171266 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c0b63f0 con 0x7f5d6c0b8d20 2021-02-12T17:18:45.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.517+0000 7f5d713ba700 1 --2- 172.21.2.102:0/2254171266 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d6c0b8d20 0x7f5d6c068830 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f5d6c14db30 tx=0x7f5d5c006ea0).ready entity=mon.0 client_cookie=b26ae0c6c3ed92ba server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:45.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.518+0000 7f5d5bfff700 1 -- 172.21.2.102:0/2254171266 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c009840 con 0x7f5d6c0b8d20 2021-02-12T17:18:45.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.518+0000 7f5d5bfff700 1 -- 172.21.2.102:0/2254171266 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c0099a0 con 0x7f5d6c0b8d20 2021-02-12T17:18:45.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.518+0000 7f5d5bfff700 1 -- 172.21.2.102:0/2254171266 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c009d20 con 0x7f5d6c0b8d20 2021-02-12T17:18:45.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.518+0000 7f5d7361e700 1 -- 172.21.2.102:0/2254171266 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d6c0b8d20 msgr2=0x7f5d6c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:45.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.518+0000 7f5d7361e700 1 --2- 172.21.2.102:0/2254171266 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d6c0b8d20 0x7f5d6c068830 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f5d6c14db30 tx=0x7f5d5c006ea0).stop 2021-02-12T17:18:45.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.518+0000 7f5d7361e700 1 -- 172.21.2.102:0/2254171266 shutdown_connections 2021-02-12T17:18:45.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.518+0000 7f5d7361e700 1 --2- 172.21.2.102:0/2254171266 >> v2:172.21.2.104:3300/0 conn(0x7f5d6c062740 0x7f5d6c062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:45.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.518+0000 7f5d7361e700 1 --2- 172.21.2.102:0/2254171266 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d6c0b8d20 0x7f5d6c068830 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:45.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.518+0000 7f5d7361e700 1 --2- 172.21.2.102:0/2254171266 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d6c14e530 0x7f5d6c0b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:45.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.518+0000 7f5d7361e700 1 -- 172.21.2.102:0/2254171266 >> 172.21.2.102:0/2254171266 conn(0x7f5d6c0bc480 msgr2=0x7f5d6c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:45.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.518+0000 7f5d7361e700 1 -- 172.21.2.102:0/2254171266 shutdown_connections 2021-02-12T17:18:45.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.518+0000 7f5d7361e700 1 -- 172.21.2.102:0/2254171266 wait complete. 2021-02-12T17:18:45.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.519+0000 7f5d7361e700 1 Processor -- start 2021-02-12T17:18:45.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.519+0000 7f5d7361e700 1 -- start start 2021-02-12T17:18:45.525 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.519+0000 7f5d7361e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5d6c062740 0x7f5d6c0b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:45.525 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.519+0000 7f5d7361e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d6c0b8d20 0x7f5d6c160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:45.525 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.519+0000 7f5d7361e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d6c14e530 0x7f5d6c0b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:45.525 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.519+0000 7f5d7361e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c1610c0 con 0x7f5d6c14e530 2021-02-12T17:18:45.525 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.519+0000 7f5d7361e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c161ac0 con 0x7f5d6c062740 2021-02-12T17:18:45.525 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.519+0000 7f5d7361e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c1612e0 con 0x7f5d6c0b8d20 2021-02-12T17:18:45.525 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.520+0000 7f5d71bbb700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d6c14e530 0x7f5d6c0b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:45.526 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.520+0000 7f5d71bbb700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d6c14e530 0x7f5d6c0b9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46364/0 (socket says 172.21.2.102:46364) 2021-02-12T17:18:45.526 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.520+0000 7f5d71bbb700 1 -- 172.21.2.102:0/2566423383 learned_addr learned my addr 172.21.2.102:0/2566423383 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:45.526 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.520+0000 7f5d71bbb700 1 -- 172.21.2.102:0/2566423383 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d6c0b8d20 msgr2=0x7f5d6c160bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:18:45.526 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.520+0000 7f5d71bbb700 1 --2- 172.21.2.102:0/2566423383 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d6c0b8d20 0x7f5d6c160bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:45.526 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.520+0000 7f5d71bbb700 1 -- 172.21.2.102:0/2566423383 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5d6c062740 msgr2=0x7f5d6c0b5b10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:18:45.526 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.520+0000 7f5d71bbb700 1 --2- 172.21.2.102:0/2566423383 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5d6c062740 0x7f5d6c0b5b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:45.526 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.520+0000 7f5d71bbb700 1 -- 172.21.2.102:0/2566423383 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c161580 con 0x7f5d6c14e530 2021-02-12T17:18:45.526 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.520+0000 7f5d71bbb700 1 --2- 172.21.2.102:0/2566423383 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d6c14e530 0x7f5d6c0b9c00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f5d6400bae0 tx=0x7f5d640090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:45.526 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.520+0000 7f5d597fa700 1 -- 172.21.2.102:0/2566423383 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6400c740 con 0x7f5d6c14e530 2021-02-12T17:18:45.526 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.520+0000 7f5d597fa700 1 -- 172.21.2.102:0/2566423383 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6400c8a0 con 0x7f5d6c14e530 2021-02-12T17:18:45.526 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.520+0000 7f5d7361e700 1 -- 172.21.2.102:0/2566423383 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6c161820 con 0x7f5d6c14e530 2021-02-12T17:18:45.527 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.520+0000 7f5d597fa700 1 -- 172.21.2.102:0/2566423383 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6400ca50 con 0x7f5d6c14e530 2021-02-12T17:18:45.527 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.520+0000 7f5d7361e700 1 -- 172.21.2.102:0/2566423383 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6c0ba0f0 con 0x7f5d6c14e530 2021-02-12T17:18:45.527 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.521+0000 7f5d7361e700 1 -- 172.21.2.102:0/2566423383 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6c064520 con 0x7f5d6c14e530 2021-02-12T17:18:45.527 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.521+0000 7f5d597fa700 1 -- 172.21.2.102:0/2566423383 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f5d6401c070 con 0x7f5d6c14e530 2021-02-12T17:18:45.527 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.522+0000 7f5d597fa700 1 --2- 172.21.2.102:0/2566423383 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5d4c059d30 0x7f5d4c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:45.527 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.522+0000 7f5d597fa700 1 -- 172.21.2.102:0/2566423383 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f5d64073330 con 0x7f5d6c14e530 2021-02-12T17:18:45.527 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.522+0000 7f5d713ba700 1 --2- 172.21.2.102:0/2566423383 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5d4c059d30 0x7f5d4c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:45.527 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.522+0000 7f5d713ba700 1 --2- 172.21.2.102:0/2566423383 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5d4c059d30 0x7f5d4c05c1f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f5d5c006ee0 tx=0x7f5d5c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:45.528 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.525+0000 7f5d597fa700 1 -- 172.21.2.102:0/2566423383 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f5d64046ac0 con 0x7f5d6c14e530 2021-02-12T17:18:45.689 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.688+0000 7f5d7361e700 1 -- 172.21.2.102:0/2566423383 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d6c15d940 con 0x7f5d6c14e530 2021-02-12T17:18:45.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.688+0000 7f5d597fa700 1 -- 172.21.2.102:0/2566423383 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3406 (secure 0 0 0) 0x7f5d6404a0e0 con 0x7f5d6c14e530 2021-02-12T17:18:45.690 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:45.690 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:41.303332+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":5,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:45.690 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.689+0000 7f5d7361e700 1 -- 172.21.2.102:0/2566423383 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5d4c059d30 msgr2=0x7f5d4c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:45.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.689+0000 7f5d7361e700 1 --2- 172.21.2.102:0/2566423383 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5d4c059d30 0x7f5d4c05c1f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f5d5c006ee0 tx=0x7f5d5c016000).stop 2021-02-12T17:18:45.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.689+0000 7f5d7361e700 1 -- 172.21.2.102:0/2566423383 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d6c14e530 msgr2=0x7f5d6c0b9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:45.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.689+0000 7f5d7361e700 1 --2- 172.21.2.102:0/2566423383 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d6c14e530 0x7f5d6c0b9c00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f5d6400bae0 tx=0x7f5d640090f0).stop 2021-02-12T17:18:45.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.690+0000 7f5d7361e700 1 -- 172.21.2.102:0/2566423383 shutdown_connections 2021-02-12T17:18:45.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.690+0000 7f5d7361e700 1 --2- 172.21.2.102:0/2566423383 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5d4c059d30 0x7f5d4c05c1f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.690+0000 7f5d7361e700 1 --2- 172.21.2.102:0/2566423383 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d6c14e530 0x7f5d6c0b9c00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.690+0000 7f5d7361e700 1 --2- 172.21.2.102:0/2566423383 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5d6c062740 0x7f5d6c0b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.690+0000 7f5d7361e700 1 --2- 172.21.2.102:0/2566423383 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d6c0b8d20 0x7f5d6c160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.690+0000 7f5d7361e700 1 -- 172.21.2.102:0/2566423383 >> 172.21.2.102:0/2566423383 conn(0x7f5d6c0bc480 msgr2=0x7f5d6c153460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.690+0000 7f5d7361e700 1 -- 172.21.2.102:0/2566423383 shutdown_connections 2021-02-12T17:18:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:45.690+0000 7f5d7361e700 1 -- 172.21.2.102:0/2566423383 wait complete. 2021-02-12T17:18:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 19 2021-02-12T17:18:45.700 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2021-02-12T17:18:47.700 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:18:47.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.788+0000 7f0590510700 1 Processor -- start 2021-02-12T17:18:47.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.788+0000 7f0590510700 1 -- start start 2021-02-12T17:18:47.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f0590510700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0588067720 0x7f05880b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:47.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f0590510700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f05880b8b60 0x7f0588144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:47.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f0590510700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05880b2930 con 0x7f0588062580 2021-02-12T17:18:47.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f0590510700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0588068980 con 0x7f05880b8b60 2021-02-12T17:18:47.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f0590510700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0588146ab0 con 0x7f0588067720 2021-02-12T17:18:47.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f058daab700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f0588062580 0x7f05881463a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55018/0 (socket says 172.21.2.102:55018) 2021-02-12T17:18:47.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f058eaad700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f05880b8b60 0x7f0588144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:47.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f058daab700 1 -- 172.21.2.102:0/4135217227 learned_addr learned my addr 172.21.2.102:0/4135217227 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:18:47.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f058eaad700 1 -- 172.21.2.102:0/4135217227 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0588067720 msgr2=0x7f05880b6350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:18:47.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f058eaad700 1 --2- 172.21.2.102:0/4135217227 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0588067720 0x7f05880b6350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:47.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f058eaad700 1 -- 172.21.2.102:0/4135217227 >> v1:172.21.2.102:6789/0 conn(0x7f0588062580 legacy=0x7f05881463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:47.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f058eaad700 1 -- 172.21.2.102:0/4135217227 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0588066db0 con 0x7f05880b8b60 2021-02-12T17:18:47.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f058eaad700 1 --2- 172.21.2.102:0/4135217227 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f05880b8b60 0x7f0588144ea0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f0580009cc0 tx=0x7f05800091d0).ready entity=mon.0 client_cookie=ec7623e4ce8853e2 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:47.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f058d2aa700 1 -- 172.21.2.102:0/4135217227 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058000bc40 con 0x7f05880b8b60 2021-02-12T17:18:47.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f058d2aa700 1 -- 172.21.2.102:0/4135217227 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058000bda0 con 0x7f05880b8b60 2021-02-12T17:18:47.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.789+0000 7f058d2aa700 1 -- 172.21.2.102:0/4135217227 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0580011610 con 0x7f05880b8b60 2021-02-12T17:18:47.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.790+0000 7f0590510700 1 -- 172.21.2.102:0/4135217227 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f05880b8b60 msgr2=0x7f0588144ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:47.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.790+0000 7f0590510700 1 --2- 172.21.2.102:0/4135217227 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f05880b8b60 0x7f0588144ea0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f0580009cc0 tx=0x7f05800091d0).stop 2021-02-12T17:18:47.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.790+0000 7f0590510700 1 -- 172.21.2.102:0/4135217227 shutdown_connections 2021-02-12T17:18:47.793 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.790+0000 7f0590510700 1 --2- 172.21.2.102:0/4135217227 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f05880b8b60 0x7f0588144ea0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:47.793 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.790+0000 7f0590510700 1 --2- 172.21.2.102:0/4135217227 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0588067720 0x7f05880b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:47.793 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.790+0000 7f0590510700 1 -- 172.21.2.102:0/4135217227 >> 172.21.2.102:0/4135217227 conn(0x7f05880bc480 msgr2=0x7f05880b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:47.793 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.790+0000 7f0590510700 1 -- 172.21.2.102:0/4135217227 shutdown_connections 2021-02-12T17:18:47.793 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.790+0000 7f0590510700 1 -- 172.21.2.102:0/4135217227 wait complete. 2021-02-12T17:18:47.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.791+0000 7f0590510700 1 Processor -- start 2021-02-12T17:18:47.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.791+0000 7f0590510700 1 -- start start 2021-02-12T17:18:47.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.791+0000 7f0590510700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0588062580 0x7f0588139e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:47.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.791+0000 7f0590510700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0588067720 0x7f0588147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:47.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.791+0000 7f0590510700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f05880b8b60 0x7f0588147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:47.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.791+0000 7f0590510700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0588149400 con 0x7f0588062580 2021-02-12T17:18:47.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.791+0000 7f0590510700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05881496a0 con 0x7f0588067720 2021-02-12T17:18:47.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.791+0000 7f0590510700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0588148210 con 0x7f05880b8b60 2021-02-12T17:18:47.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.791+0000 7f058e2ac700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0588062580 0x7f0588139e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:47.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.791+0000 7f058e2ac700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0588062580 0x7f0588139e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46380/0 (socket says 172.21.2.102:46380) 2021-02-12T17:18:47.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.791+0000 7f058e2ac700 1 -- 172.21.2.102:0/185806704 learned_addr learned my addr 172.21.2.102:0/185806704 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:18:47.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.792+0000 7f058e2ac700 1 -- 172.21.2.102:0/185806704 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f05880b8b60 msgr2=0x7f0588147530 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:18:47.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.792+0000 7f058e2ac700 1 --2- 172.21.2.102:0/185806704 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f05880b8b60 0x7f0588147530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:47.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.792+0000 7f058e2ac700 1 -- 172.21.2.102:0/185806704 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0588067720 msgr2=0x7f0588147040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:18:47.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.792+0000 7f058e2ac700 1 --2- 172.21.2.102:0/185806704 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0588067720 0x7f0588147040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:47.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.792+0000 7f058e2ac700 1 -- 172.21.2.102:0/185806704 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05881484b0 con 0x7f0588062580 2021-02-12T17:18:47.796 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.792+0000 7f058e2ac700 1 --2- 172.21.2.102:0/185806704 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0588062580 0x7f0588139e90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f057c0096b0 tx=0x7f057c006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:47.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.792+0000 7f057a7fc700 1 -- 172.21.2.102:0/185806704 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c00d590 con 0x7f0588062580 2021-02-12T17:18:47.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.792+0000 7f057a7fc700 1 -- 172.21.2.102:0/185806704 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c00d710 con 0x7f0588062580 2021-02-12T17:18:47.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.792+0000 7f0590510700 1 -- 172.21.2.102:0/185806704 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0588148750 con 0x7f0588062580 2021-02-12T17:18:47.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.792+0000 7f057a7fc700 1 -- 172.21.2.102:0/185806704 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c00dad0 con 0x7f0588062580 2021-02-12T17:18:47.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.792+0000 7f0590510700 1 -- 172.21.2.102:0/185806704 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0588149080 con 0x7f0588062580 2021-02-12T17:18:47.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.793+0000 7f0590510700 1 -- 172.21.2.102:0/185806704 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0588146eb0 con 0x7f0588062580 2021-02-12T17:18:47.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.793+0000 7f057a7fc700 1 -- 172.21.2.102:0/185806704 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f057c017030 con 0x7f0588062580 2021-02-12T17:18:47.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.793+0000 7f057a7fc700 1 --2- 172.21.2.102:0/185806704 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0568059d80 0x7f056805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:18:47.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.793+0000 7f057a7fc700 1 -- 172.21.2.102:0/185806704 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f057c073070 con 0x7f0588062580 2021-02-12T17:18:47.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.793+0000 7f058daab700 1 --2- 172.21.2.102:0/185806704 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0568059d80 0x7f056805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:18:47.797 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.794+0000 7f058daab700 1 --2- 172.21.2.102:0/185806704 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0568059d80 0x7f056805c240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f0584005590 tx=0x7f0584007780).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:18:47.798 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.796+0000 7f057a7fc700 1 -- 172.21.2.102:0/185806704 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f057c046820 con 0x7f0588062580 2021-02-12T17:18:47.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.954+0000 7f0590510700 1 -- 172.21.2.102:0/185806704 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05880b7120 con 0x7f0588062580 2021-02-12T17:18:47.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.954+0000 7f057a7fc700 1 -- 172.21.2.102:0/185806704 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3756 (secure 0 0 0) 0x7f057c049e40 con 0x7f0588062580 2021-02-12T17:18:47.956 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:18:47.956 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:41.303332+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":5,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:18:47.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.955+0000 7f0590510700 1 -- 172.21.2.102:0/185806704 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0568059d80 msgr2=0x7f056805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:47.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.955+0000 7f0590510700 1 --2- 172.21.2.102:0/185806704 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0568059d80 0x7f056805c240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f0584005590 tx=0x7f0584007780).stop 2021-02-12T17:18:47.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.955+0000 7f0590510700 1 -- 172.21.2.102:0/185806704 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0588062580 msgr2=0x7f0588139e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:18:47.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.955+0000 7f0590510700 1 --2- 172.21.2.102:0/185806704 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0588062580 0x7f0588139e90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f057c0096b0 tx=0x7f057c006de0).stop 2021-02-12T17:18:47.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.956+0000 7f0590510700 1 -- 172.21.2.102:0/185806704 shutdown_connections 2021-02-12T17:18:47.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.956+0000 7f0590510700 1 --2- 172.21.2.102:0/185806704 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f05880b8b60 0x7f0588147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:47.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.956+0000 7f0590510700 1 --2- 172.21.2.102:0/185806704 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0568059d80 0x7f056805c240 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:47.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.956+0000 7f0590510700 1 --2- 172.21.2.102:0/185806704 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0588062580 0x7f0588139e90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:18:47.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.956+0000 7f0590510700 1 --2- 172.21.2.102:0/185806704 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0588067720 0x7f0588147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:18:47.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.956+0000 7f0590510700 1 -- 172.21.2.102:0/185806704 >> 172.21.2.102:0/185806704 conn(0x7f05880bc480 msgr2=0x7f058813cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:18:47.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.956+0000 7f0590510700 1 -- 172.21.2.102:0/185806704 shutdown_connections 2021-02-12T17:18:47.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:18:47.956+0000 7f0590510700 1 -- 172.21.2.102:0/185806704 wait complete. 2021-02-12T17:18:47.958 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 20 2021-02-12T17:18:47.966 INFO:tasks.mds_thrash.fs.[a]:mds.c reported in up:standby state 2021-02-12T17:18:47.966 INFO:tasks.mds_thrash.fs.[a]:waiting for 44 secs before thrashing 2021-02-12T17:19:10.747 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:19:10.750 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:19:31.967 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:32.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.055+0000 7f83a73fd700 1 Processor -- start 2021-02-12T17:19:32.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.055+0000 7f83a73fd700 1 -- start start 2021-02-12T17:19:32.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f83a73fd700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f83a00b8d20 0x7f83a0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:32.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f83a73fd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f83a0062740 0x7f83a0062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:32.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f83a73fd700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a00b7960 con 0x7f83a014e530 2021-02-12T17:19:32.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f83a73fd700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a0068d20 con 0x7f83a0062740 2021-02-12T17:19:32.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f83a73fd700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00622a0 con 0x7f83a00b8d20 2021-02-12T17:19:32.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f83a599a700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f83a0062740 0x7f83a0062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:32.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f83a4998700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f83a014e530 0x7f83a00b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55032/0 (socket says 172.21.2.102:55032) 2021-02-12T17:19:32.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f83a4998700 1 -- 172.21.2.102:0/354189443 learned_addr learned my addr 172.21.2.102:0/354189443 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:19:32.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f83a599a700 1 -- 172.21.2.102:0/354189443 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f83a00b8d20 msgr2=0x7f83a0068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:19:32.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f83a599a700 1 --2- 172.21.2.102:0/354189443 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f83a00b8d20 0x7f83a0068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:32.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f83a599a700 1 -- 172.21.2.102:0/354189443 >> v1:172.21.2.102:6789/0 conn(0x7f83a014e530 legacy=0x7f83a00b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:32.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f83a599a700 1 -- 172.21.2.102:0/354189443 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a014ea10 con 0x7f83a0062740 2021-02-12T17:19:32.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f83a599a700 1 --2- 172.21.2.102:0/354189443 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83a0062740 0x7f83a0062bf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f8398009c90 tx=0x7f83980091d0).ready entity=mon.0 client_cookie=6a898c362e83df22 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:32.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f8393fff700 1 -- 172.21.2.102:0/354189443 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398009ea0 con 0x7f83a0062740 2021-02-12T17:19:32.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f8393fff700 1 -- 172.21.2.102:0/354189443 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839800bbf0 con 0x7f83a0062740 2021-02-12T17:19:32.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.056+0000 7f8393fff700 1 -- 172.21.2.102:0/354189443 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398011400 con 0x7f83a0062740 2021-02-12T17:19:32.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.057+0000 7f83a73fd700 1 -- 172.21.2.102:0/354189443 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83a0062740 msgr2=0x7f83a0062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:32.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.057+0000 7f83a73fd700 1 --2- 172.21.2.102:0/354189443 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83a0062740 0x7f83a0062bf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f8398009c90 tx=0x7f83980091d0).stop 2021-02-12T17:19:32.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.057+0000 7f83a73fd700 1 -- 172.21.2.102:0/354189443 shutdown_connections 2021-02-12T17:19:32.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.057+0000 7f83a73fd700 1 --2- 172.21.2.102:0/354189443 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83a0062740 0x7f83a0062bf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:32.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.057+0000 7f83a73fd700 1 --2- 172.21.2.102:0/354189443 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f83a00b8d20 0x7f83a0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:32.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.057+0000 7f83a73fd700 1 -- 172.21.2.102:0/354189443 >> 172.21.2.102:0/354189443 conn(0x7f83a00bc480 msgr2=0x7f83a00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:32.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.057+0000 7f83a73fd700 1 -- 172.21.2.102:0/354189443 shutdown_connections 2021-02-12T17:19:32.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.057+0000 7f83a73fd700 1 -- 172.21.2.102:0/354189443 wait complete. 2021-02-12T17:19:32.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.058+0000 7f83a73fd700 1 Processor -- start 2021-02-12T17:19:32.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.058+0000 7f83a73fd700 1 -- start start 2021-02-12T17:19:32.066 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a73fd700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f83a0062740 0x7f83a015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:32.066 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a73fd700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f83a00b8d20 0x7f83a0152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:32.066 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a73fd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83a014e530 0x7f83a00b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:32.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a73fd700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a015d180 con 0x7f83a014e530 2021-02-12T17:19:32.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a73fd700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00b5260 con 0x7f83a0062740 2021-02-12T17:19:32.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a73fd700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a015d370 con 0x7f83a00b8d20 2021-02-12T17:19:32.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a599a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83a014e530 0x7f83a00b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:32.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a599a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83a014e530 0x7f83a00b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46394/0 (socket says 172.21.2.102:46394) 2021-02-12T17:19:32.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a599a700 1 -- 172.21.2.102:0/3570110869 learned_addr learned my addr 172.21.2.102:0/3570110869 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:32.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a599a700 1 -- 172.21.2.102:0/3570110869 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f83a00b8d20 msgr2=0x7f83a0152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:32.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a599a700 1 --2- 172.21.2.102:0/3570110869 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f83a00b8d20 0x7f83a0152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:32.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a599a700 1 -- 172.21.2.102:0/3570110869 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f83a0062740 msgr2=0x7f83a015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:32.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a599a700 1 --2- 172.21.2.102:0/3570110869 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f83a0062740 0x7f83a015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:32.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a599a700 1 -- 172.21.2.102:0/3570110869 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a015d610 con 0x7f83a014e530 2021-02-12T17:19:32.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a599a700 1 --2- 172.21.2.102:0/3570110869 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83a014e530 0x7f83a00b3b40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f839800b750 tx=0x7f8398017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:32.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83917fa700 1 -- 172.21.2.102:0/3570110869 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839801a4f0 con 0x7f83a014e530 2021-02-12T17:19:32.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83917fa700 1 -- 172.21.2.102:0/3570110869 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839801f070 con 0x7f83a014e530 2021-02-12T17:19:32.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a73fd700 1 -- 172.21.2.102:0/3570110869 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a015d8b0 con 0x7f83a014e530 2021-02-12T17:19:32.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83917fa700 1 -- 172.21.2.102:0/3570110869 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839801a8a0 con 0x7f83a014e530 2021-02-12T17:19:32.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.059+0000 7f83a73fd700 1 -- 172.21.2.102:0/3570110869 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a0152a20 con 0x7f83a014e530 2021-02-12T17:19:32.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.060+0000 7f83a73fd700 1 -- 172.21.2.102:0/3570110869 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a015da40 con 0x7f83a014e530 2021-02-12T17:19:32.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.060+0000 7f83917fa700 1 -- 172.21.2.102:0/3570110869 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f839802a020 con 0x7f83a014e530 2021-02-12T17:19:32.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.061+0000 7f83917fa700 1 --2- 172.21.2.102:0/3570110869 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8380059db0 0x7f838005c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:32.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.061+0000 7f83917fa700 1 -- 172.21.2.102:0/3570110869 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f8398075ba0 con 0x7f83a014e530 2021-02-12T17:19:32.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.061+0000 7f83a5199700 1 --2- 172.21.2.102:0/3570110869 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8380059db0 0x7f838005c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:32.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.061+0000 7f83a5199700 1 --2- 172.21.2.102:0/3570110869 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8380059db0 0x7f838005c270 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f8394009480 tx=0x7f83940069a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:32.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.064+0000 7f83917fa700 1 -- 172.21.2.102:0/3570110869 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f83980493b0 con 0x7f83a014e530 2021-02-12T17:19:32.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.220+0000 7f83a73fd700 1 -- 172.21.2.102:0/3570110869 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83a0045460 con 0x7f83a014e530 2021-02-12T17:19:32.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.221+0000 7f83917fa700 1 -- 172.21.2.102:0/3570110869 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3756 (secure 0 0 0) 0x7f839804c9d0 con 0x7f83a014e530 2021-02-12T17:19:32.222 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:32.222 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:41.303332+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":5,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:32.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.222+0000 7f83a73fd700 1 -- 172.21.2.102:0/3570110869 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8380059db0 msgr2=0x7f838005c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:32.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.222+0000 7f83a73fd700 1 --2- 172.21.2.102:0/3570110869 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8380059db0 0x7f838005c270 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f8394009480 tx=0x7f83940069a0).stop 2021-02-12T17:19:32.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.222+0000 7f83a73fd700 1 -- 172.21.2.102:0/3570110869 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83a014e530 msgr2=0x7f83a00b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:32.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.222+0000 7f83a73fd700 1 --2- 172.21.2.102:0/3570110869 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83a014e530 0x7f83a00b3b40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f839800b750 tx=0x7f8398017000).stop 2021-02-12T17:19:32.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.222+0000 7f83a73fd700 1 -- 172.21.2.102:0/3570110869 shutdown_connections 2021-02-12T17:19:32.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.222+0000 7f83a73fd700 1 --2- 172.21.2.102:0/3570110869 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8380059db0 0x7f838005c270 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:32.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.222+0000 7f83a73fd700 1 --2- 172.21.2.102:0/3570110869 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f83a014e530 0x7f83a00b3b40 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:32.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.222+0000 7f83a73fd700 1 --2- 172.21.2.102:0/3570110869 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f83a0062740 0x7f83a015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:32.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.222+0000 7f83a73fd700 1 --2- 172.21.2.102:0/3570110869 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f83a00b8d20 0x7f83a0152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:32.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.222+0000 7f83a73fd700 1 -- 172.21.2.102:0/3570110869 >> 172.21.2.102:0/3570110869 conn(0x7f83a00bc480 msgr2=0x7f83a00ba350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:32.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.222+0000 7f83a73fd700 1 -- 172.21.2.102:0/3570110869 shutdown_connections 2021-02-12T17:19:32.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.222+0000 7f83a73fd700 1 -- 172.21.2.102:0/3570110869 wait complete. 2021-02-12T17:19:32.225 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 20 2021-02-12T17:19:32.233 INFO:tasks.mds_thrash.fs.[a]:kill mds.a (rank=0) 2021-02-12T17:19:32.234 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-12T17:19:32.234 INFO:teuthology.orchestra.run:waiting for 300 2021-02-12T17:19:32.240 INFO:tasks.ceph.mds.a:Stopped 2021-02-12T17:19:32.240 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:32.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.367+0000 7f0260d55700 1 Processor -- start 2021-02-12T17:19:32.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.367+0000 7f0260d55700 1 -- start start 2021-02-12T17:19:32.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.368+0000 7f0260d55700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f025c0b8d20 0x7f025c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:32.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.368+0000 7f0260d55700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f025c14e530 0x7f025c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:32.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.368+0000 7f0260d55700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f025c062740 0x7f025c062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:32.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.368+0000 7f0260d55700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c068d20 con 0x7f025c14e530 2021-02-12T17:19:32.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.368+0000 7f0260d55700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c0622a0 con 0x7f025c0b8d20 2021-02-12T17:19:32.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.368+0000 7f0260d55700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c14ea10 con 0x7f025c062740 2021-02-12T17:19:32.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.368+0000 7f0259d9b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f025c14e530 0x7f025c0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:32.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.368+0000 7f0259d9b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f025c14e530 0x7f025c0b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46406/0 (socket says 172.21.2.102:46406) 2021-02-12T17:19:32.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.368+0000 7f0259d9b700 1 -- 172.21.2.102:0/2262092912 learned_addr learned my addr 172.21.2.102:0/2262092912 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:32.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.368+0000 7f0259d9b700 1 -- 172.21.2.102:0/2262092912 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f025c062740 msgr2=0x7f025c062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:32.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.368+0000 7f0259d9b700 1 --2- 172.21.2.102:0/2262092912 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f025c062740 0x7f025c062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:32.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.368+0000 7f0259d9b700 1 -- 172.21.2.102:0/2262092912 >> v2:172.21.2.104:3300/0 conn(0x7f025c0b8d20 msgr2=0x7f025c068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:32.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.368+0000 7f0259d9b700 1 --2- 172.21.2.102:0/2262092912 >> v2:172.21.2.104:3300/0 conn(0x7f025c0b8d20 0x7f025c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:32.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.368+0000 7f0259d9b700 1 -- 172.21.2.102:0/2262092912 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c0b63f0 con 0x7f025c14e530 2021-02-12T17:19:32.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.369+0000 7f0259d9b700 1 --2- 172.21.2.102:0/2262092912 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c14e530 0x7f025c0b7250 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f025c06abc0 tx=0x7f0244006ea0).ready entity=mon.0 client_cookie=970d5adcff5dc15e server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:32.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.369+0000 7f025959a700 1 -- 172.21.2.102:0/2262092912 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0244009840 con 0x7f025c14e530 2021-02-12T17:19:32.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.369+0000 7f025959a700 1 -- 172.21.2.102:0/2262092912 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02440099a0 con 0x7f025c14e530 2021-02-12T17:19:32.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.369+0000 7f025959a700 1 -- 172.21.2.102:0/2262092912 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0244009d20 con 0x7f025c14e530 2021-02-12T17:19:32.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.369+0000 7f0260d55700 1 -- 172.21.2.102:0/2262092912 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c14e530 msgr2=0x7f025c0b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:32.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.369+0000 7f0260d55700 1 --2- 172.21.2.102:0/2262092912 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c14e530 0x7f025c0b7250 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f025c06abc0 tx=0x7f0244006ea0).stop 2021-02-12T17:19:32.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.369+0000 7f0260d55700 1 -- 172.21.2.102:0/2262092912 shutdown_connections 2021-02-12T17:19:32.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.369+0000 7f0260d55700 1 --2- 172.21.2.102:0/2262092912 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f025c062740 0x7f025c062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:32.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.369+0000 7f0260d55700 1 --2- 172.21.2.102:0/2262092912 >> v2:172.21.2.104:3300/0 conn(0x7f025c0b8d20 0x7f025c068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:32.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.369+0000 7f0260d55700 1 --2- 172.21.2.102:0/2262092912 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c14e530 0x7f025c0b7250 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:32.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.369+0000 7f0260d55700 1 -- 172.21.2.102:0/2262092912 >> 172.21.2.102:0/2262092912 conn(0x7f025c0bc480 msgr2=0x7f025c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:32.374 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.369+0000 7f0260d55700 1 -- 172.21.2.102:0/2262092912 shutdown_connections 2021-02-12T17:19:32.374 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.369+0000 7f0260d55700 1 -- 172.21.2.102:0/2262092912 wait complete. 2021-02-12T17:19:32.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.370+0000 7f0260d55700 1 Processor -- start 2021-02-12T17:19:32.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.370+0000 7f0260d55700 1 -- start start 2021-02-12T17:19:32.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f0260d55700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f025c062740 0x7f025c0b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:32.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f0260d55700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f025c0b8d20 0x7f025c0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:32.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f0260d55700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c14e530 0x7f025c0af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:32.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f0260d55700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c14b5d0 con 0x7f025c14e530 2021-02-12T17:19:32.376 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f0260d55700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c0b9a30 con 0x7f025c0b8d20 2021-02-12T17:19:32.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f0260d55700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c0b9cd0 con 0x7f025c062740 2021-02-12T17:19:32.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f025ad9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c14e530 0x7f025c0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:32.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f025ad9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c14e530 0x7f025c0af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46412/0 (socket says 172.21.2.102:46412) 2021-02-12T17:19:32.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f025ad9d700 1 -- 172.21.2.102:0/2829575341 learned_addr learned my addr 172.21.2.102:0/2829575341 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:32.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f025ad9d700 1 -- 172.21.2.102:0/2829575341 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f025c062740 msgr2=0x7f025c0b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:32.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f025ad9d700 1 --2- 172.21.2.102:0/2829575341 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f025c062740 0x7f025c0b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:32.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f025ad9d700 1 -- 172.21.2.102:0/2829575341 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f025c0b8d20 msgr2=0x7f025c0ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:32.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f025ad9d700 1 --2- 172.21.2.102:0/2829575341 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f025c0b8d20 0x7f025c0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:32.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f025ad9d700 1 -- 172.21.2.102:0/2829575341 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c0b9f70 con 0x7f025c14e530 2021-02-12T17:19:32.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f025ad9d700 1 --2- 172.21.2.102:0/2829575341 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c14e530 0x7f025c0af390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f025400bae0 tx=0x7f0254009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:32.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f02527fc700 1 -- 172.21.2.102:0/2829575341 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025400c8d0 con 0x7f025c14e530 2021-02-12T17:19:32.377 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f02527fc700 1 -- 172.21.2.102:0/2829575341 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025400ca30 con 0x7f025c14e530 2021-02-12T17:19:32.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f0260d55700 1 -- 172.21.2.102:0/2829575341 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025c0ba210 con 0x7f025c14e530 2021-02-12T17:19:32.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f02527fc700 1 -- 172.21.2.102:0/2829575341 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025400cbe0 con 0x7f025c14e530 2021-02-12T17:19:32.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.371+0000 7f0260d55700 1 -- 172.21.2.102:0/2829575341 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c0adbc0 con 0x7f025c14e530 2021-02-12T17:19:32.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.372+0000 7f0260d55700 1 -- 172.21.2.102:0/2829575341 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025c045460 con 0x7f025c14e530 2021-02-12T17:19:32.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.372+0000 7f02527fc700 1 -- 172.21.2.102:0/2829575341 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f025401c070 con 0x7f025c14e530 2021-02-12T17:19:32.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.373+0000 7f02527fc700 1 --2- 172.21.2.102:0/2829575341 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0240059d30 0x7f024005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:32.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.373+0000 7f02527fc700 1 -- 172.21.2.102:0/2829575341 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f0254073610 con 0x7f025c14e530 2021-02-12T17:19:32.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.373+0000 7f025a59c700 1 --2- 172.21.2.102:0/2829575341 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0240059d30 0x7f024005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:32.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.373+0000 7f025a59c700 1 --2- 172.21.2.102:0/2829575341 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0240059d30 0x7f024005c1f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f024c0094c0 tx=0x7f024c0069f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:32.378 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.376+0000 7f02527fc700 1 -- 172.21.2.102:0/2829575341 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f0254046c90 con 0x7f025c14e530 2021-02-12T17:19:32.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.536+0000 7f0260d55700 1 -- 172.21.2.102:0/2829575341 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f025c151f40 con 0x7f025c14e530 2021-02-12T17:19:32.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.536+0000 7f02527fc700 1 -- 172.21.2.102:0/2829575341 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3756 (secure 0 0 0) 0x7f025401a070 con 0x7f025c14e530 2021-02-12T17:19:32.538 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:32.538 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:41.303332+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":5,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:32.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.537+0000 7f0260d55700 1 -- 172.21.2.102:0/2829575341 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0240059d30 msgr2=0x7f024005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:32.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.537+0000 7f0260d55700 1 --2- 172.21.2.102:0/2829575341 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0240059d30 0x7f024005c1f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f024c0094c0 tx=0x7f024c0069f0).stop 2021-02-12T17:19:32.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.537+0000 7f0260d55700 1 -- 172.21.2.102:0/2829575341 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c14e530 msgr2=0x7f025c0af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:32.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.537+0000 7f0260d55700 1 --2- 172.21.2.102:0/2829575341 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c14e530 0x7f025c0af390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f025400bae0 tx=0x7f0254009220).stop 2021-02-12T17:19:32.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.537+0000 7f0260d55700 1 -- 172.21.2.102:0/2829575341 shutdown_connections 2021-02-12T17:19:32.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.537+0000 7f0260d55700 1 --2- 172.21.2.102:0/2829575341 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0240059d30 0x7f024005c1f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:32.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.537+0000 7f0260d55700 1 --2- 172.21.2.102:0/2829575341 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c14e530 0x7f025c0af390 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:32.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.537+0000 7f0260d55700 1 --2- 172.21.2.102:0/2829575341 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f025c062740 0x7f025c0b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:32.539 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.537+0000 7f0260d55700 1 --2- 172.21.2.102:0/2829575341 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f025c0b8d20 0x7f025c0ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:32.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.537+0000 7f0260d55700 1 -- 172.21.2.102:0/2829575341 >> 172.21.2.102:0/2829575341 conn(0x7f025c0bc480 msgr2=0x7f025c14cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:32.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.537+0000 7f0260d55700 1 -- 172.21.2.102:0/2829575341 shutdown_connections 2021-02-12T17:19:32.540 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:32.537+0000 7f0260d55700 1 -- 172.21.2.102:0/2829575341 wait complete. 2021-02-12T17:19:32.540 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 20 2021-02-12T17:19:32.547 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:19:34.549 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:34.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.636+0000 7fa0fd092700 1 Processor -- start 2021-02-12T17:19:34.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.636+0000 7fa0fd092700 1 -- start start 2021-02-12T17:19:34.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.637+0000 7fa0fd092700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fa0f8068710 0x7fa0f80b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:34.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.637+0000 7fa0fd092700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa0f8068af0 0x7fa0f80622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:34.644 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.637+0000 7fa0fd092700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa0f80b6350 0x7fa0f814a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:34.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.637+0000 7fa0fd092700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f80b7680 con 0x7fa0f8068af0 2021-02-12T17:19:34.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.637+0000 7fa0fd092700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f80b2360 con 0x7fa0f8068710 2021-02-12T17:19:34.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.637+0000 7fa0fd092700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80b2600 con 0x7fa0f80b6350 2021-02-12T17:19:34.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.637+0000 7fa0f659c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa0f8068af0 0x7fa0f80622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:34.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.637+0000 7fa0f659c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa0f8068af0 0x7fa0f80622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46426/0 (socket says 172.21.2.102:46426) 2021-02-12T17:19:34.645 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.637+0000 7fa0f659c700 1 -- 172.21.2.102:0/2537887712 learned_addr learned my addr 172.21.2.102:0/2537887712 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:34.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.637+0000 7fa0f6d9d700 1 --2- 172.21.2.102:0/2537887712 >> v2:172.21.2.104:3300/0 conn(0x7fa0f8068710 0x7fa0f80b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:34.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.637+0000 7fa0f759e700 1 --2- 172.21.2.102:0/2537887712 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa0f80b6350 0x7fa0f814a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:34.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0f659c700 1 -- 172.21.2.102:0/2537887712 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa0f80b6350 msgr2=0x7fa0f814a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:34.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0f659c700 1 --2- 172.21.2.102:0/2537887712 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa0f80b6350 0x7fa0f814a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:34.646 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0f659c700 1 -- 172.21.2.102:0/2537887712 >> v2:172.21.2.104:3300/0 conn(0x7fa0f8068710 msgr2=0x7fa0f80b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:34.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0f659c700 1 --2- 172.21.2.102:0/2537887712 >> v2:172.21.2.104:3300/0 conn(0x7fa0f8068710 0x7fa0f80b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:34.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0f659c700 1 -- 172.21.2.102:0/2537887712 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f81498e0 con 0x7fa0f8068af0 2021-02-12T17:19:34.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0f659c700 1 --2- 172.21.2.102:0/2537887712 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa0f8068af0 0x7fa0f80622a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fa0f806abc0 tx=0x7fa0f0009290).ready entity=mon.0 client_cookie=b3b3bd4febd76ea5 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:34.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0f5d9b700 1 -- 172.21.2.102:0/2537887712 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000bbf0 con 0x7fa0f8068af0 2021-02-12T17:19:34.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0f5d9b700 1 -- 172.21.2.102:0/2537887712 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f000bd50 con 0x7fa0f8068af0 2021-02-12T17:19:34.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0f5d9b700 1 -- 172.21.2.102:0/2537887712 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0011610 con 0x7fa0f8068af0 2021-02-12T17:19:34.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0fd092700 1 -- 172.21.2.102:0/2537887712 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa0f8068af0 msgr2=0x7fa0f80622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:34.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0fd092700 1 --2- 172.21.2.102:0/2537887712 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa0f8068af0 0x7fa0f80622a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fa0f806abc0 tx=0x7fa0f0009290).stop 2021-02-12T17:19:34.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0fd092700 1 -- 172.21.2.102:0/2537887712 shutdown_connections 2021-02-12T17:19:34.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0fd092700 1 --2- 172.21.2.102:0/2537887712 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa0f80b6350 0x7fa0f814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:34.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0fd092700 1 --2- 172.21.2.102:0/2537887712 >> v2:172.21.2.104:3300/0 conn(0x7fa0f8068710 0x7fa0f80b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0fd092700 1 --2- 172.21.2.102:0/2537887712 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa0f8068af0 0x7fa0f80622a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0fd092700 1 -- 172.21.2.102:0/2537887712 >> 172.21.2.102:0/2537887712 conn(0x7fa0f80bc480 msgr2=0x7fa0f80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0fd092700 1 -- 172.21.2.102:0/2537887712 shutdown_connections 2021-02-12T17:19:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.638+0000 7fa0fd092700 1 -- 172.21.2.102:0/2537887712 wait complete. 2021-02-12T17:19:34.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.639+0000 7fa0fd092700 1 Processor -- start 2021-02-12T17:19:34.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.639+0000 7fa0fd092700 1 -- start start 2021-02-12T17:19:34.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0fd092700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa0f8068710 0x7fa0f8062a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:34.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0fd092700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa0f8068af0 0x7fa0f814ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:34.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0fd092700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa0f80b6350 0x7fa0f814d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:34.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0fd092700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f815d100 con 0x7fa0f80b6350 2021-02-12T17:19:34.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0fd092700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f815d2f0 con 0x7fa0f8068710 2021-02-12T17:19:34.651 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0fd092700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f815d590 con 0x7fa0f8068af0 2021-02-12T17:19:34.651 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0f759e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa0f80b6350 0x7fa0f814d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:34.651 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0f759e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa0f80b6350 0x7fa0f814d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46432/0 (socket says 172.21.2.102:46432) 2021-02-12T17:19:34.651 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0f759e700 1 -- 172.21.2.102:0/3406401344 learned_addr learned my addr 172.21.2.102:0/3406401344 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:34.651 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0f6d9d700 1 --2- 172.21.2.102:0/3406401344 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa0f8068710 0x7fa0f8062a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:34.652 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0f659c700 1 --2- 172.21.2.102:0/3406401344 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa0f8068af0 0x7fa0f814ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:34.652 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0f759e700 1 -- 172.21.2.102:0/3406401344 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa0f8068af0 msgr2=0x7fa0f814ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:34.652 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0f759e700 1 --2- 172.21.2.102:0/3406401344 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa0f8068af0 0x7fa0f814ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:34.652 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0f759e700 1 -- 172.21.2.102:0/3406401344 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa0f8068710 msgr2=0x7fa0f8062a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:34.652 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0f759e700 1 --2- 172.21.2.102:0/3406401344 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa0f8068710 0x7fa0f8062a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:34.652 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0f759e700 1 -- 172.21.2.102:0/3406401344 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f815d830 con 0x7fa0f80b6350 2021-02-12T17:19:34.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.640+0000 7fa0f759e700 1 --2- 172.21.2.102:0/3406401344 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa0f80b6350 0x7fa0f814d320 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fa0e800dfd0 tx=0x7fa0e8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:34.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.641+0000 7fa0deffd700 1 -- 172.21.2.102:0/3406401344 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8011590 con 0x7fa0f80b6350 2021-02-12T17:19:34.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.641+0000 7fa0deffd700 1 -- 172.21.2.102:0/3406401344 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e80116f0 con 0x7fa0f80b6350 2021-02-12T17:19:34.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.641+0000 7fa0deffd700 1 -- 172.21.2.102:0/3406401344 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8011a90 con 0x7fa0f80b6350 2021-02-12T17:19:34.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.641+0000 7fa0fd092700 1 -- 172.21.2.102:0/3406401344 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f815dad0 con 0x7fa0f80b6350 2021-02-12T17:19:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.641+0000 7fa0fd092700 1 -- 172.21.2.102:0/3406401344 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f8062f50 con 0x7fa0f80b6350 2021-02-12T17:19:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.641+0000 7fa0fd092700 1 -- 172.21.2.102:0/3406401344 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f8045460 con 0x7fa0f80b6350 2021-02-12T17:19:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.642+0000 7fa0deffd700 1 -- 172.21.2.102:0/3406401344 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fa0e801c460 con 0x7fa0f80b6350 2021-02-12T17:19:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.642+0000 7fa0deffd700 1 --2- 172.21.2.102:0/3406401344 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa0d8059d30 0x7fa0d805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.642+0000 7fa0deffd700 1 -- 172.21.2.102:0/3406401344 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7fa0e8074090 con 0x7fa0f80b6350 2021-02-12T17:19:34.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.642+0000 7fa0f6d9d700 1 --2- 172.21.2.102:0/3406401344 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa0d8059d30 0x7fa0d805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:34.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.642+0000 7fa0f6d9d700 1 --2- 172.21.2.102:0/3406401344 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa0d8059d30 0x7fa0d805c1f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fa0ec006fd0 tx=0x7fa0ec008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:34.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.645+0000 7fa0deffd700 1 -- 172.21.2.102:0/3406401344 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fa0e80476b0 con 0x7fa0f80b6350 2021-02-12T17:19:34.806 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.804+0000 7fa0fd092700 1 -- 172.21.2.102:0/3406401344 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0f8063670 con 0x7fa0f80b6350 2021-02-12T17:19:34.806 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.805+0000 7fa0deffd700 1 -- 172.21.2.102:0/3406401344 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3756 (secure 0 0 0) 0x7fa0e804acd0 con 0x7fa0f80b6350 2021-02-12T17:19:34.806 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:34.806 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:41.303332+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":5,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:34.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.806+0000 7fa0fd092700 1 -- 172.21.2.102:0/3406401344 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa0d8059d30 msgr2=0x7fa0d805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:34.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.806+0000 7fa0fd092700 1 --2- 172.21.2.102:0/3406401344 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa0d8059d30 0x7fa0d805c1f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fa0ec006fd0 tx=0x7fa0ec008040).stop 2021-02-12T17:19:34.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.806+0000 7fa0fd092700 1 -- 172.21.2.102:0/3406401344 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa0f80b6350 msgr2=0x7fa0f814d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:34.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.806+0000 7fa0fd092700 1 --2- 172.21.2.102:0/3406401344 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa0f80b6350 0x7fa0f814d320 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fa0e800dfd0 tx=0x7fa0e8008040).stop 2021-02-12T17:19:34.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.806+0000 7fa0fd092700 1 -- 172.21.2.102:0/3406401344 shutdown_connections 2021-02-12T17:19:34.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.806+0000 7fa0fd092700 1 --2- 172.21.2.102:0/3406401344 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa0d8059d30 0x7fa0d805c1f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:34.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.806+0000 7fa0fd092700 1 --2- 172.21.2.102:0/3406401344 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa0f80b6350 0x7fa0f814d320 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:34.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.806+0000 7fa0fd092700 1 --2- 172.21.2.102:0/3406401344 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa0f8068710 0x7fa0f8062a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:34.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.806+0000 7fa0fd092700 1 --2- 172.21.2.102:0/3406401344 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa0f8068af0 0x7fa0f814ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:34.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.806+0000 7fa0fd092700 1 -- 172.21.2.102:0/3406401344 >> 172.21.2.102:0/3406401344 conn(0x7fa0f80bc480 msgr2=0x7fa0f8066f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:34.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.806+0000 7fa0fd092700 1 -- 172.21.2.102:0/3406401344 shutdown_connections 2021-02-12T17:19:34.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:34.806+0000 7fa0fd092700 1 -- 172.21.2.102:0/3406401344 wait complete. 2021-02-12T17:19:34.809 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 20 2021-02-12T17:19:34.816 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:19:36.818 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:36.906 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.905+0000 7f2fff86b700 1 Processor -- start 2021-02-12T17:19:36.906 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.905+0000 7f2fff86b700 1 -- start start 2021-02-12T17:19:36.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2fff86b700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f2ff814e530 0x7f2ff8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:36.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2fff86b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f2ff8062740 0x7f2ff8062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:36.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2fff86b700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff80b7960 con 0x7f2ff80b8d20 2021-02-12T17:19:36.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2fff86b700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff8068d20 con 0x7f2ff8062740 2021-02-12T17:19:36.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2fff86b700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff80622a0 con 0x7f2ff814e530 2021-02-12T17:19:36.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2ffde08700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f2ff8062740 0x7f2ff8062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:36.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2ffd607700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f2ff80b8d20 0x7f2ff80b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55082/0 (socket says 172.21.2.102:55082) 2021-02-12T17:19:36.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2ffd607700 1 -- 172.21.2.102:0/1116516973 learned_addr learned my addr 172.21.2.102:0/1116516973 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:19:36.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2ffde08700 1 -- 172.21.2.102:0/1116516973 >> v2:172.21.2.104:3300/0 conn(0x7f2ff814e530 msgr2=0x7f2ff8068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:19:36.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2ffde08700 1 --2- 172.21.2.102:0/1116516973 >> v2:172.21.2.104:3300/0 conn(0x7f2ff814e530 0x7f2ff8068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:36.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2ffde08700 1 -- 172.21.2.102:0/1116516973 >> v1:172.21.2.102:6789/0 conn(0x7f2ff80b8d20 legacy=0x7f2ff80b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:36.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2ffde08700 1 -- 172.21.2.102:0/1116516973 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff814ea10 con 0x7f2ff8062740 2021-02-12T17:19:36.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2ffde08700 1 --2- 172.21.2.102:0/1116516973 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2ff8062740 0x7f2ff8062bf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f2ff80654b0 tx=0x7f2ff00091d0).ready entity=mon.0 client_cookie=d6dc5e84e014ce54 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:36.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2febfff700 1 -- 172.21.2.102:0/1116516973 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0009e70 con 0x7f2ff8062740 2021-02-12T17:19:36.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2febfff700 1 -- 172.21.2.102:0/1116516973 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff000baf0 con 0x7f2ff8062740 2021-02-12T17:19:36.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.906+0000 7f2febfff700 1 -- 172.21.2.102:0/1116516973 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff000be70 con 0x7f2ff8062740 2021-02-12T17:19:36.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.907+0000 7f2fff86b700 1 -- 172.21.2.102:0/1116516973 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2ff8062740 msgr2=0x7f2ff8062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:36.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.907+0000 7f2fff86b700 1 --2- 172.21.2.102:0/1116516973 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2ff8062740 0x7f2ff8062bf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f2ff80654b0 tx=0x7f2ff00091d0).stop 2021-02-12T17:19:36.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.907+0000 7f2fff86b700 1 -- 172.21.2.102:0/1116516973 shutdown_connections 2021-02-12T17:19:36.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.907+0000 7f2fff86b700 1 --2- 172.21.2.102:0/1116516973 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2ff8062740 0x7f2ff8062bf0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:36.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.907+0000 7f2fff86b700 1 --2- 172.21.2.102:0/1116516973 >> v2:172.21.2.104:3300/0 conn(0x7f2ff814e530 0x7f2ff8068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:36.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.907+0000 7f2fff86b700 1 -- 172.21.2.102:0/1116516973 >> 172.21.2.102:0/1116516973 conn(0x7f2ff80bc480 msgr2=0x7f2ff80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:36.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.907+0000 7f2fff86b700 1 -- 172.21.2.102:0/1116516973 shutdown_connections 2021-02-12T17:19:36.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.907+0000 7f2fff86b700 1 -- 172.21.2.102:0/1116516973 wait complete. 2021-02-12T17:19:36.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.908+0000 7f2fff86b700 1 Processor -- start 2021-02-12T17:19:36.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.908+0000 7f2fff86b700 1 -- start start 2021-02-12T17:19:36.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.908+0000 7f2fff86b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2ff8062740 0x7f2ff80b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:36.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.908+0000 7f2fff86b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2ff80b8d20 0x7f2ff80b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:36.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.908+0000 7f2fff86b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2ff814e530 0x7f2ff814a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:36.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.908+0000 7f2fff86b700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80b5760 con 0x7f2ff814e530 2021-02-12T17:19:36.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.908+0000 7f2fff86b700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80b0c10 con 0x7f2ff80b8d20 2021-02-12T17:19:36.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.908+0000 7f2fff86b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80b59c0 con 0x7f2ff8062740 2021-02-12T17:19:36.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.909+0000 7f2ffde08700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2ff814e530 0x7f2ff814a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:36.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.909+0000 7f2ffde08700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2ff814e530 0x7f2ff814a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46446/0 (socket says 172.21.2.102:46446) 2021-02-12T17:19:36.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.909+0000 7f2ffde08700 1 -- 172.21.2.102:0/1210826437 learned_addr learned my addr 172.21.2.102:0/1210826437 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:36.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.909+0000 7f2ffde08700 1 -- 172.21.2.102:0/1210826437 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2ff8062740 msgr2=0x7f2ff80b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:36.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.909+0000 7f2ffde08700 1 --2- 172.21.2.102:0/1210826437 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2ff8062740 0x7f2ff80b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:36.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.909+0000 7f2ffde08700 1 -- 172.21.2.102:0/1210826437 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2ff80b8d20 msgr2=0x7f2ff80b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:36.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.909+0000 7f2ffde08700 1 --2- 172.21.2.102:0/1210826437 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2ff80b8d20 0x7f2ff80b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:36.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.909+0000 7f2ffde08700 1 -- 172.21.2.102:0/1210826437 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff80b1900 con 0x7f2ff814e530 2021-02-12T17:19:36.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.909+0000 7f2ffde08700 1 --2- 172.21.2.102:0/1210826437 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2ff814e530 0x7f2ff814a9e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f2ff000b750 tx=0x7f2ff0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:36.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.909+0000 7f2fe97fa700 1 -- 172.21.2.102:0/1210826437 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff001c700 con 0x7f2ff814e530 2021-02-12T17:19:36.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.909+0000 7f2fe97fa700 1 -- 172.21.2.102:0/1210826437 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff001c860 con 0x7f2ff814e530 2021-02-12T17:19:36.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.909+0000 7f2fff86b700 1 -- 172.21.2.102:0/1210826437 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff80b1ba0 con 0x7f2ff814e530 2021-02-12T17:19:36.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.909+0000 7f2fe97fa700 1 -- 172.21.2.102:0/1210826437 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff001c9d0 con 0x7f2ff814e530 2021-02-12T17:19:36.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.910+0000 7f2fff86b700 1 -- 172.21.2.102:0/1210826437 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff80b0800 con 0x7f2ff814e530 2021-02-12T17:19:36.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.910+0000 7f2fff86b700 1 -- 172.21.2.102:0/1210826437 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff8045460 con 0x7f2ff814e530 2021-02-12T17:19:36.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.910+0000 7f2fe97fa700 1 -- 172.21.2.102:0/1210826437 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f2ff002c070 con 0x7f2ff814e530 2021-02-12T17:19:36.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.911+0000 7f2fe97fa700 1 --2- 172.21.2.102:0/1210826437 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2fd8059d60 0x7f2fd805c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:36.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.911+0000 7f2fe97fa700 1 -- 172.21.2.102:0/1210826437 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f2ff0075df0 con 0x7f2ff814e530 2021-02-12T17:19:36.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.911+0000 7f2ffd607700 1 --2- 172.21.2.102:0/1210826437 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2fd8059d60 0x7f2fd805c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:36.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.911+0000 7f2ffd607700 1 --2- 172.21.2.102:0/1210826437 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2fd8059d60 0x7f2fd805c220 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f2ff4001470 tx=0x7f2ff4007740).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:36.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:36.914+0000 7f2fe97fa700 1 -- 172.21.2.102:0/1210826437 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f2ff0049580 con 0x7f2ff814e530 2021-02-12T17:19:37.077 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:37.076+0000 7f2fff86b700 1 -- 172.21.2.102:0/1210826437 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ff8063670 con 0x7f2ff814e530 2021-02-12T17:19:37.077 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:37.076+0000 7f2fe97fa700 1 -- 172.21.2.102:0/1210826437 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3756 (secure 0 0 0) 0x7f2ff004cba0 con 0x7f2ff814e530 2021-02-12T17:19:37.077 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:37.078 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:41.303332+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":5,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:37.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:37.077+0000 7f2fff86b700 1 -- 172.21.2.102:0/1210826437 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2fd8059d60 msgr2=0x7f2fd805c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:37.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:37.077+0000 7f2fff86b700 1 --2- 172.21.2.102:0/1210826437 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2fd8059d60 0x7f2fd805c220 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f2ff4001470 tx=0x7f2ff4007740).stop 2021-02-12T17:19:37.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:37.077+0000 7f2fff86b700 1 -- 172.21.2.102:0/1210826437 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2ff814e530 msgr2=0x7f2ff814a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:37.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:37.077+0000 7f2fff86b700 1 --2- 172.21.2.102:0/1210826437 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2ff814e530 0x7f2ff814a9e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f2ff000b750 tx=0x7f2ff0017000).stop 2021-02-12T17:19:37.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:37.077+0000 7f2fff86b700 1 -- 172.21.2.102:0/1210826437 shutdown_connections 2021-02-12T17:19:37.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:37.077+0000 7f2fff86b700 1 --2- 172.21.2.102:0/1210826437 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2fd8059d60 0x7f2fd805c220 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:37.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:37.077+0000 7f2fff86b700 1 --2- 172.21.2.102:0/1210826437 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2ff814e530 0x7f2ff814a9e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:37.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:37.077+0000 7f2fff86b700 1 --2- 172.21.2.102:0/1210826437 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2ff8062740 0x7f2ff80b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:37.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:37.077+0000 7f2fff86b700 1 --2- 172.21.2.102:0/1210826437 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2ff80b8d20 0x7f2ff80b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:37.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:37.077+0000 7f2fff86b700 1 -- 172.21.2.102:0/1210826437 >> 172.21.2.102:0/1210826437 conn(0x7f2ff80bc480 msgr2=0x7f2ff81519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:37.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:37.077+0000 7f2fff86b700 1 -- 172.21.2.102:0/1210826437 shutdown_connections 2021-02-12T17:19:37.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:37.077+0000 7f2fff86b700 1 -- 172.21.2.102:0/1210826437 wait complete. 2021-02-12T17:19:37.080 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 20 2021-02-12T17:19:37.087 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:19:39.088 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:39.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.176+0000 7fe3402ac700 1 Processor -- start 2021-02-12T17:19:39.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.176+0000 7fe3402ac700 1 -- start start 2021-02-12T17:19:39.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.177+0000 7fe3402ac700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe3380b8d20 0x7fe338068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:39.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.177+0000 7fe3402ac700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe338062740 0x7fe338062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:39.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.177+0000 7fe3402ac700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3380b7960 con 0x7fe33814e530 2021-02-12T17:19:39.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.177+0000 7fe3402ac700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe338068d20 con 0x7fe3380b8d20 2021-02-12T17:19:39.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.177+0000 7fe3402ac700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3380622a0 con 0x7fe338062740 2021-02-12T17:19:39.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.177+0000 7fe33e048700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe3380b8d20 0x7fe338068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:39.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.177+0000 7fe33e048700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe3380b8d20 0x7fe338068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46454/0 (socket says 172.21.2.102:46454) 2021-02-12T17:19:39.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.177+0000 7fe33e048700 1 -- 172.21.2.102:0/3084677133 learned_addr learned my addr 172.21.2.102:0/3084677133 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:39.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.177+0000 7fe33e048700 1 -- 172.21.2.102:0/3084677133 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe338062740 msgr2=0x7fe338062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:39.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.177+0000 7fe33e048700 1 --2- 172.21.2.102:0/3084677133 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe338062740 0x7fe338062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:39.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.177+0000 7fe33e048700 1 -- 172.21.2.102:0/3084677133 >> v1:172.21.2.102:6789/0 conn(0x7fe33814e530 legacy=0x7fe3380b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:39.181 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.177+0000 7fe33e048700 1 -- 172.21.2.102:0/3084677133 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33814ea10 con 0x7fe3380b8d20 2021-02-12T17:19:39.181 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.177+0000 7fe33e048700 1 --2- 172.21.2.102:0/3084677133 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe3380b8d20 0x7fe338068830 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fe33400b9e0 tx=0x7fe334006ea0).ready entity=mon.0 client_cookie=18c77ea63f7a2ab3 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:39.181 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.178+0000 7fe33d046700 1 -- 172.21.2.102:0/3084677133 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334009840 con 0x7fe3380b8d20 2021-02-12T17:19:39.181 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.178+0000 7fe33d046700 1 -- 172.21.2.102:0/3084677133 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3340099a0 con 0x7fe3380b8d20 2021-02-12T17:19:39.181 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.178+0000 7fe33d046700 1 -- 172.21.2.102:0/3084677133 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334009d20 con 0x7fe3380b8d20 2021-02-12T17:19:39.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.178+0000 7fe3402ac700 1 -- 172.21.2.102:0/3084677133 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe3380b8d20 msgr2=0x7fe338068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:39.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.178+0000 7fe3402ac700 1 --2- 172.21.2.102:0/3084677133 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe3380b8d20 0x7fe338068830 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fe33400b9e0 tx=0x7fe334006ea0).stop 2021-02-12T17:19:39.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.178+0000 7fe3402ac700 1 -- 172.21.2.102:0/3084677133 shutdown_connections 2021-02-12T17:19:39.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.178+0000 7fe3402ac700 1 --2- 172.21.2.102:0/3084677133 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe338062740 0x7fe338062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:39.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.178+0000 7fe3402ac700 1 --2- 172.21.2.102:0/3084677133 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe3380b8d20 0x7fe338068830 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:39.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.178+0000 7fe3402ac700 1 -- 172.21.2.102:0/3084677133 >> 172.21.2.102:0/3084677133 conn(0x7fe3380bc480 msgr2=0x7fe3380b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:39.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.178+0000 7fe3402ac700 1 -- 172.21.2.102:0/3084677133 shutdown_connections 2021-02-12T17:19:39.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.178+0000 7fe3402ac700 1 -- 172.21.2.102:0/3084677133 wait complete. 2021-02-12T17:19:39.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.179+0000 7fe3402ac700 1 Processor -- start 2021-02-12T17:19:39.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.179+0000 7fe3402ac700 1 -- start start 2021-02-12T17:19:39.185 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe3402ac700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe338062740 0x7fe3380afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:39.185 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe3402ac700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe3380b8d20 0x7fe3380b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:39.185 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe3402ac700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe33814e530 0x7fe3380acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:39.185 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe3402ac700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3380aef80 con 0x7fe3380b8d20 2021-02-12T17:19:39.185 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe3402ac700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33815dd50 con 0x7fe33814e530 2021-02-12T17:19:39.185 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe3402ac700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33815dff0 con 0x7fe338062740 2021-02-12T17:19:39.185 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe33d847700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe3380b8d20 0x7fe3380b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:39.185 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe33d847700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe3380b8d20 0x7fe3380b52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46462/0 (socket says 172.21.2.102:46462) 2021-02-12T17:19:39.185 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe33d847700 1 -- 172.21.2.102:0/890098543 learned_addr learned my addr 172.21.2.102:0/890098543 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:39.185 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe33e849700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe33814e530 0x7fe3380acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:39.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe33e048700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe338062740 0x7fe3380afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:39.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe33d847700 1 -- 172.21.2.102:0/890098543 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe338062740 msgr2=0x7fe3380afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:39.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe33d847700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe338062740 0x7fe3380afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:39.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe33d847700 1 -- 172.21.2.102:0/890098543 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe33814e530 msgr2=0x7fe3380acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:39.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe33d847700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe33814e530 0x7fe3380acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:39.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe33d847700 1 -- 172.21.2.102:0/890098543 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33815e290 con 0x7fe3380b8d20 2021-02-12T17:19:39.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe33e048700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe338062740 0x7fe3380afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:19:39.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe33d847700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe3380b8d20 0x7fe3380b52f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fe32c00c710 tx=0x7fe32c007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:39.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe32a7fc700 1 -- 172.21.2.102:0/890098543 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c00e4a0 con 0x7fe3380b8d20 2021-02-12T17:19:39.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe32a7fc700 1 -- 172.21.2.102:0/890098543 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32c00e600 con 0x7fe3380b8d20 2021-02-12T17:19:39.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe3402ac700 1 -- 172.21.2.102:0/890098543 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33815da60 con 0x7fe3380b8d20 2021-02-12T17:19:39.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.180+0000 7fe32a7fc700 1 -- 172.21.2.102:0/890098543 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c00e9a0 con 0x7fe3380b8d20 2021-02-12T17:19:39.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.181+0000 7fe3402ac700 1 -- 172.21.2.102:0/890098543 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3380b57e0 con 0x7fe3380b8d20 2021-02-12T17:19:39.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.181+0000 7fe3402ac700 1 -- 172.21.2.102:0/890098543 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3380bae60 con 0x7fe3380b8d20 2021-02-12T17:19:39.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.181+0000 7fe32a7fc700 1 -- 172.21.2.102:0/890098543 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fe32c019020 con 0x7fe3380b8d20 2021-02-12T17:19:39.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.182+0000 7fe32a7fc700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe318059d30 0x7fe31805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:39.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.182+0000 7fe32a7fc700 1 -- 172.21.2.102:0/890098543 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7fe32c073620 con 0x7fe3380b8d20 2021-02-12T17:19:39.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.182+0000 7fe33e048700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe318059d30 0x7fe31805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:39.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.182+0000 7fe33e048700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe318059d30 0x7fe31805c1f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fe334007fd0 tx=0x7fe334016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:39.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.185+0000 7fe32a7fc700 1 -- 172.21.2.102:0/890098543 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fe32c046db0 con 0x7fe3380b8d20 2021-02-12T17:19:39.344 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.343+0000 7fe3402ac700 1 -- 172.21.2.102:0/890098543 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3380633e0 con 0x7fe3380b8d20 2021-02-12T17:19:39.344 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.343+0000 7fe32a7fc700 1 -- 172.21.2.102:0/890098543 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3756 (secure 0 0 0) 0x7fe32c04a3d0 con 0x7fe3380b8d20 2021-02-12T17:19:39.344 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:39.345 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:41.303332+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":5,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:39.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.344+0000 7fe3402ac700 1 -- 172.21.2.102:0/890098543 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe318059d30 msgr2=0x7fe31805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:39.345 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.344+0000 7fe3402ac700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe318059d30 0x7fe31805c1f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fe334007fd0 tx=0x7fe334016000).stop 2021-02-12T17:19:39.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.344+0000 7fe3402ac700 1 -- 172.21.2.102:0/890098543 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe3380b8d20 msgr2=0x7fe3380b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:39.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.344+0000 7fe3402ac700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe3380b8d20 0x7fe3380b52f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fe32c00c710 tx=0x7fe32c007bf0).stop 2021-02-12T17:19:39.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.344+0000 7fe3402ac700 1 -- 172.21.2.102:0/890098543 shutdown_connections 2021-02-12T17:19:39.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.344+0000 7fe3402ac700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe33814e530 0x7fe3380acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:39.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.344+0000 7fe3402ac700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe338062740 0x7fe3380afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:39.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.344+0000 7fe3402ac700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe318059d30 0x7fe31805c1f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:39.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.344+0000 7fe3402ac700 1 --2- 172.21.2.102:0/890098543 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe3380b8d20 0x7fe3380b52f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:39.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.344+0000 7fe3402ac700 1 -- 172.21.2.102:0/890098543 >> 172.21.2.102:0/890098543 conn(0x7fe3380bc480 msgr2=0x7fe3380b8350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:39.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.344+0000 7fe3402ac700 1 -- 172.21.2.102:0/890098543 shutdown_connections 2021-02-12T17:19:39.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:39.344+0000 7fe3402ac700 1 -- 172.21.2.102:0/890098543 wait complete. 2021-02-12T17:19:39.347 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 20 2021-02-12T17:19:39.354 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:19:40.819 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:19:40.821 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:19:41.355 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:41.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.444+0000 7f6d1d481700 1 Processor -- start 2021-02-12T17:19:41.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.444+0000 7f6d1d481700 1 -- start start 2021-02-12T17:19:41.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.444+0000 7f6d1d481700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6d180b8d20 0x7f6d18068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:41.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.444+0000 7f6d1d481700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f6d1814e530 0x7f6d180b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:41.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.444+0000 7f6d1d481700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d180622a0 con 0x7f6d18062740 2021-02-12T17:19:41.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.444+0000 7f6d1d481700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d18068d20 con 0x7f6d1814e530 2021-02-12T17:19:41.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.444+0000 7f6d1d481700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1814ea10 con 0x7f6d180b8d20 2021-02-12T17:19:41.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.445+0000 7f6d167fc700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f6d1814e530 0x7f6d180b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:41.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.445+0000 7f6d16ffd700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6d180b8d20 0x7f6d18068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:41.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.445+0000 7f6d177fe700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f6d18062740 0x7f6d18062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:37480/0 (socket says 172.21.2.102:37480) 2021-02-12T17:19:41.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.445+0000 7f6d177fe700 1 -- 172.21.2.102:0/952710047 learned_addr learned my addr 172.21.2.102:0/952710047 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:19:41.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.445+0000 7f6d167fc700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f6d1814e530 0x7f6d180b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:44826/0 (socket says 172.21.2.102:44826) 2021-02-12T17:19:41.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.446+0000 7f6d167fc700 1 -- 172.21.2.102:0/952710047 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6d180b8d20 msgr2=0x7f6d18068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:41.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.446+0000 7f6d167fc700 1 --2- 172.21.2.102:0/952710047 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6d180b8d20 0x7f6d18068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:41.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.446+0000 7f6d167fc700 1 -- 172.21.2.102:0/952710047 >> v1:172.21.2.104:6789/0 conn(0x7f6d18062740 legacy=0x7f6d18062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:41.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.446+0000 7f6d167fc700 1 -- 172.21.2.102:0/952710047 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d180b63f0 con 0x7f6d1814e530 2021-02-12T17:19:41.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.446+0000 7f6d167fc700 1 --2- 172.21.2.102:0/952710047 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6d1814e530 0x7f6d180b7250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f6d0000b980 tx=0x7f6d00006de0).ready entity=mon.1 client_cookie=afb062b40b81656f server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:41.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.446+0000 7f6d15ffb700 1 -- 172.21.2.102:0/952710047 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000be70 con 0x7f6d1814e530 2021-02-12T17:19:41.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.446+0000 7f6d15ffb700 1 -- 172.21.2.102:0/952710047 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d000097e0 con 0x7f6d1814e530 2021-02-12T17:19:41.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.446+0000 7f6d15ffb700 1 -- 172.21.2.102:0/952710047 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00009b60 con 0x7f6d1814e530 2021-02-12T17:19:41.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.446+0000 7f6d1d481700 1 -- 172.21.2.102:0/952710047 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6d1814e530 msgr2=0x7f6d180b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:41.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.446+0000 7f6d1d481700 1 --2- 172.21.2.102:0/952710047 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6d1814e530 0x7f6d180b7250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f6d0000b980 tx=0x7f6d00006de0).stop 2021-02-12T17:19:41.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.447+0000 7f6d1d481700 1 -- 172.21.2.102:0/952710047 shutdown_connections 2021-02-12T17:19:41.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.447+0000 7f6d1d481700 1 --2- 172.21.2.102:0/952710047 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6d180b8d20 0x7f6d18068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:41.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.447+0000 7f6d1d481700 1 --2- 172.21.2.102:0/952710047 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6d1814e530 0x7f6d180b7250 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:41.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.447+0000 7f6d1d481700 1 -- 172.21.2.102:0/952710047 >> 172.21.2.102:0/952710047 conn(0x7f6d180bc480 msgr2=0x7f6d180b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:41.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.447+0000 7f6d1d481700 1 -- 172.21.2.102:0/952710047 shutdown_connections 2021-02-12T17:19:41.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.447+0000 7f6d1d481700 1 -- 172.21.2.102:0/952710047 wait complete. 2021-02-12T17:19:41.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.448+0000 7f6d1d481700 1 Processor -- start 2021-02-12T17:19:41.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.448+0000 7f6d1d481700 1 -- start start 2021-02-12T17:19:41.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.448+0000 7f6d1d481700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6d18062740 0x7f6d18161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:41.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.448+0000 7f6d1d481700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6d180b8d20 0x7f6d180b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:41.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.448+0000 7f6d1d481700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6d1814e530 0x7f6d180addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:41.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.448+0000 7f6d1d481700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d18161910 con 0x7f6d18062740 2021-02-12T17:19:41.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.448+0000 7f6d1d481700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d180b0b50 con 0x7f6d1814e530 2021-02-12T17:19:41.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.448+0000 7f6d1d481700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d180b4f00 con 0x7f6d180b8d20 2021-02-12T17:19:41.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.448+0000 7f6d16ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6d18062740 0x7f6d18161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:41.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.448+0000 7f6d16ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6d18062740 0x7f6d18161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46468/0 (socket says 172.21.2.102:46468) 2021-02-12T17:19:41.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.448+0000 7f6d16ffd700 1 -- 172.21.2.102:0/3195988928 learned_addr learned my addr 172.21.2.102:0/3195988928 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:41.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.448+0000 7f6d177fe700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6d1814e530 0x7f6d180addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:41.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.449+0000 7f6d167fc700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6d180b8d20 0x7f6d180b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:41.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.449+0000 7f6d16ffd700 1 -- 172.21.2.102:0/3195988928 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6d180b8d20 msgr2=0x7f6d180b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:41.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.449+0000 7f6d16ffd700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6d180b8d20 0x7f6d180b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:41.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.449+0000 7f6d16ffd700 1 -- 172.21.2.102:0/3195988928 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6d1814e530 msgr2=0x7f6d180addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:41.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.449+0000 7f6d16ffd700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6d1814e530 0x7f6d180addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:41.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.449+0000 7f6d16ffd700 1 -- 172.21.2.102:0/3195988928 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d180b51a0 con 0x7f6d18062740 2021-02-12T17:19:41.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.449+0000 7f6d177fe700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6d1814e530 0x7f6d180addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:19:41.456 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.449+0000 7f6d16ffd700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6d18062740 0x7f6d18161420 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f6d0800eb20 tx=0x7f6d08006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:41.456 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.449+0000 7f6d0effd700 1 -- 172.21.2.102:0/3195988928 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0800c920 con 0x7f6d18062740 2021-02-12T17:19:41.456 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.449+0000 7f6d0effd700 1 -- 172.21.2.102:0/3195988928 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0800ca80 con 0x7f6d18062740 2021-02-12T17:19:41.456 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.449+0000 7f6d1d481700 1 -- 172.21.2.102:0/3195988928 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d180b5440 con 0x7f6d18062740 2021-02-12T17:19:41.456 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.449+0000 7f6d0effd700 1 -- 172.21.2.102:0/3195988928 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0800ce00 con 0x7f6d18062740 2021-02-12T17:19:41.456 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.449+0000 7f6d1d481700 1 -- 172.21.2.102:0/3195988928 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d180b0780 con 0x7f6d18062740 2021-02-12T17:19:41.456 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.450+0000 7f6d1d481700 1 -- 172.21.2.102:0/3195988928 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d180adaf0 con 0x7f6d18062740 2021-02-12T17:19:41.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.450+0000 7f6d0effd700 1 -- 172.21.2.102:0/3195988928 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f6d08012600 con 0x7f6d18062740 2021-02-12T17:19:41.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.450+0000 7f6d0effd700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6cfc059d30 0x7f6cfc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:41.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.450+0000 7f6d0effd700 1 -- 172.21.2.102:0/3195988928 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f6d08074250 con 0x7f6d18062740 2021-02-12T17:19:41.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.450+0000 7f6d167fc700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6cfc059d30 0x7f6cfc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:41.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.451+0000 7f6d167fc700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6cfc059d30 0x7f6cfc05c1f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f6d0000b980 tx=0x7f6d00016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:41.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.453+0000 7f6d0effd700 1 -- 172.21.2.102:0/3195988928 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f6d080478d0 con 0x7f6d18062740 2021-02-12T17:19:41.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.610+0000 7f6d1d481700 1 -- 172.21.2.102:0/3195988928 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d180b55d0 con 0x7f6d18062740 2021-02-12T17:19:41.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.611+0000 7f6d0effd700 1 -- 172.21.2.102:0/3195988928 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3756 (secure 0 0 0) 0x7f6d0804aef0 con 0x7f6d18062740 2021-02-12T17:19:41.612 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:41.612 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:41.303332+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":5,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:41.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.612+0000 7f6d1d481700 1 -- 172.21.2.102:0/3195988928 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6cfc059d30 msgr2=0x7f6cfc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:41.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.612+0000 7f6d1d481700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6cfc059d30 0x7f6cfc05c1f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f6d0000b980 tx=0x7f6d00016000).stop 2021-02-12T17:19:41.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.612+0000 7f6d1d481700 1 -- 172.21.2.102:0/3195988928 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6d18062740 msgr2=0x7f6d18161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:41.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.612+0000 7f6d1d481700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6d18062740 0x7f6d18161420 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f6d0800eb20 tx=0x7f6d08006de0).stop 2021-02-12T17:19:41.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.612+0000 7f6d1d481700 1 -- 172.21.2.102:0/3195988928 shutdown_connections 2021-02-12T17:19:41.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.612+0000 7f6d1d481700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6d1814e530 0x7f6d180addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:41.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.612+0000 7f6d1d481700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6cfc059d30 0x7f6cfc05c1f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:41.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.612+0000 7f6d1d481700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6d18062740 0x7f6d18161420 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:41.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.612+0000 7f6d1d481700 1 --2- 172.21.2.102:0/3195988928 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6d180b8d20 0x7f6d180b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:41.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.612+0000 7f6d1d481700 1 -- 172.21.2.102:0/3195988928 >> 172.21.2.102:0/3195988928 conn(0x7f6d180bc480 msgr2=0x7f6d1814ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:41.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.612+0000 7f6d1d481700 1 -- 172.21.2.102:0/3195988928 shutdown_connections 2021-02-12T17:19:41.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:41.612+0000 7f6d1d481700 1 -- 172.21.2.102:0/3195988928 wait complete. 2021-02-12T17:19:41.615 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 20 2021-02-12T17:19:41.623 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:19:43.623 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:43.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.710+0000 7f971a805700 1 Processor -- start 2021-02-12T17:19:43.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.710+0000 7f971a805700 1 -- start start 2021-02-12T17:19:43.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.711+0000 7f971a805700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f97140b8d20 0x7f9714068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:43.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.711+0000 7f971a805700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f971414e530 0x7f97140b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:43.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.711+0000 7f971a805700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97140622a0 con 0x7f9714062740 2021-02-12T17:19:43.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.711+0000 7f971a805700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9714068d20 con 0x7f971414e530 2021-02-12T17:19:43.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.711+0000 7f971a805700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971414ea10 con 0x7f97140b8d20 2021-02-12T17:19:43.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.711+0000 7f97137fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f971414e530 0x7f97140b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:43.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.711+0000 7f97137fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f971414e530 0x7f97140b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46476/0 (socket says 172.21.2.102:46476) 2021-02-12T17:19:43.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.711+0000 7f97137fe700 1 -- 172.21.2.102:0/3345064859 learned_addr learned my addr 172.21.2.102:0/3345064859 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:43.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.711+0000 7f9718da2700 1 --1- 172.21.2.102:0/3345064859 >> v1:172.21.2.102:6789/0 conn(0x7f9714062740 0x7f9714062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55120/0 (socket says 172.21.2.102:55120) 2021-02-12T17:19:43.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.711+0000 7f97137fe700 1 -- 172.21.2.102:0/3345064859 >> v2:172.21.2.104:3300/0 conn(0x7f97140b8d20 msgr2=0x7f9714068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:19:43.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.711+0000 7f97137fe700 1 --2- 172.21.2.102:0/3345064859 >> v2:172.21.2.104:3300/0 conn(0x7f97140b8d20 0x7f9714068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:43.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.711+0000 7f97137fe700 1 -- 172.21.2.102:0/3345064859 >> v1:172.21.2.102:6789/0 conn(0x7f9714062740 legacy=0x7f9714062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:43.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.711+0000 7f97137fe700 1 -- 172.21.2.102:0/3345064859 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97140b63f0 con 0x7f971414e530 2021-02-12T17:19:43.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.712+0000 7f97137fe700 1 --2- 172.21.2.102:0/3345064859 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f971414e530 0x7f97140b7250 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f971406abc0 tx=0x7f96fc006ea0).ready entity=mon.0 client_cookie=18653bd2dae2ed9 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:43.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.712+0000 7f9712ffd700 1 -- 172.21.2.102:0/3345064859 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc009840 con 0x7f971414e530 2021-02-12T17:19:43.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.712+0000 7f9712ffd700 1 -- 172.21.2.102:0/3345064859 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc0099a0 con 0x7f971414e530 2021-02-12T17:19:43.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.712+0000 7f9712ffd700 1 -- 172.21.2.102:0/3345064859 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc009d20 con 0x7f971414e530 2021-02-12T17:19:43.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.712+0000 7f971a805700 1 -- 172.21.2.102:0/3345064859 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f971414e530 msgr2=0x7f97140b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:43.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.712+0000 7f971a805700 1 --2- 172.21.2.102:0/3345064859 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f971414e530 0x7f97140b7250 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f971406abc0 tx=0x7f96fc006ea0).stop 2021-02-12T17:19:43.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.712+0000 7f971a805700 1 -- 172.21.2.102:0/3345064859 shutdown_connections 2021-02-12T17:19:43.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.712+0000 7f971a805700 1 --2- 172.21.2.102:0/3345064859 >> v2:172.21.2.104:3300/0 conn(0x7f97140b8d20 0x7f9714068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:43.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.712+0000 7f971a805700 1 --2- 172.21.2.102:0/3345064859 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f971414e530 0x7f97140b7250 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:43.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.712+0000 7f971a805700 1 -- 172.21.2.102:0/3345064859 >> 172.21.2.102:0/3345064859 conn(0x7f97140bc480 msgr2=0x7f97140b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:43.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.712+0000 7f971a805700 1 -- 172.21.2.102:0/3345064859 shutdown_connections 2021-02-12T17:19:43.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.712+0000 7f971a805700 1 -- 172.21.2.102:0/3345064859 wait complete. 2021-02-12T17:19:43.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.713+0000 7f971a805700 1 Processor -- start 2021-02-12T17:19:43.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.713+0000 7f971a805700 1 -- start start 2021-02-12T17:19:43.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f971a805700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9714062740 0x7f97140af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:43.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f971a805700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97140b8d20 0x7f9714151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:43.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f971a805700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f971414e530 0x7f971414ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:43.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f971a805700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97140af990 con 0x7f97140b8d20 2021-02-12T17:19:43.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f971a805700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9714160bf0 con 0x7f971414e530 2021-02-12T17:19:43.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f971a805700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971411ded0 con 0x7f9714062740 2021-02-12T17:19:43.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f97137fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97140b8d20 0x7f9714151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:43.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f97137fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97140b8d20 0x7f9714151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46482/0 (socket says 172.21.2.102:46482) 2021-02-12T17:19:43.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f97137fe700 1 -- 172.21.2.102:0/1032326590 learned_addr learned my addr 172.21.2.102:0/1032326590 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:43.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f97137fe700 1 -- 172.21.2.102:0/1032326590 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9714062740 msgr2=0x7f97140af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:43.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f97137fe700 1 --2- 172.21.2.102:0/1032326590 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9714062740 0x7f97140af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:43.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f97137fe700 1 -- 172.21.2.102:0/1032326590 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f971414e530 msgr2=0x7f971414ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:43.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f97137fe700 1 --2- 172.21.2.102:0/1032326590 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f971414e530 0x7f971414ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:43.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f97137fe700 1 -- 172.21.2.102:0/1032326590 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9714161aa0 con 0x7f97140b8d20 2021-02-12T17:19:43.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f97137fe700 1 --2- 172.21.2.102:0/1032326590 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97140b8d20 0x7f9714151730 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f96fc006ee0 tx=0x7f96fc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:43.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.714+0000 7f970bfff700 1 -- 172.21.2.102:0/1032326590 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc012e80 con 0x7f97140b8d20 2021-02-12T17:19:43.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.715+0000 7f970bfff700 1 -- 172.21.2.102:0/1032326590 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc01c420 con 0x7f97140b8d20 2021-02-12T17:19:43.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.715+0000 7f970bfff700 1 -- 172.21.2.102:0/1032326590 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc01c7a0 con 0x7f97140b8d20 2021-02-12T17:19:43.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.715+0000 7f971a805700 1 -- 172.21.2.102:0/1032326590 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9714160e20 con 0x7f97140b8d20 2021-02-12T17:19:43.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.715+0000 7f971a805700 1 -- 172.21.2.102:0/1032326590 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9714161600 con 0x7f97140b8d20 2021-02-12T17:19:43.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.715+0000 7f971a805700 1 -- 172.21.2.102:0/1032326590 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97141617c0 con 0x7f97140b8d20 2021-02-12T17:19:43.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.716+0000 7f970bfff700 1 -- 172.21.2.102:0/1032326590 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f96fc023030 con 0x7f97140b8d20 2021-02-12T17:19:43.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.716+0000 7f970bfff700 1 --2- 172.21.2.102:0/1032326590 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f96f8059d30 0x7f96f805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:43.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.716+0000 7f970bfff700 1 -- 172.21.2.102:0/1032326590 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f96fc074ca0 con 0x7f97140b8d20 2021-02-12T17:19:43.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.716+0000 7f9713fff700 1 --2- 172.21.2.102:0/1032326590 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f96f8059d30 0x7f96f805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:43.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.716+0000 7f9713fff700 1 --2- 172.21.2.102:0/1032326590 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f96f8059d30 0x7f96f805c1f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f9704009480 tx=0x7f97040069a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:43.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.719+0000 7f970bfff700 1 -- 172.21.2.102:0/1032326590 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f96fc0483d0 con 0x7f97140b8d20 2021-02-12T17:19:43.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.876+0000 7f971a805700 1 -- 172.21.2.102:0/1032326590 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9714160fb0 con 0x7f97140b8d20 2021-02-12T17:19:43.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.876+0000 7f970bfff700 1 -- 172.21.2.102:0/1032326590 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3756 (secure 0 0 0) 0x7f96fc021090 con 0x7f97140b8d20 2021-02-12T17:19:43.878 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:43.878 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:41.303332+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":5,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:43.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.877+0000 7f971a805700 1 -- 172.21.2.102:0/1032326590 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f96f8059d30 msgr2=0x7f96f805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:43.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.877+0000 7f971a805700 1 --2- 172.21.2.102:0/1032326590 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f96f8059d30 0x7f96f805c1f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f9704009480 tx=0x7f97040069a0).stop 2021-02-12T17:19:43.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.877+0000 7f971a805700 1 -- 172.21.2.102:0/1032326590 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97140b8d20 msgr2=0x7f9714151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:43.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.877+0000 7f971a805700 1 --2- 172.21.2.102:0/1032326590 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97140b8d20 0x7f9714151730 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f96fc006ee0 tx=0x7f96fc016000).stop 2021-02-12T17:19:43.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.878+0000 7f971a805700 1 -- 172.21.2.102:0/1032326590 shutdown_connections 2021-02-12T17:19:43.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.878+0000 7f971a805700 1 --2- 172.21.2.102:0/1032326590 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f971414e530 0x7f971414ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:43.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.878+0000 7f971a805700 1 --2- 172.21.2.102:0/1032326590 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9714062740 0x7f97140af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:43.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.878+0000 7f971a805700 1 --2- 172.21.2.102:0/1032326590 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f96f8059d30 0x7f96f805c1f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:43.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.878+0000 7f971a805700 1 --2- 172.21.2.102:0/1032326590 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97140b8d20 0x7f9714151730 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:43.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.878+0000 7f971a805700 1 -- 172.21.2.102:0/1032326590 >> 172.21.2.102:0/1032326590 conn(0x7f97140bc480 msgr2=0x7f9714062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:43.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.878+0000 7f971a805700 1 -- 172.21.2.102:0/1032326590 shutdown_connections 2021-02-12T17:19:43.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:43.878+0000 7f971a805700 1 -- 172.21.2.102:0/1032326590 wait complete. 2021-02-12T17:19:43.880 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 20 2021-02-12T17:19:43.887 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:19:45.888 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:45.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.977+0000 7fb5d2835700 1 Processor -- start 2021-02-12T17:19:45.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.977+0000 7fb5d2835700 1 -- start start 2021-02-12T17:19:45.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.977+0000 7fb5d2835700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb5cc0b8d20 0x7fb5cc068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:45.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.977+0000 7fb5d2835700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5cc0b7960 con 0x7fb5cc062740 2021-02-12T17:19:45.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.977+0000 7fb5d2835700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5cc0622a0 con 0x7fb5cc14e530 2021-02-12T17:19:45.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.977+0000 7fb5d2835700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc068d20 con 0x7fb5cc0b8d20 2021-02-12T17:19:45.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.978+0000 7fb5d0dd2700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fb5cc062740 0x7fb5cc062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55134/0 (socket says 172.21.2.102:55134) 2021-02-12T17:19:45.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.978+0000 7fb5d0dd2700 1 -- 172.21.2.102:0/428228511 learned_addr learned my addr 172.21.2.102:0/428228511 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:19:45.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.978+0000 7fb5caffd700 1 -- 172.21.2.102:0/428228511 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317998574 0 0) 0x7fb5cc0b7960 con 0x7fb5cc062740 2021-02-12T17:19:45.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.978+0000 7fb5caffd700 1 -- 172.21.2.102:0/428228511 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5ac003230 con 0x7fb5cc062740 2021-02-12T17:19:45.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.978+0000 7fb5cbfff700 1 --2- 172.21.2.102:0/428228511 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb5cc0b8d20 0x7fb5cc068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:45.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.978+0000 7fb5caffd700 1 -- 172.21.2.102:0/428228511 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2845586559 0 0) 0x7fb5ac003230 con 0x7fb5cc062740 2021-02-12T17:19:45.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.978+0000 7fb5caffd700 1 -- 172.21.2.102:0/428228511 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb5cc0b8d20 msgr2=0x7fb5cc068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:45.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.978+0000 7fb5caffd700 1 --2- 172.21.2.102:0/428228511 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb5cc0b8d20 0x7fb5cc068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:45.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.978+0000 7fb5caffd700 1 -- 172.21.2.102:0/428228511 >> v1:172.21.2.104:6789/0 conn(0x7fb5cc14e530 legacy=0x7fb5cc0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:45.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.978+0000 7fb5caffd700 1 -- 172.21.2.102:0/428228511 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc14ea10 con 0x7fb5cc062740 2021-02-12T17:19:45.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5caffd700 1 -- 172.21.2.102:0/428228511 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fb5c4001860 con 0x7fb5cc062740 2021-02-12T17:19:45.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5caffd700 1 -- 172.21.2.102:0/428228511 >> v1:172.21.2.102:6789/0 conn(0x7fb5cc062740 legacy=0x7fb5cc062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:45.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5caffd700 1 --2- 172.21.2.102:0/428228511 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb5ac003750 0x7fb5ac003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:45.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5caffd700 1 --2- 172.21.2.102:0/428228511 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb5cc0b8d20 0x7fb5ac0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:45.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5caffd700 1 --2- 172.21.2.102:0/428228511 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb5ac0049c0 0x7fb5ac004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:45.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5caffd700 1 -- 172.21.2.102:0/428228511 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc068d20 con 0x7fb5ac0049c0 2021-02-12T17:19:45.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5caffd700 1 -- 172.21.2.102:0/428228511 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0041f0 con 0x7fb5ac003750 2021-02-12T17:19:45.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5caffd700 1 -- 172.21.2.102:0/428228511 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac00b720 con 0x7fb5cc0b8d20 2021-02-12T17:19:45.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5d0dd2700 1 --2- 172.21.2.102:0/428228511 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb5ac0049c0 0x7fb5ac004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:45.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5cbfff700 1 --2- 172.21.2.102:0/428228511 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb5ac003750 0x7fb5ac003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:45.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5cb7fe700 1 --2- 172.21.2.102:0/428228511 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb5cc0b8d20 0x7fb5ac0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:45.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5d0dd2700 1 -- 172.21.2.102:0/428228511 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb5cc0b8d20 msgr2=0x7fb5ac0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:45.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5d0dd2700 1 --2- 172.21.2.102:0/428228511 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb5cc0b8d20 0x7fb5ac0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:45.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5d0dd2700 1 -- 172.21.2.102:0/428228511 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb5ac003750 msgr2=0x7fb5ac003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:45.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5d0dd2700 1 --2- 172.21.2.102:0/428228511 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb5ac003750 0x7fb5ac003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:45.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5d0dd2700 1 -- 172.21.2.102:0/428228511 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac003230 con 0x7fb5ac0049c0 2021-02-12T17:19:45.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5cbfff700 1 --2- 172.21.2.102:0/428228511 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb5ac003750 0x7fb5ac003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:19:45.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5cb7fe700 1 --2- 172.21.2.102:0/428228511 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb5cc0b8d20 0x7fb5ac0044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:19:45.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5d0dd2700 1 --2- 172.21.2.102:0/428228511 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb5ac0049c0 0x7fb5ac004e40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fb5c400c840 tx=0x7fb5cc14eba0).ready entity=mon.0 client_cookie=b416f805cf9189a7 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:45.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5caffd700 1 -- 172.21.2.102:0/428228511 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4005b70 con 0x7fb5ac0049c0 2021-02-12T17:19:45.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5caffd700 1 -- 172.21.2.102:0/428228511 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c4005cd0 con 0x7fb5ac0049c0 2021-02-12T17:19:45.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.979+0000 7fb5caffd700 1 -- 172.21.2.102:0/428228511 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4007320 con 0x7fb5ac0049c0 2021-02-12T17:19:45.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.980+0000 7fb5d2835700 1 -- 172.21.2.102:0/428228511 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb5ac0049c0 msgr2=0x7fb5ac004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:45.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.980+0000 7fb5d2835700 1 --2- 172.21.2.102:0/428228511 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb5ac0049c0 0x7fb5ac004e40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fb5c400c840 tx=0x7fb5cc14eba0).stop 2021-02-12T17:19:45.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.980+0000 7fb5d0dd2700 1 -- 172.21.2.102:0/428228511 reap_dead start 2021-02-12T17:19:45.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.980+0000 7fb5d2835700 1 -- 172.21.2.102:0/428228511 shutdown_connections 2021-02-12T17:19:45.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.980+0000 7fb5d2835700 1 -- 172.21.2.102:0/428228511 >> 172.21.2.102:0/428228511 conn(0x7fb5cc0bc480 msgr2=0x7fb5cc0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:45.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.980+0000 7fb5d2835700 1 -- 172.21.2.102:0/428228511 shutdown_connections 2021-02-12T17:19:45.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.980+0000 7fb5d2835700 1 -- 172.21.2.102:0/428228511 wait complete. 2021-02-12T17:19:45.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.981+0000 7fb5d2835700 1 Processor -- start 2021-02-12T17:19:45.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.981+0000 7fb5d2835700 1 -- start start 2021-02-12T17:19:45.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.981+0000 7fb5d2835700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb5ac0049c0 0x7fb5cc15dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:45.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.981+0000 7fb5d2835700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb5cc11d490 0x7fb5cc151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:45.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5d2835700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb5cc0b0360 0x7fb5cc0b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:45.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5d2835700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc15e1f0 con 0x7fb5cc0b0360 2021-02-12T17:19:45.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5d2835700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc0b2690 con 0x7fb5ac0049c0 2021-02-12T17:19:45.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5d2835700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc0b23f0 con 0x7fb5cc11d490 2021-02-12T17:19:45.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5d0dd2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb5cc0b0360 0x7fb5cc0b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:45.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5d0dd2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb5cc0b0360 0x7fb5cc0b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46504/0 (socket says 172.21.2.102:46504) 2021-02-12T17:19:45.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5d0dd2700 1 -- 172.21.2.102:0/3207529676 learned_addr learned my addr 172.21.2.102:0/3207529676 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:45.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5cbfff700 1 --2- 172.21.2.102:0/3207529676 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb5ac0049c0 0x7fb5cc15dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:45.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5cb7fe700 1 --2- 172.21.2.102:0/3207529676 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb5cc11d490 0x7fb5cc151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:45.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5d0dd2700 1 -- 172.21.2.102:0/3207529676 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb5cc11d490 msgr2=0x7fb5cc151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:45.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5d0dd2700 1 --2- 172.21.2.102:0/3207529676 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb5cc11d490 0x7fb5cc151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:45.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5d0dd2700 1 -- 172.21.2.102:0/3207529676 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb5ac0049c0 msgr2=0x7fb5cc15dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:45.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5d0dd2700 1 --2- 172.21.2.102:0/3207529676 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb5ac0049c0 0x7fb5cc15dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:45.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5d0dd2700 1 -- 172.21.2.102:0/3207529676 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc0ad020 con 0x7fb5cc0b0360 2021-02-12T17:19:45.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5d0dd2700 1 --2- 172.21.2.102:0/3207529676 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb5cc0b0360 0x7fb5cc0b07e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fb5c4000f40 tx=0x7fb5c4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:45.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5c3fff700 1 -- 172.21.2.102:0/3207529676 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4001e60 con 0x7fb5cc0b0360 2021-02-12T17:19:45.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5c3fff700 1 -- 172.21.2.102:0/3207529676 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c4001250 con 0x7fb5cc0b0360 2021-02-12T17:19:45.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5d2835700 1 -- 172.21.2.102:0/3207529676 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5cc0ad2c0 con 0x7fb5cc0b0360 2021-02-12T17:19:45.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.982+0000 7fb5c3fff700 1 -- 172.21.2.102:0/3207529676 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4007690 con 0x7fb5cc0b0360 2021-02-12T17:19:45.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.983+0000 7fb5d2835700 1 -- 172.21.2.102:0/3207529676 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5cc0b20e0 con 0x7fb5cc0b0360 2021-02-12T17:19:45.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.983+0000 7fb5d2835700 1 -- 172.21.2.102:0/3207529676 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc0ad720 con 0x7fb5cc0b0360 2021-02-12T17:19:45.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.983+0000 7fb5c3fff700 1 -- 172.21.2.102:0/3207529676 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fb5c4024030 con 0x7fb5cc0b0360 2021-02-12T17:19:45.989 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.984+0000 7fb5c3fff700 1 --2- 172.21.2.102:0/3207529676 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb5b0059d30 0x7fb5b005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:45.989 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.984+0000 7fb5c3fff700 1 -- 172.21.2.102:0/3207529676 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7021+0+0 (secure 0 0 0) 0x7fb5c40749f0 con 0x7fb5cc0b0360 2021-02-12T17:19:45.989 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.984+0000 7fb5cbfff700 1 --2- 172.21.2.102:0/3207529676 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb5b0059d30 0x7fb5b005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:45.989 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.984+0000 7fb5cbfff700 1 --2- 172.21.2.102:0/3207529676 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb5b0059d30 0x7fb5b005c1f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fb5cc0b5d40 tx=0x7fb5b4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:45.989 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:45.987+0000 7fb5c3fff700 1 -- 172.21.2.102:0/3207529676 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fb5c4048070 con 0x7fb5cc0b0360 2021-02-12T17:19:46.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:46.146+0000 7fb5d2835700 1 -- 172.21.2.102:0/3207529676 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5cc045460 con 0x7fb5cc0b0360 2021-02-12T17:19:46.148 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:46.146+0000 7fb5c3fff700 1 -- 172.21.2.102:0/3207529676 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3756 (secure 0 0 0) 0x7fb5c4022090 con 0x7fb5cc0b0360 2021-02-12T17:19:46.148 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:46.148 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:18:41.303332+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":5,"addr":"172.21.2.102:6835/2191389758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2191389758},{"type":"v1","addr":"172.21.2.102:6835","nonce":2191389758}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:46.149 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:46.147+0000 7fb5d2835700 1 -- 172.21.2.102:0/3207529676 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb5b0059d30 msgr2=0x7fb5b005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:46.149 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:46.147+0000 7fb5d2835700 1 --2- 172.21.2.102:0/3207529676 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb5b0059d30 0x7fb5b005c1f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fb5cc0b5d40 tx=0x7fb5b4008040).stop 2021-02-12T17:19:46.149 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:46.147+0000 7fb5d2835700 1 -- 172.21.2.102:0/3207529676 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb5cc0b0360 msgr2=0x7fb5cc0b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:46.149 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:46.147+0000 7fb5d2835700 1 --2- 172.21.2.102:0/3207529676 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb5cc0b0360 0x7fb5cc0b07e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fb5c4000f40 tx=0x7fb5c4014000).stop 2021-02-12T17:19:46.149 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:46.148+0000 7fb5d2835700 1 -- 172.21.2.102:0/3207529676 shutdown_connections 2021-02-12T17:19:46.149 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:46.148+0000 7fb5d2835700 1 --2- 172.21.2.102:0/3207529676 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb5b0059d30 0x7fb5b005c1f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:46.149 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:46.148+0000 7fb5d2835700 1 --2- 172.21.2.102:0/3207529676 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb5cc0b0360 0x7fb5cc0b07e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:46.149 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:46.148+0000 7fb5d2835700 1 --2- 172.21.2.102:0/3207529676 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb5ac0049c0 0x7fb5cc15dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:46.149 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:46.148+0000 7fb5d2835700 1 --2- 172.21.2.102:0/3207529676 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb5cc11d490 0x7fb5cc151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:46.149 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:46.148+0000 7fb5d2835700 1 -- 172.21.2.102:0/3207529676 >> 172.21.2.102:0/3207529676 conn(0x7fb5cc0bc480 msgr2=0x7fb5cc14db60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:46.150 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:46.148+0000 7fb5d2835700 1 -- 172.21.2.102:0/3207529676 shutdown_connections 2021-02-12T17:19:46.150 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:46.148+0000 7fb5d2835700 1 -- 172.21.2.102:0/3207529676 wait complete. 2021-02-12T17:19:46.150 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 20 2021-02-12T17:19:46.158 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:19:48.159 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:48.224 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:48.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.247+0000 7fb1ad983700 1 Processor -- start 2021-02-12T17:19:48.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.247+0000 7fb1ad983700 1 -- start start 2021-02-12T17:19:48.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.248+0000 7fb1ad983700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb1a80b8bd0 0x7fb1a80b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.248+0000 7fb1ad983700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fb1a80b3090 0x7fb1a80b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.248+0000 7fb1ad983700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a80b54d0 con 0x7fb1a80b2cb0 2021-02-12T17:19:48.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.248+0000 7fb1ad983700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a80b40f0 con 0x7fb1a80b3090 2021-02-12T17:19:48.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.248+0000 7fb1ad983700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a80b4f90 con 0x7fb1a80b8bd0 2021-02-12T17:19:48.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.249+0000 7fb1a6ffd700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7fb1a80b2cb0 0x7fb1a8147cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:37536/0 (socket says 172.21.2.102:37536) 2021-02-12T17:19:48.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.249+0000 7fb1a6ffd700 1 -- 172.21.2.102:0/1059337624 learned_addr learned my addr 172.21.2.102:0/1059337624 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:19:48.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.249+0000 7fb1a67fc700 1 --2- 172.21.2.102:0/1059337624 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb1a80b8bd0 0x7fb1a80b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.249+0000 7fb1a77fe700 1 --2- 172.21.2.102:0/1059337624 >> v2:172.21.2.104:3300/0 conn(0x7fb1a80b3090 0x7fb1a80b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.249+0000 7fb1a5ffb700 1 -- 172.21.2.102:0/1059337624 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782984455 0 0) 0x7fb1a80b54d0 con 0x7fb1a80b2cb0 2021-02-12T17:19:48.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.249+0000 7fb1a5ffb700 1 -- 172.21.2.102:0/1059337624 --> v1:172.21.2.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb188003230 con 0x7fb1a80b2cb0 2021-02-12T17:19:48.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.249+0000 7fb1a77fe700 1 -- 172.21.2.102:0/1059337624 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb1a80b8bd0 msgr2=0x7fb1a80b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:48.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.249+0000 7fb1a77fe700 1 --2- 172.21.2.102:0/1059337624 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb1a80b8bd0 0x7fb1a80b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.249+0000 7fb1a77fe700 1 -- 172.21.2.102:0/1059337624 >> v1:172.21.2.104:6789/0 conn(0x7fb1a80b2cb0 legacy=0x7fb1a8147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.249+0000 7fb1a77fe700 1 -- 172.21.2.102:0/1059337624 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a80b5230 con 0x7fb1a80b3090 2021-02-12T17:19:48.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.249+0000 7fb1a67fc700 1 --2- 172.21.2.102:0/1059337624 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb1a80b8bd0 0x7fb1a80b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:19:48.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.250+0000 7fb1a77fe700 1 --2- 172.21.2.102:0/1059337624 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb1a80b3090 0x7fb1a80b4680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb1a0009c90 tx=0x7fb1a00091d0).ready entity=mon.1 client_cookie=efaf638608a41eba server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:48.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.250+0000 7fb1a5ffb700 1 -- 172.21.2.102:0/1059337624 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a000b930 con 0x7fb1a80b3090 2021-02-12T17:19:48.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.250+0000 7fb1a5ffb700 1 -- 172.21.2.102:0/1059337624 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a000ba90 con 0x7fb1a80b3090 2021-02-12T17:19:48.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.250+0000 7fb1a5ffb700 1 -- 172.21.2.102:0/1059337624 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a000be10 con 0x7fb1a80b3090 2021-02-12T17:19:48.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.250+0000 7fb1ad983700 1 -- 172.21.2.102:0/1059337624 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb1a80b3090 msgr2=0x7fb1a80b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.250+0000 7fb1ad983700 1 --2- 172.21.2.102:0/1059337624 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb1a80b3090 0x7fb1a80b4680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb1a0009c90 tx=0x7fb1a00091d0).stop 2021-02-12T17:19:48.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.250+0000 7fb1ad983700 1 -- 172.21.2.102:0/1059337624 shutdown_connections 2021-02-12T17:19:48.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.250+0000 7fb1ad983700 1 --2- 172.21.2.102:0/1059337624 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb1a80b3090 0x7fb1a80b4680 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.250+0000 7fb1ad983700 1 --2- 172.21.2.102:0/1059337624 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb1a80b8bd0 0x7fb1a80b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.250+0000 7fb1ad983700 1 -- 172.21.2.102:0/1059337624 >> 172.21.2.102:0/1059337624 conn(0x7fb1a80bc480 msgr2=0x7fb1a80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:48.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.250+0000 7fb1ad983700 1 -- 172.21.2.102:0/1059337624 shutdown_connections 2021-02-12T17:19:48.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.250+0000 7fb1ad983700 1 -- 172.21.2.102:0/1059337624 wait complete. 2021-02-12T17:19:48.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.251+0000 7fb1ad983700 1 Processor -- start 2021-02-12T17:19:48.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.251+0000 7fb1ad983700 1 -- start start 2021-02-12T17:19:48.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1ad983700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb1a80b2cb0 0x7fb1a814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1ad983700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb1a80b3090 0x7fb1a81594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.256 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1ad983700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb1a80b8bd0 0x7fb1a814e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.256 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1ad983700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a814a120 con 0x7fb1a80b8bd0 2021-02-12T17:19:48.256 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1ad983700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a8149e80 con 0x7fb1a80b2cb0 2021-02-12T17:19:48.256 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1ad983700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a8158ac0 con 0x7fb1a80b3090 2021-02-12T17:19:48.256 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1a77fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb1a80b8bd0 0x7fb1a814e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.256 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1a77fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb1a80b8bd0 0x7fb1a814e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46530/0 (socket says 172.21.2.102:46530) 2021-02-12T17:19:48.256 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1a77fe700 1 -- 172.21.2.102:0/4166624314 learned_addr learned my addr 172.21.2.102:0/4166624314 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:48.256 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1a6ffd700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb1a80b2cb0 0x7fb1a814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.256 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1a67fc700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb1a80b3090 0x7fb1a81594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.256 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1a77fe700 1 -- 172.21.2.102:0/4166624314 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb1a80b3090 msgr2=0x7fb1a81594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.256 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1a77fe700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb1a80b3090 0x7fb1a81594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.256 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1a77fe700 1 -- 172.21.2.102:0/4166624314 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb1a80b2cb0 msgr2=0x7fb1a814acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.257 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1a77fe700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb1a80b2cb0 0x7fb1a814acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.257 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1a77fe700 1 -- 172.21.2.102:0/4166624314 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a8158d60 con 0x7fb1a80b8bd0 2021-02-12T17:19:48.257 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.252+0000 7fb1a6ffd700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb1a80b2cb0 0x7fb1a814acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:19:48.257 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.253+0000 7fb1a77fe700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb1a80b8bd0 0x7fb1a814e640 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fb1a80653c0 tx=0x7fb1a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:48.257 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.253+0000 7fb19effd700 1 -- 172.21.2.102:0/4166624314 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a001c630 con 0x7fb1a80b8bd0 2021-02-12T17:19:48.257 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.253+0000 7fb19effd700 1 -- 172.21.2.102:0/4166624314 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a001c790 con 0x7fb1a80b8bd0 2021-02-12T17:19:48.257 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.253+0000 7fb1ad983700 1 -- 172.21.2.102:0/4166624314 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a8159000 con 0x7fb1a80b8bd0 2021-02-12T17:19:48.257 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.253+0000 7fb1ad983700 1 -- 172.21.2.102:0/4166624314 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a814b660 con 0x7fb1a80b8bd0 2021-02-12T17:19:48.257 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.253+0000 7fb19effd700 1 -- 172.21.2.102:0/4166624314 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a001cb10 con 0x7fb1a80b8bd0 2021-02-12T17:19:48.257 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.254+0000 7fb1ad983700 1 -- 172.21.2.102:0/4166624314 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb180004f60 con 0x7fb1a80b8bd0 2021-02-12T17:19:48.257 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.254+0000 7fb19effd700 1 -- 172.21.2.102:0/4166624314 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fb1a002c070 con 0x7fb1a80b8bd0 2021-02-12T17:19:48.257 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.254+0000 7fb19effd700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb18c059d80 0x7fb18c05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.257 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.254+0000 7fb19effd700 1 -- 172.21.2.102:0/4166624314 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7fb1a0075e80 con 0x7fb1a80b8bd0 2021-02-12T17:19:48.258 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.254+0000 7fb1a6ffd700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb18c059d80 0x7fb18c05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.258 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.255+0000 7fb1a6ffd700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb18c059d80 0x7fb18c05c240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fb198007fd0 tx=0x7fb198009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:48.258 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.257+0000 7fb19effd700 1 -- 172.21.2.102:0/4166624314 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fb1a0049520 con 0x7fb1a80b8bd0 2021-02-12T17:19:48.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.314+0000 7fa60c280700 1 Processor -- start 2021-02-12T17:19:48.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.315+0000 7fa60c280700 1 -- start start 2021-02-12T17:19:48.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.315+0000 7fa60c280700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa6040b8d20 0x7fa604068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.315+0000 7fa60c280700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa60414e530 0x7fa6040b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.315+0000 7fa60c280700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fa604062740 0x7fa604062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.315+0000 7fa60c280700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa604068d20 con 0x7fa60414e530 2021-02-12T17:19:48.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.315+0000 7fa60c280700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6040622a0 con 0x7fa604062740 2021-02-12T17:19:48.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.315+0000 7fa60c280700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60414ea10 con 0x7fa6040b8d20 2021-02-12T17:19:48.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.315+0000 7fa60981b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa60414e530 0x7fa6040b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.315+0000 7fa60981b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa60414e530 0x7fa6040b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46540/0 (socket says 172.21.2.102:46540) 2021-02-12T17:19:48.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.315+0000 7fa60981b700 1 -- 172.21.2.102:0/1174078778 learned_addr learned my addr 172.21.2.102:0/1174078778 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:48.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60981b700 1 -- 172.21.2.102:0/1174078778 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa6040b8d20 msgr2=0x7fa604068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:19:48.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60981b700 1 --2- 172.21.2.102:0/1174078778 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa6040b8d20 0x7fa604068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:48.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60981b700 1 -- 172.21.2.102:0/1174078778 >> v2:172.21.2.104:3300/0 conn(0x7fa604062740 msgr2=0x7fa604062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:19:48.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60981b700 1 --2- 172.21.2.102:0/1174078778 >> v2:172.21.2.104:3300/0 conn(0x7fa604062740 0x7fa604062bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:48.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60981b700 1 -- 172.21.2.102:0/1174078778 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6040b63f0 con 0x7fa60414e530 2021-02-12T17:19:48.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60981b700 1 --2- 172.21.2.102:0/1174078778 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa60414e530 0x7fa6040b7250 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fa604067bb0 tx=0x7fa600006ea0).ready entity=mon.0 client_cookie=5dd24e39bcd3b19a server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:48.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60901a700 1 -- 172.21.2.102:0/1174078778 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600009840 con 0x7fa60414e530 2021-02-12T17:19:48.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60901a700 1 -- 172.21.2.102:0/1174078778 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6000099a0 con 0x7fa60414e530 2021-02-12T17:19:48.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60901a700 1 -- 172.21.2.102:0/1174078778 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600009d20 con 0x7fa60414e530 2021-02-12T17:19:48.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60c280700 1 -- 172.21.2.102:0/1174078778 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa60414e530 msgr2=0x7fa6040b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60c280700 1 --2- 172.21.2.102:0/1174078778 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa60414e530 0x7fa6040b7250 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fa604067bb0 tx=0x7fa600006ea0).stop 2021-02-12T17:19:48.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60c280700 1 -- 172.21.2.102:0/1174078778 shutdown_connections 2021-02-12T17:19:48.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60c280700 1 --2- 172.21.2.102:0/1174078778 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa6040b8d20 0x7fa604068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:48.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60c280700 1 --2- 172.21.2.102:0/1174078778 >> v2:172.21.2.104:3300/0 conn(0x7fa604062740 0x7fa604062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:48.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60c280700 1 --2- 172.21.2.102:0/1174078778 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa60414e530 0x7fa6040b7250 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60c280700 1 -- 172.21.2.102:0/1174078778 >> 172.21.2.102:0/1174078778 conn(0x7fa6040bc480 msgr2=0x7fa6040b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:48.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60c280700 1 -- 172.21.2.102:0/1174078778 shutdown_connections 2021-02-12T17:19:48.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.316+0000 7fa60c280700 1 -- 172.21.2.102:0/1174078778 wait complete. 2021-02-12T17:19:48.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.317+0000 7fa60c280700 1 Processor -- start 2021-02-12T17:19:48.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.317+0000 7fa60c280700 1 -- start start 2021-02-12T17:19:48.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60c280700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa604062740 0x7fa60411d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60c280700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa6040b8d20 0x7fa60413f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60c280700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa60414e530 0x7fa60413fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60c280700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60415dbb0 con 0x7fa6040b8d20 2021-02-12T17:19:48.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60c280700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60415de50 con 0x7fa60414e530 2021-02-12T17:19:48.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60c280700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60415e0f0 con 0x7fa604062740 2021-02-12T17:19:48.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60981b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa6040b8d20 0x7fa60413f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60981b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa6040b8d20 0x7fa60413f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46546/0 (socket says 172.21.2.102:46546) 2021-02-12T17:19:48.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60981b700 1 -- 172.21.2.102:0/4292736183 learned_addr learned my addr 172.21.2.102:0/4292736183 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:48.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60981b700 1 -- 172.21.2.102:0/4292736183 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa604062740 msgr2=0x7fa60411d570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:19:48.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60981b700 1 --2- 172.21.2.102:0/4292736183 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa604062740 0x7fa60411d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:48.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60981b700 1 -- 172.21.2.102:0/4292736183 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa60414e530 msgr2=0x7fa60413fa30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:19:48.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60981b700 1 --2- 172.21.2.102:0/4292736183 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa60414e530 0x7fa60413fa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:48.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60981b700 1 -- 172.21.2.102:0/4292736183 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60415e390 con 0x7fa6040b8d20 2021-02-12T17:19:48.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60981b700 1 --2- 172.21.2.102:0/4292736183 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa6040b8d20 0x7fa60413f540 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fa600006ee0 tx=0x7fa600016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:48.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa5f27fc700 1 -- 172.21.2.102:0/4292736183 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60001c420 con 0x7fa6040b8d20 2021-02-12T17:19:48.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa5f27fc700 1 -- 172.21.2.102:0/4292736183 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60001c580 con 0x7fa6040b8d20 2021-02-12T17:19:48.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60c280700 1 -- 172.21.2.102:0/4292736183 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60413ff20 con 0x7fa6040b8d20 2021-02-12T17:19:48.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa5f27fc700 1 -- 172.21.2.102:0/4292736183 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60001c920 con 0x7fa6040b8d20 2021-02-12T17:19:48.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.318+0000 7fa60c280700 1 -- 172.21.2.102:0/4292736183 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6040b5220 con 0x7fa6040b8d20 2021-02-12T17:19:48.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.319+0000 7fa60c280700 1 -- 172.21.2.102:0/4292736183 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa604045460 con 0x7fa6040b8d20 2021-02-12T17:19:48.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.319+0000 7fa5f27fc700 1 -- 172.21.2.102:0/4292736183 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fa600023030 con 0x7fa6040b8d20 2021-02-12T17:19:48.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.319+0000 7fa5f27fc700 1 --2- 172.21.2.102:0/4292736183 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa5e4059d80 0x7fa5e405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.320+0000 7fa5f27fc700 1 -- 172.21.2.102:0/4292736183 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7fa600074bf0 con 0x7fa6040b8d20 2021-02-12T17:19:48.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.320+0000 7fa60a01c700 1 --2- 172.21.2.102:0/4292736183 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa5e4059d80 0x7fa5e405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.320+0000 7fa60a01c700 1 --2- 172.21.2.102:0/4292736183 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa5e4059d80 0x7fa5e405c240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fa5f400b420 tx=0x7fa5f4006920).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:48.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.322+0000 7fa5f27fc700 1 -- 172.21.2.102:0/4292736183 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fa600048340 con 0x7fa6040b8d20 2021-02-12T17:19:48.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.424+0000 7fb1ad983700 1 -- 172.21.2.102:0/4166624314 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb180005790 con 0x7fb1a80b8bd0 2021-02-12T17:19:48.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.424+0000 7fb19effd700 1 -- 172.21.2.102:0/4166624314 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3404 (secure 0 0 0) 0x7fb1a0020030 con 0x7fb1a80b8bd0 2021-02-12T17:19:48.426 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:48.426 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:48.304450+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":18,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:48.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.425+0000 7fb1ad983700 1 -- 172.21.2.102:0/4166624314 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb18c059d80 msgr2=0x7fb18c05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.425+0000 7fb1ad983700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb18c059d80 0x7fb18c05c240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fb198007fd0 tx=0x7fb198009040).stop 2021-02-12T17:19:48.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.425+0000 7fb1ad983700 1 -- 172.21.2.102:0/4166624314 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb1a80b8bd0 msgr2=0x7fb1a814e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.425+0000 7fb1ad983700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb1a80b8bd0 0x7fb1a814e640 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fb1a80653c0 tx=0x7fb1a0017000).stop 2021-02-12T17:19:48.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.426+0000 7fb1ad983700 1 -- 172.21.2.102:0/4166624314 shutdown_connections 2021-02-12T17:19:48.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.426+0000 7fb1ad983700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb18c059d80 0x7fb18c05c240 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.426+0000 7fb1ad983700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb1a80b8bd0 0x7fb1a814e640 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.426+0000 7fb1ad983700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb1a80b2cb0 0x7fb1a814acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.426+0000 7fb1ad983700 1 --2- 172.21.2.102:0/4166624314 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb1a80b3090 0x7fb1a81594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.426+0000 7fb1ad983700 1 -- 172.21.2.102:0/4166624314 >> 172.21.2.102:0/4166624314 conn(0x7fb1a80bc480 msgr2=0x7fb1a80b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:48.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.426+0000 7fb1ad983700 1 -- 172.21.2.102:0/4166624314 shutdown_connections 2021-02-12T17:19:48.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.426+0000 7fb1ad983700 1 -- 172.21.2.102:0/4166624314 wait complete. 2021-02-12T17:19:48.428 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 23 2021-02-12T17:19:48.435 INFO:tasks.mds_thrash.fs.[a]:mds.a down, removed from mdsmap 2021-02-12T17:19:48.435 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2021-02-12T17:19:48.435 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:48.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.486+0000 7fa60c280700 1 -- 172.21.2.102:0/4292736183 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6040b8910 con 0x7fa6040b8d20 2021-02-12T17:19:48.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.487+0000 7fa5f27fc700 1 -- 172.21.2.102:0/4292736183 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3404 (secure 0 0 0) 0x7fa600021020 con 0x7fa6040b8d20 2021-02-12T17:19:48.488 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:48.488 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:48.304450+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":18,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:48.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.488+0000 7fa60c280700 1 -- 172.21.2.102:0/4292736183 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa5e4059d80 msgr2=0x7fa5e405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.488+0000 7fa60c280700 1 --2- 172.21.2.102:0/4292736183 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa5e4059d80 0x7fa5e405c240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fa5f400b420 tx=0x7fa5f4006920).stop 2021-02-12T17:19:48.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.488+0000 7fa60c280700 1 -- 172.21.2.102:0/4292736183 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa6040b8d20 msgr2=0x7fa60413f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.488+0000 7fa60c280700 1 --2- 172.21.2.102:0/4292736183 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa6040b8d20 0x7fa60413f540 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fa600006ee0 tx=0x7fa600016000).stop 2021-02-12T17:19:48.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.488+0000 7fa60c280700 1 -- 172.21.2.102:0/4292736183 shutdown_connections 2021-02-12T17:19:48.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.488+0000 7fa60c280700 1 --2- 172.21.2.102:0/4292736183 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa60414e530 0x7fa60413fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:48.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.488+0000 7fa60c280700 1 --2- 172.21.2.102:0/4292736183 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa604062740 0x7fa60411d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:48.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.488+0000 7fa60c280700 1 --2- 172.21.2.102:0/4292736183 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa5e4059d80 0x7fa5e405c240 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.488+0000 7fa60c280700 1 --2- 172.21.2.102:0/4292736183 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa6040b8d20 0x7fa60413f540 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.488+0000 7fa60c280700 1 -- 172.21.2.102:0/4292736183 >> 172.21.2.102:0/4292736183 conn(0x7fa6040bc480 msgr2=0x7fa60414ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:48.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.488+0000 7fa60c280700 1 -- 172.21.2.102:0/4292736183 shutdown_connections 2021-02-12T17:19:48.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.488+0000 7fa60c280700 1 -- 172.21.2.102:0/4292736183 wait complete. 2021-02-12T17:19:48.491 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 23 2021-02-12T17:19:48.498 INFO:tasks.mds_thrash.fs.[b]:kill mds.d (rank=0) 2021-02-12T17:19:48.498 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2021-02-12T17:19:48.498 INFO:teuthology.orchestra.run:waiting for 300 2021-02-12T17:19:48.505 INFO:tasks.ceph.mds.d:Stopped 2021-02-12T17:19:48.505 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:48.566 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.565+0000 7fe634d87700 1 Processor -- start 2021-02-12T17:19:48.566 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.565+0000 7fe634d87700 1 -- start start 2021-02-12T17:19:48.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe634d87700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fe6300b8d20 0x7fe630068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe634d87700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe630062740 0x7fe630062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe634d87700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6300b7960 con 0x7fe63014e530 2021-02-12T17:19:48.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe634d87700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe630068d20 con 0x7fe630062740 2021-02-12T17:19:48.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe634d87700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6300622a0 con 0x7fe6300b8d20 2021-02-12T17:19:48.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe62ed9d700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe630062740 0x7fe630062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe62ed9d700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe630062740 0x7fe630062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46554/0 (socket says 172.21.2.102:46554) 2021-02-12T17:19:48.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe62ed9d700 1 -- 172.21.2.102:0/1123643520 learned_addr learned my addr 172.21.2.102:0/1123643520 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:48.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe62ed9d700 1 -- 172.21.2.102:0/1123643520 >> v2:172.21.2.104:3300/0 conn(0x7fe6300b8d20 msgr2=0x7fe630068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:48.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe62e59c700 1 --2- 172.21.2.102:0/1123643520 >> v2:172.21.2.104:3300/0 conn(0x7fe6300b8d20 0x7fe630068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe62ed9d700 1 --2- 172.21.2.102:0/1123643520 >> v2:172.21.2.104:3300/0 conn(0x7fe6300b8d20 0x7fe630068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe62ed9d700 1 -- 172.21.2.102:0/1123643520 >> v1:172.21.2.104:6789/0 conn(0x7fe63014e530 legacy=0x7fe6300b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:48.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe62ed9d700 1 -- 172.21.2.102:0/1123643520 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63014ea10 con 0x7fe630062740 2021-02-12T17:19:48.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe62e59c700 1 --2- 172.21.2.102:0/1123643520 >> v2:172.21.2.104:3300/0 conn(0x7fe6300b8d20 0x7fe630068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:19:48.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe62ed9d700 1 --2- 172.21.2.102:0/1123643520 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe630062740 0x7fe630062bf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fe63006abc0 tx=0x7fe628009290).ready entity=mon.0 client_cookie=14697823def77cff server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:48.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe62d59a700 1 -- 172.21.2.102:0/1123643520 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62800bbb0 con 0x7fe630062740 2021-02-12T17:19:48.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe62d59a700 1 -- 172.21.2.102:0/1123643520 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62800bd10 con 0x7fe630062740 2021-02-12T17:19:48.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.566+0000 7fe62d59a700 1 -- 172.21.2.102:0/1123643520 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628011610 con 0x7fe630062740 2021-02-12T17:19:48.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.567+0000 7fe634d87700 1 -- 172.21.2.102:0/1123643520 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe630062740 msgr2=0x7fe630062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.567+0000 7fe634d87700 1 --2- 172.21.2.102:0/1123643520 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe630062740 0x7fe630062bf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fe63006abc0 tx=0x7fe628009290).stop 2021-02-12T17:19:48.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.567+0000 7fe634d87700 1 -- 172.21.2.102:0/1123643520 shutdown_connections 2021-02-12T17:19:48.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.567+0000 7fe634d87700 1 --2- 172.21.2.102:0/1123643520 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe630062740 0x7fe630062bf0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.567+0000 7fe634d87700 1 --2- 172.21.2.102:0/1123643520 >> v2:172.21.2.104:3300/0 conn(0x7fe6300b8d20 0x7fe630068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.567+0000 7fe634d87700 1 -- 172.21.2.102:0/1123643520 >> 172.21.2.102:0/1123643520 conn(0x7fe6300bc480 msgr2=0x7fe6300b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:48.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.567+0000 7fe634d87700 1 -- 172.21.2.102:0/1123643520 shutdown_connections 2021-02-12T17:19:48.570 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.567+0000 7fe634d87700 1 -- 172.21.2.102:0/1123643520 wait complete. 2021-02-12T17:19:48.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.568+0000 7fe634d87700 1 Processor -- start 2021-02-12T17:19:48.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.568+0000 7fe634d87700 1 -- start start 2021-02-12T17:19:48.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.568+0000 7fe634d87700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe630062740 0x7fe630160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.568+0000 7fe634d87700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe6300b8d20 0x7fe63014cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.568+0000 7fe634d87700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe63014e530 0x7fe6300b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.568+0000 7fe634d87700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6300afc20 con 0x7fe630062740 2021-02-12T17:19:48.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.568+0000 7fe634d87700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe630161420 con 0x7fe63014e530 2021-02-12T17:19:48.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.568+0000 7fe634d87700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6300b9da0 con 0x7fe6300b8d20 2021-02-12T17:19:48.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.568+0000 7fe62e59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe630062740 0x7fe630160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.568+0000 7fe62e59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe630062740 0x7fe630160f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46556/0 (socket says 172.21.2.102:46556) 2021-02-12T17:19:48.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.568+0000 7fe62e59c700 1 -- 172.21.2.102:0/3495848756 learned_addr learned my addr 172.21.2.102:0/3495848756 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:48.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.569+0000 7fe62ed9d700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe63014e530 0x7fe6300b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.569+0000 7fe62dd9b700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe6300b8d20 0x7fe63014cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.569+0000 7fe62e59c700 1 -- 172.21.2.102:0/3495848756 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe6300b8d20 msgr2=0x7fe63014cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.569+0000 7fe62e59c700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe6300b8d20 0x7fe63014cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.569+0000 7fe62e59c700 1 -- 172.21.2.102:0/3495848756 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe63014e530 msgr2=0x7fe6300b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.569+0000 7fe62e59c700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe63014e530 0x7fe6300b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.573 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.569+0000 7fe62e59c700 1 -- 172.21.2.102:0/3495848756 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6300afe10 con 0x7fe630062740 2021-02-12T17:19:48.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.569+0000 7fe62dd9b700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe6300b8d20 0x7fe63014cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:19:48.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.569+0000 7fe62e59c700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe630062740 0x7fe630160f30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fe61800cb80 tx=0x7fe618008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:48.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.569+0000 7fe6267fc700 1 -- 172.21.2.102:0/3495848756 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618007740 con 0x7fe630062740 2021-02-12T17:19:48.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.569+0000 7fe6267fc700 1 -- 172.21.2.102:0/3495848756 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6180078a0 con 0x7fe630062740 2021-02-12T17:19:48.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.569+0000 7fe634d87700 1 -- 172.21.2.102:0/3495848756 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6300b00b0 con 0x7fe630062740 2021-02-12T17:19:48.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.569+0000 7fe6267fc700 1 -- 172.21.2.102:0/3495848756 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618007c20 con 0x7fe630062740 2021-02-12T17:19:48.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.569+0000 7fe634d87700 1 -- 172.21.2.102:0/3495848756 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6300b05f0 con 0x7fe630062740 2021-02-12T17:19:48.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.570+0000 7fe634d87700 1 -- 172.21.2.102:0/3495848756 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe630045460 con 0x7fe630062740 2021-02-12T17:19:48.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.570+0000 7fe6267fc700 1 -- 172.21.2.102:0/3495848756 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fe618011620 con 0x7fe630062740 2021-02-12T17:19:48.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.570+0000 7fe6267fc700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe614059d30 0x7fe61405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.570+0000 7fe6267fc700 1 -- 172.21.2.102:0/3495848756 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7fe6180740c0 con 0x7fe630062740 2021-02-12T17:19:48.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.570+0000 7fe62dd9b700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe614059d30 0x7fe61405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.570+0000 7fe62dd9b700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe614059d30 0x7fe61405c1f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fe6300ba120 tx=0x7fe620008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:48.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.573+0000 7fe6267fc700 1 -- 172.21.2.102:0/3495848756 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fe6180476e0 con 0x7fe630062740 2021-02-12T17:19:48.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.627+0000 7f695fbcd700 1 Processor -- start 2021-02-12T17:19:48.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.627+0000 7f695fbcd700 1 -- start start 2021-02-12T17:19:48.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.628+0000 7f695fbcd700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f695814e530 0x7f6958068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.628+0000 7f695fbcd700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f6958062740 0x7f6958062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.628+0000 7f695fbcd700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69580b7960 con 0x7f69580b8d20 2021-02-12T17:19:48.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.628+0000 7f695fbcd700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6958068d20 con 0x7f6958062740 2021-02-12T17:19:48.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.628+0000 7f695fbcd700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69580622a0 con 0x7f695814e530 2021-02-12T17:19:48.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.628+0000 7f695d969700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f69580b8d20 0x7f69580b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55208/0 (socket says 172.21.2.102:55208) 2021-02-12T17:19:48.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.628+0000 7f695d969700 1 -- 172.21.2.102:0/1336880252 learned_addr learned my addr 172.21.2.102:0/1336880252 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:19:48.631 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.628+0000 7f695c967700 1 -- 172.21.2.102:0/1336880252 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794153039 0 0) 0x7f69580b7960 con 0x7f69580b8d20 2021-02-12T17:19:48.631 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.628+0000 7f695c967700 1 -- 172.21.2.102:0/1336880252 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6940003230 con 0x7f69580b8d20 2021-02-12T17:19:48.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 -- 172.21.2.102:0/1336880252 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2422024998 0 0) 0x7f6940003230 con 0x7f69580b8d20 2021-02-12T17:19:48.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 -- 172.21.2.102:0/1336880252 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f695814e530 msgr2=0x7f6958068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:48.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 --2- 172.21.2.102:0/1336880252 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f695814e530 0x7f6958068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:48.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 -- 172.21.2.102:0/1336880252 >> v2:172.21.2.104:3300/0 conn(0x7f6958062740 msgr2=0x7f6958062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:48.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 --2- 172.21.2.102:0/1336880252 >> v2:172.21.2.104:3300/0 conn(0x7f6958062740 0x7f6958062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:48.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 -- 172.21.2.102:0/1336880252 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695814ea10 con 0x7f69580b8d20 2021-02-12T17:19:48.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 -- 172.21.2.102:0/1336880252 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f69540014e0 con 0x7f69580b8d20 2021-02-12T17:19:48.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 -- 172.21.2.102:0/1336880252 >> v1:172.21.2.102:6789/0 conn(0x7f69580b8d20 legacy=0x7f69580b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 --2- 172.21.2.102:0/1336880252 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6940003720 0x7f6940003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 --2- 172.21.2.102:0/1336880252 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f69400044d0 0x7f6940004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 --2- 172.21.2.102:0/1336880252 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f695814e530 0x7f6940004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 -- 172.21.2.102:0/1336880252 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6958068d20 con 0x7f69400044d0 2021-02-12T17:19:48.632 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 -- 172.21.2.102:0/1336880252 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69580622a0 con 0x7f6940003720 2021-02-12T17:19:48.633 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 -- 172.21.2.102:0/1336880252 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6940004260 con 0x7f695814e530 2021-02-12T17:19:48.633 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695d168700 1 --2- 172.21.2.102:0/1336880252 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f69400044d0 0x7f6940004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.633 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695d969700 1 --2- 172.21.2.102:0/1336880252 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6940003720 0x7f6940003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.633 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695d168700 1 -- 172.21.2.102:0/1336880252 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f695814e530 msgr2=0x7f6940004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:48.633 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695d168700 1 --2- 172.21.2.102:0/1336880252 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f695814e530 0x7f6940004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:48.633 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695d168700 1 -- 172.21.2.102:0/1336880252 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6940003720 msgr2=0x7f6940003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:48.633 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695d168700 1 --2- 172.21.2.102:0/1336880252 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6940003720 0x7f6940003b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.633 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695d168700 1 -- 172.21.2.102:0/1336880252 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6940003230 con 0x7f69400044d0 2021-02-12T17:19:48.633 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695d168700 1 --2- 172.21.2.102:0/1336880252 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f69400044d0 0x7f6940004950 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f694c00b950 tx=0x7f694c006e20).ready entity=mon.0 client_cookie=86837eacabd738e2 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:48.633 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 -- 172.21.2.102:0/1336880252 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c0097e0 con 0x7f69400044d0 2021-02-12T17:19:48.633 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 -- 172.21.2.102:0/1336880252 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c009940 con 0x7f69400044d0 2021-02-12T17:19:48.633 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695c967700 1 -- 172.21.2.102:0/1336880252 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c009d00 con 0x7f69400044d0 2021-02-12T17:19:48.633 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695fbcd700 1 -- 172.21.2.102:0/1336880252 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f69400044d0 msgr2=0x7f6940004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695fbcd700 1 --2- 172.21.2.102:0/1336880252 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f69400044d0 0x7f6940004950 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f694c00b950 tx=0x7f694c006e20).stop 2021-02-12T17:19:48.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695e16a700 1 -- 172.21.2.102:0/1336880252 reap_dead start 2021-02-12T17:19:48.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695fbcd700 1 -- 172.21.2.102:0/1336880252 shutdown_connections 2021-02-12T17:19:48.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695fbcd700 1 -- 172.21.2.102:0/1336880252 >> 172.21.2.102:0/1336880252 conn(0x7f69580bc480 msgr2=0x7f69580b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:48.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695fbcd700 1 -- 172.21.2.102:0/1336880252 shutdown_connections 2021-02-12T17:19:48.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.629+0000 7f695fbcd700 1 -- 172.21.2.102:0/1336880252 wait complete. 2021-02-12T17:19:48.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.630+0000 7f695fbcd700 1 Processor -- start 2021-02-12T17:19:48.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.630+0000 7f695fbcd700 1 -- start start 2021-02-12T17:19:48.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695fbcd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f695814bc80 0x7f69580b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695fbcd700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f69580b5130 0x7f69580b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695fbcd700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f69580b1b80 0x7f69580b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695fbcd700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69580b0d90 con 0x7f695814bc80 2021-02-12T17:19:48.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695fbcd700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6958160d00 con 0x7f69580b1b80 2021-02-12T17:19:48.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695fbcd700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6958160fa0 con 0x7f69580b5130 2021-02-12T17:19:48.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695d969700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f695814bc80 0x7f69580b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695d969700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f695814bc80 0x7f69580b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46576/0 (socket says 172.21.2.102:46576) 2021-02-12T17:19:48.636 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695d969700 1 -- 172.21.2.102:0/2131557893 learned_addr learned my addr 172.21.2.102:0/2131557893 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:48.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695d168700 1 --2- 172.21.2.102:0/2131557893 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f69580b5130 0x7f69580b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695d969700 1 -- 172.21.2.102:0/2131557893 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f69580b5130 msgr2=0x7f69580b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695d969700 1 --2- 172.21.2.102:0/2131557893 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f69580b5130 0x7f69580b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695d969700 1 -- 172.21.2.102:0/2131557893 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f69580b1b80 msgr2=0x7f69580b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695d969700 1 --2- 172.21.2.102:0/2131557893 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f69580b1b80 0x7f69580b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:48.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695d969700 1 -- 172.21.2.102:0/2131557893 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6958161240 con 0x7f695814bc80 2021-02-12T17:19:48.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695d969700 1 --2- 172.21.2.102:0/2131557893 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f695814bc80 0x7f69580b11a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f695400ddd0 tx=0x7f6954009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:48.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f6949ffb700 1 -- 172.21.2.102:0/2131557893 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695400bbf0 con 0x7f695814bc80 2021-02-12T17:19:48.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f6949ffb700 1 -- 172.21.2.102:0/2131557893 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695400bd50 con 0x7f695814bc80 2021-02-12T17:19:48.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f6949ffb700 1 -- 172.21.2.102:0/2131557893 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954007380 con 0x7f695814bc80 2021-02-12T17:19:48.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695fbcd700 1 -- 172.21.2.102:0/2131557893 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69581614e0 con 0x7f695814bc80 2021-02-12T17:19:48.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.631+0000 7f695fbcd700 1 -- 172.21.2.102:0/2131557893 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69581609f0 con 0x7f695814bc80 2021-02-12T17:19:48.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.632+0000 7f695fbcd700 1 -- 172.21.2.102:0/2131557893 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6958061c30 con 0x7f695814bc80 2021-02-12T17:19:48.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.632+0000 7f6949ffb700 1 -- 172.21.2.102:0/2131557893 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f69540047c0 con 0x7f695814bc80 2021-02-12T17:19:48.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.632+0000 7f6949ffb700 1 --2- 172.21.2.102:0/2131557893 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6938059d30 0x7f693805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:48.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.632+0000 7f6949ffb700 1 -- 172.21.2.102:0/2131557893 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7f6954074380 con 0x7f695814bc80 2021-02-12T17:19:48.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.632+0000 7f695d168700 1 --2- 172.21.2.102:0/2131557893 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6938059d30 0x7f693805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:48.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.632+0000 7f695d168700 1 --2- 172.21.2.102:0/2131557893 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6938059d30 0x7f693805c1f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f6958063470 tx=0x7f694c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:48.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.635+0000 7f6949ffb700 1 -- 172.21.2.102:0/2131557893 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f6954047ab0 con 0x7f695814bc80 2021-02-12T17:19:48.738 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.737+0000 7fe634d87700 1 -- 172.21.2.102:0/3495848756 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe630063670 con 0x7fe630062740 2021-02-12T17:19:48.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.737+0000 7fe6267fc700 1 -- 172.21.2.102:0/3495848756 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3404 (secure 0 0 0) 0x7fe61804ad00 con 0x7fe630062740 2021-02-12T17:19:48.739 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:48.739 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:48.304450+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":18,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:48.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.739+0000 7fe634d87700 1 -- 172.21.2.102:0/3495848756 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe614059d30 msgr2=0x7fe61405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.739+0000 7fe634d87700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe614059d30 0x7fe61405c1f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fe6300ba120 tx=0x7fe620008040).stop 2021-02-12T17:19:48.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.739+0000 7fe634d87700 1 -- 172.21.2.102:0/3495848756 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe630062740 msgr2=0x7fe630160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.739+0000 7fe634d87700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe630062740 0x7fe630160f30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fe61800cb80 tx=0x7fe618008040).stop 2021-02-12T17:19:48.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.739+0000 7fe634d87700 1 -- 172.21.2.102:0/3495848756 shutdown_connections 2021-02-12T17:19:48.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.739+0000 7fe634d87700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe63014e530 0x7fe6300b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.739+0000 7fe634d87700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe614059d30 0x7fe61405c1f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.739+0000 7fe634d87700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe630062740 0x7fe630160f30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.739+0000 7fe634d87700 1 --2- 172.21.2.102:0/3495848756 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe6300b8d20 0x7fe63014cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.739+0000 7fe634d87700 1 -- 172.21.2.102:0/3495848756 >> 172.21.2.102:0/3495848756 conn(0x7fe6300bc480 msgr2=0x7fe6300bb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:48.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.739+0000 7fe634d87700 1 -- 172.21.2.102:0/3495848756 shutdown_connections 2021-02-12T17:19:48.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.739+0000 7fe634d87700 1 -- 172.21.2.102:0/3495848756 wait complete. 2021-02-12T17:19:48.741 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 23 2021-02-12T17:19:48.750 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 23, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:01.991560+0000", "damaged": [], "data_pools": [ 4 ], "enabled": true, "epoch": 23, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "a", "in": [ 0 ], "info": { "gid_5157": { "addr": "172.21.2.102:6837/115463068", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6836", "nonce": 115463068, "type": "v2" }, { "addr": "172.21.2.102:6837", "nonce": 115463068, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5157, "incarnation": 21, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:rejoin", "state_seq": 18 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2021-02-12T17:19:48.304450+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5157 } } }, { "id": 2, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:08.529588+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 14, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "b", "in": [ 0 ], "info": { "gid_4246": { "addr": "172.21.2.104:6835/3140564541", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6833", "nonce": 3140564541, "type": "v2" }, { "addr": "172.21.2.104:6835", "nonce": 3140564541, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4246, "incarnation": 11, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:active", "state_seq": 40 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 5, "modified": "2021-02-12T17:18:29.290637+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4246 } } } ], "standbys": [ { "addr": "172.21.2.104:6834/3149030842", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6832", "nonce": 3149030842, "type": "v2" }, { "addr": "172.21.2.104:6834", "nonce": 3149030842, "type": "v1" } ] }, "epoch": 5, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4243, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 2 } ] } 2021-02-12T17:19:48.801 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.799+0000 7f695fbcd700 1 -- 172.21.2.102:0/2131557893 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69580b0fa0 con 0x7f695814bc80 2021-02-12T17:19:48.801 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.799+0000 7f6949ffb700 1 -- 172.21.2.102:0/2131557893 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3404 (secure 0 0 0) 0x7f695404b0d0 con 0x7f695814bc80 2021-02-12T17:19:48.801 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:48.802 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:48.304450+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":18,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:48.803 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.800+0000 7f695fbcd700 1 -- 172.21.2.102:0/2131557893 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6938059d30 msgr2=0x7f693805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.803 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.800+0000 7f695fbcd700 1 --2- 172.21.2.102:0/2131557893 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6938059d30 0x7f693805c1f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f6958063470 tx=0x7f694c016000).stop 2021-02-12T17:19:48.803 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.800+0000 7f695fbcd700 1 -- 172.21.2.102:0/2131557893 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f695814bc80 msgr2=0x7f69580b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:48.803 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.800+0000 7f695fbcd700 1 --2- 172.21.2.102:0/2131557893 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f695814bc80 0x7f69580b11a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f695400ddd0 tx=0x7f6954009040).stop 2021-02-12T17:19:48.803 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.801+0000 7f695fbcd700 1 -- 172.21.2.102:0/2131557893 shutdown_connections 2021-02-12T17:19:48.804 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.801+0000 7f695fbcd700 1 --2- 172.21.2.102:0/2131557893 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f69580b1b80 0x7f69580b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:48.804 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.801+0000 7f695fbcd700 1 --2- 172.21.2.102:0/2131557893 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6938059d30 0x7f693805c1f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.804 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.801+0000 7f695fbcd700 1 --2- 172.21.2.102:0/2131557893 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f695814bc80 0x7f69580b11a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.805 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.801+0000 7f695fbcd700 1 --2- 172.21.2.102:0/2131557893 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f69580b5130 0x7f69580b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:48.805 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.801+0000 7f695fbcd700 1 -- 172.21.2.102:0/2131557893 >> 172.21.2.102:0/2131557893 conn(0x7f69580bc480 msgr2=0x7f695814cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:48.805 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.801+0000 7f695fbcd700 1 -- 172.21.2.102:0/2131557893 shutdown_connections 2021-02-12T17:19:48.805 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:48.801+0000 7f695fbcd700 1 -- 172.21.2.102:0/2131557893 wait complete. 2021-02-12T17:19:48.805 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 23 2021-02-12T17:19:48.811 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:19:50.750 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:50.811 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:50.840 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.839+0000 7fe85f519700 1 Processor -- start 2021-02-12T17:19:50.840 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.839+0000 7fe85f519700 1 -- start start 2021-02-12T17:19:50.843 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.839+0000 7fe85f519700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fe85814e530 0x7fe858068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:50.843 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.839+0000 7fe85f519700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8580b7960 con 0x7fe8580b8d20 2021-02-12T17:19:50.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.839+0000 7fe85f519700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8580622a0 con 0x7fe858062740 2021-02-12T17:19:50.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.839+0000 7fe85f519700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe858068d20 con 0x7fe85814e530 2021-02-12T17:19:50.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.839+0000 7fe85d2b5700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fe8580b8d20 0x7fe8580b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55228/0 (socket says 172.21.2.102:55228) 2021-02-12T17:19:50.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.839+0000 7fe85d2b5700 1 -- 172.21.2.102:0/2237186369 learned_addr learned my addr 172.21.2.102:0/2237186369 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:19:50.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 -- 172.21.2.102:0/2237186369 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124230475 0 0) 0x7fe8580b7960 con 0x7fe8580b8d20 2021-02-12T17:19:50.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 -- 172.21.2.102:0/2237186369 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe840003230 con 0x7fe8580b8d20 2021-02-12T17:19:50.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 -- 172.21.2.102:0/2237186369 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 913541454 0 0) 0x7fe840003230 con 0x7fe8580b8d20 2021-02-12T17:19:50.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 -- 172.21.2.102:0/2237186369 >> v2:172.21.2.104:3300/0 conn(0x7fe85814e530 msgr2=0x7fe858068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:50.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe85cab4700 1 --2- 172.21.2.102:0/2237186369 >> v2:172.21.2.104:3300/0 conn(0x7fe85814e530 0x7fe858068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:50.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 --2- 172.21.2.102:0/2237186369 >> v2:172.21.2.104:3300/0 conn(0x7fe85814e530 0x7fe858068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:50.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 -- 172.21.2.102:0/2237186369 >> v1:172.21.2.104:6789/0 conn(0x7fe858062740 legacy=0x7fe858062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:50.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 -- 172.21.2.102:0/2237186369 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85814ea10 con 0x7fe8580b8d20 2021-02-12T17:19:50.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 -- 172.21.2.102:0/2237186369 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fe84c0014e0 con 0x7fe8580b8d20 2021-02-12T17:19:50.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 -- 172.21.2.102:0/2237186369 >> v1:172.21.2.102:6789/0 conn(0x7fe8580b8d20 legacy=0x7fe8580b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:50.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 --2- 172.21.2.102:0/2237186369 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe840003720 0x7fe840003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:50.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 --2- 172.21.2.102:0/2237186369 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8400044d0 0x7fe840004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:50.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 --2- 172.21.2.102:0/2237186369 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe840004e40 0x7fe84000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:50.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 -- 172.21.2.102:0/2237186369 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe858068d20 con 0x7fe8400044d0 2021-02-12T17:19:50.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 -- 172.21.2.102:0/2237186369 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe840004230 con 0x7fe840004e40 2021-02-12T17:19:50.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe84bfff700 1 -- 172.21.2.102:0/2237186369 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84000bc10 con 0x7fe840003720 2021-02-12T17:19:50.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe85cab4700 1 --2- 172.21.2.102:0/2237186369 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8400044d0 0x7fe840004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:50.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.840+0000 7fe85d2b5700 1 --2- 172.21.2.102:0/2237186369 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe840003720 0x7fe840003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:50.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe85cab4700 1 -- 172.21.2.102:0/2237186369 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe840003720 msgr2=0x7fe840003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:50.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe85cab4700 1 --2- 172.21.2.102:0/2237186369 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe840003720 0x7fe840003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:50.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe85cab4700 1 -- 172.21.2.102:0/2237186369 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe840004e40 msgr2=0x7fe84000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:50.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe85cab4700 1 --2- 172.21.2.102:0/2237186369 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe840004e40 0x7fe84000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:50.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe85cab4700 1 -- 172.21.2.102:0/2237186369 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe840003230 con 0x7fe8400044d0 2021-02-12T17:19:50.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe85dab6700 1 -- 172.21.2.102:0/2237186369 reap_dead start 2021-02-12T17:19:50.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe85cab4700 1 --2- 172.21.2.102:0/2237186369 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8400044d0 0x7fe840004950 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fe85400ca20 tx=0x7fe854008040).ready entity=mon.0 client_cookie=b6ec64f458011500 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:50.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe84bfff700 1 -- 172.21.2.102:0/2237186369 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85400a850 con 0x7fe8400044d0 2021-02-12T17:19:50.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe84bfff700 1 -- 172.21.2.102:0/2237186369 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85400c030 con 0x7fe8400044d0 2021-02-12T17:19:50.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe84bfff700 1 -- 172.21.2.102:0/2237186369 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85400abc0 con 0x7fe8400044d0 2021-02-12T17:19:50.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe85f519700 1 -- 172.21.2.102:0/2237186369 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8400044d0 msgr2=0x7fe840004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:50.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe85f519700 1 --2- 172.21.2.102:0/2237186369 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8400044d0 0x7fe840004950 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fe85400ca20 tx=0x7fe854008040).stop 2021-02-12T17:19:50.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe85f519700 1 -- 172.21.2.102:0/2237186369 shutdown_connections 2021-02-12T17:19:50.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe85f519700 1 --2- 172.21.2.102:0/2237186369 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8400044d0 0x7fe840004950 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:50.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe85f519700 1 -- 172.21.2.102:0/2237186369 >> 172.21.2.102:0/2237186369 conn(0x7fe8580bc480 msgr2=0x7fe8580b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:50.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe85f519700 1 -- 172.21.2.102:0/2237186369 shutdown_connections 2021-02-12T17:19:50.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.841+0000 7fe85f519700 1 -- 172.21.2.102:0/2237186369 wait complete. 2021-02-12T17:19:50.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.842+0000 7fe85f519700 1 Processor -- start 2021-02-12T17:19:50.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.842+0000 7fe85f519700 1 -- start start 2021-02-12T17:19:50.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85f519700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8400044d0 0x7fe858150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:50.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85f519700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe858152fa0 0x7fe85815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:50.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85f519700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe858153420 0x7fe85815e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:50.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85f519700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85815d5a0 con 0x7fe858152fa0 2021-02-12T17:19:50.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85f519700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe858152520 con 0x7fe858153420 2021-02-12T17:19:50.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85f519700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8581527c0 con 0x7fe8400044d0 2021-02-12T17:19:50.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85cab4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe858152fa0 0x7fe85815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:50.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85cab4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe858152fa0 0x7fe85815dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46596/0 (socket says 172.21.2.102:46596) 2021-02-12T17:19:50.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85cab4700 1 -- 172.21.2.102:0/3489552619 learned_addr learned my addr 172.21.2.102:0/3489552619 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:50.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85d2b5700 1 --2- 172.21.2.102:0/3489552619 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8400044d0 0x7fe858150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:50.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85cab4700 1 -- 172.21.2.102:0/3489552619 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8400044d0 msgr2=0x7fe858150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:50.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85cab4700 1 --2- 172.21.2.102:0/3489552619 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8400044d0 0x7fe858150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:50.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85cab4700 1 -- 172.21.2.102:0/3489552619 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe858153420 msgr2=0x7fe85815e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:50.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85cab4700 1 --2- 172.21.2.102:0/3489552619 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe858153420 0x7fe85815e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:50.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85cab4700 1 -- 172.21.2.102:0/3489552619 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe858152a60 con 0x7fe858152fa0 2021-02-12T17:19:50.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85d2b5700 1 --2- 172.21.2.102:0/3489552619 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8400044d0 0x7fe858150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:19:50.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85cab4700 1 --2- 172.21.2.102:0/3489552619 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe858152fa0 0x7fe85815dc30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fe85400afd0 tx=0x7fe854008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:50.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe8497fa700 1 -- 172.21.2.102:0/3489552619 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854013e30 con 0x7fe858152fa0 2021-02-12T17:19:50.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe8497fa700 1 -- 172.21.2.102:0/3489552619 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85401d420 con 0x7fe858152fa0 2021-02-12T17:19:50.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85f519700 1 -- 172.21.2.102:0/3489552619 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85815d790 con 0x7fe858152fa0 2021-02-12T17:19:50.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe8497fa700 1 -- 172.21.2.102:0/3489552619 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85401d7e0 con 0x7fe858152fa0 2021-02-12T17:19:50.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.843+0000 7fe85f519700 1 -- 172.21.2.102:0/3489552619 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe858153e60 con 0x7fe858152fa0 2021-02-12T17:19:50.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.844+0000 7fe85f519700 1 -- 172.21.2.102:0/3489552619 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe858045460 con 0x7fe858152fa0 2021-02-12T17:19:50.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.844+0000 7fe8497fa700 1 -- 172.21.2.102:0/3489552619 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fe854024030 con 0x7fe858152fa0 2021-02-12T17:19:50.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.845+0000 7fe8497fa700 1 --2- 172.21.2.102:0/3489552619 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe838059d30 0x7fe83805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:50.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.845+0000 7fe8497fa700 1 -- 172.21.2.102:0/3489552619 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7fe854075380 con 0x7fe858152fa0 2021-02-12T17:19:50.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.845+0000 7fe85d2b5700 1 --2- 172.21.2.102:0/3489552619 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe838059d30 0x7fe83805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:50.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.845+0000 7fe85d2b5700 1 --2- 172.21.2.102:0/3489552619 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe838059d30 0x7fe83805c1f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fe84c005830 tx=0x7fe85814eba0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:50.852 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.848+0000 7fe8497fa700 1 -- 172.21.2.102:0/3489552619 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fe854048ab0 con 0x7fe858152fa0 2021-02-12T17:19:50.901 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.900+0000 7f94e7157700 1 Processor -- start 2021-02-12T17:19:50.901 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.900+0000 7f94e7157700 1 -- start start 2021-02-12T17:19:50.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.900+0000 7f94e7157700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f94e00b8d20 0x7f94e0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:50.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.900+0000 7f94e7157700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94e0062740 0x7f94e0062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:50.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.900+0000 7f94e7157700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00b7960 con 0x7f94e014e530 2021-02-12T17:19:50.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.900+0000 7f94e7157700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e0068d20 con 0x7f94e00b8d20 2021-02-12T17:19:50.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.900+0000 7f94e7157700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00622a0 con 0x7f94e0062740 2021-02-12T17:19:50.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.901+0000 7f94e4ef3700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f94e00b8d20 0x7f94e0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:50.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.901+0000 7f94e4ef3700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f94e00b8d20 0x7f94e0068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46604/0 (socket says 172.21.2.102:46604) 2021-02-12T17:19:50.904 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.901+0000 7f94e4ef3700 1 -- 172.21.2.102:0/2331771470 learned_addr learned my addr 172.21.2.102:0/2331771470 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:50.904 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.901+0000 7f94e4ef3700 1 -- 172.21.2.102:0/2331771470 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94e0062740 msgr2=0x7f94e0062bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:19:50.904 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.901+0000 7f94e4ef3700 1 --2- 172.21.2.102:0/2331771470 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94e0062740 0x7f94e0062bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:50.904 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.901+0000 7f94e4ef3700 1 -- 172.21.2.102:0/2331771470 >> v1:172.21.2.104:6789/0 conn(0x7f94e014e530 legacy=0x7f94e00b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:19:50.904 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.901+0000 7f94e4ef3700 1 -- 172.21.2.102:0/2331771470 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e014ea10 con 0x7f94e00b8d20 2021-02-12T17:19:50.904 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.901+0000 7f94e4ef3700 1 --2- 172.21.2.102:0/2331771470 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94e00b8d20 0x7f94e0068830 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f94c800b9e0 tx=0x7f94c8006ea0).ready entity=mon.0 client_cookie=96737efd17609200 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:50.904 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.901+0000 7f94df7fe700 1 -- 172.21.2.102:0/2331771470 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8009800 con 0x7f94e00b8d20 2021-02-12T17:19:50.904 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.901+0000 7f94df7fe700 1 -- 172.21.2.102:0/2331771470 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c8009960 con 0x7f94e00b8d20 2021-02-12T17:19:50.905 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.901+0000 7f94df7fe700 1 -- 172.21.2.102:0/2331771470 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8009ce0 con 0x7f94e00b8d20 2021-02-12T17:19:50.905 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.902+0000 7f94e7157700 1 -- 172.21.2.102:0/2331771470 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94e00b8d20 msgr2=0x7f94e0068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:50.905 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.902+0000 7f94e7157700 1 --2- 172.21.2.102:0/2331771470 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94e00b8d20 0x7f94e0068830 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f94c800b9e0 tx=0x7f94c8006ea0).stop 2021-02-12T17:19:50.905 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.902+0000 7f94e7157700 1 -- 172.21.2.102:0/2331771470 shutdown_connections 2021-02-12T17:19:50.905 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.902+0000 7f94e7157700 1 --2- 172.21.2.102:0/2331771470 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94e0062740 0x7f94e0062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:50.905 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.902+0000 7f94e7157700 1 --2- 172.21.2.102:0/2331771470 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94e00b8d20 0x7f94e0068830 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:50.905 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.902+0000 7f94e7157700 1 -- 172.21.2.102:0/2331771470 >> 172.21.2.102:0/2331771470 conn(0x7f94e00bc480 msgr2=0x7f94e00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:50.905 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.902+0000 7f94e7157700 1 -- 172.21.2.102:0/2331771470 shutdown_connections 2021-02-12T17:19:50.905 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.902+0000 7f94e7157700 1 -- 172.21.2.102:0/2331771470 wait complete. 2021-02-12T17:19:50.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.903+0000 7f94e7157700 1 Processor -- start 2021-02-12T17:19:50.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.903+0000 7f94e7157700 1 -- start start 2021-02-12T17:19:50.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.903+0000 7f94e7157700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94e0062740 0x7f94e00acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:50.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.903+0000 7f94e7157700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94e00b8d20 0x7f94e00ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:50.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.903+0000 7f94e7157700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f94e014e530 0x7f94e00b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:50.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.903+0000 7f94e7157700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00af760 con 0x7f94e0062740 2021-02-12T17:19:50.907 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.903+0000 7f94e7157700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e015d980 con 0x7f94e014e530 2021-02-12T17:19:50.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.903+0000 7f94e7157700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e015dc20 con 0x7f94e00b8d20 2021-02-12T17:19:50.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.904+0000 7f94e4ef3700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94e0062740 0x7f94e00acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:50.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.904+0000 7f94e4ef3700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94e0062740 0x7f94e00acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46608/0 (socket says 172.21.2.102:46608) 2021-02-12T17:19:50.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.904+0000 7f94e4ef3700 1 -- 172.21.2.102:0/1208770686 learned_addr learned my addr 172.21.2.102:0/1208770686 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:50.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.904+0000 7f94e4ef3700 1 -- 172.21.2.102:0/1208770686 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94e00b8d20 msgr2=0x7f94e00ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:50.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.904+0000 7f94e4ef3700 1 --2- 172.21.2.102:0/1208770686 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94e00b8d20 0x7f94e00ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:50.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.904+0000 7f94e4ef3700 1 -- 172.21.2.102:0/1208770686 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f94e014e530 msgr2=0x7f94e00b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:50.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.904+0000 7f94e4ef3700 1 --2- 172.21.2.102:0/1208770686 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f94e014e530 0x7f94e00b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:50.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.904+0000 7f94e4ef3700 1 -- 172.21.2.102:0/1208770686 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e015dec0 con 0x7f94e0062740 2021-02-12T17:19:50.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.904+0000 7f94e4ef3700 1 --2- 172.21.2.102:0/1208770686 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94e0062740 0x7f94e00acf10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f94c8006ee0 tx=0x7f94c8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:50.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.904+0000 7f94dcff9700 1 -- 172.21.2.102:0/1208770686 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c801c420 con 0x7f94e0062740 2021-02-12T17:19:50.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.904+0000 7f94dcff9700 1 -- 172.21.2.102:0/1208770686 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c801c580 con 0x7f94e0062740 2021-02-12T17:19:50.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.904+0000 7f94e7157700 1 -- 172.21.2.102:0/1208770686 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e015e160 con 0x7f94e0062740 2021-02-12T17:19:50.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.904+0000 7f94dcff9700 1 -- 172.21.2.102:0/1208770686 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c801c920 con 0x7f94e0062740 2021-02-12T17:19:50.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.904+0000 7f94e7157700 1 -- 172.21.2.102:0/1208770686 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e00b4f60 con 0x7f94e0062740 2021-02-12T17:19:50.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.905+0000 7f94e7157700 1 -- 172.21.2.102:0/1208770686 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e00b77a0 con 0x7f94e0062740 2021-02-12T17:19:50.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.905+0000 7f94dcff9700 1 -- 172.21.2.102:0/1208770686 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f94c800f070 con 0x7f94e0062740 2021-02-12T17:19:50.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.905+0000 7f94dcff9700 1 --2- 172.21.2.102:0/1208770686 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f94c4059d30 0x7f94c405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:50.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.905+0000 7f94dcff9700 1 -- 172.21.2.102:0/1208770686 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7f94c8075620 con 0x7f94e0062740 2021-02-12T17:19:50.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.905+0000 7f94dffff700 1 --2- 172.21.2.102:0/1208770686 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f94c4059d30 0x7f94c405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:50.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.906+0000 7f94dffff700 1 --2- 172.21.2.102:0/1208770686 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f94c4059d30 0x7f94c405c1f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f94e0152100 tx=0x7f94d0006900).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:50.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:50.908+0000 7f94dcff9700 1 -- 172.21.2.102:0/1208770686 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f94c8048d50 con 0x7f94e0062740 2021-02-12T17:19:51.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.009+0000 7fe85f519700 1 -- 172.21.2.102:0/3489552619 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe85815d920 con 0x7fe858152fa0 2021-02-12T17:19:51.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.009+0000 7fe8497fa700 1 -- 172.21.2.102:0/3489552619 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3404 (secure 0 0 0) 0x7fe854022090 con 0x7fe858152fa0 2021-02-12T17:19:51.011 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:51.011 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:51.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.011+0000 7fe85f519700 1 -- 172.21.2.102:0/3489552619 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe838059d30 msgr2=0x7fe83805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:51.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.011+0000 7fe85f519700 1 --2- 172.21.2.102:0/3489552619 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe838059d30 0x7fe83805c1f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fe84c005830 tx=0x7fe85814eba0).stop 2021-02-12T17:19:51.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.011+0000 7fe85f519700 1 -- 172.21.2.102:0/3489552619 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe858152fa0 msgr2=0x7fe85815dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:51.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.011+0000 7fe85f519700 1 --2- 172.21.2.102:0/3489552619 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe858152fa0 0x7fe85815dc30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fe85400afd0 tx=0x7fe854008040).stop 2021-02-12T17:19:51.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.011+0000 7fe85f519700 1 -- 172.21.2.102:0/3489552619 shutdown_connections 2021-02-12T17:19:51.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.011+0000 7fe85f519700 1 --2- 172.21.2.102:0/3489552619 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe858153420 0x7fe85815e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:51.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.011+0000 7fe85f519700 1 --2- 172.21.2.102:0/3489552619 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8400044d0 0x7fe858150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:51.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.011+0000 7fe85f519700 1 --2- 172.21.2.102:0/3489552619 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe838059d30 0x7fe83805c1f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:51.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.011+0000 7fe85f519700 1 --2- 172.21.2.102:0/3489552619 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe858152fa0 0x7fe85815dc30 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:51.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.011+0000 7fe85f519700 1 -- 172.21.2.102:0/3489552619 >> 172.21.2.102:0/3489552619 conn(0x7fe8580bc480 msgr2=0x7fe8580b7060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:51.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.011+0000 7fe85f519700 1 -- 172.21.2.102:0/3489552619 shutdown_connections 2021-02-12T17:19:51.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.011+0000 7fe85f519700 1 -- 172.21.2.102:0/3489552619 wait complete. 2021-02-12T17:19:51.013 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 24 2021-02-12T17:19:51.021 INFO:tasks.mds_thrash.fs.[a]:mds.c has gained rank=0, replacing gid=5082 2021-02-12T17:19:51.021 INFO:tasks.mds_thrash.fs.[a]:waiting for 3 secs before reviving mds.a 2021-02-12T17:19:51.070 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.069+0000 7f94e7157700 1 -- 172.21.2.102:0/1208770686 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94e0045460 con 0x7f94e0062740 2021-02-12T17:19:51.071 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.069+0000 7f94dcff9700 1 -- 172.21.2.102:0/1208770686 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3404 (secure 0 0 0) 0x7f94c804c370 con 0x7f94e0062740 2021-02-12T17:19:51.071 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:51.071 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:51.072 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.071+0000 7f94e7157700 1 -- 172.21.2.102:0/1208770686 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f94c4059d30 msgr2=0x7f94c405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:51.072 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.071+0000 7f94e7157700 1 --2- 172.21.2.102:0/1208770686 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f94c4059d30 0x7f94c405c1f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f94e0152100 tx=0x7f94d0006900).stop 2021-02-12T17:19:51.072 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.071+0000 7f94e7157700 1 -- 172.21.2.102:0/1208770686 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94e0062740 msgr2=0x7f94e00acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:51.072 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.071+0000 7f94e7157700 1 --2- 172.21.2.102:0/1208770686 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94e0062740 0x7f94e00acf10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f94c8006ee0 tx=0x7f94c8016000).stop 2021-02-12T17:19:51.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.071+0000 7f94e7157700 1 -- 172.21.2.102:0/1208770686 shutdown_connections 2021-02-12T17:19:51.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.071+0000 7f94e7157700 1 --2- 172.21.2.102:0/1208770686 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f94e014e530 0x7f94e00b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:51.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.071+0000 7f94e7157700 1 --2- 172.21.2.102:0/1208770686 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f94c4059d30 0x7f94c405c1f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:51.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.071+0000 7f94e7157700 1 --2- 172.21.2.102:0/1208770686 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94e0062740 0x7f94e00acf10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:51.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.071+0000 7f94e7157700 1 --2- 172.21.2.102:0/1208770686 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94e00b8d20 0x7f94e00ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:51.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.071+0000 7f94e7157700 1 -- 172.21.2.102:0/1208770686 >> 172.21.2.102:0/1208770686 conn(0x7f94e00bc480 msgr2=0x7f94e00b6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:51.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.071+0000 7f94e7157700 1 -- 172.21.2.102:0/1208770686 shutdown_connections 2021-02-12T17:19:51.073 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:51.071+0000 7f94e7157700 1 -- 172.21.2.102:0/1208770686 wait complete. 2021-02-12T17:19:51.073 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 24 2021-02-12T17:19:51.081 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:19:51.331 INFO:tasks.ceph.mds.c.gibba002.stderr:2021-02-12T17:19:51.330+0000 7fc8bada4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-02-12T17:19:53.082 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:53.171 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.170+0000 7f625d226700 1 Processor -- start 2021-02-12T17:19:53.171 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.170+0000 7f625d226700 1 -- start start 2021-02-12T17:19:53.172 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.171+0000 7f625d226700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f62580b8110 0x7f6258145b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:53.172 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.171+0000 7f625d226700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f62580b98e0 0x7f62580b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:53.172 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.171+0000 7f625d226700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62580b6c10 con 0x7f62580b2120 2021-02-12T17:19:53.172 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.171+0000 7f625d226700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62581463f0 con 0x7f62580b98e0 2021-02-12T17:19:53.172 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.171+0000 7f625d226700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6258146690 con 0x7f62580b8110 2021-02-12T17:19:53.172 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.171+0000 7f625759e700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f62580b98e0 0x7f62580b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:53.172 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.171+0000 7f625759e700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f62580b98e0 0x7f62580b8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46618/0 (socket says 172.21.2.102:46618) 2021-02-12T17:19:53.172 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.171+0000 7f625759e700 1 -- 172.21.2.102:0/2567166248 learned_addr learned my addr 172.21.2.102:0/2567166248 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:53.173 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.171+0000 7f6256d9d700 1 --2- 172.21.2.102:0/2567166248 >> v2:172.21.2.104:3300/0 conn(0x7f62580b8110 0x7f6258145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:53.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.171+0000 7f625759e700 1 -- 172.21.2.102:0/2567166248 >> v2:172.21.2.104:3300/0 conn(0x7f62580b8110 msgr2=0x7f6258145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:53.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.171+0000 7f625759e700 1 --2- 172.21.2.102:0/2567166248 >> v2:172.21.2.104:3300/0 conn(0x7f62580b8110 0x7f6258145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:53.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.171+0000 7f625759e700 1 -- 172.21.2.102:0/2567166248 >> v1:172.21.2.102:6789/0 conn(0x7f62580b2120 legacy=0x7f62580b72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:53.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.171+0000 7f625759e700 1 -- 172.21.2.102:0/2567166248 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258146930 con 0x7f62580b98e0 2021-02-12T17:19:53.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.172+0000 7f625759e700 1 --2- 172.21.2.102:0/2567166248 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f62580b98e0 0x7f62580b8c50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f62580bd2c0 tx=0x7f6250009290).ready entity=mon.0 client_cookie=c32834397c5bddcb server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:53.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.172+0000 7f6255d9b700 1 -- 172.21.2.102:0/2567166248 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625000bbf0 con 0x7f62580b98e0 2021-02-12T17:19:53.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.172+0000 7f6255d9b700 1 -- 172.21.2.102:0/2567166248 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625000bd50 con 0x7f62580b98e0 2021-02-12T17:19:53.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.172+0000 7f6255d9b700 1 -- 172.21.2.102:0/2567166248 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250011610 con 0x7f62580b98e0 2021-02-12T17:19:53.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.172+0000 7f625d226700 1 -- 172.21.2.102:0/2567166248 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f62580b98e0 msgr2=0x7f62580b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:53.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.172+0000 7f625d226700 1 --2- 172.21.2.102:0/2567166248 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f62580b98e0 0x7f62580b8c50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f62580bd2c0 tx=0x7f6250009290).stop 2021-02-12T17:19:53.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.172+0000 7f625d226700 1 -- 172.21.2.102:0/2567166248 shutdown_connections 2021-02-12T17:19:53.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.172+0000 7f625d226700 1 --2- 172.21.2.102:0/2567166248 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f62580b98e0 0x7f62580b8c50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:53.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.172+0000 7f625d226700 1 --2- 172.21.2.102:0/2567166248 >> v2:172.21.2.104:3300/0 conn(0x7f62580b8110 0x7f6258145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:53.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.172+0000 7f625d226700 1 -- 172.21.2.102:0/2567166248 >> 172.21.2.102:0/2567166248 conn(0x7f6258060da0 msgr2=0x7f62580611b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:53.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.172+0000 7f625d226700 1 -- 172.21.2.102:0/2567166248 shutdown_connections 2021-02-12T17:19:53.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.172+0000 7f625d226700 1 -- 172.21.2.102:0/2567166248 wait complete. 2021-02-12T17:19:53.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.173+0000 7f625d226700 1 Processor -- start 2021-02-12T17:19:53.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.173+0000 7f625d226700 1 -- start start 2021-02-12T17:19:53.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625d226700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f62580b2120 0x7f62581470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:53.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625d226700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f62580b8110 0x7f625815d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:53.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625d226700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f62580b98e0 0x7f6258160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:53.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625d226700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62581379d0 con 0x7f62580b8110 2021-02-12T17:19:53.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625d226700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6258148f80 con 0x7f62580b98e0 2021-02-12T17:19:53.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625d226700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6258149220 con 0x7f62580b2120 2021-02-12T17:19:53.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625659c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f62580b8110 0x7f625815d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:53.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625659c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f62580b8110 0x7f625815d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46622/0 (socket says 172.21.2.102:46622) 2021-02-12T17:19:53.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625659c700 1 -- 172.21.2.102:0/3148173165 learned_addr learned my addr 172.21.2.102:0/3148173165 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:53.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625659c700 1 -- 172.21.2.102:0/3148173165 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f62580b2120 msgr2=0x7f62581470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:53.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625659c700 1 --2- 172.21.2.102:0/3148173165 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f62580b2120 0x7f62581470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:53.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625659c700 1 -- 172.21.2.102:0/3148173165 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f62580b98e0 msgr2=0x7f6258160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:53.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625659c700 1 --2- 172.21.2.102:0/3148173165 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f62580b98e0 0x7f6258160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:53.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625659c700 1 -- 172.21.2.102:0/3148173165 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62581494c0 con 0x7f62580b8110 2021-02-12T17:19:53.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625659c700 1 --2- 172.21.2.102:0/3148173165 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f62580b8110 0x7f625815d6f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f624c00c710 tx=0x7f624c007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:53.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f623effd700 1 -- 172.21.2.102:0/3148173165 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c007020 con 0x7f62580b8110 2021-02-12T17:19:53.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f623effd700 1 -- 172.21.2.102:0/3148173165 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c007180 con 0x7f62580b8110 2021-02-12T17:19:53.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f625d226700 1 -- 172.21.2.102:0/3148173165 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625815d250 con 0x7f62580b8110 2021-02-12T17:19:53.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.174+0000 7f623effd700 1 -- 172.21.2.102:0/3148173165 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0064e0 con 0x7f62580b8110 2021-02-12T17:19:53.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.175+0000 7f625d226700 1 -- 172.21.2.102:0/3148173165 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6258147590 con 0x7f62580b8110 2021-02-12T17:19:53.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.175+0000 7f625d226700 1 -- 172.21.2.102:0/3148173165 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625815d3e0 con 0x7f62580b8110 2021-02-12T17:19:53.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.175+0000 7f623effd700 1 -- 172.21.2.102:0/3148173165 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f624c010070 con 0x7f62580b8110 2021-02-12T17:19:53.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.176+0000 7f623effd700 1 --2- 172.21.2.102:0/3148173165 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6238059d30 0x7f623805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:53.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.176+0000 7f623effd700 1 -- 172.21.2.102:0/3148173165 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7f624c073250 con 0x7f62580b8110 2021-02-12T17:19:53.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.176+0000 7f6256d9d700 1 --2- 172.21.2.102:0/3148173165 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6238059d30 0x7f623805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:53.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.176+0000 7f6256d9d700 1 --2- 172.21.2.102:0/3148173165 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6238059d30 0x7f623805c1f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f6248006760 tx=0x7f6248008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:53.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.179+0000 7f623effd700 1 -- 172.21.2.102:0/3148173165 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f624c046870 con 0x7f62580b8110 2021-02-12T17:19:53.336 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.334+0000 7f625d226700 1 -- 172.21.2.102:0/3148173165 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6258045460 con 0x7f62580b8110 2021-02-12T17:19:53.336 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.334+0000 7f623effd700 1 -- 172.21.2.102:0/3148173165 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3404 (secure 0 0 0) 0x7f624c049e90 con 0x7f62580b8110 2021-02-12T17:19:53.336 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:53.337 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:53.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.336+0000 7f625d226700 1 -- 172.21.2.102:0/3148173165 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6238059d30 msgr2=0x7f623805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:53.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.336+0000 7f625d226700 1 --2- 172.21.2.102:0/3148173165 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6238059d30 0x7f623805c1f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f6248006760 tx=0x7f6248008040).stop 2021-02-12T17:19:53.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.336+0000 7f625d226700 1 -- 172.21.2.102:0/3148173165 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f62580b8110 msgr2=0x7f625815d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:53.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.336+0000 7f625d226700 1 --2- 172.21.2.102:0/3148173165 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f62580b8110 0x7f625815d6f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f624c00c710 tx=0x7f624c007c40).stop 2021-02-12T17:19:53.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.336+0000 7f625d226700 1 -- 172.21.2.102:0/3148173165 shutdown_connections 2021-02-12T17:19:53.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.336+0000 7f625d226700 1 --2- 172.21.2.102:0/3148173165 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f62580b98e0 0x7f6258160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:53.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.336+0000 7f625d226700 1 --2- 172.21.2.102:0/3148173165 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f62580b2120 0x7f62581470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:53.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.336+0000 7f625d226700 1 --2- 172.21.2.102:0/3148173165 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6238059d30 0x7f623805c1f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:53.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.336+0000 7f625d226700 1 --2- 172.21.2.102:0/3148173165 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f62580b8110 0x7f625815d6f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:53.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.336+0000 7f625d226700 1 -- 172.21.2.102:0/3148173165 >> 172.21.2.102:0/3148173165 conn(0x7f6258060da0 msgr2=0x7f6258069830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:53.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.336+0000 7f625d226700 1 -- 172.21.2.102:0/3148173165 shutdown_connections 2021-02-12T17:19:53.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:53.336+0000 7f625d226700 1 -- 172.21.2.102:0/3148173165 wait complete. 2021-02-12T17:19:53.339 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 24 2021-02-12T17:19:53.346 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:19:54.023 INFO:tasks.mds_thrash.fs.[a]:reviving mds.a 2021-02-12T17:19:54.023 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-12T17:19:54.023 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-12T17:19:54.027 INFO:tasks.ceph.mds.a:Started 2021-02-12T17:19:54.027 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:54.084 INFO:tasks.ceph.mds.a.gibba002.stdout:starting mds.a at 2021-02-12T17:19:54.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.117+0000 7f2952321700 1 Processor -- start 2021-02-12T17:19:54.118 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.117+0000 7f2952321700 1 -- start start 2021-02-12T17:19:54.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.117+0000 7f2952321700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f294c0b8d20 0x7f294c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:54.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.117+0000 7f2952321700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f294c062740 0x7f294c062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:54.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.117+0000 7f2952321700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294c0b7960 con 0x7f294c14e530 2021-02-12T17:19:54.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.117+0000 7f2952321700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294c068d20 con 0x7f294c0b8d20 2021-02-12T17:19:54.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.117+0000 7f2952321700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0622a0 con 0x7f294c062740 2021-02-12T17:19:54.119 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f294bfff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f294c0b8d20 0x7f294c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:54.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f294bfff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f294c0b8d20 0x7f294c068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46646/0 (socket says 172.21.2.102:46646) 2021-02-12T17:19:54.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f294bfff700 1 -- 172.21.2.102:0/39987946 learned_addr learned my addr 172.21.2.102:0/39987946 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:54.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f294bfff700 1 -- 172.21.2.102:0/39987946 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f294c062740 msgr2=0x7f294c062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:54.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f294bfff700 1 --2- 172.21.2.102:0/39987946 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f294c062740 0x7f294c062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:54.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f294bfff700 1 -- 172.21.2.102:0/39987946 >> v1:172.21.2.104:6789/0 conn(0x7f294c14e530 legacy=0x7f294c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:54.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f294bfff700 1 -- 172.21.2.102:0/39987946 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c14ea10 con 0x7f294c0b8d20 2021-02-12T17:19:54.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f294bfff700 1 --2- 172.21.2.102:0/39987946 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f294c0b8d20 0x7f294c068830 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f293400b9e0 tx=0x7f2934006ea0).ready entity=mon.0 client_cookie=5f19090ecce0b37b server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:54.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f294affd700 1 -- 172.21.2.102:0/39987946 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934009800 con 0x7f294c0b8d20 2021-02-12T17:19:54.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f294affd700 1 -- 172.21.2.102:0/39987946 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2934009960 con 0x7f294c0b8d20 2021-02-12T17:19:54.120 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f294affd700 1 -- 172.21.2.102:0/39987946 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934009ce0 con 0x7f294c0b8d20 2021-02-12T17:19:54.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f2952321700 1 -- 172.21.2.102:0/39987946 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f294c0b8d20 msgr2=0x7f294c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:54.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f2952321700 1 --2- 172.21.2.102:0/39987946 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f294c0b8d20 0x7f294c068830 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f293400b9e0 tx=0x7f2934006ea0).stop 2021-02-12T17:19:54.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f2952321700 1 -- 172.21.2.102:0/39987946 shutdown_connections 2021-02-12T17:19:54.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f2952321700 1 --2- 172.21.2.102:0/39987946 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f294c062740 0x7f294c062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:54.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f2952321700 1 --2- 172.21.2.102:0/39987946 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f294c0b8d20 0x7f294c068830 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:54.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f2952321700 1 -- 172.21.2.102:0/39987946 >> 172.21.2.102:0/39987946 conn(0x7f294c0bc480 msgr2=0x7f294c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:54.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.118+0000 7f2952321700 1 -- 172.21.2.102:0/39987946 shutdown_connections 2021-02-12T17:19:54.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.119+0000 7f2952321700 1 -- 172.21.2.102:0/39987946 wait complete. 2021-02-12T17:19:54.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.119+0000 7f2952321700 1 Processor -- start 2021-02-12T17:19:54.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.119+0000 7f2952321700 1 -- start start 2021-02-12T17:19:54.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f2952321700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f294c062740 0x7f294c1613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:54.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f2952321700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f294c0b8d20 0x7f294c1537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:54.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f2952321700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f294c14e530 0x7f294c14a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:54.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f2952321700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0afa60 con 0x7f294c0b8d20 2021-02-12T17:19:54.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f2952321700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c1618a0 con 0x7f294c062740 2021-02-12T17:19:54.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f2952321700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c15d3d0 con 0x7f294c14e530 2021-02-12T17:19:54.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f294b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f294c0b8d20 0x7f294c1537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:54.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f294b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f294c0b8d20 0x7f294c1537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46648/0 (socket says 172.21.2.102:46648) 2021-02-12T17:19:54.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f294b7fe700 1 -- 172.21.2.102:0/92816348 learned_addr learned my addr 172.21.2.102:0/92816348 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:54.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f294b7fe700 1 -- 172.21.2.102:0/92816348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f294c14e530 msgr2=0x7f294c14a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:54.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f294b7fe700 1 --2- 172.21.2.102:0/92816348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f294c14e530 0x7f294c14a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:54.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f294b7fe700 1 -- 172.21.2.102:0/92816348 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f294c062740 msgr2=0x7f294c1613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:54.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f294b7fe700 1 --2- 172.21.2.102:0/92816348 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f294c062740 0x7f294c1613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:54.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f294b7fe700 1 -- 172.21.2.102:0/92816348 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c0acff0 con 0x7f294c0b8d20 2021-02-12T17:19:54.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f294b7fe700 1 --2- 172.21.2.102:0/92816348 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f294c0b8d20 0x7f294c1537c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f293c009710 tx=0x7f293c006d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:54.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f2943fff700 1 -- 172.21.2.102:0/92816348 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c00d4a0 con 0x7f294c0b8d20 2021-02-12T17:19:54.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f2943fff700 1 -- 172.21.2.102:0/92816348 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c000e90 con 0x7f294c0b8d20 2021-02-12T17:19:54.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f2943fff700 1 -- 172.21.2.102:0/92816348 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c00d870 con 0x7f294c0b8d20 2021-02-12T17:19:54.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f2952321700 1 -- 172.21.2.102:0/92816348 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294c0afc50 con 0x7f294c0b8d20 2021-02-12T17:19:54.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.120+0000 7f2952321700 1 -- 172.21.2.102:0/92816348 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294c0b0430 con 0x7f294c0b8d20 2021-02-12T17:19:54.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.121+0000 7f2952321700 1 -- 172.21.2.102:0/92816348 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294c15d510 con 0x7f294c0b8d20 2021-02-12T17:19:54.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.121+0000 7f2943fff700 1 -- 172.21.2.102:0/92816348 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f293c00f030 con 0x7f294c0b8d20 2021-02-12T17:19:54.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.121+0000 7f2943fff700 1 --2- 172.21.2.102:0/92816348 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2930059d30 0x7f293005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:54.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.122+0000 7f2943fff700 1 -- 172.21.2.102:0/92816348 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7f293c0739b0 con 0x7f294c0b8d20 2021-02-12T17:19:54.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.122+0000 7f294bfff700 1 --2- 172.21.2.102:0/92816348 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2930059d30 0x7f293005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:54.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.122+0000 7f294bfff700 1 --2- 172.21.2.102:0/92816348 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2930059d30 0x7f293005c1f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f294c068c90 tx=0x7f2934016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:54.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.124+0000 7f2943fff700 1 -- 172.21.2.102:0/92816348 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f293c0470e0 con 0x7f294c0b8d20 2021-02-12T17:19:54.284 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.283+0000 7f2952321700 1 -- 172.21.2.102:0/92816348 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f294c045460 con 0x7f294c0b8d20 2021-02-12T17:19:54.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.284+0000 7f2943fff700 1 -- 172.21.2.102:0/92816348 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3404 (secure 0 0 0) 0x7f293c04a700 con 0x7f294c0b8d20 2021-02-12T17:19:54.285 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:54.285 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:54.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.285+0000 7f2952321700 1 -- 172.21.2.102:0/92816348 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2930059d30 msgr2=0x7f293005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:54.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.285+0000 7f2952321700 1 --2- 172.21.2.102:0/92816348 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2930059d30 0x7f293005c1f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f294c068c90 tx=0x7f2934016000).stop 2021-02-12T17:19:54.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.285+0000 7f2952321700 1 -- 172.21.2.102:0/92816348 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f294c0b8d20 msgr2=0x7f294c1537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:54.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.285+0000 7f2952321700 1 --2- 172.21.2.102:0/92816348 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f294c0b8d20 0x7f294c1537c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f293c009710 tx=0x7f293c006d40).stop 2021-02-12T17:19:54.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.285+0000 7f2952321700 1 -- 172.21.2.102:0/92816348 shutdown_connections 2021-02-12T17:19:54.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.285+0000 7f2952321700 1 --2- 172.21.2.102:0/92816348 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f294c14e530 0x7f294c14a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:54.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.285+0000 7f2952321700 1 --2- 172.21.2.102:0/92816348 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f294c062740 0x7f294c1613b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:54.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.285+0000 7f2952321700 1 --2- 172.21.2.102:0/92816348 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2930059d30 0x7f293005c1f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:54.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.285+0000 7f2952321700 1 --2- 172.21.2.102:0/92816348 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f294c0b8d20 0x7f294c1537c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:54.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.285+0000 7f2952321700 1 -- 172.21.2.102:0/92816348 >> 172.21.2.102:0/92816348 conn(0x7f294c0bc480 msgr2=0x7f294c0b8130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:54.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.285+0000 7f2952321700 1 -- 172.21.2.102:0/92816348 shutdown_connections 2021-02-12T17:19:54.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:54.285+0000 7f2952321700 1 -- 172.21.2.102:0/92816348 wait complete. 2021-02-12T17:19:54.288 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 24 2021-02-12T17:19:54.295 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-02-12T17:19:55.347 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:55.435 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.434+0000 7f94cd4f7700 1 Processor -- start 2021-02-12T17:19:55.435 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.434+0000 7f94cd4f7700 1 -- start start 2021-02-12T17:19:55.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.434+0000 7f94cd4f7700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f94c80b8d20 0x7f94c8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:55.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.434+0000 7f94cd4f7700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94c814e530 0x7f94c80b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:55.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.434+0000 7f94cd4f7700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f94c8062740 0x7f94c8062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:55.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.434+0000 7f94cd4f7700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c8068d20 con 0x7f94c8062740 2021-02-12T17:19:55.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.434+0000 7f94cd4f7700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c80622a0 con 0x7f94c80b8d20 2021-02-12T17:19:55.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.434+0000 7f94cd4f7700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c814ea10 con 0x7f94c814e530 2021-02-12T17:19:55.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c77fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f94c8062740 0x7f94c8062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:55.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c77fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f94c8062740 0x7f94c8062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46662/0 (socket says 172.21.2.102:46662) 2021-02-12T17:19:55.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c77fe700 1 -- 172.21.2.102:0/371859939 learned_addr learned my addr 172.21.2.102:0/371859939 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:55.438 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c6ffd700 1 --2- 172.21.2.102:0/371859939 >> v2:172.21.2.104:3300/0 conn(0x7f94c80b8d20 0x7f94c8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:55.438 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c77fe700 1 -- 172.21.2.102:0/371859939 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94c814e530 msgr2=0x7f94c80b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:55.438 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c67fc700 1 --2- 172.21.2.102:0/371859939 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94c814e530 0x7f94c80b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:55.438 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c77fe700 1 --2- 172.21.2.102:0/371859939 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94c814e530 0x7f94c80b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:55.438 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c77fe700 1 -- 172.21.2.102:0/371859939 >> v2:172.21.2.104:3300/0 conn(0x7f94c80b8d20 msgr2=0x7f94c8068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:55.438 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c77fe700 1 --2- 172.21.2.102:0/371859939 >> v2:172.21.2.104:3300/0 conn(0x7f94c80b8d20 0x7f94c8068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:55.438 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c77fe700 1 -- 172.21.2.102:0/371859939 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c80b63f0 con 0x7f94c8062740 2021-02-12T17:19:55.438 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c6ffd700 1 --2- 172.21.2.102:0/371859939 >> v2:172.21.2.104:3300/0 conn(0x7f94c80b8d20 0x7f94c8068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:19:55.438 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c67fc700 1 --2- 172.21.2.102:0/371859939 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94c814e530 0x7f94c80b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:19:55.439 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c77fe700 1 --2- 172.21.2.102:0/371859939 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94c8062740 0x7f94c8062bf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f94c806abc0 tx=0x7f94b0009290).ready entity=mon.0 client_cookie=c27ee5e8a857c6b3 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:55.439 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c5ffb700 1 -- 172.21.2.102:0/371859939 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b000bbf0 con 0x7f94c8062740 2021-02-12T17:19:55.439 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c5ffb700 1 -- 172.21.2.102:0/371859939 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b000bd50 con 0x7f94c8062740 2021-02-12T17:19:55.439 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.435+0000 7f94c5ffb700 1 -- 172.21.2.102:0/371859939 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0011610 con 0x7f94c8062740 2021-02-12T17:19:55.439 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.436+0000 7f94cd4f7700 1 -- 172.21.2.102:0/371859939 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94c8062740 msgr2=0x7f94c8062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:55.439 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.436+0000 7f94cd4f7700 1 --2- 172.21.2.102:0/371859939 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94c8062740 0x7f94c8062bf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f94c806abc0 tx=0x7f94b0009290).stop 2021-02-12T17:19:55.439 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.436+0000 7f94cd4f7700 1 -- 172.21.2.102:0/371859939 shutdown_connections 2021-02-12T17:19:55.439 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.436+0000 7f94cd4f7700 1 --2- 172.21.2.102:0/371859939 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94c8062740 0x7f94c8062bf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:55.440 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.436+0000 7f94cd4f7700 1 --2- 172.21.2.102:0/371859939 >> v2:172.21.2.104:3300/0 conn(0x7f94c80b8d20 0x7f94c8068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:55.440 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.436+0000 7f94cd4f7700 1 --2- 172.21.2.102:0/371859939 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94c814e530 0x7f94c80b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:55.440 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.436+0000 7f94cd4f7700 1 -- 172.21.2.102:0/371859939 >> 172.21.2.102:0/371859939 conn(0x7f94c80bc480 msgr2=0x7f94c80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:55.443 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.436+0000 7f94cd4f7700 1 -- 172.21.2.102:0/371859939 shutdown_connections 2021-02-12T17:19:55.443 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.436+0000 7f94cd4f7700 1 -- 172.21.2.102:0/371859939 wait complete. 2021-02-12T17:19:55.443 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.437+0000 7f94cd4f7700 1 Processor -- start 2021-02-12T17:19:55.443 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.437+0000 7f94cd4f7700 1 -- start start 2021-02-12T17:19:55.443 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94cd4f7700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f94c8062740 0x7f94c80ba240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:55.443 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94cd4f7700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94c80b8d20 0x7f94c815d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:55.443 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94cd4f7700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94c814e530 0x7f94c815da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:55.443 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94cd4f7700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c815df00 con 0x7f94c80b8d20 2021-02-12T17:19:55.443 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94cd4f7700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c813e4b0 con 0x7f94c8062740 2021-02-12T17:19:55.443 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94cd4f7700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c80b0780 con 0x7f94c814e530 2021-02-12T17:19:55.443 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94c67fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94c80b8d20 0x7f94c815d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:55.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94c67fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94c80b8d20 0x7f94c815d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46666/0 (socket says 172.21.2.102:46666) 2021-02-12T17:19:55.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94c67fc700 1 -- 172.21.2.102:0/3619456072 learned_addr learned my addr 172.21.2.102:0/3619456072 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:55.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94c67fc700 1 -- 172.21.2.102:0/3619456072 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94c814e530 msgr2=0x7f94c815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:55.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94c67fc700 1 --2- 172.21.2.102:0/3619456072 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94c814e530 0x7f94c815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:55.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94c67fc700 1 -- 172.21.2.102:0/3619456072 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f94c8062740 msgr2=0x7f94c80ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:55.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94c67fc700 1 --2- 172.21.2.102:0/3619456072 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f94c8062740 0x7f94c80ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:55.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94c67fc700 1 -- 172.21.2.102:0/3619456072 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c80b0a20 con 0x7f94c80b8d20 2021-02-12T17:19:55.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94c67fc700 1 --2- 172.21.2.102:0/3619456072 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94c80b8d20 0x7f94c815d520 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f94b800c920 tx=0x7f94b8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:55.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94beffd700 1 -- 172.21.2.102:0/3619456072 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b800cec0 con 0x7f94c80b8d20 2021-02-12T17:19:55.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94beffd700 1 -- 172.21.2.102:0/3619456072 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b8007740 con 0x7f94c80b8d20 2021-02-12T17:19:55.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94cd4f7700 1 -- 172.21.2.102:0/3619456072 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c80b0cc0 con 0x7f94c80b8d20 2021-02-12T17:19:55.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94beffd700 1 -- 172.21.2.102:0/3619456072 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b8007ac0 con 0x7f94c80b8d20 2021-02-12T17:19:55.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.438+0000 7f94cd4f7700 1 -- 172.21.2.102:0/3619456072 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c80b0fe0 con 0x7f94c80b8d20 2021-02-12T17:19:55.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.439+0000 7f94cd4f7700 1 -- 172.21.2.102:0/3619456072 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c815d240 con 0x7f94c80b8d20 2021-02-12T17:19:55.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.439+0000 7f94beffd700 1 -- 172.21.2.102:0/3619456072 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f94b801b460 con 0x7f94c80b8d20 2021-02-12T17:19:55.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.440+0000 7f94beffd700 1 --2- 172.21.2.102:0/3619456072 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f94a0059d30 0x7f94a005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:55.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.440+0000 7f94beffd700 1 -- 172.21.2.102:0/3619456072 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7f94b8073eb0 con 0x7f94c80b8d20 2021-02-12T17:19:55.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.440+0000 7f94c6ffd700 1 --2- 172.21.2.102:0/3619456072 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f94a0059d30 0x7f94a005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:55.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.440+0000 7f94c6ffd700 1 --2- 172.21.2.102:0/3619456072 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f94a0059d30 0x7f94a005c1f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f94c80af480 tx=0x7f94c0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:55.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.444+0000 7f94beffd700 1 -- 172.21.2.102:0/3619456072 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f94b8047580 con 0x7f94c80b8d20 2021-02-12T17:19:55.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.602+0000 7f94cd4f7700 1 -- 172.21.2.102:0/3619456072 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94c8045460 con 0x7f94c80b8d20 2021-02-12T17:19:55.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.602+0000 7f94beffd700 1 -- 172.21.2.102:0/3619456072 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3404 (secure 0 0 0) 0x7f94b804aba0 con 0x7f94c80b8d20 2021-02-12T17:19:55.604 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:55.604 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:55.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.604+0000 7f94cd4f7700 1 -- 172.21.2.102:0/3619456072 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f94a0059d30 msgr2=0x7f94a005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:55.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.604+0000 7f94cd4f7700 1 --2- 172.21.2.102:0/3619456072 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f94a0059d30 0x7f94a005c1f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f94c80af480 tx=0x7f94c0008040).stop 2021-02-12T17:19:55.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.604+0000 7f94cd4f7700 1 -- 172.21.2.102:0/3619456072 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94c80b8d20 msgr2=0x7f94c815d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:55.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.604+0000 7f94cd4f7700 1 --2- 172.21.2.102:0/3619456072 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94c80b8d20 0x7f94c815d520 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f94b800c920 tx=0x7f94b8008040).stop 2021-02-12T17:19:55.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.604+0000 7f94cd4f7700 1 -- 172.21.2.102:0/3619456072 shutdown_connections 2021-02-12T17:19:55.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.604+0000 7f94cd4f7700 1 --2- 172.21.2.102:0/3619456072 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94c814e530 0x7f94c815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:55.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.604+0000 7f94cd4f7700 1 --2- 172.21.2.102:0/3619456072 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f94c8062740 0x7f94c80ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:55.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.604+0000 7f94cd4f7700 1 --2- 172.21.2.102:0/3619456072 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f94a0059d30 0x7f94a005c1f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:55.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.604+0000 7f94cd4f7700 1 --2- 172.21.2.102:0/3619456072 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94c80b8d20 0x7f94c815d520 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:55.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.604+0000 7f94cd4f7700 1 -- 172.21.2.102:0/3619456072 >> 172.21.2.102:0/3619456072 conn(0x7f94c80bc480 msgr2=0x7f94c8062b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:55.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.604+0000 7f94cd4f7700 1 -- 172.21.2.102:0/3619456072 shutdown_connections 2021-02-12T17:19:55.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:55.604+0000 7f94cd4f7700 1 -- 172.21.2.102:0/3619456072 wait complete. 2021-02-12T17:19:55.606 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 24 2021-02-12T17:19:55.614 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:19:56.296 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:56.386 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.385+0000 7f1cad33e700 1 Processor -- start 2021-02-12T17:19:56.386 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.385+0000 7f1cad33e700 1 -- start start 2021-02-12T17:19:56.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.385+0000 7f1cad33e700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f1ca80b9f90 0x7f1ca80b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:56.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.386+0000 7f1cad33e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1ca8147f70 0x7f1ca80659e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:56.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.386+0000 7f1cad33e700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca8148400 con 0x7f1ca80ba7a0 2021-02-12T17:19:56.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.386+0000 7f1cad33e700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca80b4290 con 0x7f1ca80b9f90 2021-02-12T17:19:56.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.386+0000 7f1cad33e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca80b4530 con 0x7f1ca8147f70 2021-02-12T17:19:56.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.386+0000 7f1ca77fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1ca8147f70 0x7f1ca80659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:56.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.386+0000 7f1ca67fc700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f1ca80b9f90 0x7f1ca80b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:56.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.386+0000 7f1ca6ffd700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f1ca80ba7a0 0x7f1ca80b9880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:37686/0 (socket says 172.21.2.102:37686) 2021-02-12T17:19:56.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.386+0000 7f1ca6ffd700 1 -- 172.21.2.102:0/2186042499 learned_addr learned my addr 172.21.2.102:0/2186042499 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:19:56.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.386+0000 7f1ca77fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1ca8147f70 0x7f1ca80659e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.102:48826/0 (socket says 172.21.2.102:48826) 2021-02-12T17:19:56.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1ca77fe700 1 -- 172.21.2.102:0/2186042499 >> v2:172.21.2.104:3300/0 conn(0x7f1ca80b9f90 msgr2=0x7f1ca80b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:56.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1ca77fe700 1 --2- 172.21.2.102:0/2186042499 >> v2:172.21.2.104:3300/0 conn(0x7f1ca80b9f90 0x7f1ca80b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:56.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1ca77fe700 1 -- 172.21.2.102:0/2186042499 >> v1:172.21.2.104:6789/0 conn(0x7f1ca80ba7a0 legacy=0x7f1ca80b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:56.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1ca77fe700 1 -- 172.21.2.102:0/2186042499 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca80652a0 con 0x7f1ca8147f70 2021-02-12T17:19:56.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1ca67fc700 1 --2- 172.21.2.102:0/2186042499 >> v2:172.21.2.104:3300/0 conn(0x7f1ca80b9f90 0x7f1ca80b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:19:56.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1ca77fe700 1 --2- 172.21.2.102:0/2186042499 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1ca8147f70 0x7f1ca80659e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f1ca0009c90 tx=0x7f1ca00091d0).ready entity=mon.2 client_cookie=ad2c0fd99adba031 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:56.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1ca5ffb700 1 -- 172.21.2.102:0/2186042499 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca000b9e0 con 0x7f1ca8147f70 2021-02-12T17:19:56.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1ca5ffb700 1 -- 172.21.2.102:0/2186042499 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca000bb40 con 0x7f1ca8147f70 2021-02-12T17:19:56.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1ca5ffb700 1 -- 172.21.2.102:0/2186042499 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0011400 con 0x7f1ca8147f70 2021-02-12T17:19:56.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1cad33e700 1 -- 172.21.2.102:0/2186042499 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1ca8147f70 msgr2=0x7f1ca80659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:56.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1cad33e700 1 --2- 172.21.2.102:0/2186042499 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1ca8147f70 0x7f1ca80659e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f1ca0009c90 tx=0x7f1ca00091d0).stop 2021-02-12T17:19:56.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1cad33e700 1 -- 172.21.2.102:0/2186042499 shutdown_connections 2021-02-12T17:19:56.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1cad33e700 1 --2- 172.21.2.102:0/2186042499 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1ca8147f70 0x7f1ca80659e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:56.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1cad33e700 1 --2- 172.21.2.102:0/2186042499 >> v2:172.21.2.104:3300/0 conn(0x7f1ca80b9f90 0x7f1ca80b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:56.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1cad33e700 1 -- 172.21.2.102:0/2186042499 >> 172.21.2.102:0/2186042499 conn(0x7f1ca8069830 msgr2=0x7f1ca8069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:56.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1cad33e700 1 -- 172.21.2.102:0/2186042499 shutdown_connections 2021-02-12T17:19:56.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.387+0000 7f1cad33e700 1 -- 172.21.2.102:0/2186042499 wait complete. 2021-02-12T17:19:56.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.388+0000 7f1cad33e700 1 Processor -- start 2021-02-12T17:19:56.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.388+0000 7f1cad33e700 1 -- start start 2021-02-12T17:19:56.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1cad33e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1ca80b9f90 0x7f1ca8151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:56.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1cad33e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1ca80ba7a0 0x7f1ca814f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:56.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1cad33e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1ca8147f70 0x7f1ca814f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:56.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1cad33e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca8063df0 con 0x7f1ca80ba7a0 2021-02-12T17:19:56.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1cad33e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca80bd0a0 con 0x7f1ca8147f70 2021-02-12T17:19:56.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1cad33e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca814fd40 con 0x7f1ca80b9f90 2021-02-12T17:19:56.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1ca67fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1ca80ba7a0 0x7f1ca814f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:56.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1ca67fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1ca80ba7a0 0x7f1ca814f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46682/0 (socket says 172.21.2.102:46682) 2021-02-12T17:19:56.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1ca67fc700 1 -- 172.21.2.102:0/3220566944 learned_addr learned my addr 172.21.2.102:0/3220566944 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:56.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1ca77fe700 1 --2- 172.21.2.102:0/3220566944 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1ca8147f70 0x7f1ca814f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:56.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1ca6ffd700 1 --2- 172.21.2.102:0/3220566944 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1ca80b9f90 0x7f1ca8151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:56.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1ca67fc700 1 -- 172.21.2.102:0/3220566944 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1ca80b9f90 msgr2=0x7f1ca8151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:56.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1ca67fc700 1 --2- 172.21.2.102:0/3220566944 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1ca80b9f90 0x7f1ca8151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:56.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1ca67fc700 1 -- 172.21.2.102:0/3220566944 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1ca8147f70 msgr2=0x7f1ca814f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:56.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1ca67fc700 1 --2- 172.21.2.102:0/3220566944 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1ca8147f70 0x7f1ca814f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:56.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.389+0000 7f1ca67fc700 1 -- 172.21.2.102:0/3220566944 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca80bc620 con 0x7f1ca80ba7a0 2021-02-12T17:19:56.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.390+0000 7f1ca67fc700 1 --2- 172.21.2.102:0/3220566944 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1ca80ba7a0 0x7f1ca814f360 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f1c9c00ef50 tx=0x7f1c9c006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:56.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.390+0000 7f1c8effd700 1 -- 172.21.2.102:0/3220566944 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c00cab0 con 0x7f1ca80ba7a0 2021-02-12T17:19:56.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.390+0000 7f1c8effd700 1 -- 172.21.2.102:0/3220566944 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c00cc10 con 0x7f1ca80ba7a0 2021-02-12T17:19:56.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.390+0000 7f1c8effd700 1 -- 172.21.2.102:0/3220566944 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0123f0 con 0x7f1ca80ba7a0 2021-02-12T17:19:56.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.390+0000 7f1cad33e700 1 -- 172.21.2.102:0/3220566944 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca80bc8c0 con 0x7f1ca80ba7a0 2021-02-12T17:19:56.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.390+0000 7f1cad33e700 1 -- 172.21.2.102:0/3220566944 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca80bce00 con 0x7f1ca80ba7a0 2021-02-12T17:19:56.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.391+0000 7f1cad33e700 1 -- 172.21.2.102:0/3220566944 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca814f0a0 con 0x7f1ca80ba7a0 2021-02-12T17:19:56.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.391+0000 7f1c8effd700 1 -- 172.21.2.102:0/3220566944 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f1c9c012760 con 0x7f1ca80ba7a0 2021-02-12T17:19:56.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.391+0000 7f1c8effd700 1 --2- 172.21.2.102:0/3220566944 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1c88059d30 0x7f1c8805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:56.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.391+0000 7f1c8effd700 1 -- 172.21.2.102:0/3220566944 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7f1c9c0742e0 con 0x7f1ca80ba7a0 2021-02-12T17:19:56.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.391+0000 7f1ca6ffd700 1 --2- 172.21.2.102:0/3220566944 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1c88059d30 0x7f1c8805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:56.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.391+0000 7f1ca6ffd700 1 --2- 172.21.2.102:0/3220566944 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1c88059d30 0x7f1c8805c1f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f1c980045d0 tx=0x7f1c98007b70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:56.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.394+0000 7f1c8effd700 1 -- 172.21.2.102:0/3220566944 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f1ca814f0a0 con 0x7f1ca80ba7a0 2021-02-12T17:19:56.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.553+0000 7f1cad33e700 1 -- 172.21.2.102:0/3220566944 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ca814f0a0 con 0x7f1ca80ba7a0 2021-02-12T17:19:56.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.553+0000 7f1c8effd700 1 -- 172.21.2.102:0/3220566944 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3404 (secure 0 0 0) 0x7f1ca814f0a0 con 0x7f1ca80ba7a0 2021-02-12T17:19:56.554 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:56.555 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:56.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.554+0000 7f1cad33e700 1 -- 172.21.2.102:0/3220566944 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1c88059d30 msgr2=0x7f1c8805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:56.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.554+0000 7f1cad33e700 1 --2- 172.21.2.102:0/3220566944 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1c88059d30 0x7f1c8805c1f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f1c980045d0 tx=0x7f1c98007b70).stop 2021-02-12T17:19:56.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.555+0000 7f1cad33e700 1 -- 172.21.2.102:0/3220566944 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1ca80ba7a0 msgr2=0x7f1ca814f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:56.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.555+0000 7f1cad33e700 1 --2- 172.21.2.102:0/3220566944 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1ca80ba7a0 0x7f1ca814f360 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f1c9c00ef50 tx=0x7f1c9c006de0).stop 2021-02-12T17:19:56.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.555+0000 7f1cad33e700 1 -- 172.21.2.102:0/3220566944 shutdown_connections 2021-02-12T17:19:56.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.555+0000 7f1cad33e700 1 --2- 172.21.2.102:0/3220566944 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1ca8147f70 0x7f1ca814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:56.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.555+0000 7f1cad33e700 1 --2- 172.21.2.102:0/3220566944 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1ca80b9f90 0x7f1ca8151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:56.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.555+0000 7f1cad33e700 1 --2- 172.21.2.102:0/3220566944 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1c88059d30 0x7f1c8805c1f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:56.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.555+0000 7f1cad33e700 1 --2- 172.21.2.102:0/3220566944 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1ca80ba7a0 0x7f1ca814f360 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:56.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.555+0000 7f1cad33e700 1 -- 172.21.2.102:0/3220566944 >> 172.21.2.102:0/3220566944 conn(0x7f1ca8069830 msgr2=0x7f1ca8069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:56.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.555+0000 7f1cad33e700 1 -- 172.21.2.102:0/3220566944 shutdown_connections 2021-02-12T17:19:56.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:56.555+0000 7f1cad33e700 1 -- 172.21.2.102:0/3220566944 wait complete. 2021-02-12T17:19:56.557 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 24 2021-02-12T17:19:56.564 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-02-12T17:19:57.615 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:57.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.702+0000 7f1ca4579700 1 Processor -- start 2021-02-12T17:19:57.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.702+0000 7f1ca4579700 1 -- start start 2021-02-12T17:19:57.705 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.702+0000 7f1ca4579700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f1c9c0b8d20 0x7f1c9c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:57.705 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.702+0000 7f1ca4579700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9c0b7960 con 0x7f1c9c14e530 2021-02-12T17:19:57.705 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.702+0000 7f1ca4579700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9c0622a0 con 0x7f1c9c062740 2021-02-12T17:19:57.705 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.702+0000 7f1ca4579700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9c068d20 con 0x7f1c9c0b8d20 2021-02-12T17:19:57.705 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.702+0000 7f1ca2315700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f1c9c0b8d20 0x7f1c9c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:57.705 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.702+0000 7f1ca1b14700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f1c9c14e530 0x7f1c9c0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55334/0 (socket says 172.21.2.102:55334) 2021-02-12T17:19:57.705 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.702+0000 7f1ca1b14700 1 -- 172.21.2.102:0/2301339389 learned_addr learned my addr 172.21.2.102:0/2301339389 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:19:57.705 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.703+0000 7f1ca1313700 1 -- 172.21.2.102:0/2301339389 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131741891 0 0) 0x7f1c9c0b7960 con 0x7f1c9c14e530 2021-02-12T17:19:57.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.703+0000 7f1ca1313700 1 -- 172.21.2.102:0/2301339389 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c84003230 con 0x7f1c9c14e530 2021-02-12T17:19:57.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.703+0000 7f1ca2315700 1 -- 172.21.2.102:0/2301339389 >> v1:172.21.2.104:6789/0 conn(0x7f1c9c062740 legacy=0x7f1c9c062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:57.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.703+0000 7f1ca2315700 1 -- 172.21.2.102:0/2301339389 >> v1:172.21.2.102:6789/0 conn(0x7f1c9c14e530 legacy=0x7f1c9c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:57.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.703+0000 7f1ca2315700 1 -- 172.21.2.102:0/2301339389 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c14ea10 con 0x7f1c9c0b8d20 2021-02-12T17:19:57.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.703+0000 7f1ca2315700 1 --2- 172.21.2.102:0/2301339389 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1c9c0b8d20 0x7f1c9c068830 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f1c9000b980 tx=0x7f1c90006de0).ready entity=mon.0 client_cookie=d5f39fcc033500eb server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:57.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.703+0000 7f1ca1313700 1 -- 172.21.2.102:0/2301339389 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9000be70 con 0x7f1c9c0b8d20 2021-02-12T17:19:57.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.703+0000 7f1ca1313700 1 -- 172.21.2.102:0/2301339389 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c900097e0 con 0x7f1c9c0b8d20 2021-02-12T17:19:57.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.703+0000 7f1ca1313700 1 -- 172.21.2.102:0/2301339389 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90009b60 con 0x7f1c9c0b8d20 2021-02-12T17:19:57.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.704+0000 7f1ca4579700 1 -- 172.21.2.102:0/2301339389 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1c9c0b8d20 msgr2=0x7f1c9c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:57.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.704+0000 7f1ca4579700 1 --2- 172.21.2.102:0/2301339389 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1c9c0b8d20 0x7f1c9c068830 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f1c9000b980 tx=0x7f1c90006de0).stop 2021-02-12T17:19:57.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.704+0000 7f1ca4579700 1 -- 172.21.2.102:0/2301339389 shutdown_connections 2021-02-12T17:19:57.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.704+0000 7f1ca4579700 1 --2- 172.21.2.102:0/2301339389 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1c9c0b8d20 0x7f1c9c068830 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:57.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.704+0000 7f1ca4579700 1 -- 172.21.2.102:0/2301339389 >> 172.21.2.102:0/2301339389 conn(0x7f1c9c0bc480 msgr2=0x7f1c9c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:57.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.704+0000 7f1ca4579700 1 -- 172.21.2.102:0/2301339389 shutdown_connections 2021-02-12T17:19:57.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.704+0000 7f1ca4579700 1 -- 172.21.2.102:0/2301339389 wait complete. 2021-02-12T17:19:57.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.705+0000 7f1ca4579700 1 Processor -- start 2021-02-12T17:19:57.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.705+0000 7f1ca4579700 1 -- start start 2021-02-12T17:19:57.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.705+0000 7f1ca4579700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1c9c062740 0x7f1c9c0afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:57.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.705+0000 7f1ca4579700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1c9c0b8d20 0x7f1c9c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:57.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.705+0000 7f1ca4579700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1c9c14e530 0x7f1c9c0ba240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:57.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.705+0000 7f1ca4579700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c0b5830 con 0x7f1c9c062740 2021-02-12T17:19:57.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.705+0000 7f1ca4579700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c15d290 con 0x7f1c9c0b8d20 2021-02-12T17:19:57.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.705+0000 7f1ca4579700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c062f70 con 0x7f1c9c14e530 2021-02-12T17:19:57.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.705+0000 7f1ca2315700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1c9c062740 0x7f1c9c0afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:57.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.705+0000 7f1ca2315700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1c9c062740 0x7f1c9c0afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46694/0 (socket says 172.21.2.102:46694) 2021-02-12T17:19:57.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.705+0000 7f1ca2315700 1 -- 172.21.2.102:0/2505250412 learned_addr learned my addr 172.21.2.102:0/2505250412 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:57.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.706+0000 7f1ca2315700 1 -- 172.21.2.102:0/2505250412 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1c9c14e530 msgr2=0x7f1c9c0ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:57.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.706+0000 7f1ca2315700 1 --2- 172.21.2.102:0/2505250412 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1c9c14e530 0x7f1c9c0ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:57.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.706+0000 7f1ca2315700 1 -- 172.21.2.102:0/2505250412 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1c9c0b8d20 msgr2=0x7f1c9c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:57.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.706+0000 7f1ca2315700 1 --2- 172.21.2.102:0/2505250412 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1c9c0b8d20 0x7f1c9c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:57.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.706+0000 7f1ca2315700 1 -- 172.21.2.102:0/2505250412 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c0b04a0 con 0x7f1c9c062740 2021-02-12T17:19:57.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.706+0000 7f1ca2315700 1 --2- 172.21.2.102:0/2505250412 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1c9c062740 0x7f1c9c0afe00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f1c90009340 tx=0x7f1c90016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:57.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.706+0000 7f1c8e7fc700 1 -- 172.21.2.102:0/2505250412 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90011bc0 con 0x7f1c9c062740 2021-02-12T17:19:57.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.706+0000 7f1c8e7fc700 1 -- 172.21.2.102:0/2505250412 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c90011d20 con 0x7f1c9c062740 2021-02-12T17:19:57.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.706+0000 7f1ca4579700 1 -- 172.21.2.102:0/2505250412 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9c0b0740 con 0x7f1c9c062740 2021-02-12T17:19:57.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.706+0000 7f1c8e7fc700 1 -- 172.21.2.102:0/2505250412 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9001c630 con 0x7f1c9c062740 2021-02-12T17:19:57.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.706+0000 7f1ca4579700 1 -- 172.21.2.102:0/2505250412 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9c15d780 con 0x7f1c9c062740 2021-02-12T17:19:57.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.707+0000 7f1ca4579700 1 -- 172.21.2.102:0/2505250412 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c045460 con 0x7f1c9c062740 2021-02-12T17:19:57.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.707+0000 7f1c8e7fc700 1 -- 172.21.2.102:0/2505250412 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f1c9000f070 con 0x7f1c9c062740 2021-02-12T17:19:57.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.707+0000 7f1c8e7fc700 1 --2- 172.21.2.102:0/2505250412 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1c7c059d80 0x7f1c7c05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:57.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.707+0000 7f1c8e7fc700 1 -- 172.21.2.102:0/2505250412 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7f1c90074f60 con 0x7f1c9c062740 2021-02-12T17:19:57.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.707+0000 7f1ca1b14700 1 --2- 172.21.2.102:0/2505250412 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1c7c059d80 0x7f1c7c05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:57.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.708+0000 7f1ca1b14700 1 --2- 172.21.2.102:0/2505250412 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1c7c059d80 0x7f1c7c05c240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f1c98005590 tx=0x7f1c98007690).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:57.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.710+0000 7f1c8e7fc700 1 -- 172.21.2.102:0/2505250412 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f1c90048580 con 0x7f1c9c062740 2021-02-12T17:19:57.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.867+0000 7f1ca4579700 1 -- 172.21.2.102:0/2505250412 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c9c063670 con 0x7f1c9c062740 2021-02-12T17:19:57.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.868+0000 7f1c8e7fc700 1 -- 172.21.2.102:0/2505250412 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3404 (secure 0 0 0) 0x7f1c9004bba0 con 0x7f1c9c062740 2021-02-12T17:19:57.869 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:57.869 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:57.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.869+0000 7f1ca4579700 1 -- 172.21.2.102:0/2505250412 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1c7c059d80 msgr2=0x7f1c7c05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:57.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.869+0000 7f1ca4579700 1 --2- 172.21.2.102:0/2505250412 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1c7c059d80 0x7f1c7c05c240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f1c98005590 tx=0x7f1c98007690).stop 2021-02-12T17:19:57.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.869+0000 7f1ca4579700 1 -- 172.21.2.102:0/2505250412 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1c9c062740 msgr2=0x7f1c9c0afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:57.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.869+0000 7f1ca4579700 1 --2- 172.21.2.102:0/2505250412 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1c9c062740 0x7f1c9c0afe00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f1c90009340 tx=0x7f1c90016000).stop 2021-02-12T17:19:57.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.869+0000 7f1ca4579700 1 -- 172.21.2.102:0/2505250412 shutdown_connections 2021-02-12T17:19:57.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.869+0000 7f1ca4579700 1 --2- 172.21.2.102:0/2505250412 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1c9c14e530 0x7f1c9c0ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:57.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.869+0000 7f1ca4579700 1 --2- 172.21.2.102:0/2505250412 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1c7c059d80 0x7f1c7c05c240 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:57.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.869+0000 7f1ca4579700 1 --2- 172.21.2.102:0/2505250412 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1c9c062740 0x7f1c9c0afe00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:57.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.869+0000 7f1ca4579700 1 --2- 172.21.2.102:0/2505250412 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1c9c0b8d20 0x7f1c9c0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:57.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.869+0000 7f1ca4579700 1 -- 172.21.2.102:0/2505250412 >> 172.21.2.102:0/2505250412 conn(0x7f1c9c0bc480 msgr2=0x7f1c9c14cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:57.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.869+0000 7f1ca4579700 1 -- 172.21.2.102:0/2505250412 shutdown_connections 2021-02-12T17:19:57.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:57.869+0000 7f1ca4579700 1 -- 172.21.2.102:0/2505250412 wait complete. 2021-02-12T17:19:57.871 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 24 2021-02-12T17:19:57.879 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:19:58.565 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:58.652 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.650+0000 7f5df7f63700 1 Processor -- start 2021-02-12T17:19:58.652 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.651+0000 7f5df7f63700 1 -- start start 2021-02-12T17:19:58.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.651+0000 7f5df7f63700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f5df00b8d20 0x7f5df0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:58.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.651+0000 7f5df7f63700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f5df014e530 0x7f5df00b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:58.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.651+0000 7f5df7f63700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5df0062740 0x7f5df0062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:58.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.651+0000 7f5df7f63700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df0068d20 con 0x7f5df00b8d20 2021-02-12T17:19:58.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.651+0000 7f5df7f63700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df00622a0 con 0x7f5df014e530 2021-02-12T17:19:58.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.651+0000 7f5df7f63700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df014ea10 con 0x7f5df0062740 2021-02-12T17:19:58.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.651+0000 7f5df5cff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f5df00b8d20 0x7f5df0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:58.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.651+0000 7f5df5cff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f5df00b8d20 0x7f5df0068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46706/0 (socket says 172.21.2.102:46706) 2021-02-12T17:19:58.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.651+0000 7f5df5cff700 1 -- 172.21.2.102:0/3738904325 learned_addr learned my addr 172.21.2.102:0/3738904325 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:58.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.652+0000 7f5df5cff700 1 -- 172.21.2.102:0/3738904325 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5df0062740 msgr2=0x7f5df0062bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:19:58.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.652+0000 7f5df5cff700 1 --2- 172.21.2.102:0/3738904325 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5df0062740 0x7f5df0062bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:58.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.652+0000 7f5df5cff700 1 -- 172.21.2.102:0/3738904325 >> v2:172.21.2.104:3300/0 conn(0x7f5df014e530 msgr2=0x7f5df00b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:19:58.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.652+0000 7f5df5cff700 1 --2- 172.21.2.102:0/3738904325 >> v2:172.21.2.104:3300/0 conn(0x7f5df014e530 0x7f5df00b7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:58.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.652+0000 7f5df5cff700 1 -- 172.21.2.102:0/3738904325 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00b63f0 con 0x7f5df00b8d20 2021-02-12T17:19:58.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.652+0000 7f5df5cff700 1 --2- 172.21.2.102:0/3738904325 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5df00b8d20 0x7f5df0068830 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f5df00654b0 tx=0x7f5dec006ea0).ready entity=mon.0 client_cookie=4e7ba85cf6e798fc server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:58.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.652+0000 7f5df4cfd700 1 -- 172.21.2.102:0/3738904325 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec009840 con 0x7f5df00b8d20 2021-02-12T17:19:58.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.652+0000 7f5df4cfd700 1 -- 172.21.2.102:0/3738904325 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec0099a0 con 0x7f5df00b8d20 2021-02-12T17:19:58.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.652+0000 7f5df4cfd700 1 -- 172.21.2.102:0/3738904325 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec009d20 con 0x7f5df00b8d20 2021-02-12T17:19:58.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.652+0000 7f5df7f63700 1 -- 172.21.2.102:0/3738904325 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5df00b8d20 msgr2=0x7f5df0068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:58.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.652+0000 7f5df7f63700 1 --2- 172.21.2.102:0/3738904325 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5df00b8d20 0x7f5df0068830 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f5df00654b0 tx=0x7f5dec006ea0).stop 2021-02-12T17:19:58.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.653+0000 7f5df7f63700 1 -- 172.21.2.102:0/3738904325 shutdown_connections 2021-02-12T17:19:58.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.653+0000 7f5df7f63700 1 --2- 172.21.2.102:0/3738904325 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5df0062740 0x7f5df0062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:58.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.653+0000 7f5df7f63700 1 --2- 172.21.2.102:0/3738904325 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5df00b8d20 0x7f5df0068830 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:58.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.653+0000 7f5df7f63700 1 --2- 172.21.2.102:0/3738904325 >> v2:172.21.2.104:3300/0 conn(0x7f5df014e530 0x7f5df00b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:58.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.653+0000 7f5df7f63700 1 -- 172.21.2.102:0/3738904325 >> 172.21.2.102:0/3738904325 conn(0x7f5df00bc480 msgr2=0x7f5df00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:58.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.653+0000 7f5df7f63700 1 -- 172.21.2.102:0/3738904325 shutdown_connections 2021-02-12T17:19:58.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.653+0000 7f5df7f63700 1 -- 172.21.2.102:0/3738904325 wait complete. 2021-02-12T17:19:58.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.654+0000 7f5df7f63700 1 Processor -- start 2021-02-12T17:19:58.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.654+0000 7f5df7f63700 1 -- start start 2021-02-12T17:19:58.657 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.654+0000 7f5df7f63700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5df0062740 0x7f5df00b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:58.657 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.654+0000 7f5df7f63700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5df00b8d20 0x7f5df014aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:58.657 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.654+0000 7f5df7f63700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5df014e530 0x7f5df014afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:58.657 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.654+0000 7f5df7f63700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00aee30 con 0x7f5df014e530 2021-02-12T17:19:58.657 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.654+0000 7f5df7f63700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00b4c20 con 0x7f5df0062740 2021-02-12T17:19:58.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.654+0000 7f5df7f63700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00ad820 con 0x7f5df00b8d20 2021-02-12T17:19:58.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.654+0000 7f5df6500700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5df014e530 0x7f5df014afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:58.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.654+0000 7f5df6500700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5df014e530 0x7f5df014afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46712/0 (socket says 172.21.2.102:46712) 2021-02-12T17:19:58.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.654+0000 7f5df6500700 1 -- 172.21.2.102:0/1968219038 learned_addr learned my addr 172.21.2.102:0/1968219038 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:58.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.655+0000 7f5df6500700 1 -- 172.21.2.102:0/1968219038 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5df00b8d20 msgr2=0x7f5df014aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:58.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.655+0000 7f5df6500700 1 --2- 172.21.2.102:0/1968219038 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5df00b8d20 0x7f5df014aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:58.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.655+0000 7f5df6500700 1 -- 172.21.2.102:0/1968219038 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5df0062740 msgr2=0x7f5df00b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:58.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.655+0000 7f5df6500700 1 --2- 172.21.2.102:0/1968219038 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5df0062740 0x7f5df00b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:58.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.655+0000 7f5df6500700 1 -- 172.21.2.102:0/1968219038 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00adac0 con 0x7f5df014e530 2021-02-12T17:19:58.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.655+0000 7f5df6500700 1 --2- 172.21.2.102:0/1968219038 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5df014e530 0x7f5df014afd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f5de800bab0 tx=0x7f5de80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:58.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.655+0000 7f5de1ffb700 1 -- 172.21.2.102:0/1968219038 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de800c7d0 con 0x7f5df014e530 2021-02-12T17:19:58.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.655+0000 7f5de1ffb700 1 -- 172.21.2.102:0/1968219038 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de800c930 con 0x7f5df014e530 2021-02-12T17:19:58.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.655+0000 7f5df7f63700 1 -- 172.21.2.102:0/1968219038 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df00add60 con 0x7f5df014e530 2021-02-12T17:19:58.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.655+0000 7f5de1ffb700 1 -- 172.21.2.102:0/1968219038 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de800cae0 con 0x7f5df014e530 2021-02-12T17:19:58.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.655+0000 7f5df7f63700 1 -- 172.21.2.102:0/1968219038 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df00b1bd0 con 0x7f5df014e530 2021-02-12T17:19:58.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.656+0000 7f5df7f63700 1 -- 172.21.2.102:0/1968219038 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df00b4d90 con 0x7f5df014e530 2021-02-12T17:19:58.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.656+0000 7f5de1ffb700 1 -- 172.21.2.102:0/1968219038 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f5de801c070 con 0x7f5df014e530 2021-02-12T17:19:58.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.657+0000 7f5de1ffb700 1 --2- 172.21.2.102:0/1968219038 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5dd0059d80 0x7f5dd005c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:58.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.657+0000 7f5de1ffb700 1 -- 172.21.2.102:0/1968219038 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7f5de8073550 con 0x7f5df014e530 2021-02-12T17:19:58.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.657+0000 7f5df5cff700 1 --2- 172.21.2.102:0/1968219038 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5dd0059d80 0x7f5dd005c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:58.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.657+0000 7f5df5cff700 1 --2- 172.21.2.102:0/1968219038 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5dd0059d80 0x7f5dd005c240 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f5dec00b190 tx=0x7f5dec016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:58.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.659+0000 7f5de1ffb700 1 -- 172.21.2.102:0/1968219038 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f5df00b4d90 con 0x7f5df014e530 2021-02-12T17:19:58.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.816+0000 7f5df7f63700 1 -- 172.21.2.102:0/1968219038 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5df00b4d90 con 0x7f5df014e530 2021-02-12T17:19:58.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.816+0000 7f5de1ffb700 1 -- 172.21.2.102:0/1968219038 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3754 (secure 0 0 0) 0x7f5df00b4d90 con 0x7f5df014e530 2021-02-12T17:19:58.818 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:19:58.818 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:19:58.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.817+0000 7f5df7f63700 1 -- 172.21.2.102:0/1968219038 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5dd0059d80 msgr2=0x7f5dd005c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:58.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.817+0000 7f5df7f63700 1 --2- 172.21.2.102:0/1968219038 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5dd0059d80 0x7f5dd005c240 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f5dec00b190 tx=0x7f5dec016000).stop 2021-02-12T17:19:58.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.817+0000 7f5df7f63700 1 -- 172.21.2.102:0/1968219038 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5df014e530 msgr2=0x7f5df014afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:58.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.818+0000 7f5df7f63700 1 --2- 172.21.2.102:0/1968219038 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5df014e530 0x7f5df014afd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f5de800bab0 tx=0x7f5de80090f0).stop 2021-02-12T17:19:58.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.818+0000 7f5df7f63700 1 -- 172.21.2.102:0/1968219038 shutdown_connections 2021-02-12T17:19:58.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.818+0000 7f5df7f63700 1 --2- 172.21.2.102:0/1968219038 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5dd0059d80 0x7f5dd005c240 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:58.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.818+0000 7f5df7f63700 1 --2- 172.21.2.102:0/1968219038 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5df014e530 0x7f5df014afd0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:58.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.818+0000 7f5df7f63700 1 --2- 172.21.2.102:0/1968219038 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5df0062740 0x7f5df00b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:58.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.818+0000 7f5df7f63700 1 --2- 172.21.2.102:0/1968219038 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5df00b8d20 0x7f5df014aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:19:58.819 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.818+0000 7f5df7f63700 1 -- 172.21.2.102:0/1968219038 >> 172.21.2.102:0/1968219038 conn(0x7f5df00bc480 msgr2=0x7f5df014bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:58.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.818+0000 7f5df7f63700 1 -- 172.21.2.102:0/1968219038 shutdown_connections 2021-02-12T17:19:58.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:58.818+0000 7f5df7f63700 1 -- 172.21.2.102:0/1968219038 wait complete. 2021-02-12T17:19:58.820 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 25 2021-02-12T17:19:58.827 INFO:tasks.mds_thrash.fs.[a]:mds.a reported in up:standby state 2021-02-12T17:19:58.828 INFO:tasks.mds_thrash.fs.[a]:waiting for 15 secs before thrashing 2021-02-12T17:19:59.880 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:19:59.969 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.968+0000 7f0d89646700 1 Processor -- start 2021-02-12T17:19:59.969 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.968+0000 7f0d89646700 1 -- start start 2021-02-12T17:19:59.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.968+0000 7f0d89646700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f0d84149f00 0x7f0d840b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:59.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.968+0000 7f0d89646700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d84146e30 0x7f0d8412f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:59.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.968+0000 7f0d89646700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8414a440 con 0x7f0d840b96e0 2021-02-12T17:19:59.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.968+0000 7f0d89646700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840ad310 con 0x7f0d84149f00 2021-02-12T17:19:59.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.968+0000 7f0d89646700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8414a6e0 con 0x7f0d84146e30 2021-02-12T17:19:59.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.969+0000 7f0d82ffd700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f0d840b96e0 0x7f0d84062930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:37730/0 (socket says 172.21.2.102:37730) 2021-02-12T17:19:59.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.969+0000 7f0d827fc700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f0d84149f00 0x7f0d840b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:59.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.969+0000 7f0d837fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d84146e30 0x7f0d8412f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:59.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.969+0000 7f0d82ffd700 1 -- 172.21.2.102:0/561703426 learned_addr learned my addr 172.21.2.102:0/561703426 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:19:59.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.969+0000 7f0d81ffb700 1 -- 172.21.2.102:0/561703426 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054263987 0 0) 0x7f0d8414a440 con 0x7f0d840b96e0 2021-02-12T17:19:59.971 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.969+0000 7f0d81ffb700 1 -- 172.21.2.102:0/561703426 --> v1:172.21.2.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d64003230 con 0x7f0d840b96e0 2021-02-12T17:19:59.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.969+0000 7f0d827fc700 1 -- 172.21.2.102:0/561703426 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d84146e30 msgr2=0x7f0d8412f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:19:59.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.969+0000 7f0d827fc700 1 --2- 172.21.2.102:0/561703426 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d84146e30 0x7f0d8412f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:59.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.969+0000 7f0d827fc700 1 -- 172.21.2.102:0/561703426 >> v1:172.21.2.104:6789/0 conn(0x7f0d840b96e0 legacy=0x7f0d84062930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:59.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.969+0000 7f0d827fc700 1 -- 172.21.2.102:0/561703426 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d84061f50 con 0x7f0d84149f00 2021-02-12T17:19:59.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.969+0000 7f0d827fc700 1 --2- 172.21.2.102:0/561703426 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0d84149f00 0x7f0d840b7490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f0d7400b980 tx=0x7f0d74006de0).ready entity=mon.1 client_cookie=4a31ca2a6cd9827d server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:59.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.970+0000 7f0d81ffb700 1 -- 172.21.2.102:0/561703426 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74009650 con 0x7f0d84149f00 2021-02-12T17:19:59.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.970+0000 7f0d81ffb700 1 -- 172.21.2.102:0/561703426 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d740097b0 con 0x7f0d84149f00 2021-02-12T17:19:59.972 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.970+0000 7f0d81ffb700 1 -- 172.21.2.102:0/561703426 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74009b30 con 0x7f0d84149f00 2021-02-12T17:19:59.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.970+0000 7f0d89646700 1 -- 172.21.2.102:0/561703426 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0d84149f00 msgr2=0x7f0d840b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:59.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.970+0000 7f0d89646700 1 --2- 172.21.2.102:0/561703426 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0d84149f00 0x7f0d840b7490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f0d7400b980 tx=0x7f0d74006de0).stop 2021-02-12T17:19:59.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.970+0000 7f0d89646700 1 -- 172.21.2.102:0/561703426 shutdown_connections 2021-02-12T17:19:59.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.970+0000 7f0d89646700 1 --2- 172.21.2.102:0/561703426 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d84146e30 0x7f0d8412f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:59.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.970+0000 7f0d89646700 1 --2- 172.21.2.102:0/561703426 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0d84149f00 0x7f0d840b7490 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:59.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.970+0000 7f0d89646700 1 -- 172.21.2.102:0/561703426 >> 172.21.2.102:0/561703426 conn(0x7f0d840633b0 msgr2=0x7f0d840637c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:19:59.974 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.970+0000 7f0d89646700 1 -- 172.21.2.102:0/561703426 shutdown_connections 2021-02-12T17:19:59.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.970+0000 7f0d89646700 1 -- 172.21.2.102:0/561703426 wait complete. 2021-02-12T17:19:59.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.971+0000 7f0d89646700 1 Processor -- start 2021-02-12T17:19:59.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.971+0000 7f0d89646700 1 -- start start 2021-02-12T17:19:59.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d89646700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d840b96e0 0x7f0d840baae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:59.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d89646700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0d84146e30 0x7f0d8415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:59.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d89646700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d84149f00 0x7f0d8415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:59.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d89646700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8414c130 con 0x7f0d840b96e0 2021-02-12T17:19:59.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d89646700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8415cbf0 con 0x7f0d84146e30 2021-02-12T17:19:59.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d89646700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8414c360 con 0x7f0d84149f00 2021-02-12T17:19:59.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d82ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d840b96e0 0x7f0d840baae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:59.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d82ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d840b96e0 0x7f0d840baae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46722/0 (socket says 172.21.2.102:46722) 2021-02-12T17:19:59.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d82ffd700 1 -- 172.21.2.102:0/3489082788 learned_addr learned my addr 172.21.2.102:0/3489082788 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:19:59.975 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d827fc700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0d84146e30 0x7f0d8415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:59.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d837fe700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d84149f00 0x7f0d8415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:59.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d82ffd700 1 -- 172.21.2.102:0/3489082788 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d84149f00 msgr2=0x7f0d8415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:59.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d82ffd700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d84149f00 0x7f0d8415d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:59.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d82ffd700 1 -- 172.21.2.102:0/3489082788 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0d84146e30 msgr2=0x7f0d8415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:19:59.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d82ffd700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0d84146e30 0x7f0d8415d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:19:59.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d82ffd700 1 -- 172.21.2.102:0/3489082788 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8414c600 con 0x7f0d840b96e0 2021-02-12T17:19:59.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d827fc700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0d84146e30 0x7f0d8415d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:19:59.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.972+0000 7f0d82ffd700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d840b96e0 0x7f0d840baae0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f0d6c00c6e0 tx=0x7f0d6c007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:59.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.973+0000 7f0d7affd700 1 -- 172.21.2.102:0/3489082788 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0072e0 con 0x7f0d840b96e0 2021-02-12T17:19:59.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.973+0000 7f0d7affd700 1 -- 172.21.2.102:0/3489082788 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c007440 con 0x7f0d840b96e0 2021-02-12T17:19:59.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.973+0000 7f0d89646700 1 -- 172.21.2.102:0/3489082788 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8415ce20 con 0x7f0d840b96e0 2021-02-12T17:19:59.976 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.973+0000 7f0d7affd700 1 -- 172.21.2.102:0/3489082788 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0057f0 con 0x7f0d840b96e0 2021-02-12T17:19:59.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.973+0000 7f0d89646700 1 -- 172.21.2.102:0/3489082788 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d84147370 con 0x7f0d840b96e0 2021-02-12T17:19:59.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.973+0000 7f0d89646700 1 -- 172.21.2.102:0/3489082788 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d84045460 con 0x7f0d840b96e0 2021-02-12T17:19:59.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.974+0000 7f0d7affd700 1 -- 172.21.2.102:0/3489082788 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f0d6c010070 con 0x7f0d840b96e0 2021-02-12T17:19:59.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.974+0000 7f0d7affd700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0d68059db0 0x7f0d6805c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:19:59.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.974+0000 7f0d7affd700 1 -- 172.21.2.102:0/3489082788 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7f0d6c0733a0 con 0x7f0d840b96e0 2021-02-12T17:19:59.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.974+0000 7f0d827fc700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0d68059db0 0x7f0d6805c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:19:59.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.975+0000 7f0d827fc700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0d68059db0 0x7f0d6805c270 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f0d8414a370 tx=0x7f0d74016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:19:59.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:19:59.977+0000 7f0d7affd700 1 -- 172.21.2.102:0/3489082788 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f0d6c0469e0 con 0x7f0d840b96e0 2021-02-12T17:20:00.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:00.134+0000 7f0d89646700 1 -- 172.21.2.102:0/3489082788 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d8414c790 con 0x7f0d840b96e0 2021-02-12T17:20:00.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:00.134+0000 7f0d7affd700 1 -- 172.21.2.102:0/3489082788 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3754 (secure 0 0 0) 0x7f0d6c04a000 con 0x7f0d840b96e0 2021-02-12T17:20:00.136 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:00.136 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:00.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:00.135+0000 7f0d89646700 1 -- 172.21.2.102:0/3489082788 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0d68059db0 msgr2=0x7f0d6805c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:00.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:00.135+0000 7f0d89646700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0d68059db0 0x7f0d6805c270 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f0d8414a370 tx=0x7f0d74016000).stop 2021-02-12T17:20:00.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:00.135+0000 7f0d89646700 1 -- 172.21.2.102:0/3489082788 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d840b96e0 msgr2=0x7f0d840baae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:00.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:00.135+0000 7f0d89646700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d840b96e0 0x7f0d840baae0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f0d6c00c6e0 tx=0x7f0d6c007ab0).stop 2021-02-12T17:20:00.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:00.135+0000 7f0d89646700 1 -- 172.21.2.102:0/3489082788 shutdown_connections 2021-02-12T17:20:00.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:00.135+0000 7f0d89646700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0d84149f00 0x7f0d8415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:00.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:00.135+0000 7f0d89646700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0d68059db0 0x7f0d6805c270 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:00.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:00.135+0000 7f0d89646700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0d840b96e0 0x7f0d840baae0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:00.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:00.135+0000 7f0d89646700 1 --2- 172.21.2.102:0/3489082788 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0d84146e30 0x7f0d8415d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:00.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:00.135+0000 7f0d89646700 1 -- 172.21.2.102:0/3489082788 >> 172.21.2.102:0/3489082788 conn(0x7f0d840633b0 msgr2=0x7f0d840bc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:00.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:00.135+0000 7f0d89646700 1 -- 172.21.2.102:0/3489082788 shutdown_connections 2021-02-12T17:20:00.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:00.135+0000 7f0d89646700 1 -- 172.21.2.102:0/3489082788 wait complete. 2021-02-12T17:20:00.138 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 25 2021-02-12T17:20:00.145 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:20:02.147 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:02.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.235+0000 7fbdb0aef700 1 Processor -- start 2021-02-12T17:20:02.236 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.235+0000 7fbdb0aef700 1 -- start start 2021-02-12T17:20:02.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.235+0000 7fbdb0aef700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbdac0b8d20 0x7fbdac068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:02.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.235+0000 7fbdb0aef700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fbdac062740 0x7fbdac062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:02.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.235+0000 7fbdb0aef700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac0b7960 con 0x7fbdac14e530 2021-02-12T17:20:02.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.235+0000 7fbdb0aef700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac068d20 con 0x7fbdac062740 2021-02-12T17:20:02.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.235+0000 7fbdb0aef700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0622a0 con 0x7fbdac0b8d20 2021-02-12T17:20:02.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.236+0000 7fbdaad9d700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fbdac062740 0x7fbdac062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:02.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.236+0000 7fbdaad9d700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fbdac062740 0x7fbdac062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46730/0 (socket says 172.21.2.102:46730) 2021-02-12T17:20:02.237 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.236+0000 7fbdaad9d700 1 -- 172.21.2.102:0/3189478949 learned_addr learned my addr 172.21.2.102:0/3189478949 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.236+0000 7fbdaad9d700 1 -- 172.21.2.102:0/3189478949 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbdac0b8d20 msgr2=0x7fbdac068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.236+0000 7fbdaad9d700 1 --2- 172.21.2.102:0/3189478949 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbdac0b8d20 0x7fbdac068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.236+0000 7fbdaad9d700 1 -- 172.21.2.102:0/3189478949 >> v1:172.21.2.104:6789/0 conn(0x7fbdac14e530 legacy=0x7fbdac0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.236+0000 7fbdaad9d700 1 -- 172.21.2.102:0/3189478949 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac14ea10 con 0x7fbdac062740 2021-02-12T17:20:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.236+0000 7fbdaad9d700 1 --2- 172.21.2.102:0/3189478949 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbdac062740 0x7fbdac062bf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fbda4009d50 tx=0x7fbda4009290).ready entity=mon.0 client_cookie=ead914daf86fdb56 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.236+0000 7fbda959a700 1 -- 172.21.2.102:0/3189478949 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda400bbb0 con 0x7fbdac062740 2021-02-12T17:20:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.236+0000 7fbda959a700 1 -- 172.21.2.102:0/3189478949 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda400bd10 con 0x7fbdac062740 2021-02-12T17:20:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.236+0000 7fbda959a700 1 -- 172.21.2.102:0/3189478949 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4011610 con 0x7fbdac062740 2021-02-12T17:20:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.237+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3189478949 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbdac062740 msgr2=0x7fbdac062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.237+0000 7fbdb0aef700 1 --2- 172.21.2.102:0/3189478949 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbdac062740 0x7fbdac062bf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fbda4009d50 tx=0x7fbda4009290).stop 2021-02-12T17:20:02.239 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.237+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3189478949 shutdown_connections 2021-02-12T17:20:02.240 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.237+0000 7fbdb0aef700 1 --2- 172.21.2.102:0/3189478949 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbdac062740 0x7fbdac062bf0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:02.240 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.237+0000 7fbdb0aef700 1 --2- 172.21.2.102:0/3189478949 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbdac0b8d20 0x7fbdac068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:02.240 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.237+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3189478949 >> 172.21.2.102:0/3189478949 conn(0x7fbdac0bc480 msgr2=0x7fbdac0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:02.240 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.237+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3189478949 shutdown_connections 2021-02-12T17:20:02.240 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.237+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3189478949 wait complete. 2021-02-12T17:20:02.240 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.238+0000 7fbdb0aef700 1 Processor -- start 2021-02-12T17:20:02.241 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.238+0000 7fbdb0aef700 1 -- start start 2021-02-12T17:20:02.241 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.238+0000 7fbdb0aef700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbdac062740 0x7fbdac1610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:02.241 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.238+0000 7fbdb0aef700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbdac0b8d20 0x7fbdac151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:02.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.238+0000 7fbdb0aef700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbdac14e530 0x7fbdac15d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:02.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.238+0000 7fbdb0aef700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0b0a10 con 0x7fbdac14e530 2021-02-12T17:20:02.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.238+0000 7fbdb0aef700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac160750 con 0x7fbdac062740 2021-02-12T17:20:02.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.238+0000 7fbdb0aef700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac1615b0 con 0x7fbdac0b8d20 2021-02-12T17:20:02.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbdaad9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbdac14e530 0x7fbdac15d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:02.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbdaad9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbdac14e530 0x7fbdac15d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46738/0 (socket says 172.21.2.102:46738) 2021-02-12T17:20:02.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbdaad9d700 1 -- 172.21.2.102:0/3493107618 learned_addr learned my addr 172.21.2.102:0/3493107618 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:02.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbda9d9b700 1 --2- 172.21.2.102:0/3493107618 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbdac0b8d20 0x7fbdac151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:02.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbdaa59c700 1 --2- 172.21.2.102:0/3493107618 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbdac062740 0x7fbdac1610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:02.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbdaad9d700 1 -- 172.21.2.102:0/3493107618 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbdac0b8d20 msgr2=0x7fbdac151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:02.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbdaad9d700 1 --2- 172.21.2.102:0/3493107618 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbdac0b8d20 0x7fbdac151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:02.242 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbdaad9d700 1 -- 172.21.2.102:0/3493107618 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbdac062740 msgr2=0x7fbdac1610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:02.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbdaad9d700 1 --2- 172.21.2.102:0/3493107618 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbdac062740 0x7fbdac1610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:02.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbdaad9d700 1 -- 172.21.2.102:0/3493107618 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac0b5200 con 0x7fbdac14e530 2021-02-12T17:20:02.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbdaad9d700 1 --2- 172.21.2.102:0/3493107618 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbdac14e530 0x7fbdac15d090 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fbdac0653c0 tx=0x7fbda4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:02.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbda27fc700 1 -- 172.21.2.102:0/3493107618 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4011e70 con 0x7fbdac14e530 2021-02-12T17:20:02.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbda27fc700 1 -- 172.21.2.102:0/3493107618 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4006c00 con 0x7fbdac14e530 2021-02-12T17:20:02.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3493107618 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdac0b54a0 con 0x7fbdac14e530 2021-02-12T17:20:02.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbda27fc700 1 -- 172.21.2.102:0/3493107618 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4010dd0 con 0x7fbdac14e530 2021-02-12T17:20:02.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.239+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3493107618 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac160980 con 0x7fbdac14e530 2021-02-12T17:20:02.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.240+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3493107618 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdac045460 con 0x7fbdac14e530 2021-02-12T17:20:02.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.240+0000 7fbda27fc700 1 -- 172.21.2.102:0/3493107618 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fbda402a070 con 0x7fbdac14e530 2021-02-12T17:20:02.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.240+0000 7fbda27fc700 1 --2- 172.21.2.102:0/3493107618 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbd90059d30 0x7fbd9005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:02.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.241+0000 7fbda27fc700 1 -- 172.21.2.102:0/3493107618 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7fbda4075f80 con 0x7fbdac14e530 2021-02-12T17:20:02.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.241+0000 7fbdaa59c700 1 --2- 172.21.2.102:0/3493107618 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbd90059d30 0x7fbd9005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:02.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.241+0000 7fbdaa59c700 1 --2- 172.21.2.102:0/3493107618 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbd90059d30 0x7fbd9005c1f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fbd9c00b750 tx=0x7fbd9c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:02.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.244+0000 7fbda27fc700 1 -- 172.21.2.102:0/3493107618 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fbda40495a0 con 0x7fbdac14e530 2021-02-12T17:20:02.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.400+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3493107618 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdac063670 con 0x7fbdac14e530 2021-02-12T17:20:02.402 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.401+0000 7fbda27fc700 1 -- 172.21.2.102:0/3493107618 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3754 (secure 0 0 0) 0x7fbda404cbc0 con 0x7fbdac14e530 2021-02-12T17:20:02.402 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:02.402 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:02.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.402+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3493107618 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbd90059d30 msgr2=0x7fbd9005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:02.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.402+0000 7fbdb0aef700 1 --2- 172.21.2.102:0/3493107618 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbd90059d30 0x7fbd9005c1f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fbd9c00b750 tx=0x7fbd9c008040).stop 2021-02-12T17:20:02.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.402+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3493107618 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbdac14e530 msgr2=0x7fbdac15d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:02.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.402+0000 7fbdb0aef700 1 --2- 172.21.2.102:0/3493107618 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbdac14e530 0x7fbdac15d090 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fbdac0653c0 tx=0x7fbda4017000).stop 2021-02-12T17:20:02.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.402+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3493107618 shutdown_connections 2021-02-12T17:20:02.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.402+0000 7fbdb0aef700 1 --2- 172.21.2.102:0/3493107618 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbd90059d30 0x7fbd9005c1f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:02.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.402+0000 7fbdb0aef700 1 --2- 172.21.2.102:0/3493107618 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbdac14e530 0x7fbdac15d090 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:02.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.402+0000 7fbdb0aef700 1 --2- 172.21.2.102:0/3493107618 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbdac062740 0x7fbdac1610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:02.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.402+0000 7fbdb0aef700 1 --2- 172.21.2.102:0/3493107618 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbdac0b8d20 0x7fbdac151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:02.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.402+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3493107618 >> 172.21.2.102:0/3493107618 conn(0x7fbdac0bc480 msgr2=0x7fbdac14ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:02.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.402+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3493107618 shutdown_connections 2021-02-12T17:20:02.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:02.402+0000 7fbdb0aef700 1 -- 172.21.2.102:0/3493107618 wait complete. 2021-02-12T17:20:02.404 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 25 2021-02-12T17:20:02.412 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:20:04.413 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:04.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.503+0000 7f4dd7fff700 1 Processor -- start 2021-02-12T17:20:04.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.503+0000 7f4dd7fff700 1 -- start start 2021-02-12T17:20:04.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.503+0000 7f4dd7fff700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4dd80b1a20 0x7f4dd80b5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:04.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.503+0000 7f4dd7fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f4dd80b2d10 0x7f4dd80b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:04.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.503+0000 7f4dd7fff700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f4dd80b7690 0x7f4dd8145570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:04.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.503+0000 7f4dd7fff700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd81498d0 con 0x7f4dd80b2d10 2021-02-12T17:20:04.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.503+0000 7f4dd7fff700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd8149b70 con 0x7f4dd80b7690 2021-02-12T17:20:04.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.503+0000 7f4dd7fff700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8149e10 con 0x7f4dd80b1a20 2021-02-12T17:20:04.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.504+0000 7f4dd67fc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f4dd80b2d10 0x7f4dd80b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:04.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.504+0000 7f4dd67fc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f4dd80b2d10 0x7f4dd80b71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46744/0 (socket says 172.21.2.102:46744) 2021-02-12T17:20:04.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.504+0000 7f4dd67fc700 1 -- 172.21.2.102:0/2461229171 learned_addr learned my addr 172.21.2.102:0/2461229171 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:04.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.504+0000 7f4dd67fc700 1 -- 172.21.2.102:0/2461229171 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4dd80b1a20 msgr2=0x7f4dd80b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:04.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.504+0000 7f4dd67fc700 1 --2- 172.21.2.102:0/2461229171 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4dd80b1a20 0x7f4dd80b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:04.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.504+0000 7f4dd67fc700 1 -- 172.21.2.102:0/2461229171 >> v2:172.21.2.104:3300/0 conn(0x7f4dd80b7690 msgr2=0x7f4dd8145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:04.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.504+0000 7f4dd67fc700 1 --2- 172.21.2.102:0/2461229171 >> v2:172.21.2.104:3300/0 conn(0x7f4dd80b7690 0x7f4dd8145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:04.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.504+0000 7f4dd67fc700 1 -- 172.21.2.102:0/2461229171 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd814a0b0 con 0x7f4dd80b2d10 2021-02-12T17:20:04.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.504+0000 7f4dd67fc700 1 --2- 172.21.2.102:0/2461229171 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4dd80b2d10 0x7f4dd80b71a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f4dd809b190 tx=0x7f4dc0006ea0).ready entity=mon.0 client_cookie=17e91591af6a4c62 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:04.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.504+0000 7f4dd5ffb700 1 -- 172.21.2.102:0/2461229171 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc00098d0 con 0x7f4dd80b2d10 2021-02-12T17:20:04.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.504+0000 7f4dd5ffb700 1 -- 172.21.2.102:0/2461229171 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc0009a30 con 0x7f4dd80b2d10 2021-02-12T17:20:04.507 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.504+0000 7f4dd5ffb700 1 -- 172.21.2.102:0/2461229171 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0009db0 con 0x7f4dd80b2d10 2021-02-12T17:20:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.504+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2461229171 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4dd80b2d10 msgr2=0x7f4dd80b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.504+0000 7f4dd7fff700 1 --2- 172.21.2.102:0/2461229171 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4dd80b2d10 0x7f4dd80b71a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f4dd809b190 tx=0x7f4dc0006ea0).stop 2021-02-12T17:20:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.505+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2461229171 shutdown_connections 2021-02-12T17:20:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.505+0000 7f4dd7fff700 1 --2- 172.21.2.102:0/2461229171 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4dd80b1a20 0x7f4dd80b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.505+0000 7f4dd7fff700 1 --2- 172.21.2.102:0/2461229171 >> v2:172.21.2.104:3300/0 conn(0x7f4dd80b7690 0x7f4dd8145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.505+0000 7f4dd7fff700 1 --2- 172.21.2.102:0/2461229171 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4dd80b2d10 0x7f4dd80b71a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.505+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2461229171 >> 172.21.2.102:0/2461229171 conn(0x7f4dd80b8290 msgr2=0x7f4dd80b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.505+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2461229171 shutdown_connections 2021-02-12T17:20:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.505+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2461229171 wait complete. 2021-02-12T17:20:04.509 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.506+0000 7f4dd7fff700 1 Processor -- start 2021-02-12T17:20:04.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.506+0000 7f4dd7fff700 1 -- start start 2021-02-12T17:20:04.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.506+0000 7f4dd7fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4dd80b1a20 0x7f4dd8148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:04.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.506+0000 7f4dd7fff700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4dd80b2d10 0x7f4dd80b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:04.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.506+0000 7f4dd7fff700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4dd80b7690 0x7f4dd813cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:04.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.506+0000 7f4dd7fff700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd81445d0 con 0x7f4dd80b1a20 2021-02-12T17:20:04.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.506+0000 7f4dd7fff700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8160a90 con 0x7f4dd80b2d10 2021-02-12T17:20:04.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.506+0000 7f4dd7fff700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8160d30 con 0x7f4dd80b7690 2021-02-12T17:20:04.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.506+0000 7f4dd6ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4dd80b1a20 0x7f4dd8148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:04.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.506+0000 7f4dd6ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4dd80b1a20 0x7f4dd8148880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46748/0 (socket says 172.21.2.102:46748) 2021-02-12T17:20:04.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.506+0000 7f4dd6ffd700 1 -- 172.21.2.102:0/2562412516 learned_addr learned my addr 172.21.2.102:0/2562412516 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:04.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.506+0000 7f4dd67fc700 1 --2- 172.21.2.102:0/2562412516 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4dd80b2d10 0x7f4dd80b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:04.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.507+0000 7f4dd77fe700 1 --2- 172.21.2.102:0/2562412516 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4dd80b7690 0x7f4dd813cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:04.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.507+0000 7f4dd6ffd700 1 -- 172.21.2.102:0/2562412516 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4dd80b7690 msgr2=0x7f4dd813cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:04.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.507+0000 7f4dd6ffd700 1 --2- 172.21.2.102:0/2562412516 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4dd80b7690 0x7f4dd813cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:04.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.507+0000 7f4dd6ffd700 1 -- 172.21.2.102:0/2562412516 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4dd80b2d10 msgr2=0x7f4dd80b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:04.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.507+0000 7f4dd6ffd700 1 --2- 172.21.2.102:0/2562412516 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4dd80b2d10 0x7f4dd80b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:04.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.507+0000 7f4dd6ffd700 1 -- 172.21.2.102:0/2562412516 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd8160fd0 con 0x7f4dd80b1a20 2021-02-12T17:20:04.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.507+0000 7f4dd6ffd700 1 --2- 172.21.2.102:0/2562412516 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4dd80b1a20 0x7f4dd8148880 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f4dc80096e0 tx=0x7f4dc8006e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:04.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.507+0000 7f4dceffd700 1 -- 172.21.2.102:0/2562412516 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800d590 con 0x7f4dd80b1a20 2021-02-12T17:20:04.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.507+0000 7f4dceffd700 1 -- 172.21.2.102:0/2562412516 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc8000e90 con 0x7f4dd80b1a20 2021-02-12T17:20:04.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.507+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2562412516 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd8161270 con 0x7f4dd80b1a20 2021-02-12T17:20:04.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.507+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2562412516 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd8161560 con 0x7f4dd80b1a20 2021-02-12T17:20:04.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.507+0000 7f4dceffd700 1 -- 172.21.2.102:0/2562412516 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800d940 con 0x7f4dd80b1a20 2021-02-12T17:20:04.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.508+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2562412516 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd8044c00 con 0x7f4dd80b1a20 2021-02-12T17:20:04.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.508+0000 7f4dceffd700 1 -- 172.21.2.102:0/2562412516 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f4dc8017030 con 0x7f4dd80b1a20 2021-02-12T17:20:04.512 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.508+0000 7f4dceffd700 1 --2- 172.21.2.102:0/2562412516 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4dbc059d80 0x7f4dbc05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:04.512 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.508+0000 7f4dceffd700 1 -- 172.21.2.102:0/2562412516 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7107+0+0 (secure 0 0 0) 0x7f4dc8073030 con 0x7f4dd80b1a20 2021-02-12T17:20:04.512 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.508+0000 7f4dd67fc700 1 --2- 172.21.2.102:0/2562412516 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4dbc059d80 0x7f4dbc05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:04.513 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.509+0000 7f4dd67fc700 1 --2- 172.21.2.102:0/2562412516 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4dbc059d80 0x7f4dbc05c240 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f4dd809b190 tx=0x7f4dc0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:04.513 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.511+0000 7f4dceffd700 1 -- 172.21.2.102:0/2562412516 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f4dc804a1b0 con 0x7f4dd80b1a20 2021-02-12T17:20:04.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.671+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2562412516 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dd805cf60 con 0x7f4dd80b1a20 2021-02-12T17:20:04.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.671+0000 7f4dceffd700 1 -- 172.21.2.102:0/2562412516 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3754 (secure 0 0 0) 0x7f4dc800dcb0 con 0x7f4dd80b1a20 2021-02-12T17:20:04.673 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:04.673 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5280,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:18:29.290637+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":40,"addr":"172.21.2.104:6835/3140564541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3140564541},{"type":"v1","addr":"172.21.2.104:6835","nonce":3140564541}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:04.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.672+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2562412516 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4dbc059d80 msgr2=0x7f4dbc05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:04.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.672+0000 7f4dd7fff700 1 --2- 172.21.2.102:0/2562412516 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4dbc059d80 0x7f4dbc05c240 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f4dd809b190 tx=0x7f4dc0016000).stop 2021-02-12T17:20:04.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.672+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2562412516 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4dd80b1a20 msgr2=0x7f4dd8148880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:04.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.672+0000 7f4dd7fff700 1 --2- 172.21.2.102:0/2562412516 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4dd80b1a20 0x7f4dd8148880 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f4dc80096e0 tx=0x7f4dc8006e10).stop 2021-02-12T17:20:04.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.673+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2562412516 shutdown_connections 2021-02-12T17:20:04.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.673+0000 7f4dd7fff700 1 --2- 172.21.2.102:0/2562412516 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4dd80b7690 0x7f4dd813cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:04.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.673+0000 7f4dd7fff700 1 --2- 172.21.2.102:0/2562412516 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4dbc059d80 0x7f4dbc05c240 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:04.675 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.673+0000 7f4dd7fff700 1 --2- 172.21.2.102:0/2562412516 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4dd80b1a20 0x7f4dd8148880 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:04.675 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.673+0000 7f4dd7fff700 1 --2- 172.21.2.102:0/2562412516 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4dd80b2d10 0x7f4dd80b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:04.675 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.673+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2562412516 >> 172.21.2.102:0/2562412516 conn(0x7f4dd80b8290 msgr2=0x7f4dd813ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:04.675 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.673+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2562412516 shutdown_connections 2021-02-12T17:20:04.675 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:04.673+0000 7f4dd7fff700 1 -- 172.21.2.102:0/2562412516 wait complete. 2021-02-12T17:20:04.675 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 25 2021-02-12T17:20:04.682 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:20:06.683 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:06.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.769+0000 7f0c74bb7700 1 Processor -- start 2021-02-12T17:20:06.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.770+0000 7f0c74bb7700 1 -- start start 2021-02-12T17:20:06.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.770+0000 7f0c74bb7700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c700b8d20 0x7f0c70068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:06.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.770+0000 7f0c74bb7700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0c7014e530 0x7f0c700b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:06.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.770+0000 7f0c74bb7700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f0c70062740 0x7f0c70062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:06.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.770+0000 7f0c74bb7700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c70068d20 con 0x7f0c7014e530 2021-02-12T17:20:06.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.770+0000 7f0c74bb7700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c700622a0 con 0x7f0c70062740 2021-02-12T17:20:06.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.770+0000 7f0c74bb7700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7014ea10 con 0x7f0c700b8d20 2021-02-12T17:20:06.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.770+0000 7f0c6dd9b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0c7014e530 0x7f0c700b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:06.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.770+0000 7f0c6dd9b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0c7014e530 0x7f0c700b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46768/0 (socket says 172.21.2.102:46768) 2021-02-12T17:20:06.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.770+0000 7f0c6dd9b700 1 -- 172.21.2.102:0/3895898089 learned_addr learned my addr 172.21.2.102:0/3895898089 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:06.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.771+0000 7f0c6dd9b700 1 -- 172.21.2.102:0/3895898089 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c700b8d20 msgr2=0x7f0c70068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:06.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.771+0000 7f0c6dd9b700 1 --2- 172.21.2.102:0/3895898089 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c700b8d20 0x7f0c70068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:06.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.771+0000 7f0c6dd9b700 1 -- 172.21.2.102:0/3895898089 >> v2:172.21.2.104:3300/0 conn(0x7f0c70062740 msgr2=0x7f0c70062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:06.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.771+0000 7f0c6dd9b700 1 --2- 172.21.2.102:0/3895898089 >> v2:172.21.2.104:3300/0 conn(0x7f0c70062740 0x7f0c70062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:06.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.771+0000 7f0c6dd9b700 1 -- 172.21.2.102:0/3895898089 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c700b63f0 con 0x7f0c7014e530 2021-02-12T17:20:06.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.771+0000 7f0c6dd9b700 1 --2- 172.21.2.102:0/3895898089 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c7014e530 0x7f0c700b7250 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f0c70067bb0 tx=0x7f0c60006ea0).ready entity=mon.0 client_cookie=538e51b57af4db45 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:06.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.771+0000 7f0c6d59a700 1 -- 172.21.2.102:0/3895898089 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60009840 con 0x7f0c7014e530 2021-02-12T17:20:06.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.771+0000 7f0c6d59a700 1 -- 172.21.2.102:0/3895898089 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c600099a0 con 0x7f0c7014e530 2021-02-12T17:20:06.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.771+0000 7f0c6d59a700 1 -- 172.21.2.102:0/3895898089 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60009d20 con 0x7f0c7014e530 2021-02-12T17:20:06.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.771+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3895898089 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c7014e530 msgr2=0x7f0c700b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:06.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.771+0000 7f0c74bb7700 1 --2- 172.21.2.102:0/3895898089 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c7014e530 0x7f0c700b7250 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f0c70067bb0 tx=0x7f0c60006ea0).stop 2021-02-12T17:20:06.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.772+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3895898089 shutdown_connections 2021-02-12T17:20:06.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.772+0000 7f0c74bb7700 1 --2- 172.21.2.102:0/3895898089 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c700b8d20 0x7f0c70068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:06.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.772+0000 7f0c74bb7700 1 --2- 172.21.2.102:0/3895898089 >> v2:172.21.2.104:3300/0 conn(0x7f0c70062740 0x7f0c70062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:06.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.772+0000 7f0c74bb7700 1 --2- 172.21.2.102:0/3895898089 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c7014e530 0x7f0c700b7250 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:06.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.772+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3895898089 >> 172.21.2.102:0/3895898089 conn(0x7f0c700bc480 msgr2=0x7f0c700b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:06.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.772+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3895898089 shutdown_connections 2021-02-12T17:20:06.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.772+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3895898089 wait complete. 2021-02-12T17:20:06.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.773+0000 7f0c74bb7700 1 Processor -- start 2021-02-12T17:20:06.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.773+0000 7f0c74bb7700 1 -- start start 2021-02-12T17:20:06.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.773+0000 7f0c74bb7700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0c70062740 0x7f0c700b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:06.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.773+0000 7f0c74bb7700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c700b8d20 0x7f0c700b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:06.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.773+0000 7f0c74bb7700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c7014e530 0x7f0c700b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:06.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.773+0000 7f0c74bb7700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70151f00 con 0x7f0c7014e530 2021-02-12T17:20:06.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.773+0000 7f0c74bb7700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7015e240 con 0x7f0c70062740 2021-02-12T17:20:06.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.773+0000 7f0c74bb7700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700ba130 con 0x7f0c700b8d20 2021-02-12T17:20:06.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.773+0000 7f0c6ed9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c7014e530 0x7f0c700b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:06.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.773+0000 7f0c6ed9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c7014e530 0x7f0c700b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46776/0 (socket says 172.21.2.102:46776) 2021-02-12T17:20:06.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.773+0000 7f0c6ed9d700 1 -- 172.21.2.102:0/3244940719 learned_addr learned my addr 172.21.2.102:0/3244940719 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:06.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.774+0000 7f0c6ed9d700 1 -- 172.21.2.102:0/3244940719 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c700b8d20 msgr2=0x7f0c700b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:06.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.774+0000 7f0c6ed9d700 1 --2- 172.21.2.102:0/3244940719 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c700b8d20 0x7f0c700b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:06.777 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.774+0000 7f0c6ed9d700 1 -- 172.21.2.102:0/3244940719 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0c70062740 msgr2=0x7f0c700b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:06.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.774+0000 7f0c6ed9d700 1 --2- 172.21.2.102:0/3244940719 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0c70062740 0x7f0c700b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:06.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.774+0000 7f0c6ed9d700 1 -- 172.21.2.102:0/3244940719 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c700acf10 con 0x7f0c7014e530 2021-02-12T17:20:06.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.774+0000 7f0c6ed9d700 1 --2- 172.21.2.102:0/3244940719 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c7014e530 0x7f0c700b14d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f0c6800bae0 tx=0x7f0c68009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:06.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.774+0000 7f0c667fc700 1 -- 172.21.2.102:0/3244940719 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6800c8d0 con 0x7f0c7014e530 2021-02-12T17:20:06.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.774+0000 7f0c667fc700 1 -- 172.21.2.102:0/3244940719 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6800ca30 con 0x7f0c7014e530 2021-02-12T17:20:06.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.774+0000 7f0c667fc700 1 -- 172.21.2.102:0/3244940719 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6800cbe0 con 0x7f0c7014e530 2021-02-12T17:20:06.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.774+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3244940719 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7015e470 con 0x7f0c7014e530 2021-02-12T17:20:06.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.774+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3244940719 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c700ad1b0 con 0x7f0c7014e530 2021-02-12T17:20:06.778 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.775+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3244940719 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c700b0e90 con 0x7f0c7014e530 2021-02-12T17:20:06.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.775+0000 7f0c667fc700 1 -- 172.21.2.102:0/3244940719 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f0c6801c070 con 0x7f0c7014e530 2021-02-12T17:20:06.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.775+0000 7f0c667fc700 1 --2- 172.21.2.102:0/3244940719 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0c54059d80 0x7f0c5405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:06.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.775+0000 7f0c667fc700 1 -- 172.21.2.102:0/3244940719 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7193+0+0 (secure 0 0 0) 0x7f0c680735e0 con 0x7f0c7014e530 2021-02-12T17:20:06.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.776+0000 7f0c6e59c700 1 --2- 172.21.2.102:0/3244940719 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0c54059d80 0x7f0c5405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:06.779 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.776+0000 7f0c6e59c700 1 --2- 172.21.2.102:0/3244940719 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0c54059d80 0x7f0c5405c240 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f0c580094c0 tx=0x7f0c580069f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:06.780 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.778+0000 7f0c667fc700 1 -- 172.21.2.102:0/3244940719 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f0c700b0e90 con 0x7f0c7014e530 2021-02-12T17:20:06.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.936+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3244940719 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c700b0e90 con 0x7f0c7014e530 2021-02-12T17:20:06.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.937+0000 7f0c667fc700 1 -- 172.21.2.102:0/3244940719 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3400 (secure 0 0 0) 0x7f0c700b0e90 con 0x7f0c7014e530 2021-02-12T17:20:06.938 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:06.939 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:06.301267+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:replay","state_seq":2,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:06.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.938+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3244940719 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0c54059d80 msgr2=0x7f0c5405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:06.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.938+0000 7f0c74bb7700 1 --2- 172.21.2.102:0/3244940719 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0c54059d80 0x7f0c5405c240 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f0c580094c0 tx=0x7f0c580069f0).stop 2021-02-12T17:20:06.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.938+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3244940719 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c7014e530 msgr2=0x7f0c700b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:06.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.938+0000 7f0c74bb7700 1 --2- 172.21.2.102:0/3244940719 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c7014e530 0x7f0c700b14d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f0c6800bae0 tx=0x7f0c68009220).stop 2021-02-12T17:20:06.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.938+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3244940719 shutdown_connections 2021-02-12T17:20:06.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.938+0000 7f0c74bb7700 1 --2- 172.21.2.102:0/3244940719 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0c54059d80 0x7f0c5405c240 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:06.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.938+0000 7f0c74bb7700 1 --2- 172.21.2.102:0/3244940719 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0c7014e530 0x7f0c700b14d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:06.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.938+0000 7f0c74bb7700 1 --2- 172.21.2.102:0/3244940719 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0c70062740 0x7f0c700b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:06.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.938+0000 7f0c74bb7700 1 --2- 172.21.2.102:0/3244940719 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0c700b8d20 0x7f0c700b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:06.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.938+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3244940719 >> 172.21.2.102:0/3244940719 conn(0x7f0c700bc480 msgr2=0x7f0c7014cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:06.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.938+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3244940719 shutdown_connections 2021-02-12T17:20:06.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:06.939+0000 7f0c74bb7700 1 -- 172.21.2.102:0/3244940719 wait complete. 2021-02-12T17:20:06.941 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 26 2021-02-12T17:20:06.948 INFO:tasks.mds_thrash.fs.[b]:mds.d down, removed from mdsmap 2021-02-12T17:20:06.948 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2021-02-12T17:20:06.948 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:07.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.036+0000 7f3f91fa8700 1 Processor -- start 2021-02-12T17:20:07.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.036+0000 7f3f91fa8700 1 -- start start 2021-02-12T17:20:07.039 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.036+0000 7f3f91fa8700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f3f8c14e530 0x7f3f8c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:07.039 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f91fa8700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3f8c062740 0x7f3f8c062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:07.039 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f91fa8700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8c0b7960 con 0x7f3f8c0b8d20 2021-02-12T17:20:07.039 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f91fa8700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f8c068d20 con 0x7f3f8c062740 2021-02-12T17:20:07.040 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f91fa8700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f8c0622a0 con 0x7f3f8c14e530 2021-02-12T17:20:07.040 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f8bfff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3f8c062740 0x7f3f8c062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:07.040 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f8bfff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3f8c062740 0x7f3f8c062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46784/0 (socket says 172.21.2.102:46784) 2021-02-12T17:20:07.040 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f8bfff700 1 -- 172.21.2.102:0/1248950428 learned_addr learned my addr 172.21.2.102:0/1248950428 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:07.040 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f8bfff700 1 -- 172.21.2.102:0/1248950428 >> v2:172.21.2.104:3300/0 conn(0x7f3f8c14e530 msgr2=0x7f3f8c068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:20:07.040 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f8bfff700 1 --2- 172.21.2.102:0/1248950428 >> v2:172.21.2.104:3300/0 conn(0x7f3f8c14e530 0x7f3f8c068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:07.040 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f8bfff700 1 -- 172.21.2.102:0/1248950428 >> v1:172.21.2.104:6789/0 conn(0x7f3f8c0b8d20 legacy=0x7f3f8c0b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:20:07.040 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f8bfff700 1 -- 172.21.2.102:0/1248950428 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c14ea10 con 0x7f3f8c062740 2021-02-12T17:20:07.040 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f8bfff700 1 --2- 172.21.2.102:0/1248950428 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f8c062740 0x7f3f8c062bf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f3f8c0654b0 tx=0x7f3f84009290).ready entity=mon.0 client_cookie=95ff39d4f6611bf9 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:07.040 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f8a7fc700 1 -- 172.21.2.102:0/1248950428 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400bbb0 con 0x7f3f8c062740 2021-02-12T17:20:07.040 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f8a7fc700 1 -- 172.21.2.102:0/1248950428 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8400bd10 con 0x7f3f8c062740 2021-02-12T17:20:07.040 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.037+0000 7f3f8a7fc700 1 -- 172.21.2.102:0/1248950428 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f84011610 con 0x7f3f8c062740 2021-02-12T17:20:07.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.038+0000 7f3f91fa8700 1 -- 172.21.2.102:0/1248950428 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f8c062740 msgr2=0x7f3f8c062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:07.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.038+0000 7f3f91fa8700 1 --2- 172.21.2.102:0/1248950428 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f8c062740 0x7f3f8c062bf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f3f8c0654b0 tx=0x7f3f84009290).stop 2021-02-12T17:20:07.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.038+0000 7f3f91fa8700 1 -- 172.21.2.102:0/1248950428 shutdown_connections 2021-02-12T17:20:07.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.038+0000 7f3f91fa8700 1 --2- 172.21.2.102:0/1248950428 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f8c062740 0x7f3f8c062bf0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:07.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.038+0000 7f3f91fa8700 1 --2- 172.21.2.102:0/1248950428 >> v2:172.21.2.104:3300/0 conn(0x7f3f8c14e530 0x7f3f8c068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:07.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.038+0000 7f3f91fa8700 1 -- 172.21.2.102:0/1248950428 >> 172.21.2.102:0/1248950428 conn(0x7f3f8c0bc480 msgr2=0x7f3f8c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:07.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.038+0000 7f3f91fa8700 1 -- 172.21.2.102:0/1248950428 shutdown_connections 2021-02-12T17:20:07.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.038+0000 7f3f91fa8700 1 -- 172.21.2.102:0/1248950428 wait complete. 2021-02-12T17:20:07.043 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.039+0000 7f3f91fa8700 1 Processor -- start 2021-02-12T17:20:07.043 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.039+0000 7f3f91fa8700 1 -- start start 2021-02-12T17:20:07.043 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.039+0000 7f3f91fa8700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3f8c062740 0x7f3f8c153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:07.043 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.039+0000 7f3f91fa8700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f8c0b8d20 0x7f3f8c0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:07.043 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.039+0000 7f3f91fa8700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3f8c14e530 0x7f3f8c161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:07.043 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.039+0000 7f3f91fa8700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c15d840 con 0x7f3f8c0b8d20 2021-02-12T17:20:07.044 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.039+0000 7f3f91fa8700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0ad1c0 con 0x7f3f8c062740 2021-02-12T17:20:07.044 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.039+0000 7f3f91fa8700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0ad3f0 con 0x7f3f8c14e530 2021-02-12T17:20:07.044 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.039+0000 7f3f8affd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f8c0b8d20 0x7f3f8c0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:07.044 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.040+0000 7f3f8affd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f8c0b8d20 0x7f3f8c0b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46790/0 (socket says 172.21.2.102:46790) 2021-02-12T17:20:07.044 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.040+0000 7f3f8affd700 1 -- 172.21.2.102:0/3718787690 learned_addr learned my addr 172.21.2.102:0/3718787690 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:07.044 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.040+0000 7f3f8affd700 1 -- 172.21.2.102:0/3718787690 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3f8c14e530 msgr2=0x7f3f8c161030 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:20:07.044 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.040+0000 7f3f8affd700 1 --2- 172.21.2.102:0/3718787690 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3f8c14e530 0x7f3f8c161030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:07.044 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.040+0000 7f3f8affd700 1 -- 172.21.2.102:0/3718787690 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3f8c062740 msgr2=0x7f3f8c153500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:20:07.044 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.040+0000 7f3f8affd700 1 --2- 172.21.2.102:0/3718787690 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3f8c062740 0x7f3f8c153500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:07.045 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.040+0000 7f3f8affd700 1 -- 172.21.2.102:0/3718787690 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c0ad690 con 0x7f3f8c0b8d20 2021-02-12T17:20:07.045 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.040+0000 7f3f8affd700 1 --2- 172.21.2.102:0/3718787690 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f8c0b8d20 0x7f3f8c0b3d20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f3f7c009710 tx=0x7f3f7c006d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:07.045 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.040+0000 7f3f837fe700 1 -- 172.21.2.102:0/3718787690 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c0103f0 con 0x7f3f8c0b8d20 2021-02-12T17:20:07.045 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.040+0000 7f3f837fe700 1 -- 172.21.2.102:0/3718787690 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c000e90 con 0x7f3f8c0b8d20 2021-02-12T17:20:07.045 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.040+0000 7f3f91fa8700 1 -- 172.21.2.102:0/3718787690 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8c0ad930 con 0x7f3f8c0b8d20 2021-02-12T17:20:07.045 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.040+0000 7f3f91fa8700 1 -- 172.21.2.102:0/3718787690 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8c0b7630 con 0x7f3f8c0b8d20 2021-02-12T17:20:07.045 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.040+0000 7f3f837fe700 1 -- 172.21.2.102:0/3718787690 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c0107c0 con 0x7f3f8c0b8d20 2021-02-12T17:20:07.045 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.041+0000 7f3f91fa8700 1 -- 172.21.2.102:0/3718787690 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f64004f60 con 0x7f3f8c0b8d20 2021-02-12T17:20:07.045 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.041+0000 7f3f837fe700 1 -- 172.21.2.102:0/3718787690 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f3f7c017030 con 0x7f3f8c0b8d20 2021-02-12T17:20:07.045 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.041+0000 7f3f837fe700 1 --2- 172.21.2.102:0/3718787690 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3f70059d80 0x7f3f7005c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:07.045 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.041+0000 7f3f837fe700 1 -- 172.21.2.102:0/3718787690 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7193+0+0 (secure 0 0 0) 0x7f3f7c072ed0 con 0x7f3f8c0b8d20 2021-02-12T17:20:07.046 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.041+0000 7f3f8b7fe700 1 --2- 172.21.2.102:0/3718787690 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3f70059d80 0x7f3f7005c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:07.046 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.042+0000 7f3f8b7fe700 1 --2- 172.21.2.102:0/3718787690 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3f70059d80 0x7f3f7005c240 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f3f7400b420 tx=0x7f3f74006920).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:07.046 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.044+0000 7f3f837fe700 1 -- 172.21.2.102:0/3718787690 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f3f7c0465d0 con 0x7f3f8c0b8d20 2021-02-12T17:20:07.205 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.204+0000 7f3f91fa8700 1 -- 172.21.2.102:0/3718787690 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f64005790 con 0x7f3f8c0b8d20 2021-02-12T17:20:07.206 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.205+0000 7f3f837fe700 1 -- 172.21.2.102:0/3718787690 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3400 (secure 0 0 0) 0x7f3f7c049bf0 con 0x7f3f8c0b8d20 2021-02-12T17:20:07.206 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:07.206 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:06.301267+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:replay","state_seq":2,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:07.207 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.206+0000 7f3f91fa8700 1 -- 172.21.2.102:0/3718787690 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3f70059d80 msgr2=0x7f3f7005c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:07.207 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.206+0000 7f3f91fa8700 1 --2- 172.21.2.102:0/3718787690 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3f70059d80 0x7f3f7005c240 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f3f7400b420 tx=0x7f3f74006920).stop 2021-02-12T17:20:07.207 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.206+0000 7f3f91fa8700 1 -- 172.21.2.102:0/3718787690 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f8c0b8d20 msgr2=0x7f3f8c0b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:07.207 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.206+0000 7f3f91fa8700 1 --2- 172.21.2.102:0/3718787690 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f8c0b8d20 0x7f3f8c0b3d20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f3f7c009710 tx=0x7f3f7c006d40).stop 2021-02-12T17:20:07.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.206+0000 7f3f91fa8700 1 -- 172.21.2.102:0/3718787690 shutdown_connections 2021-02-12T17:20:07.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.206+0000 7f3f91fa8700 1 --2- 172.21.2.102:0/3718787690 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3f8c14e530 0x7f3f8c161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:07.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.206+0000 7f3f91fa8700 1 --2- 172.21.2.102:0/3718787690 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3f8c062740 0x7f3f8c153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:07.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.206+0000 7f3f91fa8700 1 --2- 172.21.2.102:0/3718787690 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3f70059d80 0x7f3f7005c240 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:07.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.206+0000 7f3f91fa8700 1 --2- 172.21.2.102:0/3718787690 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3f8c0b8d20 0x7f3f8c0b3d20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:07.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.206+0000 7f3f91fa8700 1 -- 172.21.2.102:0/3718787690 >> 172.21.2.102:0/3718787690 conn(0x7f3f8c0bc480 msgr2=0x7f3f8c14cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:07.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.206+0000 7f3f91fa8700 1 -- 172.21.2.102:0/3718787690 shutdown_connections 2021-02-12T17:20:07.209 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:07.206+0000 7f3f91fa8700 1 -- 172.21.2.102:0/3718787690 wait complete. 2021-02-12T17:20:07.209 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 26 2021-02-12T17:20:07.217 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 26, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:01.991560+0000", "damaged": [], "data_pools": [ 4 ], "enabled": true, "epoch": 24, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "a", "in": [ 0 ], "info": { "gid_5157": { "addr": "172.21.2.102:6837/115463068", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6836", "nonce": 115463068, "type": "v2" }, { "addr": "172.21.2.102:6837", "nonce": 115463068, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5157, "incarnation": 21, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 19 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2021-02-12T17:19:49.306514+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5157 } } }, { "id": 2, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:08.529588+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 26, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "b", "in": [ 0 ], "info": { "gid_5280": { "addr": "172.21.2.102:6835/277624455", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6834", "nonce": 277624455, "type": "v2" }, { "addr": "172.21.2.102:6835", "nonce": 277624455, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5280, "incarnation": 26, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 2 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 5, "modified": "2021-02-12T17:20:06.301267+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5280 } } } ], "standbys": [ { "addr": "172.21.2.104:6834/3149030842", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6832", "nonce": 3149030842, "type": "v2" }, { "addr": "172.21.2.104:6834", "nonce": 3149030842, "type": "v1" } ] }, "epoch": 5, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4243, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 2 } ] } 2021-02-12T17:20:09.218 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:09.313 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.312+0000 7f8df7909700 1 Processor -- start 2021-02-12T17:20:09.313 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.312+0000 7f8df7909700 1 -- start start 2021-02-12T17:20:09.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.313+0000 7f8df7909700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8df0149af0 0x7f8df0149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:09.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.313+0000 7f8df7909700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f8df00b8bd0 0x7f8df014a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:09.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.313+0000 7f8df7909700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df0068550 con 0x7f8df0147830 2021-02-12T17:20:09.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.313+0000 7f8df7909700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df0067630 con 0x7f8df00b8bd0 2021-02-12T17:20:09.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.313+0000 7f8df7909700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df00678d0 con 0x7f8df0149af0 2021-02-12T17:20:09.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.313+0000 7f8df5ea6700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f8df0147830 0x7f8df0147ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55444/0 (socket says 172.21.2.102:55444) 2021-02-12T17:20:09.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.313+0000 7f8df5ea6700 1 -- 172.21.2.102:0/3644877717 learned_addr learned my addr 172.21.2.102:0/3644877717 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:20:09.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.313+0000 7f8df4ea4700 1 --2- 172.21.2.102:0/3644877717 >> v2:172.21.2.104:3300/0 conn(0x7f8df00b8bd0 0x7f8df014a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:09.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8df56a5700 1 --2- 172.21.2.102:0/3644877717 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8df0149af0 0x7f8df0149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:09.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 -- 172.21.2.102:0/3644877717 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205484647 0 0) 0x7f8df0068550 con 0x7f8df0147830 2021-02-12T17:20:09.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 -- 172.21.2.102:0/3644877717 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dd8003230 con 0x7f8df0147830 2021-02-12T17:20:09.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 -- 172.21.2.102:0/3644877717 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 282192570 0 0) 0x7f8dd8003230 con 0x7f8df0147830 2021-02-12T17:20:09.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 -- 172.21.2.102:0/3644877717 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8df0149af0 msgr2=0x7f8df0149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:09.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 --2- 172.21.2.102:0/3644877717 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8df0149af0 0x7f8df0149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:09.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 -- 172.21.2.102:0/3644877717 >> v2:172.21.2.104:3300/0 conn(0x7f8df00b8bd0 msgr2=0x7f8df014a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:09.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 --2- 172.21.2.102:0/3644877717 >> v2:172.21.2.104:3300/0 conn(0x7f8df00b8bd0 0x7f8df014a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:09.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 -- 172.21.2.102:0/3644877717 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df0067b70 con 0x7f8df0147830 2021-02-12T17:20:09.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 -- 172.21.2.102:0/3644877717 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f8de8001860 con 0x7f8df0147830 2021-02-12T17:20:09.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 -- 172.21.2.102:0/3644877717 >> v1:172.21.2.102:6789/0 conn(0x7f8df0147830 legacy=0x7f8df0147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:09.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 --2- 172.21.2.102:0/3644877717 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8df0149af0 0x7f8dd80037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:09.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 --2- 172.21.2.102:0/3644877717 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8dd8003d00 0x7f8dd80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:09.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 --2- 172.21.2.102:0/3644877717 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8dd80049c0 0x7f8dd8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:09.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 -- 172.21.2.102:0/3644877717 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0067630 con 0x7f8dd8003d00 2021-02-12T17:20:09.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 -- 172.21.2.102:0/3644877717 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df00678d0 con 0x7f8dd80049c0 2021-02-12T17:20:09.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 -- 172.21.2.102:0/3644877717 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80042c0 con 0x7f8df0149af0 2021-02-12T17:20:09.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8df4ea4700 1 --2- 172.21.2.102:0/3644877717 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8dd8003d00 0x7f8dd80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:09.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8df56a5700 1 --2- 172.21.2.102:0/3644877717 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8df0149af0 0x7f8dd80037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:09.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8df5ea6700 1 --2- 172.21.2.102:0/3644877717 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8dd80049c0 0x7f8dd8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:09.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8df4ea4700 1 -- 172.21.2.102:0/3644877717 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8df0149af0 msgr2=0x7f8dd80037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:09.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8df4ea4700 1 --2- 172.21.2.102:0/3644877717 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8df0149af0 0x7f8dd80037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:09.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8df4ea4700 1 -- 172.21.2.102:0/3644877717 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8dd80049c0 msgr2=0x7f8dd8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:09.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8df4ea4700 1 --2- 172.21.2.102:0/3644877717 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8dd80049c0 0x7f8dd8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:09.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8df4ea4700 1 -- 172.21.2.102:0/3644877717 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd8003230 con 0x7f8dd8003d00 2021-02-12T17:20:09.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8df5ea6700 1 --2- 172.21.2.102:0/3644877717 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8dd80049c0 0x7f8dd8004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:20:09.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8df4ea4700 1 --2- 172.21.2.102:0/3644877717 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8dd8003d00 0x7f8dd80044d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f8df0065830 tx=0x7f8dec008040).ready entity=mon.0 client_cookie=e00a242473709659 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:09.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 -- 172.21.2.102:0/3644877717 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00b2b0 con 0x7f8dd8003d00 2021-02-12T17:20:09.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 -- 172.21.2.102:0/3644877717 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dec00e940 con 0x7f8dd8003d00 2021-02-12T17:20:09.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.314+0000 7f8ddffff700 1 -- 172.21.2.102:0/3644877717 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00ecc0 con 0x7f8dd8003d00 2021-02-12T17:20:09.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.315+0000 7f8df7909700 1 -- 172.21.2.102:0/3644877717 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8dd8003d00 msgr2=0x7f8dd80044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:09.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.315+0000 7f8df7909700 1 --2- 172.21.2.102:0/3644877717 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8dd8003d00 0x7f8dd80044d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f8df0065830 tx=0x7f8dec008040).stop 2021-02-12T17:20:09.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.315+0000 7f8df5ea6700 1 -- 172.21.2.102:0/3644877717 reap_dead start 2021-02-12T17:20:09.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.315+0000 7f8df7909700 1 -- 172.21.2.102:0/3644877717 shutdown_connections 2021-02-12T17:20:09.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.315+0000 7f8df7909700 1 -- 172.21.2.102:0/3644877717 >> 172.21.2.102:0/3644877717 conn(0x7f8df00bc480 msgr2=0x7f8df00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:09.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.315+0000 7f8df7909700 1 -- 172.21.2.102:0/3644877717 shutdown_connections 2021-02-12T17:20:09.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.315+0000 7f8df7909700 1 -- 172.21.2.102:0/3644877717 wait complete. 2021-02-12T17:20:09.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.316+0000 7f8df7909700 1 Processor -- start 2021-02-12T17:20:09.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.316+0000 7f8df7909700 1 -- start start 2021-02-12T17:20:09.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.316+0000 7f8df7909700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8dd8003d00 0x7f8df00b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:09.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.316+0000 7f8df7909700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8df0114ba0 0x7f8df00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:09.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.316+0000 7f8df7909700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8df00b7720 0x7f8df0143450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:09.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.316+0000 7f8df7909700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df00af060 con 0x7f8dd8003d00 2021-02-12T17:20:09.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.316+0000 7f8df7909700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df00b1ca0 con 0x7f8df0114ba0 2021-02-12T17:20:09.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.316+0000 7f8df7909700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0155470 con 0x7f8df00b7720 2021-02-12T17:20:09.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8df56a5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8dd8003d00 0x7f8df00b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:09.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8df56a5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8dd8003d00 0x7f8df00b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46812/0 (socket says 172.21.2.102:46812) 2021-02-12T17:20:09.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8df56a5700 1 -- 172.21.2.102:0/3713270763 learned_addr learned my addr 172.21.2.102:0/3713270763 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:09.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8df5ea6700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8df00b7720 0x7f8df0143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:09.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8df4ea4700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8df0114ba0 0x7f8df00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:09.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8df56a5700 1 -- 172.21.2.102:0/3713270763 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8df00b7720 msgr2=0x7f8df0143450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:09.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8df56a5700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8df00b7720 0x7f8df0143450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:09.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8df56a5700 1 -- 172.21.2.102:0/3713270763 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8df0114ba0 msgr2=0x7f8df00b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:09.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8df56a5700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8df0114ba0 0x7f8df00b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:09.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8df56a5700 1 -- 172.21.2.102:0/3713270763 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df0155710 con 0x7f8dd8003d00 2021-02-12T17:20:09.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8df4ea4700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8df0114ba0 0x7f8df00b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:20:09.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8df56a5700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8dd8003d00 0x7f8df00b17b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f8de0010c50 tx=0x7f8de0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:09.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8ddd7fa700 1 -- 172.21.2.102:0/3713270763 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de000eae0 con 0x7f8dd8003d00 2021-02-12T17:20:09.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8ddd7fa700 1 -- 172.21.2.102:0/3713270763 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de000ec40 con 0x7f8dd8003d00 2021-02-12T17:20:09.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8df7909700 1 -- 172.21.2.102:0/3713270763 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df00af290 con 0x7f8dd8003d00 2021-02-12T17:20:09.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8ddd7fa700 1 -- 172.21.2.102:0/3713270763 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0014470 con 0x7f8dd8003d00 2021-02-12T17:20:09.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.317+0000 7f8df7909700 1 -- 172.21.2.102:0/3713270763 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df00acf10 con 0x7f8dd8003d00 2021-02-12T17:20:09.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.318+0000 7f8df7909700 1 -- 172.21.2.102:0/3713270763 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df014a6f0 con 0x7f8dd8003d00 2021-02-12T17:20:09.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.318+0000 7f8ddd7fa700 1 -- 172.21.2.102:0/3713270763 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f8de00148a0 con 0x7f8dd8003d00 2021-02-12T17:20:09.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.319+0000 7f8ddd7fa700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8dd0059d30 0x7f8dd005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:09.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.319+0000 7f8ddd7fa700 1 -- 172.21.2.102:0/3713270763 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7193+0+0 (secure 0 0 0) 0x7f8de0074360 con 0x7f8dd8003d00 2021-02-12T17:20:09.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.319+0000 7f8df4ea4700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8dd0059d30 0x7f8dd005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:09.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.319+0000 7f8df4ea4700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8dd0059d30 0x7f8dd005c1f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f8dec006cf0 tx=0x7f8dec01c000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:09.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.322+0000 7f8ddd7fa700 1 -- 172.21.2.102:0/3713270763 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f8de0047a40 con 0x7f8dd8003d00 2021-02-12T17:20:09.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.483+0000 7f8df7909700 1 -- 172.21.2.102:0/3713270763 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8df00af6f0 con 0x7f8dd8003d00 2021-02-12T17:20:09.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.483+0000 7f8ddd7fa700 1 -- 172.21.2.102:0/3713270763 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3400 (secure 0 0 0) 0x7f8de0018020 con 0x7f8dd8003d00 2021-02-12T17:20:09.485 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:09.485 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:09.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.484+0000 7f8df7909700 1 -- 172.21.2.102:0/3713270763 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8dd0059d30 msgr2=0x7f8dd005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:09.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.484+0000 7f8df7909700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8dd0059d30 0x7f8dd005c1f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f8dec006cf0 tx=0x7f8dec01c000).stop 2021-02-12T17:20:09.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.484+0000 7f8df7909700 1 -- 172.21.2.102:0/3713270763 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8dd8003d00 msgr2=0x7f8df00b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:09.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.484+0000 7f8df7909700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8dd8003d00 0x7f8df00b17b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f8de0010c50 tx=0x7f8de0008040).stop 2021-02-12T17:20:09.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.484+0000 7f8df7909700 1 -- 172.21.2.102:0/3713270763 shutdown_connections 2021-02-12T17:20:09.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.484+0000 7f8df7909700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8df00b7720 0x7f8df0143450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:09.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.485+0000 7f8df7909700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8dd0059d30 0x7f8dd005c1f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:09.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.485+0000 7f8df7909700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8dd8003d00 0x7f8df00b17b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:09.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.485+0000 7f8df7909700 1 --2- 172.21.2.102:0/3713270763 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8df0114ba0 0x7f8df00b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:09.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.485+0000 7f8df7909700 1 -- 172.21.2.102:0/3713270763 >> 172.21.2.102:0/3713270763 conn(0x7f8df00bc480 msgr2=0x7f8df00b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:09.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.485+0000 7f8df7909700 1 -- 172.21.2.102:0/3713270763 shutdown_connections 2021-02-12T17:20:09.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:09.485+0000 7f8df7909700 1 -- 172.21.2.102:0/3713270763 wait complete. 2021-02-12T17:20:09.487 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 29 2021-02-12T17:20:09.495 INFO:tasks.mds_thrash.fs.[b]:mds.a has gained rank=0, replacing gid=4246 2021-02-12T17:20:09.495 INFO:tasks.mds_thrash.fs.[b]:waiting for 9 secs before reviving mds.d 2021-02-12T17:20:10.866 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:20:10.870 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:20:13.458 INFO:tasks.ceph.mds.a.gibba002.stderr:2021-02-12T17:20:13.457+0000 7f15b584f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-02-12T17:20:13.829 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:13.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.927+0000 7fe8a2332700 1 Processor -- start 2021-02-12T17:20:13.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.927+0000 7fe8a2332700 1 -- start start 2021-02-12T17:20:13.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.928+0000 7fe8a2332700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fe89c146400 0x7fe89c0681b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:13.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.928+0000 7fe8a2332700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe89c1477f0 0x7fe89c1451f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:13.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.928+0000 7fe8a2332700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c067290 con 0x7fe89c0b8d20 2021-02-12T17:20:13.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.928+0000 7fe8a2332700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c0686a0 con 0x7fe89c1477f0 2021-02-12T17:20:13.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.928+0000 7fe8a2332700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c067530 con 0x7fe89c146400 2021-02-12T17:20:13.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.928+0000 7fe89bfff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fe89c0b8d20 0x7fe89c066aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55460/0 (socket says 172.21.2.102:55460) 2021-02-12T17:20:13.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.928+0000 7fe89bfff700 1 -- 172.21.2.102:0/4204253475 learned_addr learned my addr 172.21.2.102:0/4204253475 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:20:13.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.928+0000 7fe8a08cf700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe89c1477f0 0x7fe89c1451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:13.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe8a08cf700 1 -- 172.21.2.102:0/4204253475 >> v2:172.21.2.104:3300/0 conn(0x7fe89c146400 msgr2=0x7fe89c0681b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:13.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe8a08cf700 1 --2- 172.21.2.102:0/4204253475 >> v2:172.21.2.104:3300/0 conn(0x7fe89c146400 0x7fe89c0681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:13.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe8a08cf700 1 -- 172.21.2.102:0/4204253475 >> v1:172.21.2.102:6789/0 conn(0x7fe89c0b8d20 legacy=0x7fe89c066aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:13.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe89affd700 1 -- 172.21.2.102:0/4204253475 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274910345 0 0) 0x7fe89c067290 con 0x7fe89c0b8d20 2021-02-12T17:20:13.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe8a08cf700 1 -- 172.21.2.102:0/4204253475 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c0677d0 con 0x7fe89c1477f0 2021-02-12T17:20:13.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe8a08cf700 1 --2- 172.21.2.102:0/4204253475 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe89c1477f0 0x7fe89c1451f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fe89c068f10 tx=0x7fe8940091d0).ready entity=mon.0 client_cookie=2c54393d69a3b50c server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:13.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe89affd700 1 -- 172.21.2.102:0/4204253475 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894009e70 con 0x7fe89c1477f0 2021-02-12T17:20:13.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe89affd700 1 -- 172.21.2.102:0/4204253475 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89400bc80 con 0x7fe89c1477f0 2021-02-12T17:20:13.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe89affd700 1 -- 172.21.2.102:0/4204253475 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894011400 con 0x7fe89c1477f0 2021-02-12T17:20:13.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe8a2332700 1 -- 172.21.2.102:0/4204253475 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe89c1477f0 msgr2=0x7fe89c1451f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:13.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe8a2332700 1 --2- 172.21.2.102:0/4204253475 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe89c1477f0 0x7fe89c1451f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fe89c068f10 tx=0x7fe8940091d0).stop 2021-02-12T17:20:13.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe8a2332700 1 -- 172.21.2.102:0/4204253475 shutdown_connections 2021-02-12T17:20:13.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe8a2332700 1 --2- 172.21.2.102:0/4204253475 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe89c1477f0 0x7fe89c1451f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:13.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe8a2332700 1 --2- 172.21.2.102:0/4204253475 >> v2:172.21.2.104:3300/0 conn(0x7fe89c146400 0x7fe89c0681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:13.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.929+0000 7fe8a2332700 1 -- 172.21.2.102:0/4204253475 >> 172.21.2.102:0/4204253475 conn(0x7fe89c0bc480 msgr2=0x7fe89c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:13.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.930+0000 7fe8a2332700 1 -- 172.21.2.102:0/4204253475 shutdown_connections 2021-02-12T17:20:13.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.930+0000 7fe8a2332700 1 -- 172.21.2.102:0/4204253475 wait complete. 2021-02-12T17:20:13.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.930+0000 7fe8a2332700 1 Processor -- start 2021-02-12T17:20:13.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.930+0000 7fe8a2332700 1 -- start start 2021-02-12T17:20:13.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.931+0000 7fe8a2332700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe89c0b8d20 0x7fe89c0ba100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:13.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.931+0000 7fe8a2332700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe89c146400 0x7fe89c145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:13.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.931+0000 7fe8a2332700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe89c1477f0 0x7fe89c13b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:13.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.931+0000 7fe8a2332700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c0b9b10 con 0x7fe89c146400 2021-02-12T17:20:13.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.931+0000 7fe8a2332700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c0ba5f0 con 0x7fe89c1477f0 2021-02-12T17:20:13.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.931+0000 7fe8a2332700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c0ba810 con 0x7fe89c0b8d20 2021-02-12T17:20:13.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.931+0000 7fe89b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe89c146400 0x7fe89c145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:13.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.931+0000 7fe89b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe89c146400 0x7fe89c145320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46822/0 (socket says 172.21.2.102:46822) 2021-02-12T17:20:13.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.931+0000 7fe89b7fe700 1 -- 172.21.2.102:0/596411665 learned_addr learned my addr 172.21.2.102:0/596411665 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:13.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.931+0000 7fe89bfff700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe89c0b8d20 0x7fe89c0ba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:13.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.931+0000 7fe8a08cf700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe89c1477f0 0x7fe89c13b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:13.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.932+0000 7fe89b7fe700 1 -- 172.21.2.102:0/596411665 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe89c0b8d20 msgr2=0x7fe89c0ba100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:13.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.932+0000 7fe89b7fe700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe89c0b8d20 0x7fe89c0ba100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:13.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.932+0000 7fe89b7fe700 1 -- 172.21.2.102:0/596411665 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe89c1477f0 msgr2=0x7fe89c13b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:13.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.932+0000 7fe89b7fe700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe89c1477f0 0x7fe89c13b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:13.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.932+0000 7fe89b7fe700 1 -- 172.21.2.102:0/596411665 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c0ad410 con 0x7fe89c146400 2021-02-12T17:20:13.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.932+0000 7fe8a08cf700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe89c1477f0 0x7fe89c13b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:20:13.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.932+0000 7fe89b7fe700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe89c146400 0x7fe89c145320 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fe88c009790 tx=0x7fe88c006e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:13.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.932+0000 7fe893fff700 1 -- 172.21.2.102:0/596411665 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00d5a0 con 0x7fe89c146400 2021-02-12T17:20:13.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.932+0000 7fe893fff700 1 -- 172.21.2.102:0/596411665 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c000e90 con 0x7fe89c146400 2021-02-12T17:20:13.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.932+0000 7fe8a2332700 1 -- 172.21.2.102:0/596411665 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c0ad6b0 con 0x7fe89c146400 2021-02-12T17:20:13.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.932+0000 7fe8a2332700 1 -- 172.21.2.102:0/596411665 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c145810 con 0x7fe89c146400 2021-02-12T17:20:13.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.932+0000 7fe893fff700 1 -- 172.21.2.102:0/596411665 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00d970 con 0x7fe89c146400 2021-02-12T17:20:13.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.933+0000 7fe8a2332700 1 -- 172.21.2.102:0/596411665 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe874004f60 con 0x7fe89c146400 2021-02-12T17:20:13.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.933+0000 7fe893fff700 1 -- 172.21.2.102:0/596411665 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fe88c017030 con 0x7fe89c146400 2021-02-12T17:20:13.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.933+0000 7fe893fff700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe880059d30 0x7fe88005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:13.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.933+0000 7fe893fff700 1 -- 172.21.2.102:0/596411665 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7193+0+0 (secure 0 0 0) 0x7fe88c073060 con 0x7fe89c146400 2021-02-12T17:20:13.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.933+0000 7fe89bfff700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe880059d30 0x7fe88005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:13.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.934+0000 7fe89bfff700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe880059d30 0x7fe88005c1f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fe884007fd0 tx=0x7fe884009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:13.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:13.936+0000 7fe893fff700 1 -- 172.21.2.102:0/596411665 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fe88c046680 con 0x7fe89c146400 2021-02-12T17:20:14.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.096+0000 7fe8a2332700 1 -- 172.21.2.102:0/596411665 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe874005790 con 0x7fe89c146400 2021-02-12T17:20:14.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.097+0000 7fe893fff700 1 -- 172.21.2.102:0/596411665 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3400 (secure 0 0 0) 0x7fe88c015020 con 0x7fe89c146400 2021-02-12T17:20:14.098 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:14.098 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:14.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.098+0000 7fe8a2332700 1 -- 172.21.2.102:0/596411665 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe880059d30 msgr2=0x7fe88005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:14.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.098+0000 7fe8a2332700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe880059d30 0x7fe88005c1f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fe884007fd0 tx=0x7fe884009040).stop 2021-02-12T17:20:14.099 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.098+0000 7fe8a2332700 1 -- 172.21.2.102:0/596411665 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe89c146400 msgr2=0x7fe89c145320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:14.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.098+0000 7fe8a2332700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe89c146400 0x7fe89c145320 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fe88c009790 tx=0x7fe88c006e80).stop 2021-02-12T17:20:14.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.098+0000 7fe8a2332700 1 -- 172.21.2.102:0/596411665 shutdown_connections 2021-02-12T17:20:14.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.098+0000 7fe8a2332700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe89c1477f0 0x7fe89c13b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:14.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.098+0000 7fe8a2332700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe89c0b8d20 0x7fe89c0ba100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:14.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.098+0000 7fe8a2332700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe880059d30 0x7fe88005c1f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:14.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.098+0000 7fe8a2332700 1 --2- 172.21.2.102:0/596411665 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe89c146400 0x7fe89c145320 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:14.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.098+0000 7fe8a2332700 1 -- 172.21.2.102:0/596411665 >> 172.21.2.102:0/596411665 conn(0x7fe89c0bc480 msgr2=0x7fe89c0b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:14.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.098+0000 7fe8a2332700 1 -- 172.21.2.102:0/596411665 shutdown_connections 2021-02-12T17:20:14.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.098+0000 7fe8a2332700 1 -- 172.21.2.102:0/596411665 wait complete. 2021-02-12T17:20:14.101 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 29 2021-02-12T17:20:14.108 INFO:tasks.mds_thrash.fs.[a]:kill mds.c (rank=0) 2021-02-12T17:20:14.108 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-02-12T17:20:14.109 INFO:teuthology.orchestra.run:waiting for 300 2021-02-12T17:20:14.116 INFO:tasks.ceph.mds.c:Stopped 2021-02-12T17:20:14.116 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:14.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.244+0000 7f0ef3331700 1 Processor -- start 2021-02-12T17:20:14.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.244+0000 7f0ef3331700 1 -- start start 2021-02-12T17:20:14.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.245+0000 7f0ef3331700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f0eec0b8d20 0x7f0eec068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:14.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.245+0000 7f0ef3331700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0eec14e530 0x7f0eec0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:14.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.245+0000 7f0ef3331700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec0622a0 con 0x7f0eec062740 2021-02-12T17:20:14.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.245+0000 7f0ef3331700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec068d20 con 0x7f0eec14e530 2021-02-12T17:20:14.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.245+0000 7f0ef3331700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec14ea10 con 0x7f0eec0b8d20 2021-02-12T17:20:14.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.245+0000 7f0ef08cc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0eec14e530 0x7f0eec0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:14.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.245+0000 7f0ef08cc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0eec14e530 0x7f0eec0b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46834/0 (socket says 172.21.2.102:46834) 2021-02-12T17:20:14.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.245+0000 7f0ef08cc700 1 -- 172.21.2.102:0/4165250647 learned_addr learned my addr 172.21.2.102:0/4165250647 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:14.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.245+0000 7f0ef08cc700 1 -- 172.21.2.102:0/4165250647 >> v2:172.21.2.104:3300/0 conn(0x7f0eec0b8d20 msgr2=0x7f0eec068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:14.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.245+0000 7f0ef08cc700 1 --2- 172.21.2.102:0/4165250647 >> v2:172.21.2.104:3300/0 conn(0x7f0eec0b8d20 0x7f0eec068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:14.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.245+0000 7f0ef08cc700 1 -- 172.21.2.102:0/4165250647 >> v1:172.21.2.102:6789/0 conn(0x7f0eec062740 legacy=0x7f0eec062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:14.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.245+0000 7f0ef08cc700 1 -- 172.21.2.102:0/4165250647 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec0b63f0 con 0x7f0eec14e530 2021-02-12T17:20:14.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.246+0000 7f0ef08cc700 1 --2- 172.21.2.102:0/4165250647 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0eec14e530 0x7f0eec0b7250 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f0eec06abc0 tx=0x7f0ee8006ea0).ready entity=mon.0 client_cookie=22a85feeadc36d4a server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:14.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.246+0000 7f0edbfff700 1 -- 172.21.2.102:0/4165250647 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8009840 con 0x7f0eec14e530 2021-02-12T17:20:14.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.246+0000 7f0edbfff700 1 -- 172.21.2.102:0/4165250647 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee80099a0 con 0x7f0eec14e530 2021-02-12T17:20:14.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.246+0000 7f0edbfff700 1 -- 172.21.2.102:0/4165250647 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8009d20 con 0x7f0eec14e530 2021-02-12T17:20:14.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.246+0000 7f0ef3331700 1 -- 172.21.2.102:0/4165250647 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0eec14e530 msgr2=0x7f0eec0b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:14.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.246+0000 7f0ef3331700 1 --2- 172.21.2.102:0/4165250647 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0eec14e530 0x7f0eec0b7250 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f0eec06abc0 tx=0x7f0ee8006ea0).stop 2021-02-12T17:20:14.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.246+0000 7f0ef3331700 1 -- 172.21.2.102:0/4165250647 shutdown_connections 2021-02-12T17:20:14.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.246+0000 7f0ef3331700 1 --2- 172.21.2.102:0/4165250647 >> v2:172.21.2.104:3300/0 conn(0x7f0eec0b8d20 0x7f0eec068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:14.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.246+0000 7f0ef3331700 1 --2- 172.21.2.102:0/4165250647 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0eec14e530 0x7f0eec0b7250 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:14.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.246+0000 7f0ef3331700 1 -- 172.21.2.102:0/4165250647 >> 172.21.2.102:0/4165250647 conn(0x7f0eec0bc480 msgr2=0x7f0eec0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:14.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.246+0000 7f0ef3331700 1 -- 172.21.2.102:0/4165250647 shutdown_connections 2021-02-12T17:20:14.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.246+0000 7f0ef3331700 1 -- 172.21.2.102:0/4165250647 wait complete. 2021-02-12T17:20:14.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.247+0000 7f0ef3331700 1 Processor -- start 2021-02-12T17:20:14.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.247+0000 7f0ef3331700 1 -- start start 2021-02-12T17:20:14.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef3331700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0eec062740 0x7f0eec0ba480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:14.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef3331700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0eec0b8d20 0x7f0eec0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:14.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef3331700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0eec14e530 0x7f0eec0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:14.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef3331700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0b16f0 con 0x7f0eec0b8d20 2021-02-12T17:20:14.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef3331700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0b5870 con 0x7f0eec14e530 2021-02-12T17:20:14.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef3331700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec15d4e0 con 0x7f0eec062740 2021-02-12T17:20:14.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef08cc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0eec0b8d20 0x7f0eec0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:14.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef08cc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0eec0b8d20 0x7f0eec0b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46838/0 (socket says 172.21.2.102:46838) 2021-02-12T17:20:14.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef08cc700 1 -- 172.21.2.102:0/272911515 learned_addr learned my addr 172.21.2.102:0/272911515 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:14.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef08cc700 1 -- 172.21.2.102:0/272911515 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0eec062740 msgr2=0x7f0eec0ba480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:14.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef08cc700 1 --2- 172.21.2.102:0/272911515 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0eec062740 0x7f0eec0ba480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:14.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef08cc700 1 -- 172.21.2.102:0/272911515 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0eec14e530 msgr2=0x7f0eec0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:14.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef08cc700 1 --2- 172.21.2.102:0/272911515 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0eec14e530 0x7f0eec0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:14.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef08cc700 1 -- 172.21.2.102:0/272911515 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec15d780 con 0x7f0eec0b8d20 2021-02-12T17:20:14.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef08cc700 1 --2- 172.21.2.102:0/272911515 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0eec0b8d20 0x7f0eec0b0d10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f0ee8006ee0 tx=0x7f0ee8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:14.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ed97fa700 1 -- 172.21.2.102:0/272911515 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee801b410 con 0x7f0eec0b8d20 2021-02-12T17:20:14.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ed97fa700 1 -- 172.21.2.102:0/272911515 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee801b590 con 0x7f0eec0b8d20 2021-02-12T17:20:14.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef3331700 1 -- 172.21.2.102:0/272911515 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec15da20 con 0x7f0eec0b8d20 2021-02-12T17:20:14.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ed97fa700 1 -- 172.21.2.102:0/272911515 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee801b950 con 0x7f0eec0b8d20 2021-02-12T17:20:14.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.248+0000 7f0ef3331700 1 -- 172.21.2.102:0/272911515 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec0b4f10 con 0x7f0eec0b8d20 2021-02-12T17:20:14.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.249+0000 7f0ef3331700 1 -- 172.21.2.102:0/272911515 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec15de80 con 0x7f0eec0b8d20 2021-02-12T17:20:14.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.249+0000 7f0ed97fa700 1 -- 172.21.2.102:0/272911515 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f0ee802a070 con 0x7f0eec0b8d20 2021-02-12T17:20:14.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.249+0000 7f0ed97fa700 1 --2- 172.21.2.102:0/272911515 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0ecc059d30 0x7f0ecc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:14.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.250+0000 7f0ed97fa700 1 -- 172.21.2.102:0/272911515 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7193+0+0 (secure 0 0 0) 0x7f0ee8075270 con 0x7f0eec0b8d20 2021-02-12T17:20:14.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.250+0000 7f0ef10cd700 1 --2- 172.21.2.102:0/272911515 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0ecc059d30 0x7f0ecc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:14.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.250+0000 7f0ef10cd700 1 --2- 172.21.2.102:0/272911515 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0ecc059d30 0x7f0ecc05c1f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f0edc009540 tx=0x7f0edc006a70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:14.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.252+0000 7f0ed97fa700 1 -- 172.21.2.102:0/272911515 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f0ee8048950 con 0x7f0eec0b8d20 2021-02-12T17:20:14.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.410+0000 7f0ef3331700 1 -- 172.21.2.102:0/272911515 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0eec045460 con 0x7f0eec0b8d20 2021-02-12T17:20:14.412 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.410+0000 7f0ed97fa700 1 -- 172.21.2.102:0/272911515 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3400 (secure 0 0 0) 0x7f0ee8028090 con 0x7f0eec0b8d20 2021-02-12T17:20:14.412 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:14.412 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:14.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.412+0000 7f0ef3331700 1 -- 172.21.2.102:0/272911515 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0ecc059d30 msgr2=0x7f0ecc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:14.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.412+0000 7f0ef3331700 1 --2- 172.21.2.102:0/272911515 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0ecc059d30 0x7f0ecc05c1f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f0edc009540 tx=0x7f0edc006a70).stop 2021-02-12T17:20:14.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.412+0000 7f0ef3331700 1 -- 172.21.2.102:0/272911515 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0eec0b8d20 msgr2=0x7f0eec0b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:14.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.412+0000 7f0ef3331700 1 --2- 172.21.2.102:0/272911515 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0eec0b8d20 0x7f0eec0b0d10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f0ee8006ee0 tx=0x7f0ee8016000).stop 2021-02-12T17:20:14.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.412+0000 7f0ef3331700 1 -- 172.21.2.102:0/272911515 shutdown_connections 2021-02-12T17:20:14.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.412+0000 7f0ef3331700 1 --2- 172.21.2.102:0/272911515 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0eec14e530 0x7f0eec0b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:14.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.412+0000 7f0ef3331700 1 --2- 172.21.2.102:0/272911515 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0eec062740 0x7f0eec0ba480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:14.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.412+0000 7f0ef3331700 1 --2- 172.21.2.102:0/272911515 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0ecc059d30 0x7f0ecc05c1f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:14.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.412+0000 7f0ef3331700 1 --2- 172.21.2.102:0/272911515 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0eec0b8d20 0x7f0eec0b0d10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:14.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.412+0000 7f0ef3331700 1 -- 172.21.2.102:0/272911515 >> 172.21.2.102:0/272911515 conn(0x7f0eec0bc480 msgr2=0x7f0eec0b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:14.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.412+0000 7f0ef3331700 1 -- 172.21.2.102:0/272911515 shutdown_connections 2021-02-12T17:20:14.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:14.412+0000 7f0ef3331700 1 -- 172.21.2.102:0/272911515 wait complete. 2021-02-12T17:20:14.415 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 29 2021-02-12T17:20:14.422 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:20:16.422 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:16.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.509+0000 7fa7aa9da700 1 Processor -- start 2021-02-12T17:20:16.510 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.509+0000 7fa7aa9da700 1 -- start start 2021-02-12T17:20:16.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.509+0000 7fa7aa9da700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fa7a414e530 0x7fa7a4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:16.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.509+0000 7fa7aa9da700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa7a4062740 0x7fa7a4062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:16.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.509+0000 7fa7aa9da700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a40b7960 con 0x7fa7a40b8d20 2021-02-12T17:20:16.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.509+0000 7fa7aa9da700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a4068d20 con 0x7fa7a414e530 2021-02-12T17:20:16.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.509+0000 7fa7aa9da700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40622a0 con 0x7fa7a4062740 2021-02-12T17:20:16.512 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.510+0000 7fa7a37fe700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fa7a414e530 0x7fa7a4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:16.512 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.510+0000 7fa7a3fff700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7fa7a40b8d20 0x7fa7a40b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:37866/0 (socket says 172.21.2.102:37866) 2021-02-12T17:20:16.512 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.510+0000 7fa7a8f77700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa7a4062740 0x7fa7a4062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:16.512 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.510+0000 7fa7a3fff700 1 -- 172.21.2.102:0/2145519627 learned_addr learned my addr 172.21.2.102:0/2145519627 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:20:16.512 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.511+0000 7fa7a37fe700 1 -- 172.21.2.102:0/2145519627 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa7a4062740 msgr2=0x7fa7a4062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:16.513 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.511+0000 7fa7a37fe700 1 --2- 172.21.2.102:0/2145519627 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa7a4062740 0x7fa7a4062bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:16.513 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.511+0000 7fa7a37fe700 1 -- 172.21.2.102:0/2145519627 >> v1:172.21.2.104:6789/0 conn(0x7fa7a40b8d20 legacy=0x7fa7a40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:16.513 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.511+0000 7fa7a37fe700 1 -- 172.21.2.102:0/2145519627 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a414ea10 con 0x7fa7a414e530 2021-02-12T17:20:16.513 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.511+0000 7fa7a37fe700 1 --2- 172.21.2.102:0/2145519627 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa7a414e530 0x7fa7a4068830 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fa79400b980 tx=0x7fa794006de0).ready entity=mon.1 client_cookie=b73c1b673968ab90 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:16.513 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.511+0000 7fa7a2ffd700 1 -- 172.21.2.102:0/2145519627 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79400be70 con 0x7fa7a414e530 2021-02-12T17:20:16.513 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.512+0000 7fa7a2ffd700 1 -- 172.21.2.102:0/2145519627 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7940096e0 con 0x7fa7a414e530 2021-02-12T17:20:16.513 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.512+0000 7fa7a2ffd700 1 -- 172.21.2.102:0/2145519627 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794009a60 con 0x7fa7a414e530 2021-02-12T17:20:16.514 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.512+0000 7fa7aa9da700 1 -- 172.21.2.102:0/2145519627 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa7a414e530 msgr2=0x7fa7a4068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:16.514 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.512+0000 7fa7aa9da700 1 --2- 172.21.2.102:0/2145519627 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa7a414e530 0x7fa7a4068830 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fa79400b980 tx=0x7fa794006de0).stop 2021-02-12T17:20:16.514 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.512+0000 7fa7aa9da700 1 -- 172.21.2.102:0/2145519627 shutdown_connections 2021-02-12T17:20:16.514 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.512+0000 7fa7aa9da700 1 --2- 172.21.2.102:0/2145519627 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa7a4062740 0x7fa7a4062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:16.514 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.512+0000 7fa7aa9da700 1 --2- 172.21.2.102:0/2145519627 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa7a414e530 0x7fa7a4068830 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:16.514 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.512+0000 7fa7aa9da700 1 -- 172.21.2.102:0/2145519627 >> 172.21.2.102:0/2145519627 conn(0x7fa7a40bc480 msgr2=0x7fa7a40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:16.514 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.512+0000 7fa7aa9da700 1 -- 172.21.2.102:0/2145519627 shutdown_connections 2021-02-12T17:20:16.515 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.512+0000 7fa7aa9da700 1 -- 172.21.2.102:0/2145519627 wait complete. 2021-02-12T17:20:16.515 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.513+0000 7fa7aa9da700 1 Processor -- start 2021-02-12T17:20:16.515 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.513+0000 7fa7aa9da700 1 -- start start 2021-02-12T17:20:16.516 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.513+0000 7fa7aa9da700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa7a4062740 0x7fa7a4151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:16.516 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.513+0000 7fa7aa9da700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa7a40b8d20 0x7fa7a411d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:16.516 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.513+0000 7fa7aa9da700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa7a414e530 0x7fa7a411d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:16.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.513+0000 7fa7aa9da700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a413f8b0 con 0x7fa7a414e530 2021-02-12T17:20:16.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.513+0000 7fa7aa9da700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a413fb50 con 0x7fa7a4062740 2021-02-12T17:20:16.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.513+0000 7fa7aa9da700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a413fdf0 con 0x7fa7a40b8d20 2021-02-12T17:20:16.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.514+0000 7fa7a8f77700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa7a414e530 0x7fa7a411d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:16.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.514+0000 7fa7a3fff700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa7a4062740 0x7fa7a4151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:16.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.514+0000 7fa7a8f77700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa7a414e530 0x7fa7a411d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46860/0 (socket says 172.21.2.102:46860) 2021-02-12T17:20:16.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.514+0000 7fa7a8f77700 1 -- 172.21.2.102:0/1915718721 learned_addr learned my addr 172.21.2.102:0/1915718721 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:16.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.514+0000 7fa7a37fe700 1 --2- 172.21.2.102:0/1915718721 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa7a40b8d20 0x7fa7a411d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:16.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.514+0000 7fa7a8f77700 1 -- 172.21.2.102:0/1915718721 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa7a40b8d20 msgr2=0x7fa7a411d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:16.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.514+0000 7fa7a8f77700 1 --2- 172.21.2.102:0/1915718721 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa7a40b8d20 0x7fa7a411d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:16.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.514+0000 7fa7a8f77700 1 -- 172.21.2.102:0/1915718721 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa7a4062740 msgr2=0x7fa7a4151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:16.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.514+0000 7fa7a8f77700 1 --2- 172.21.2.102:0/1915718721 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa7a4062740 0x7fa7a4151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:16.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.514+0000 7fa7a8f77700 1 -- 172.21.2.102:0/1915718721 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a4140090 con 0x7fa7a414e530 2021-02-12T17:20:16.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.514+0000 7fa7a8f77700 1 --2- 172.21.2.102:0/1915718721 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa7a414e530 0x7fa7a411d980 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fa79c00ef50 tx=0x7fa79c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:16.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.515+0000 7fa79bfff700 1 -- 172.21.2.102:0/1915718721 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c009700 con 0x7fa7a414e530 2021-02-12T17:20:16.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.515+0000 7fa79bfff700 1 -- 172.21.2.102:0/1915718721 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c00cb40 con 0x7fa7a414e530 2021-02-12T17:20:16.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.515+0000 7fa79bfff700 1 -- 172.21.2.102:0/1915718721 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00cee0 con 0x7fa7a414e530 2021-02-12T17:20:16.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.515+0000 7fa7aa9da700 1 -- 172.21.2.102:0/1915718721 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a415d740 con 0x7fa7a414e530 2021-02-12T17:20:16.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.515+0000 7fa7aa9da700 1 -- 172.21.2.102:0/1915718721 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a4151a20 con 0x7fa7a414e530 2021-02-12T17:20:16.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.516+0000 7fa7aa9da700 1 -- 172.21.2.102:0/1915718721 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a415d8d0 con 0x7fa7a414e530 2021-02-12T17:20:16.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.516+0000 7fa79bfff700 1 -- 172.21.2.102:0/1915718721 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fa79c022070 con 0x7fa7a414e530 2021-02-12T17:20:16.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.516+0000 7fa79bfff700 1 --2- 172.21.2.102:0/1915718721 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa788059d30 0x7fa78805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:16.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.516+0000 7fa79bfff700 1 -- 172.21.2.102:0/1915718721 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7193+0+0 (secure 0 0 0) 0x7fa79c074680 con 0x7fa7a414e530 2021-02-12T17:20:16.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.516+0000 7fa7a3fff700 1 --2- 172.21.2.102:0/1915718721 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa788059d30 0x7fa78805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:16.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.517+0000 7fa7a3fff700 1 --2- 172.21.2.102:0/1915718721 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa788059d30 0x7fa78805c1f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fa7a414b900 tx=0x7fa78c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:16.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.519+0000 7fa79bfff700 1 -- 172.21.2.102:0/1915718721 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fa79c047c50 con 0x7fa7a414e530 2021-02-12T17:20:16.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.679+0000 7fa7aa9da700 1 -- 172.21.2.102:0/1915718721 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7a4045460 con 0x7fa7a414e530 2021-02-12T17:20:16.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.679+0000 7fa79bfff700 1 -- 172.21.2.102:0/1915718721 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3400 (secure 0 0 0) 0x7fa79c016070 con 0x7fa7a414e530 2021-02-12T17:20:16.681 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:16.681 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:16.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.680+0000 7fa7aa9da700 1 -- 172.21.2.102:0/1915718721 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa788059d30 msgr2=0x7fa78805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:16.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.680+0000 7fa7aa9da700 1 --2- 172.21.2.102:0/1915718721 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa788059d30 0x7fa78805c1f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fa7a414b900 tx=0x7fa78c009040).stop 2021-02-12T17:20:16.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.680+0000 7fa7aa9da700 1 -- 172.21.2.102:0/1915718721 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa7a414e530 msgr2=0x7fa7a411d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:16.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.680+0000 7fa7aa9da700 1 --2- 172.21.2.102:0/1915718721 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa7a414e530 0x7fa7a411d980 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fa79c00ef50 tx=0x7fa79c0091d0).stop 2021-02-12T17:20:16.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.680+0000 7fa7aa9da700 1 -- 172.21.2.102:0/1915718721 shutdown_connections 2021-02-12T17:20:16.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.680+0000 7fa7aa9da700 1 --2- 172.21.2.102:0/1915718721 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa788059d30 0x7fa78805c1f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:16.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.680+0000 7fa7aa9da700 1 --2- 172.21.2.102:0/1915718721 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa7a414e530 0x7fa7a411d980 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:16.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.680+0000 7fa7aa9da700 1 --2- 172.21.2.102:0/1915718721 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa7a4062740 0x7fa7a4151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:16.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.680+0000 7fa7aa9da700 1 --2- 172.21.2.102:0/1915718721 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa7a40b8d20 0x7fa7a411d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:16.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.680+0000 7fa7aa9da700 1 -- 172.21.2.102:0/1915718721 >> 172.21.2.102:0/1915718721 conn(0x7fa7a40bc480 msgr2=0x7fa7a40b7250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:16.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.681+0000 7fa7aa9da700 1 -- 172.21.2.102:0/1915718721 shutdown_connections 2021-02-12T17:20:16.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:16.681+0000 7fa7aa9da700 1 -- 172.21.2.102:0/1915718721 wait complete. 2021-02-12T17:20:16.683 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 29 2021-02-12T17:20:16.690 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:20:18.496 INFO:tasks.mds_thrash.fs.[b]:reviving mds.d 2021-02-12T17:20:18.496 INFO:tasks.ceph.mds.d:Restarting daemon 2021-02-12T17:20:18.497 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2021-02-12T17:20:18.501 INFO:tasks.ceph.mds.d:Started 2021-02-12T17:20:18.501 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:18.556 INFO:tasks.ceph.mds.d.gibba004.stdout:starting mds.d at 2021-02-12T17:20:18.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.590+0000 7efcfd5b4700 1 Processor -- start 2021-02-12T17:20:18.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.590+0000 7efcfd5b4700 1 -- start start 2021-02-12T17:20:18.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcfd5b4700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7efcf80b8d20 0x7efcf8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:18.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcfd5b4700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efcf814e530 0x7efcf80b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:18.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcfd5b4700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf80622a0 con 0x7efcf8062740 2021-02-12T17:20:18.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcfd5b4700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf8068d20 con 0x7efcf80b8d20 2021-02-12T17:20:18.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcfd5b4700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf814ea10 con 0x7efcf814e530 2021-02-12T17:20:18.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcf6ffd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7efcf80b8d20 0x7efcf8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:18.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcf6ffd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7efcf80b8d20 0x7efcf8068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46870/0 (socket says 172.21.2.102:46870) 2021-02-12T17:20:18.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcf6ffd700 1 -- 172.21.2.102:0/2462610200 learned_addr learned my addr 172.21.2.102:0/2462610200 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:18.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcf6ffd700 1 -- 172.21.2.102:0/2462610200 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efcf814e530 msgr2=0x7efcf80b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:20:18.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcf6ffd700 1 --2- 172.21.2.102:0/2462610200 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efcf814e530 0x7efcf80b7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:18.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcf6ffd700 1 -- 172.21.2.102:0/2462610200 >> v1:172.21.2.104:6789/0 conn(0x7efcf8062740 legacy=0x7efcf8062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:20:18.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcf6ffd700 1 -- 172.21.2.102:0/2462610200 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80b63f0 con 0x7efcf80b8d20 2021-02-12T17:20:18.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcf6ffd700 1 --2- 172.21.2.102:0/2462610200 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efcf80b8d20 0x7efcf8068830 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7efce800b9e0 tx=0x7efce8006ea0).ready entity=mon.0 client_cookie=d108bf4e666fdf19 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:18.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcf5ffb700 1 -- 172.21.2.102:0/2462610200 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8009800 con 0x7efcf80b8d20 2021-02-12T17:20:18.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcf5ffb700 1 -- 172.21.2.102:0/2462610200 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce8009960 con 0x7efcf80b8d20 2021-02-12T17:20:18.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.591+0000 7efcf5ffb700 1 -- 172.21.2.102:0/2462610200 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8009ce0 con 0x7efcf80b8d20 2021-02-12T17:20:18.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.592+0000 7efcfd5b4700 1 -- 172.21.2.102:0/2462610200 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efcf80b8d20 msgr2=0x7efcf8068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:18.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.592+0000 7efcfd5b4700 1 --2- 172.21.2.102:0/2462610200 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efcf80b8d20 0x7efcf8068830 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7efce800b9e0 tx=0x7efce8006ea0).stop 2021-02-12T17:20:18.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.592+0000 7efcfd5b4700 1 -- 172.21.2.102:0/2462610200 shutdown_connections 2021-02-12T17:20:18.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.592+0000 7efcfd5b4700 1 --2- 172.21.2.102:0/2462610200 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efcf80b8d20 0x7efcf8068830 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:18.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.592+0000 7efcfd5b4700 1 --2- 172.21.2.102:0/2462610200 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efcf814e530 0x7efcf80b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:18.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.592+0000 7efcfd5b4700 1 -- 172.21.2.102:0/2462610200 >> 172.21.2.102:0/2462610200 conn(0x7efcf80bc480 msgr2=0x7efcf80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:18.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.592+0000 7efcfd5b4700 1 -- 172.21.2.102:0/2462610200 shutdown_connections 2021-02-12T17:20:18.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.592+0000 7efcfd5b4700 1 -- 172.21.2.102:0/2462610200 wait complete. 2021-02-12T17:20:18.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.593+0000 7efcfd5b4700 1 Processor -- start 2021-02-12T17:20:18.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.593+0000 7efcfd5b4700 1 -- start start 2021-02-12T17:20:18.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.593+0000 7efcfd5b4700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efcf8062740 0x7efcf8140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:18.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.593+0000 7efcfd5b4700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7efcf80b8d20 0x7efcf815d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:18.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.593+0000 7efcfd5b4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efcf814e530 0x7efcf80b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:18.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.593+0000 7efcfd5b4700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf811e220 con 0x7efcf814e530 2021-02-12T17:20:18.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.593+0000 7efcfd5b4700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8140530 con 0x7efcf80b8d20 2021-02-12T17:20:18.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.593+0000 7efcfd5b4700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf811da40 con 0x7efcf8062740 2021-02-12T17:20:18.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.593+0000 7efcf77fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efcf814e530 0x7efcf80b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:18.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.593+0000 7efcf77fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efcf814e530 0x7efcf80b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46876/0 (socket says 172.21.2.102:46876) 2021-02-12T17:20:18.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.593+0000 7efcf77fe700 1 -- 172.21.2.102:0/215960775 learned_addr learned my addr 172.21.2.102:0/215960775 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:18.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.594+0000 7efcf77fe700 1 -- 172.21.2.102:0/215960775 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efcf8062740 msgr2=0x7efcf8140040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:20:18.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.594+0000 7efcf77fe700 1 --2- 172.21.2.102:0/215960775 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efcf8062740 0x7efcf8140040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:18.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.594+0000 7efcf77fe700 1 -- 172.21.2.102:0/215960775 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7efcf80b8d20 msgr2=0x7efcf815d770 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:20:18.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.594+0000 7efcf77fe700 1 --2- 172.21.2.102:0/215960775 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7efcf80b8d20 0x7efcf815d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:18.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.594+0000 7efcf77fe700 1 -- 172.21.2.102:0/215960775 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf811dce0 con 0x7efcf814e530 2021-02-12T17:20:18.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.594+0000 7efcf77fe700 1 --2- 172.21.2.102:0/215960775 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efcf814e530 0x7efcf80b55b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7efcf000bae0 tx=0x7efcf00091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:18.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.594+0000 7efceeffd700 1 -- 172.21.2.102:0/215960775 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf000c7f0 con 0x7efcf814e530 2021-02-12T17:20:18.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.594+0000 7efceeffd700 1 -- 172.21.2.102:0/215960775 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf000c990 con 0x7efcf814e530 2021-02-12T17:20:18.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.594+0000 7efcfd5b4700 1 -- 172.21.2.102:0/215960775 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf811df80 con 0x7efcf814e530 2021-02-12T17:20:18.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.594+0000 7efceeffd700 1 -- 172.21.2.102:0/215960775 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf000cb40 con 0x7efcf814e530 2021-02-12T17:20:18.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.594+0000 7efcfd5b4700 1 -- 172.21.2.102:0/215960775 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf815dc60 con 0x7efcf814e530 2021-02-12T17:20:18.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.595+0000 7efcfd5b4700 1 -- 172.21.2.102:0/215960775 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf813fd60 con 0x7efcf814e530 2021-02-12T17:20:18.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.595+0000 7efceeffd700 1 -- 172.21.2.102:0/215960775 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7efcf001c070 con 0x7efcf814e530 2021-02-12T17:20:18.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.595+0000 7efceeffd700 1 --2- 172.21.2.102:0/215960775 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efcdc059d30 0x7efcdc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:18.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.595+0000 7efceeffd700 1 -- 172.21.2.102:0/215960775 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7193+0+0 (secure 0 0 0) 0x7efcf0073530 con 0x7efcf814e530 2021-02-12T17:20:18.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.595+0000 7efcf6ffd700 1 --2- 172.21.2.102:0/215960775 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efcdc059d30 0x7efcdc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:18.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.596+0000 7efcf6ffd700 1 --2- 172.21.2.102:0/215960775 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efcdc059d30 0x7efcdc05c1f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7efce800b190 tx=0x7efce8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:18.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.598+0000 7efceeffd700 1 -- 172.21.2.102:0/215960775 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7efcf0046c10 con 0x7efcf814e530 2021-02-12T17:20:18.691 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:18.758 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.757+0000 7efcfd5b4700 1 -- 172.21.2.102:0/215960775 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcf8045460 con 0x7efcf814e530 2021-02-12T17:20:18.759 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.757+0000 7efceeffd700 1 -- 172.21.2.102:0/215960775 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3400 (secure 0 0 0) 0x7efcf001a070 con 0x7efcf814e530 2021-02-12T17:20:18.759 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:18.759 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:18.760 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.759+0000 7efcfd5b4700 1 -- 172.21.2.102:0/215960775 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efcdc059d30 msgr2=0x7efcdc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:18.760 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.759+0000 7efcfd5b4700 1 --2- 172.21.2.102:0/215960775 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efcdc059d30 0x7efcdc05c1f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7efce800b190 tx=0x7efce8016000).stop 2021-02-12T17:20:18.760 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.759+0000 7efcfd5b4700 1 -- 172.21.2.102:0/215960775 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efcf814e530 msgr2=0x7efcf80b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:18.760 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.759+0000 7efcfd5b4700 1 --2- 172.21.2.102:0/215960775 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efcf814e530 0x7efcf80b55b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7efcf000bae0 tx=0x7efcf00091a0).stop 2021-02-12T17:20:18.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.759+0000 7efcfd5b4700 1 -- 172.21.2.102:0/215960775 shutdown_connections 2021-02-12T17:20:18.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.759+0000 7efcfd5b4700 1 --2- 172.21.2.102:0/215960775 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efcdc059d30 0x7efcdc05c1f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:18.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.759+0000 7efcfd5b4700 1 --2- 172.21.2.102:0/215960775 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efcf814e530 0x7efcf80b55b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:18.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.759+0000 7efcfd5b4700 1 --2- 172.21.2.102:0/215960775 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efcf8062740 0x7efcf8140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:18.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.759+0000 7efcfd5b4700 1 --2- 172.21.2.102:0/215960775 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7efcf80b8d20 0x7efcf815d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:18.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.759+0000 7efcfd5b4700 1 -- 172.21.2.102:0/215960775 >> 172.21.2.102:0/215960775 conn(0x7efcf80bc480 msgr2=0x7efcf814cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:18.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.759+0000 7efcfd5b4700 1 -- 172.21.2.102:0/215960775 shutdown_connections 2021-02-12T17:20:18.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.759+0000 7efcfd5b4700 1 -- 172.21.2.102:0/215960775 wait complete. 2021-02-12T17:20:18.761 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 29 2021-02-12T17:20:18.769 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2021-02-12T17:20:18.781 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.780+0000 7fdb650f6700 1 Processor -- start 2021-02-12T17:20:18.781 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.780+0000 7fdb650f6700 1 -- start start 2021-02-12T17:20:18.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.780+0000 7fdb650f6700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fdb600b8d20 0x7fdb60068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:18.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.780+0000 7fdb650f6700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fdb6014e530 0x7fdb600b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:18.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.780+0000 7fdb650f6700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb600622a0 con 0x7fdb60062740 2021-02-12T17:20:18.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.780+0000 7fdb650f6700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb60068d20 con 0x7fdb600b8d20 2021-02-12T17:20:18.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.780+0000 7fdb650f6700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6014ea10 con 0x7fdb6014e530 2021-02-12T17:20:18.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.780+0000 7fdb5f59e700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fdb60062740 0x7fdb60062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55524/0 (socket says 172.21.2.102:55524) 2021-02-12T17:20:18.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.780+0000 7fdb5f59e700 1 -- 172.21.2.102:0/3123921202 learned_addr learned my addr 172.21.2.102:0/3123921202 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:20:18.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.780+0000 7fdb5ed9d700 1 --2- 172.21.2.102:0/3123921202 >> v2:172.21.2.102:3300/0 conn(0x7fdb600b8d20 0x7fdb60068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:18.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb5dd9b700 1 -- 172.21.2.102:0/3123921202 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124500231 0 0) 0x7fdb600622a0 con 0x7fdb60062740 2021-02-12T17:20:18.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb5dd9b700 1 -- 172.21.2.102:0/3123921202 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb40003230 con 0x7fdb60062740 2021-02-12T17:20:18.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb5ed9d700 1 -- 172.21.2.102:0/3123921202 >> v2:172.21.2.104:3300/0 conn(0x7fdb6014e530 msgr2=0x7fdb600b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:18.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb5ed9d700 1 --2- 172.21.2.102:0/3123921202 >> v2:172.21.2.104:3300/0 conn(0x7fdb6014e530 0x7fdb600b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:18.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb5ed9d700 1 -- 172.21.2.102:0/3123921202 >> v1:172.21.2.102:6789/0 conn(0x7fdb60062740 legacy=0x7fdb60062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:18.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb5ed9d700 1 -- 172.21.2.102:0/3123921202 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb600b63f0 con 0x7fdb600b8d20 2021-02-12T17:20:18.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb5ed9d700 1 --2- 172.21.2.102:0/3123921202 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdb600b8d20 0x7fdb60068830 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fdb600654b0 tx=0x7fdb500091d0).ready entity=mon.0 client_cookie=66e53c1c8c07a787 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:18.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb5dd9b700 1 -- 172.21.2.102:0/3123921202 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000b9e0 con 0x7fdb600b8d20 2021-02-12T17:20:18.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb5dd9b700 1 -- 172.21.2.102:0/3123921202 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5000bb40 con 0x7fdb600b8d20 2021-02-12T17:20:18.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb5dd9b700 1 -- 172.21.2.102:0/3123921202 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50011400 con 0x7fdb600b8d20 2021-02-12T17:20:18.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb650f6700 1 -- 172.21.2.102:0/3123921202 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdb600b8d20 msgr2=0x7fdb60068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:18.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb650f6700 1 --2- 172.21.2.102:0/3123921202 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdb600b8d20 0x7fdb60068830 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fdb600654b0 tx=0x7fdb500091d0).stop 2021-02-12T17:20:18.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb650f6700 1 -- 172.21.2.102:0/3123921202 shutdown_connections 2021-02-12T17:20:18.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb650f6700 1 --2- 172.21.2.102:0/3123921202 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdb600b8d20 0x7fdb60068830 secure :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0x7fdb600654b0 tx=0x7fdb500091d0).stop 2021-02-12T17:20:18.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb650f6700 1 --2- 172.21.2.102:0/3123921202 >> v2:172.21.2.104:3300/0 conn(0x7fdb6014e530 0x7fdb600b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:18.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.781+0000 7fdb650f6700 1 -- 172.21.2.102:0/3123921202 >> 172.21.2.102:0/3123921202 conn(0x7fdb600bc480 msgr2=0x7fdb600b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:18.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.782+0000 7fdb650f6700 1 -- 172.21.2.102:0/3123921202 shutdown_connections 2021-02-12T17:20:18.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.782+0000 7fdb650f6700 1 -- 172.21.2.102:0/3123921202 wait complete. 2021-02-12T17:20:18.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.782+0000 7fdb650f6700 1 Processor -- start 2021-02-12T17:20:18.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.782+0000 7fdb650f6700 1 -- start start 2021-02-12T17:20:18.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb650f6700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdb60062740 0x7fdb60152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:18.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb650f6700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdb6014e530 0x7fdb600b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:18.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb650f6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdb6015d9a0 0x7fdb60160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:18.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb650f6700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600aeda0 con 0x7fdb60062740 2021-02-12T17:20:18.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb650f6700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600b4930 con 0x7fdb6014e530 2021-02-12T17:20:18.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb650f6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600b4690 con 0x7fdb6015d9a0 2021-02-12T17:20:18.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb5ed9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdb60062740 0x7fdb60152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:18.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb5ed9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdb60062740 0x7fdb60152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46886/0 (socket says 172.21.2.102:46886) 2021-02-12T17:20:18.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb5ed9d700 1 -- 172.21.2.102:0/4195050000 learned_addr learned my addr 172.21.2.102:0/4195050000 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:18.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb5e59c700 1 --2- 172.21.2.102:0/4195050000 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdb6014e530 0x7fdb600b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:18.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb5ed9d700 1 -- 172.21.2.102:0/4195050000 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdb6015d9a0 msgr2=0x7fdb60160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:18.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb5ed9d700 1 --2- 172.21.2.102:0/4195050000 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdb6015d9a0 0x7fdb60160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:18.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb5ed9d700 1 -- 172.21.2.102:0/4195050000 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdb6014e530 msgr2=0x7fdb600b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:18.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb5ed9d700 1 --2- 172.21.2.102:0/4195050000 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdb6014e530 0x7fdb600b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:18.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb5ed9d700 1 -- 172.21.2.102:0/4195050000 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb600ad280 con 0x7fdb60062740 2021-02-12T17:20:18.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.783+0000 7fdb5ed9d700 1 --2- 172.21.2.102:0/4195050000 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdb60062740 0x7fdb60152530 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fdb50011000 tx=0x7fdb50017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:18.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.784+0000 7fdb56ffd700 1 -- 172.21.2.102:0/4195050000 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5001c630 con 0x7fdb60062740 2021-02-12T17:20:18.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.784+0000 7fdb56ffd700 1 -- 172.21.2.102:0/4195050000 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5001c7b0 con 0x7fdb60062740 2021-02-12T17:20:18.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.784+0000 7fdb650f6700 1 -- 172.21.2.102:0/4195050000 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb600ada80 con 0x7fdb60062740 2021-02-12T17:20:18.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.784+0000 7fdb56ffd700 1 -- 172.21.2.102:0/4195050000 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5001cb70 con 0x7fdb60062740 2021-02-12T17:20:18.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.784+0000 7fdb650f6700 1 -- 172.21.2.102:0/4195050000 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb600afd40 con 0x7fdb60062740 2021-02-12T17:20:18.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.784+0000 7fdb650f6700 1 -- 172.21.2.102:0/4195050000 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6014efe0 con 0x7fdb60062740 2021-02-12T17:20:18.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.785+0000 7fdb56ffd700 1 -- 172.21.2.102:0/4195050000 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fdb5000f070 con 0x7fdb60062740 2021-02-12T17:20:18.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.785+0000 7fdb56ffd700 1 --2- 172.21.2.102:0/4195050000 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdb44059d30 0x7fdb4405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:18.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.785+0000 7fdb56ffd700 1 -- 172.21.2.102:0/4195050000 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7193+0+0 (secure 0 0 0) 0x7fdb50075d90 con 0x7fdb60062740 2021-02-12T17:20:18.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.785+0000 7fdb5e59c700 1 --2- 172.21.2.102:0/4195050000 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdb44059d30 0x7fdb4405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:18.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.785+0000 7fdb5e59c700 1 --2- 172.21.2.102:0/4195050000 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdb44059d30 0x7fdb4405c1f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fdb4800b6b0 tx=0x7fdb48008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:18.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.788+0000 7fdb56ffd700 1 -- 172.21.2.102:0/4195050000 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fdb50049470 con 0x7fdb60062740 2021-02-12T17:20:18.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.950+0000 7fdb650f6700 1 -- 172.21.2.102:0/4195050000 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb600adc10 con 0x7fdb60062740 2021-02-12T17:20:18.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.950+0000 7fdb56ffd700 1 -- 172.21.2.102:0/4195050000 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3400 (secure 0 0 0) 0x7fdb5004ca90 con 0x7fdb60062740 2021-02-12T17:20:18.952 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:18.952 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:18.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.951+0000 7fdb650f6700 1 -- 172.21.2.102:0/4195050000 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdb44059d30 msgr2=0x7fdb4405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:18.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.951+0000 7fdb650f6700 1 --2- 172.21.2.102:0/4195050000 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdb44059d30 0x7fdb4405c1f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fdb4800b6b0 tx=0x7fdb48008040).stop 2021-02-12T17:20:18.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.951+0000 7fdb650f6700 1 -- 172.21.2.102:0/4195050000 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdb60062740 msgr2=0x7fdb60152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:18.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.951+0000 7fdb650f6700 1 --2- 172.21.2.102:0/4195050000 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdb60062740 0x7fdb60152530 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fdb50011000 tx=0x7fdb50017000).stop 2021-02-12T17:20:18.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.952+0000 7fdb650f6700 1 -- 172.21.2.102:0/4195050000 shutdown_connections 2021-02-12T17:20:18.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.952+0000 7fdb650f6700 1 --2- 172.21.2.102:0/4195050000 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdb6015d9a0 0x7fdb60160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:18.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.952+0000 7fdb650f6700 1 --2- 172.21.2.102:0/4195050000 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdb44059d30 0x7fdb4405c1f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:18.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.952+0000 7fdb650f6700 1 --2- 172.21.2.102:0/4195050000 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdb60062740 0x7fdb60152530 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:18.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.952+0000 7fdb650f6700 1 --2- 172.21.2.102:0/4195050000 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdb6014e530 0x7fdb600b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:18.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.952+0000 7fdb650f6700 1 -- 172.21.2.102:0/4195050000 >> 172.21.2.102:0/4195050000 conn(0x7fdb600bc480 msgr2=0x7fdb600baa10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:18.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.952+0000 7fdb650f6700 1 -- 172.21.2.102:0/4195050000 shutdown_connections 2021-02-12T17:20:18.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:18.952+0000 7fdb650f6700 1 -- 172.21.2.102:0/4195050000 wait complete. 2021-02-12T17:20:18.954 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 29 2021-02-12T17:20:18.961 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:20:20.770 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:20.858 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.857+0000 7f67eb9e1700 1 Processor -- start 2021-02-12T17:20:20.858 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.857+0000 7f67eb9e1700 1 -- start start 2021-02-12T17:20:20.859 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.857+0000 7f67eb9e1700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f67e40b8d20 0x7f67e4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:20.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.857+0000 7f67eb9e1700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e40b7960 con 0x7f67e4062740 2021-02-12T17:20:20.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.857+0000 7f67eb9e1700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e40622a0 con 0x7f67e414e530 2021-02-12T17:20:20.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.857+0000 7f67eb9e1700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e4068d20 con 0x7f67e40b8d20 2021-02-12T17:20:20.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.858+0000 7f67e977d700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f67e40b8d20 0x7f67e4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:20.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.858+0000 7f67e977d700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f67e40b8d20 0x7f67e4068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46896/0 (socket says 172.21.2.102:46896) 2021-02-12T17:20:20.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.858+0000 7f67e977d700 1 -- 172.21.2.102:0/3144855213 learned_addr learned my addr 172.21.2.102:0/3144855213 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:20.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.858+0000 7f67e977d700 1 -- 172.21.2.102:0/3144855213 >> v1:172.21.2.104:6789/0 conn(0x7f67e414e530 legacy=0x7f67e40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:20.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.858+0000 7f67e977d700 1 -- 172.21.2.102:0/3144855213 >> v1:172.21.2.102:6789/0 conn(0x7f67e4062740 legacy=0x7f67e4062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:20.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.858+0000 7f67e977d700 1 -- 172.21.2.102:0/3144855213 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e414ea10 con 0x7f67e40b8d20 2021-02-12T17:20:20.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.858+0000 7f67e977d700 1 --2- 172.21.2.102:0/3144855213 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f67e40b8d20 0x7f67e4068830 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f67e000b9e0 tx=0x7f67e0006ea0).ready entity=mon.0 client_cookie=282e243a39e0d347 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:20.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.858+0000 7f67d3fff700 1 -- 172.21.2.102:0/3144855213 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0009800 con 0x7f67e40b8d20 2021-02-12T17:20:20.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.859+0000 7f67d3fff700 1 -- 172.21.2.102:0/3144855213 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e0009960 con 0x7f67e40b8d20 2021-02-12T17:20:20.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.859+0000 7f67d3fff700 1 -- 172.21.2.102:0/3144855213 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0009ce0 con 0x7f67e40b8d20 2021-02-12T17:20:20.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.859+0000 7f67eb9e1700 1 -- 172.21.2.102:0/3144855213 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f67e40b8d20 msgr2=0x7f67e4068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:20.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.859+0000 7f67eb9e1700 1 --2- 172.21.2.102:0/3144855213 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f67e40b8d20 0x7f67e4068830 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f67e000b9e0 tx=0x7f67e0006ea0).stop 2021-02-12T17:20:20.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.859+0000 7f67eb9e1700 1 -- 172.21.2.102:0/3144855213 shutdown_connections 2021-02-12T17:20:20.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.859+0000 7f67eb9e1700 1 --2- 172.21.2.102:0/3144855213 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f67e40b8d20 0x7f67e4068830 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:20.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.859+0000 7f67eb9e1700 1 -- 172.21.2.102:0/3144855213 >> 172.21.2.102:0/3144855213 conn(0x7f67e40bc480 msgr2=0x7f67e40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:20.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.859+0000 7f67eb9e1700 1 -- 172.21.2.102:0/3144855213 shutdown_connections 2021-02-12T17:20:20.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.859+0000 7f67eb9e1700 1 -- 172.21.2.102:0/3144855213 wait complete. 2021-02-12T17:20:20.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.860+0000 7f67eb9e1700 1 Processor -- start 2021-02-12T17:20:20.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.860+0000 7f67eb9e1700 1 -- start start 2021-02-12T17:20:20.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67eb9e1700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f67e4062740 0x7f67e40b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:20.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67eb9e1700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f67e40b8d20 0x7f67e40ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:20.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67eb9e1700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f67e414e530 0x7f67e40ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:20.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67eb9e1700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e415d770 con 0x7f67e4062740 2021-02-12T17:20:20.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67eb9e1700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e41402c0 con 0x7f67e414e530 2021-02-12T17:20:20.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67eb9e1700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e40aee90 con 0x7f67e40b8d20 2021-02-12T17:20:20.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67e977d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f67e4062740 0x7f67e40b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:20.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67e977d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f67e4062740 0x7f67e40b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46902/0 (socket says 172.21.2.102:46902) 2021-02-12T17:20:20.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67e977d700 1 -- 172.21.2.102:0/1932220841 learned_addr learned my addr 172.21.2.102:0/1932220841 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:20.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67e977d700 1 -- 172.21.2.102:0/1932220841 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f67e40b8d20 msgr2=0x7f67e40ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:20.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67e977d700 1 --2- 172.21.2.102:0/1932220841 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f67e40b8d20 0x7f67e40ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:20.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67e977d700 1 -- 172.21.2.102:0/1932220841 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f67e414e530 msgr2=0x7f67e40ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:20.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67e977d700 1 --2- 172.21.2.102:0/1932220841 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f67e414e530 0x7f67e40ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:20.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67e977d700 1 -- 172.21.2.102:0/1932220841 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e40acf10 con 0x7f67e4062740 2021-02-12T17:20:20.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67e977d700 1 --2- 172.21.2.102:0/1932220841 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f67e4062740 0x7f67e40b5890 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f67e40653c0 tx=0x7f67e0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:20.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67d17fa700 1 -- 172.21.2.102:0/1932220841 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0011e70 con 0x7f67e4062740 2021-02-12T17:20:20.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67d17fa700 1 -- 172.21.2.102:0/1932220841 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e001d430 con 0x7f67e4062740 2021-02-12T17:20:20.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67eb9e1700 1 -- 172.21.2.102:0/1932220841 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e413f840 con 0x7f67e4062740 2021-02-12T17:20:20.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67d17fa700 1 -- 172.21.2.102:0/1932220841 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e001d7b0 con 0x7f67e4062740 2021-02-12T17:20:20.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.861+0000 7f67eb9e1700 1 -- 172.21.2.102:0/1932220841 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e413fd80 con 0x7f67e4062740 2021-02-12T17:20:20.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.862+0000 7f67eb9e1700 1 -- 172.21.2.102:0/1932220841 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e41400e0 con 0x7f67e4062740 2021-02-12T17:20:20.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.862+0000 7f67d17fa700 1 -- 172.21.2.102:0/1932220841 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f67e0024030 con 0x7f67e4062740 2021-02-12T17:20:20.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.863+0000 7f67d17fa700 1 --2- 172.21.2.102:0/1932220841 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f67c4059d30 0x7f67c405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:20.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.863+0000 7f67d17fa700 1 -- 172.21.2.102:0/1932220841 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7193+0+0 (secure 0 0 0) 0x7f67e0074ed0 con 0x7f67e4062740 2021-02-12T17:20:20.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.863+0000 7f67e8f7c700 1 --2- 172.21.2.102:0/1932220841 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f67c4059d30 0x7f67c405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:20.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.863+0000 7f67e8f7c700 1 --2- 172.21.2.102:0/1932220841 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f67c4059d30 0x7f67c405c1f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f67e40b2680 tx=0x7f67d4006900).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:20.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:20.865+0000 7f67d17fa700 1 -- 172.21.2.102:0/1932220841 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f67e0048660 con 0x7f67e4062740 2021-02-12T17:20:20.962 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:21.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.029+0000 7f67eb9e1700 1 -- 172.21.2.102:0/1932220841 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67e4045460 con 0x7f67e4062740 2021-02-12T17:20:21.031 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.029+0000 7f67d17fa700 1 -- 172.21.2.102:0/1932220841 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3753 (secure 0 0 0) 0x7f67e0022070 con 0x7f67e4062740 2021-02-12T17:20:21.031 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:21.031 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4744,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:21.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.031+0000 7f67eb9e1700 1 -- 172.21.2.102:0/1932220841 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f67c4059d30 msgr2=0x7f67c405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:21.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.031+0000 7f67eb9e1700 1 --2- 172.21.2.102:0/1932220841 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f67c4059d30 0x7f67c405c1f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f67e40b2680 tx=0x7f67d4006900).stop 2021-02-12T17:20:21.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.031+0000 7f67eb9e1700 1 -- 172.21.2.102:0/1932220841 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f67e4062740 msgr2=0x7f67e40b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:21.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.031+0000 7f67eb9e1700 1 --2- 172.21.2.102:0/1932220841 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f67e4062740 0x7f67e40b5890 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f67e40653c0 tx=0x7f67e0016000).stop 2021-02-12T17:20:21.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.031+0000 7f67eb9e1700 1 -- 172.21.2.102:0/1932220841 shutdown_connections 2021-02-12T17:20:21.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.031+0000 7f67eb9e1700 1 --2- 172.21.2.102:0/1932220841 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f67e414e530 0x7f67e40ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:21.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.031+0000 7f67eb9e1700 1 --2- 172.21.2.102:0/1932220841 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f67c4059d30 0x7f67c405c1f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:21.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.031+0000 7f67eb9e1700 1 --2- 172.21.2.102:0/1932220841 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f67e4062740 0x7f67e40b5890 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:21.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.031+0000 7f67eb9e1700 1 --2- 172.21.2.102:0/1932220841 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f67e40b8d20 0x7f67e40ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:21.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.031+0000 7f67eb9e1700 1 -- 172.21.2.102:0/1932220841 >> 172.21.2.102:0/1932220841 conn(0x7f67e40bc480 msgr2=0x7f67e4062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:21.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.031+0000 7f67eb9e1700 1 -- 172.21.2.102:0/1932220841 shutdown_connections 2021-02-12T17:20:21.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.031+0000 7f67eb9e1700 1 -- 172.21.2.102:0/1932220841 wait complete. 2021-02-12T17:20:21.034 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 30 2021-02-12T17:20:21.041 INFO:tasks.mds_thrash.fs.[b]:mds.d reported in up:standby state 2021-02-12T17:20:21.041 INFO:tasks.mds_thrash.fs.[b]:waiting for 79 secs before thrashing 2021-02-12T17:20:21.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.052+0000 7f8d30b21700 1 Processor -- start 2021-02-12T17:20:21.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.052+0000 7f8d30b21700 1 -- start start 2021-02-12T17:20:21.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.053+0000 7f8d30b21700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f8d2c0b8d20 0x7f8d2c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:21.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.053+0000 7f8d30b21700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8d2c14e530 0x7f8d2c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:21.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.053+0000 7f8d30b21700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2c0622a0 con 0x7f8d2c062740 2021-02-12T17:20:21.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.053+0000 7f8d30b21700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2c068d20 con 0x7f8d2c0b8d20 2021-02-12T17:20:21.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.053+0000 7f8d30b21700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c14ea10 con 0x7f8d2c14e530 2021-02-12T17:20:21.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.053+0000 7f8d2a59c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f8d2c0b8d20 0x7f8d2c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:21.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.053+0000 7f8d2a59c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f8d2c0b8d20 0x7f8d2c068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46912/0 (socket says 172.21.2.102:46912) 2021-02-12T17:20:21.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.053+0000 7f8d2a59c700 1 -- 172.21.2.102:0/4151119834 learned_addr learned my addr 172.21.2.102:0/4151119834 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:21.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.053+0000 7f8d2a59c700 1 -- 172.21.2.102:0/4151119834 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8d2c14e530 msgr2=0x7f8d2c0b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:20:21.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.053+0000 7f8d2a59c700 1 --2- 172.21.2.102:0/4151119834 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8d2c14e530 0x7f8d2c0b7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:21.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.053+0000 7f8d2a59c700 1 -- 172.21.2.102:0/4151119834 >> v1:172.21.2.102:6789/0 conn(0x7f8d2c062740 legacy=0x7f8d2c062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:21.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.053+0000 7f8d2a59c700 1 -- 172.21.2.102:0/4151119834 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c0b63f0 con 0x7f8d2c0b8d20 2021-02-12T17:20:21.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.053+0000 7f8d2a59c700 1 --2- 172.21.2.102:0/4151119834 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8d2c0b8d20 0x7f8d2c068830 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f8d1c00b9e0 tx=0x7f8d1c006ea0).ready entity=mon.0 client_cookie=9a8740e1614e8fbc server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:21.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.053+0000 7f8d2959a700 1 -- 172.21.2.102:0/4151119834 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c009840 con 0x7f8d2c0b8d20 2021-02-12T17:20:21.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.054+0000 7f8d2959a700 1 -- 172.21.2.102:0/4151119834 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c0099a0 con 0x7f8d2c0b8d20 2021-02-12T17:20:21.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.054+0000 7f8d2959a700 1 -- 172.21.2.102:0/4151119834 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c009d20 con 0x7f8d2c0b8d20 2021-02-12T17:20:21.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.054+0000 7f8d30b21700 1 -- 172.21.2.102:0/4151119834 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8d2c0b8d20 msgr2=0x7f8d2c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:21.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.054+0000 7f8d30b21700 1 --2- 172.21.2.102:0/4151119834 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8d2c0b8d20 0x7f8d2c068830 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f8d1c00b9e0 tx=0x7f8d1c006ea0).stop 2021-02-12T17:20:21.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.054+0000 7f8d30b21700 1 -- 172.21.2.102:0/4151119834 shutdown_connections 2021-02-12T17:20:21.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.054+0000 7f8d30b21700 1 --2- 172.21.2.102:0/4151119834 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8d2c0b8d20 0x7f8d2c068830 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:21.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.054+0000 7f8d30b21700 1 --2- 172.21.2.102:0/4151119834 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8d2c14e530 0x7f8d2c0b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:21.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.054+0000 7f8d30b21700 1 -- 172.21.2.102:0/4151119834 >> 172.21.2.102:0/4151119834 conn(0x7f8d2c0bc480 msgr2=0x7f8d2c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:21.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.054+0000 7f8d30b21700 1 -- 172.21.2.102:0/4151119834 shutdown_connections 2021-02-12T17:20:21.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.054+0000 7f8d30b21700 1 -- 172.21.2.102:0/4151119834 wait complete. 2021-02-12T17:20:21.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.055+0000 7f8d30b21700 1 Processor -- start 2021-02-12T17:20:21.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.055+0000 7f8d30b21700 1 -- start start 2021-02-12T17:20:21.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.055+0000 7f8d30b21700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8d2c062740 0x7f8d2c0b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:21.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.055+0000 7f8d30b21700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8d2c0b8d20 0x7f8d2c152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:21.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.055+0000 7f8d30b21700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8d2c14e530 0x7f8d2c15dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:21.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.055+0000 7f8d30b21700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c0b2090 con 0x7f8d2c062740 2021-02-12T17:20:21.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.055+0000 7f8d30b21700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c0b1b50 con 0x7f8d2c14e530 2021-02-12T17:20:21.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.055+0000 7f8d30b21700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c0b1df0 con 0x7f8d2c0b8d20 2021-02-12T17:20:21.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d2a59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8d2c062740 0x7f8d2c0b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:21.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d2a59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8d2c062740 0x7f8d2c0b0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46916/0 (socket says 172.21.2.102:46916) 2021-02-12T17:20:21.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d2a59c700 1 -- 172.21.2.102:0/2327248697 learned_addr learned my addr 172.21.2.102:0/2327248697 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:21.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d2ad9d700 1 --2- 172.21.2.102:0/2327248697 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8d2c14e530 0x7f8d2c15dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:21.061 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d29d9b700 1 --2- 172.21.2.102:0/2327248697 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8d2c0b8d20 0x7f8d2c152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:21.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d2a59c700 1 -- 172.21.2.102:0/2327248697 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8d2c0b8d20 msgr2=0x7f8d2c152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:21.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d2a59c700 1 --2- 172.21.2.102:0/2327248697 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8d2c0b8d20 0x7f8d2c152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:21.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d2a59c700 1 -- 172.21.2.102:0/2327248697 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8d2c14e530 msgr2=0x7f8d2c15dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:21.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d2a59c700 1 --2- 172.21.2.102:0/2327248697 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8d2c14e530 0x7f8d2c15dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:21.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d2a59c700 1 -- 172.21.2.102:0/2327248697 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c15d4b0 con 0x7f8d2c062740 2021-02-12T17:20:21.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d2a59c700 1 --2- 172.21.2.102:0/2327248697 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8d2c062740 0x7f8d2c0b0620 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f8d1c00b190 tx=0x7f8d1c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:21.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d227fc700 1 -- 172.21.2.102:0/2327248697 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c01c420 con 0x7f8d2c062740 2021-02-12T17:20:21.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d227fc700 1 -- 172.21.2.102:0/2327248697 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c01c580 con 0x7f8d2c062740 2021-02-12T17:20:21.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d30b21700 1 -- 172.21.2.102:0/2327248697 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2c15d750 con 0x7f8d2c062740 2021-02-12T17:20:21.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d227fc700 1 -- 172.21.2.102:0/2327248697 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c01c920 con 0x7f8d2c062740 2021-02-12T17:20:21.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.056+0000 7f8d30b21700 1 -- 172.21.2.102:0/2327248697 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2c152a20 con 0x7f8d2c062740 2021-02-12T17:20:21.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.057+0000 7f8d30b21700 1 -- 172.21.2.102:0/2327248697 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2c045460 con 0x7f8d2c062740 2021-02-12T17:20:21.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.057+0000 7f8d227fc700 1 -- 172.21.2.102:0/2327248697 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f8d1c00f070 con 0x7f8d2c062740 2021-02-12T17:20:21.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.058+0000 7f8d227fc700 1 --2- 172.21.2.102:0/2327248697 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8d10059d30 0x7f8d1005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:21.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.058+0000 7f8d227fc700 1 -- 172.21.2.102:0/2327248697 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7193+0+0 (secure 0 0 0) 0x7f8d1c0757a0 con 0x7f8d2c062740 2021-02-12T17:20:21.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.058+0000 7f8d29d9b700 1 --2- 172.21.2.102:0/2327248697 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8d10059d30 0x7f8d1005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:21.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.058+0000 7f8d29d9b700 1 --2- 172.21.2.102:0/2327248697 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8d10059d30 0x7f8d1005c1f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f8d2c152d00 tx=0x7f8d14008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:21.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.060+0000 7f8d227fc700 1 -- 172.21.2.102:0/2327248697 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f8d1c048d70 con 0x7f8d2c062740 2021-02-12T17:20:21.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.223+0000 7f8d30b21700 1 -- 172.21.2.102:0/2327248697 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d2c0bac90 con 0x7f8d2c062740 2021-02-12T17:20:21.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.224+0000 7f8d227fc700 1 -- 172.21.2.102:0/2327248697 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3753 (secure 0 0 0) 0x7f8d1c04c390 con 0x7f8d2c062740 2021-02-12T17:20:21.225 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:21.225 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4744,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:21.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.225+0000 7f8d30b21700 1 -- 172.21.2.102:0/2327248697 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8d10059d30 msgr2=0x7f8d1005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:21.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.225+0000 7f8d30b21700 1 --2- 172.21.2.102:0/2327248697 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8d10059d30 0x7f8d1005c1f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f8d2c152d00 tx=0x7f8d14008040).stop 2021-02-12T17:20:21.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.225+0000 7f8d30b21700 1 -- 172.21.2.102:0/2327248697 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8d2c062740 msgr2=0x7f8d2c0b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:21.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.225+0000 7f8d30b21700 1 --2- 172.21.2.102:0/2327248697 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8d2c062740 0x7f8d2c0b0620 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f8d1c00b190 tx=0x7f8d1c016000).stop 2021-02-12T17:20:21.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.225+0000 7f8d30b21700 1 -- 172.21.2.102:0/2327248697 shutdown_connections 2021-02-12T17:20:21.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.225+0000 7f8d30b21700 1 --2- 172.21.2.102:0/2327248697 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8d2c14e530 0x7f8d2c15dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:21.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.225+0000 7f8d30b21700 1 --2- 172.21.2.102:0/2327248697 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8d10059d30 0x7f8d1005c1f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:21.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.225+0000 7f8d30b21700 1 --2- 172.21.2.102:0/2327248697 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8d2c062740 0x7f8d2c0b0620 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:21.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.225+0000 7f8d30b21700 1 --2- 172.21.2.102:0/2327248697 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8d2c0b8d20 0x7f8d2c152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:21.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.225+0000 7f8d30b21700 1 -- 172.21.2.102:0/2327248697 >> 172.21.2.102:0/2327248697 conn(0x7f8d2c0bc480 msgr2=0x7f8d2c0b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:21.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.225+0000 7f8d30b21700 1 -- 172.21.2.102:0/2327248697 shutdown_connections 2021-02-12T17:20:21.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:21.225+0000 7f8d30b21700 1 -- 172.21.2.102:0/2327248697 wait complete. 2021-02-12T17:20:21.227 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 30 2021-02-12T17:20:21.235 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:20:23.236 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:23.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.324+0000 7fdcc6738700 1 Processor -- start 2021-02-12T17:20:23.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.324+0000 7fdcc6738700 1 -- start start 2021-02-12T17:20:23.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.325+0000 7fdcc6738700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fdcc00b8d20 0x7fdcc00681b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:23.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.325+0000 7fdcc6738700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fdcc0146400 0x7fdcc0066aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:23.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.325+0000 7fdcc6738700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc0067290 con 0x7fdcc01477f0 2021-02-12T17:20:23.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.325+0000 7fdcc6738700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc00686a0 con 0x7fdcc00b8d20 2021-02-12T17:20:23.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.325+0000 7fdcc6738700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc0067530 con 0x7fdcc0146400 2021-02-12T17:20:23.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.325+0000 7fdcbffff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fdcc00b8d20 0x7fdcc00681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:23.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.325+0000 7fdcbffff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fdcc00b8d20 0x7fdcc00681b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46924/0 (socket says 172.21.2.102:46924) 2021-02-12T17:20:23.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.325+0000 7fdcbffff700 1 -- 172.21.2.102:0/1718772720 learned_addr learned my addr 172.21.2.102:0/1718772720 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:23.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcbffff700 1 -- 172.21.2.102:0/1718772720 >> v2:172.21.2.104:3300/0 conn(0x7fdcc0146400 msgr2=0x7fdcc0066aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:20:23.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcbffff700 1 --2- 172.21.2.102:0/1718772720 >> v2:172.21.2.104:3300/0 conn(0x7fdcc0146400 0x7fdcc0066aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:23.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcbffff700 1 -- 172.21.2.102:0/1718772720 >> v1:172.21.2.102:6789/0 conn(0x7fdcc01477f0 legacy=0x7fdcc01498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:23.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcbffff700 1 -- 172.21.2.102:0/1718772720 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc00677d0 con 0x7fdcc00b8d20 2021-02-12T17:20:23.328 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcbffff700 1 --2- 172.21.2.102:0/1718772720 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdcc00b8d20 0x7fdcc00681b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fdcc0068f10 tx=0x7fdca8006ea0).ready entity=mon.0 client_cookie=68a9d355283d8ae server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:23.328 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcbeffd700 1 -- 172.21.2.102:0/1718772720 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca80098d0 con 0x7fdcc00b8d20 2021-02-12T17:20:23.328 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcbeffd700 1 -- 172.21.2.102:0/1718772720 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca8009a30 con 0x7fdcc00b8d20 2021-02-12T17:20:23.328 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcbeffd700 1 -- 172.21.2.102:0/1718772720 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8009db0 con 0x7fdcc00b8d20 2021-02-12T17:20:23.329 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcc6738700 1 -- 172.21.2.102:0/1718772720 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdcc00b8d20 msgr2=0x7fdcc00681b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:23.329 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcc6738700 1 --2- 172.21.2.102:0/1718772720 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdcc00b8d20 0x7fdcc00681b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fdcc0068f10 tx=0x7fdca8006ea0).stop 2021-02-12T17:20:23.329 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcc6738700 1 -- 172.21.2.102:0/1718772720 shutdown_connections 2021-02-12T17:20:23.329 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcc6738700 1 --2- 172.21.2.102:0/1718772720 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdcc00b8d20 0x7fdcc00681b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:23.329 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcc6738700 1 --2- 172.21.2.102:0/1718772720 >> v2:172.21.2.104:3300/0 conn(0x7fdcc0146400 0x7fdcc0066aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:23.329 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcc6738700 1 -- 172.21.2.102:0/1718772720 >> 172.21.2.102:0/1718772720 conn(0x7fdcc00bc480 msgr2=0x7fdcc00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:23.329 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcc6738700 1 -- 172.21.2.102:0/1718772720 shutdown_connections 2021-02-12T17:20:23.329 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.326+0000 7fdcc6738700 1 -- 172.21.2.102:0/1718772720 wait complete. 2021-02-12T17:20:23.329 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.327+0000 7fdcc6738700 1 Processor -- start 2021-02-12T17:20:23.329 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.327+0000 7fdcc6738700 1 -- start start 2021-02-12T17:20:23.331 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc6738700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdcc00b8d20 0x7fdcc0149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:23.331 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc6738700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdcc0146400 0x7fdcc00b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:23.331 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc6738700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdcc01477f0 0x7fdcc0147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:23.331 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc6738700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc014a220 con 0x7fdcc01477f0 2021-02-12T17:20:23.331 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc6738700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc0155cc0 con 0x7fdcc0146400 2021-02-12T17:20:23.331 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc6738700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc0155f60 con 0x7fdcc00b8d20 2021-02-12T17:20:23.331 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc4cd5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdcc01477f0 0x7fdcc0147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:23.331 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc4cd5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdcc01477f0 0x7fdcc0147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46934/0 (socket says 172.21.2.102:46934) 2021-02-12T17:20:23.331 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc4cd5700 1 -- 172.21.2.102:0/3827441404 learned_addr learned my addr 172.21.2.102:0/3827441404 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:23.331 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc4cd5700 1 -- 172.21.2.102:0/3827441404 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdcc00b8d20 msgr2=0x7fdcc0149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:23.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc4cd5700 1 --2- 172.21.2.102:0/3827441404 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdcc00b8d20 0x7fdcc0149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:23.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc4cd5700 1 -- 172.21.2.102:0/3827441404 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdcc0146400 msgr2=0x7fdcc00b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:23.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc4cd5700 1 --2- 172.21.2.102:0/3827441404 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdcc0146400 0x7fdcc00b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:23.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc4cd5700 1 -- 172.21.2.102:0/3827441404 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc0156200 con 0x7fdcc01477f0 2021-02-12T17:20:23.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcc4cd5700 1 --2- 172.21.2.102:0/3827441404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdcc01477f0 0x7fdcc0147c60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fdcb800c710 tx=0x7fdcb8007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:23.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.328+0000 7fdcb7fff700 1 -- 172.21.2.102:0/3827441404 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb800e4a0 con 0x7fdcc01477f0 2021-02-12T17:20:23.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.329+0000 7fdcb7fff700 1 -- 172.21.2.102:0/3827441404 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb800e600 con 0x7fdcc01477f0 2021-02-12T17:20:23.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.329+0000 7fdcc6738700 1 -- 172.21.2.102:0/3827441404 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc01564a0 con 0x7fdcc01477f0 2021-02-12T17:20:23.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.329+0000 7fdcc6738700 1 -- 172.21.2.102:0/3827441404 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc00b1d10 con 0x7fdcc01477f0 2021-02-12T17:20:23.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.329+0000 7fdcb7fff700 1 -- 172.21.2.102:0/3827441404 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb800e980 con 0x7fdcc01477f0 2021-02-12T17:20:23.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.329+0000 7fdcc6738700 1 -- 172.21.2.102:0/3827441404 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc98004f60 con 0x7fdcc01477f0 2021-02-12T17:20:23.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.330+0000 7fdcb7fff700 1 -- 172.21.2.102:0/3827441404 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fdcb8019030 con 0x7fdcc01477f0 2021-02-12T17:20:23.333 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.330+0000 7fdcb7fff700 1 --2- 172.21.2.102:0/3827441404 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdca4059d30 0x7fdca405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:23.333 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.330+0000 7fdcb7fff700 1 -- 172.21.2.102:0/3827441404 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7193+0+0 (secure 0 0 0) 0x7fdcb8073230 con 0x7fdcc01477f0 2021-02-12T17:20:23.333 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.330+0000 7fdcbffff700 1 --2- 172.21.2.102:0/3827441404 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdca4059d30 0x7fdca405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:23.333 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.330+0000 7fdcbffff700 1 --2- 172.21.2.102:0/3827441404 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdca4059d30 0x7fdca405c1f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fdcc00b0250 tx=0x7fdca8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:23.334 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.333+0000 7fdcb7fff700 1 -- 172.21.2.102:0/3827441404 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fdcb8045580 con 0x7fdcc01477f0 2021-02-12T17:20:23.492 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.491+0000 7fdcc6738700 1 -- 172.21.2.102:0/3827441404 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc98005790 con 0x7fdcc01477f0 2021-02-12T17:20:23.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.492+0000 7fdcb7fff700 1 -- 172.21.2.102:0/3827441404 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3753 (secure 0 0 0) 0x7fdcb80468b0 con 0x7fdcc01477f0 2021-02-12T17:20:23.493 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:23.493 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4744,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:23.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.493+0000 7fdcc6738700 1 -- 172.21.2.102:0/3827441404 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdca4059d30 msgr2=0x7fdca405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:23.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.493+0000 7fdcc6738700 1 --2- 172.21.2.102:0/3827441404 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdca4059d30 0x7fdca405c1f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fdcc00b0250 tx=0x7fdca8016000).stop 2021-02-12T17:20:23.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.493+0000 7fdcc6738700 1 -- 172.21.2.102:0/3827441404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdcc01477f0 msgr2=0x7fdcc0147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:23.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.493+0000 7fdcc6738700 1 --2- 172.21.2.102:0/3827441404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdcc01477f0 0x7fdcc0147c60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fdcb800c710 tx=0x7fdcb8007bc0).stop 2021-02-12T17:20:23.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.493+0000 7fdcc6738700 1 -- 172.21.2.102:0/3827441404 shutdown_connections 2021-02-12T17:20:23.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.493+0000 7fdcc6738700 1 --2- 172.21.2.102:0/3827441404 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdca4059d30 0x7fdca405c1f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:23.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.493+0000 7fdcc6738700 1 --2- 172.21.2.102:0/3827441404 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdcc01477f0 0x7fdcc0147c60 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:23.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.493+0000 7fdcc6738700 1 --2- 172.21.2.102:0/3827441404 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdcc00b8d20 0x7fdcc0149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:23.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.493+0000 7fdcc6738700 1 --2- 172.21.2.102:0/3827441404 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdcc0146400 0x7fdcc00b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:23.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.493+0000 7fdcc6738700 1 -- 172.21.2.102:0/3827441404 >> 172.21.2.102:0/3827441404 conn(0x7fdcc00bc480 msgr2=0x7fdcc00b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:23.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.493+0000 7fdcc6738700 1 -- 172.21.2.102:0/3827441404 shutdown_connections 2021-02-12T17:20:23.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:23.493+0000 7fdcc6738700 1 -- 172.21.2.102:0/3827441404 wait complete. 2021-02-12T17:20:23.496 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 30 2021-02-12T17:20:23.503 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:20:25.504 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:25.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.595+0000 7fbf3a427700 1 Processor -- start 2021-02-12T17:20:25.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.595+0000 7fbf3a427700 1 -- start start 2021-02-12T17:20:25.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.596+0000 7fbf3a427700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fbf340b8d20 0x7fbf34068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:25.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.596+0000 7fbf3a427700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbf34062740 0x7fbf34062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:25.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.596+0000 7fbf3a427700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf340b7960 con 0x7fbf3414e530 2021-02-12T17:20:25.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.596+0000 7fbf3a427700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf34068d20 con 0x7fbf340b8d20 2021-02-12T17:20:25.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.596+0000 7fbf3a427700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340622a0 con 0x7fbf34062740 2021-02-12T17:20:25.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.596+0000 7fbf389c4700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbf34062740 0x7fbf34062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:25.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.596+0000 7fbf33fff700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fbf340b8d20 0x7fbf34068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:25.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.596+0000 7fbf389c4700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbf34062740 0x7fbf34062bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.102:49088/0 (socket says 172.21.2.102:49088) 2021-02-12T17:20:25.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.596+0000 7fbf389c4700 1 -- 172.21.2.102:0/3700695075 learned_addr learned my addr 172.21.2.102:0/3700695075 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:25.598 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.597+0000 7fbf389c4700 1 -- 172.21.2.102:0/3700695075 >> v2:172.21.2.104:3300/0 conn(0x7fbf340b8d20 msgr2=0x7fbf34068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:25.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.597+0000 7fbf389c4700 1 --2- 172.21.2.102:0/3700695075 >> v2:172.21.2.104:3300/0 conn(0x7fbf340b8d20 0x7fbf34068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:25.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.597+0000 7fbf389c4700 1 -- 172.21.2.102:0/3700695075 >> v1:172.21.2.104:6789/0 conn(0x7fbf3414e530 legacy=0x7fbf340b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:25.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.597+0000 7fbf32ffd700 1 -- 172.21.2.102:0/3700695075 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036155261 0 0) 0x7fbf340b7960 con 0x7fbf3414e530 2021-02-12T17:20:25.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.597+0000 7fbf389c4700 1 -- 172.21.2.102:0/3700695075 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3414ea10 con 0x7fbf34062740 2021-02-12T17:20:25.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.597+0000 7fbf33fff700 1 --2- 172.21.2.102:0/3700695075 >> v2:172.21.2.104:3300/0 conn(0x7fbf340b8d20 0x7fbf34068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:20:25.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.597+0000 7fbf389c4700 1 --2- 172.21.2.102:0/3700695075 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbf34062740 0x7fbf34062bc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fbf2c009d50 tx=0x7fbf2c009290).ready entity=mon.2 client_cookie=a82181c13f17fe70 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:25.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.597+0000 7fbf32ffd700 1 -- 172.21.2.102:0/3700695075 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c00bbf0 con 0x7fbf34062740 2021-02-12T17:20:25.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.598+0000 7fbf32ffd700 1 -- 172.21.2.102:0/3700695075 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c00bd50 con 0x7fbf34062740 2021-02-12T17:20:25.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.598+0000 7fbf32ffd700 1 -- 172.21.2.102:0/3700695075 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c011610 con 0x7fbf34062740 2021-02-12T17:20:25.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.598+0000 7fbf3a427700 1 -- 172.21.2.102:0/3700695075 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbf34062740 msgr2=0x7fbf34062bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:25.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.598+0000 7fbf3a427700 1 --2- 172.21.2.102:0/3700695075 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbf34062740 0x7fbf34062bc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fbf2c009d50 tx=0x7fbf2c009290).stop 2021-02-12T17:20:25.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.598+0000 7fbf3a427700 1 -- 172.21.2.102:0/3700695075 shutdown_connections 2021-02-12T17:20:25.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.598+0000 7fbf3a427700 1 --2- 172.21.2.102:0/3700695075 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbf34062740 0x7fbf34062bc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:25.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.598+0000 7fbf3a427700 1 --2- 172.21.2.102:0/3700695075 >> v2:172.21.2.104:3300/0 conn(0x7fbf340b8d20 0x7fbf34068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:25.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.598+0000 7fbf3a427700 1 -- 172.21.2.102:0/3700695075 >> 172.21.2.102:0/3700695075 conn(0x7fbf340bc480 msgr2=0x7fbf340b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:25.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.598+0000 7fbf3a427700 1 -- 172.21.2.102:0/3700695075 shutdown_connections 2021-02-12T17:20:25.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.598+0000 7fbf3a427700 1 -- 172.21.2.102:0/3700695075 wait complete. 2021-02-12T17:20:25.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.599+0000 7fbf3a427700 1 Processor -- start 2021-02-12T17:20:25.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.599+0000 7fbf3a427700 1 -- start start 2021-02-12T17:20:25.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.599+0000 7fbf3a427700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbf34062740 0x7fbf340affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:25.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.599+0000 7fbf3a427700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbf340b8d20 0x7fbf340b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:25.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.599+0000 7fbf3a427700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbf3414e530 0x7fbf340b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:25.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.599+0000 7fbf3a427700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340b2be0 con 0x7fbf34062740 2021-02-12T17:20:25.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.599+0000 7fbf3a427700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf34160a10 con 0x7fbf3414e530 2021-02-12T17:20:25.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.599+0000 7fbf3a427700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf34160770 con 0x7fbf340b8d20 2021-02-12T17:20:25.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.599+0000 7fbf33fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbf34062740 0x7fbf340affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:25.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.599+0000 7fbf389c4700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbf3414e530 0x7fbf340b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:25.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf33fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbf34062740 0x7fbf340affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46948/0 (socket says 172.21.2.102:46948) 2021-02-12T17:20:25.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf33fff700 1 -- 172.21.2.102:0/861704656 learned_addr learned my addr 172.21.2.102:0/861704656 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:25.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf337fe700 1 --2- 172.21.2.102:0/861704656 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbf340b8d20 0x7fbf340b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:25.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf33fff700 1 -- 172.21.2.102:0/861704656 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbf340b8d20 msgr2=0x7fbf340b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:25.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf33fff700 1 --2- 172.21.2.102:0/861704656 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbf340b8d20 0x7fbf340b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:25.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf33fff700 1 -- 172.21.2.102:0/861704656 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbf3414e530 msgr2=0x7fbf340b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:25.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf33fff700 1 --2- 172.21.2.102:0/861704656 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbf3414e530 0x7fbf340b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:25.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf33fff700 1 -- 172.21.2.102:0/861704656 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf340b2e40 con 0x7fbf34062740 2021-02-12T17:20:25.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf389c4700 1 --2- 172.21.2.102:0/861704656 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbf3414e530 0x7fbf340b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:20:25.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf33fff700 1 --2- 172.21.2.102:0/861704656 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbf34062740 0x7fbf340affa0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fbf2400ef50 tx=0x7fbf24006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:25.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf2bfff700 1 -- 172.21.2.102:0/861704656 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2400cab0 con 0x7fbf34062740 2021-02-12T17:20:25.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf2bfff700 1 -- 172.21.2.102:0/861704656 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2400cc10 con 0x7fbf34062740 2021-02-12T17:20:25.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf3a427700 1 -- 172.21.2.102:0/861704656 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf340b30e0 con 0x7fbf34062740 2021-02-12T17:20:25.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf3a427700 1 -- 172.21.2.102:0/861704656 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf3414d300 con 0x7fbf34062740 2021-02-12T17:20:25.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.600+0000 7fbf2bfff700 1 -- 172.21.2.102:0/861704656 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf240123f0 con 0x7fbf34062740 2021-02-12T17:20:25.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.601+0000 7fbf3a427700 1 -- 172.21.2.102:0/861704656 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf34062470 con 0x7fbf34062740 2021-02-12T17:20:25.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.601+0000 7fbf2bfff700 1 -- 172.21.2.102:0/861704656 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fbf240127a0 con 0x7fbf34062740 2021-02-12T17:20:25.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.601+0000 7fbf2bfff700 1 --2- 172.21.2.102:0/861704656 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbf18059d60 0x7fbf1805c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:25.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.602+0000 7fbf2bfff700 1 -- 172.21.2.102:0/861704656 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7193+0+0 (secure 0 0 0) 0x7fbf24074290 con 0x7fbf34062740 2021-02-12T17:20:25.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.602+0000 7fbf337fe700 1 --2- 172.21.2.102:0/861704656 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbf18059d60 0x7fbf1805c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:25.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.602+0000 7fbf337fe700 1 --2- 172.21.2.102:0/861704656 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbf18059d60 0x7fbf1805c220 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fbf340b4cc0 tx=0x7fbf1c007b60).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:25.606 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.605+0000 7fbf2bfff700 1 -- 172.21.2.102:0/861704656 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fbf24047970 con 0x7fbf34062740 2021-02-12T17:20:25.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.763+0000 7fbf3a427700 1 -- 172.21.2.102:0/861704656 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf34045460 con 0x7fbf34062740 2021-02-12T17:20:25.765 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.763+0000 7fbf2bfff700 1 -- 172.21.2.102:0/861704656 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3753 (secure 0 0 0) 0x7fbf2404af90 con 0x7fbf34062740 2021-02-12T17:20:25.765 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:25.765 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4744,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:25.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.765+0000 7fbf3a427700 1 -- 172.21.2.102:0/861704656 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbf18059d60 msgr2=0x7fbf1805c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:25.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.765+0000 7fbf3a427700 1 --2- 172.21.2.102:0/861704656 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbf18059d60 0x7fbf1805c220 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fbf340b4cc0 tx=0x7fbf1c007b60).stop 2021-02-12T17:20:25.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.765+0000 7fbf3a427700 1 -- 172.21.2.102:0/861704656 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbf34062740 msgr2=0x7fbf340affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:25.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.765+0000 7fbf3a427700 1 --2- 172.21.2.102:0/861704656 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbf34062740 0x7fbf340affa0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fbf2400ef50 tx=0x7fbf24006de0).stop 2021-02-12T17:20:25.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.765+0000 7fbf3a427700 1 -- 172.21.2.102:0/861704656 shutdown_connections 2021-02-12T17:20:25.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.765+0000 7fbf3a427700 1 --2- 172.21.2.102:0/861704656 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbf3414e530 0x7fbf340b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:25.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.765+0000 7fbf3a427700 1 --2- 172.21.2.102:0/861704656 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbf18059d60 0x7fbf1805c220 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:25.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.765+0000 7fbf3a427700 1 --2- 172.21.2.102:0/861704656 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbf34062740 0x7fbf340affa0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:25.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.765+0000 7fbf3a427700 1 --2- 172.21.2.102:0/861704656 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbf340b8d20 0x7fbf340b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:25.767 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.765+0000 7fbf3a427700 1 -- 172.21.2.102:0/861704656 >> 172.21.2.102:0/861704656 conn(0x7fbf340bc480 msgr2=0x7fbf34062b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:25.767 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.765+0000 7fbf3a427700 1 -- 172.21.2.102:0/861704656 shutdown_connections 2021-02-12T17:20:25.767 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:25.765+0000 7fbf3a427700 1 -- 172.21.2.102:0/861704656 wait complete. 2021-02-12T17:20:25.767 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 30 2021-02-12T17:20:25.774 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:20:27.775 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:27.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.862+0000 7f76b02e2700 1 Processor -- start 2021-02-12T17:20:27.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.862+0000 7f76b02e2700 1 -- start start 2021-02-12T17:20:27.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.863+0000 7f76b02e2700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f76a814e530 0x7f76a8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:27.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.863+0000 7f76b02e2700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a80b7960 con 0x7f76a80b8d20 2021-02-12T17:20:27.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.863+0000 7f76b02e2700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a80622a0 con 0x7f76a8062740 2021-02-12T17:20:27.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.863+0000 7f76b02e2700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a8068d20 con 0x7f76a814e530 2021-02-12T17:20:27.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.863+0000 7f76ad87d700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f76a814e530 0x7f76a8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:27.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.863+0000 7f76ad87d700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f76a814e530 0x7f76a8068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46954/0 (socket says 172.21.2.102:46954) 2021-02-12T17:20:27.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.863+0000 7f76ad87d700 1 -- 172.21.2.102:0/1864114646 learned_addr learned my addr 172.21.2.102:0/1864114646 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:27.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.864+0000 7f76ad87d700 1 -- 172.21.2.102:0/1864114646 >> v1:172.21.2.104:6789/0 conn(0x7f76a8062740 legacy=0x7f76a8062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:27.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.864+0000 7f76ad87d700 1 -- 172.21.2.102:0/1864114646 >> v1:172.21.2.102:6789/0 conn(0x7f76a80b8d20 legacy=0x7f76a80b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:27.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.864+0000 7f76ad87d700 1 -- 172.21.2.102:0/1864114646 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a814ea10 con 0x7f76a814e530 2021-02-12T17:20:27.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.864+0000 7f76ad87d700 1 --2- 172.21.2.102:0/1864114646 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f76a814e530 0x7f76a8068830 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f769c00b9e0 tx=0x7f769c006ea0).ready entity=mon.0 client_cookie=a15e86a1043a0041 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:27.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.864+0000 7f76ad07c700 1 -- 172.21.2.102:0/1864114646 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c009800 con 0x7f76a814e530 2021-02-12T17:20:27.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.864+0000 7f76ad07c700 1 -- 172.21.2.102:0/1864114646 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c009960 con 0x7f76a814e530 2021-02-12T17:20:27.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.864+0000 7f76ad07c700 1 -- 172.21.2.102:0/1864114646 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c009ce0 con 0x7f76a814e530 2021-02-12T17:20:27.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.864+0000 7f76b02e2700 1 -- 172.21.2.102:0/1864114646 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f76a814e530 msgr2=0x7f76a8068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:27.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.864+0000 7f76b02e2700 1 --2- 172.21.2.102:0/1864114646 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f76a814e530 0x7f76a8068830 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f769c00b9e0 tx=0x7f769c006ea0).stop 2021-02-12T17:20:27.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.864+0000 7f76b02e2700 1 -- 172.21.2.102:0/1864114646 shutdown_connections 2021-02-12T17:20:27.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.864+0000 7f76b02e2700 1 --2- 172.21.2.102:0/1864114646 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f76a814e530 0x7f76a8068830 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:27.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.864+0000 7f76b02e2700 1 -- 172.21.2.102:0/1864114646 >> 172.21.2.102:0/1864114646 conn(0x7f76a80bc480 msgr2=0x7f76a80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:27.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.864+0000 7f76b02e2700 1 -- 172.21.2.102:0/1864114646 shutdown_connections 2021-02-12T17:20:27.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.865+0000 7f76b02e2700 1 -- 172.21.2.102:0/1864114646 wait complete. 2021-02-12T17:20:27.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.865+0000 7f76b02e2700 1 Processor -- start 2021-02-12T17:20:27.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.865+0000 7f76b02e2700 1 -- start start 2021-02-12T17:20:27.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76b02e2700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f76a8062740 0x7f76a80ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:27.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76b02e2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f76a80b8d20 0x7f76a815e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:27.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76b02e2700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f76a814e530 0x7f76a80b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:27.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76b02e2700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80b1b00 con 0x7f76a80b8d20 2021-02-12T17:20:27.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76b02e2700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a815d9e0 con 0x7f76a8062740 2021-02-12T17:20:27.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76b02e2700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80af8c0 con 0x7f76a814e530 2021-02-12T17:20:27.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76ad87d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f76a80b8d20 0x7f76a815e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:27.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76ad87d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f76a80b8d20 0x7f76a815e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46960/0 (socket says 172.21.2.102:46960) 2021-02-12T17:20:27.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76ad87d700 1 -- 172.21.2.102:0/2979959479 learned_addr learned my addr 172.21.2.102:0/2979959479 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:27.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76ae87f700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f76a814e530 0x7f76a80b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:27.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76ae07e700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f76a8062740 0x7f76a80ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:27.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76ad87d700 1 -- 172.21.2.102:0/2979959479 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f76a814e530 msgr2=0x7f76a80b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:27.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76ad87d700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f76a814e530 0x7f76a80b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:27.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76ad87d700 1 -- 172.21.2.102:0/2979959479 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f76a8062740 msgr2=0x7f76a80ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:27.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76ad87d700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f76a8062740 0x7f76a80ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:27.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76ad87d700 1 -- 172.21.2.102:0/2979959479 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a815dc00 con 0x7f76a80b8d20 2021-02-12T17:20:27.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.866+0000 7f76ae87f700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f76a814e530 0x7f76a80b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:20:27.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.867+0000 7f76ad87d700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f76a80b8d20 0x7f76a815e5e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f76a80653c0 tx=0x7f769c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:27.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.867+0000 7f769a7fc700 1 -- 172.21.2.102:0/2979959479 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c011e70 con 0x7f76a80b8d20 2021-02-12T17:20:27.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.867+0000 7f769a7fc700 1 -- 172.21.2.102:0/2979959479 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c01d430 con 0x7f76a80b8d20 2021-02-12T17:20:27.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.867+0000 7f769a7fc700 1 -- 172.21.2.102:0/2979959479 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c01d7b0 con 0x7f76a80b8d20 2021-02-12T17:20:27.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.867+0000 7f76b02e2700 1 -- 172.21.2.102:0/2979959479 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a815dea0 con 0x7f76a80b8d20 2021-02-12T17:20:27.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.867+0000 7f76b02e2700 1 -- 172.21.2.102:0/2979959479 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a815e1a0 con 0x7f76a80b8d20 2021-02-12T17:20:27.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.868+0000 7f76b02e2700 1 -- 172.21.2.102:0/2979959479 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a8045460 con 0x7f76a80b8d20 2021-02-12T17:20:27.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.868+0000 7f769a7fc700 1 -- 172.21.2.102:0/2979959479 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f769c024030 con 0x7f76a80b8d20 2021-02-12T17:20:27.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.868+0000 7f769a7fc700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7688059d80 0x7f768805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:27.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.868+0000 7f769a7fc700 1 -- 172.21.2.102:0/2979959479 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7193+0+0 (secure 0 0 0) 0x7f769c074e50 con 0x7f76a80b8d20 2021-02-12T17:20:27.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.868+0000 7f76ae07e700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7688059d80 0x7f768805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:27.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.869+0000 7f76ae07e700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7688059d80 0x7f768805c240 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f76a814d3c0 tx=0x7f76a4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:27.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:27.871+0000 7f769a7fc700 1 -- 172.21.2.102:0/2979959479 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f769c048550 con 0x7f76a80b8d20 2021-02-12T17:20:28.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:28.029+0000 7f76b02e2700 1 -- 172.21.2.102:0/2979959479 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76a80b7010 con 0x7f76a80b8d20 2021-02-12T17:20:28.031 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:28.030+0000 7f769a7fc700 1 -- 172.21.2.102:0/2979959479 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3753 (secure 0 0 0) 0x7f769c022070 con 0x7f76a80b8d20 2021-02-12T17:20:28.031 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:28.031 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4744,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:28.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:28.031+0000 7f76b02e2700 1 -- 172.21.2.102:0/2979959479 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7688059d80 msgr2=0x7f768805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:28.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:28.031+0000 7f76b02e2700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7688059d80 0x7f768805c240 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f76a814d3c0 tx=0x7f76a4009040).stop 2021-02-12T17:20:28.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:28.031+0000 7f76b02e2700 1 -- 172.21.2.102:0/2979959479 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f76a80b8d20 msgr2=0x7f76a815e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:28.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:28.031+0000 7f76b02e2700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f76a80b8d20 0x7f76a815e5e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f76a80653c0 tx=0x7f769c016000).stop 2021-02-12T17:20:28.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:28.031+0000 7f76b02e2700 1 -- 172.21.2.102:0/2979959479 shutdown_connections 2021-02-12T17:20:28.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:28.031+0000 7f76b02e2700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f76a814e530 0x7f76a80b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:28.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:28.031+0000 7f76b02e2700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f76a8062740 0x7f76a80ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:28.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:28.031+0000 7f76b02e2700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7688059d80 0x7f768805c240 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:28.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:28.031+0000 7f76b02e2700 1 --2- 172.21.2.102:0/2979959479 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f76a80b8d20 0x7f76a815e5e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:28.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:28.031+0000 7f76b02e2700 1 -- 172.21.2.102:0/2979959479 >> 172.21.2.102:0/2979959479 conn(0x7f76a80bc480 msgr2=0x7f76a80b7250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:28.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:28.031+0000 7f76b02e2700 1 -- 172.21.2.102:0/2979959479 shutdown_connections 2021-02-12T17:20:28.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:28.031+0000 7f76b02e2700 1 -- 172.21.2.102:0/2979959479 wait complete. 2021-02-12T17:20:28.033 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 30 2021-02-12T17:20:28.041 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:20:30.042 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:30.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.130+0000 7fda3e270700 1 Processor -- start 2021-02-12T17:20:30.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.130+0000 7fda3e270700 1 -- start start 2021-02-12T17:20:30.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.130+0000 7fda3e270700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fda380b8d20 0x7fda38068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:30.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.130+0000 7fda3e270700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fda38062740 0x7fda38062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:30.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.130+0000 7fda3e270700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda380b7960 con 0x7fda3814e530 2021-02-12T17:20:30.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.130+0000 7fda3e270700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda38068d20 con 0x7fda38062740 2021-02-12T17:20:30.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.130+0000 7fda3e270700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda380622a0 con 0x7fda380b8d20 2021-02-12T17:20:30.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.131+0000 7fda3c80d700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fda38062740 0x7fda38062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:30.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.131+0000 7fda37fff700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fda380b8d20 0x7fda38068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:30.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.131+0000 7fda3c80d700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fda38062740 0x7fda38062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:45330/0 (socket says 172.21.2.102:45330) 2021-02-12T17:20:30.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.131+0000 7fda3c80d700 1 -- 172.21.2.102:0/630546517 learned_addr learned my addr 172.21.2.102:0/630546517 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:30.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.131+0000 7fda377fe700 1 --1- 172.21.2.102:0/630546517 >> v1:172.21.2.104:6789/0 conn(0x7fda3814e530 0x7fda380b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:37982/0 (socket says 172.21.2.102:37982) 2021-02-12T17:20:30.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.132+0000 7fda37fff700 1 -- 172.21.2.102:0/630546517 >> v2:172.21.2.104:3300/0 conn(0x7fda38062740 msgr2=0x7fda38062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:30.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.132+0000 7fda37fff700 1 --2- 172.21.2.102:0/630546517 >> v2:172.21.2.104:3300/0 conn(0x7fda38062740 0x7fda38062bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:30.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.132+0000 7fda37fff700 1 -- 172.21.2.102:0/630546517 >> v1:172.21.2.104:6789/0 conn(0x7fda3814e530 legacy=0x7fda380b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:30.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.132+0000 7fda37fff700 1 -- 172.21.2.102:0/630546517 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3814ea10 con 0x7fda380b8d20 2021-02-12T17:20:30.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.132+0000 7fda37fff700 1 --2- 172.21.2.102:0/630546517 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fda380b8d20 0x7fda38068830 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fda2800b980 tx=0x7fda28006de0).ready entity=mon.2 client_cookie=8c15a72392cbd5ff server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:30.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.132+0000 7fda36ffd700 1 -- 172.21.2.102:0/630546517 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2800be70 con 0x7fda380b8d20 2021-02-12T17:20:30.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.133+0000 7fda36ffd700 1 -- 172.21.2.102:0/630546517 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda280097e0 con 0x7fda380b8d20 2021-02-12T17:20:30.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.133+0000 7fda36ffd700 1 -- 172.21.2.102:0/630546517 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28009b60 con 0x7fda380b8d20 2021-02-12T17:20:30.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.133+0000 7fda3e270700 1 -- 172.21.2.102:0/630546517 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fda380b8d20 msgr2=0x7fda38068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:30.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.133+0000 7fda3e270700 1 --2- 172.21.2.102:0/630546517 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fda380b8d20 0x7fda38068830 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fda2800b980 tx=0x7fda28006de0).stop 2021-02-12T17:20:30.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.133+0000 7fda3e270700 1 -- 172.21.2.102:0/630546517 shutdown_connections 2021-02-12T17:20:30.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.133+0000 7fda3e270700 1 --2- 172.21.2.102:0/630546517 >> v2:172.21.2.104:3300/0 conn(0x7fda38062740 0x7fda38062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:30.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.133+0000 7fda3e270700 1 --2- 172.21.2.102:0/630546517 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fda380b8d20 0x7fda38068830 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:30.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.133+0000 7fda3e270700 1 -- 172.21.2.102:0/630546517 >> 172.21.2.102:0/630546517 conn(0x7fda380bc480 msgr2=0x7fda380b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:30.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.133+0000 7fda3e270700 1 -- 172.21.2.102:0/630546517 shutdown_connections 2021-02-12T17:20:30.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.133+0000 7fda3e270700 1 -- 172.21.2.102:0/630546517 wait complete. 2021-02-12T17:20:30.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.134+0000 7fda3e270700 1 Processor -- start 2021-02-12T17:20:30.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.134+0000 7fda3e270700 1 -- start start 2021-02-12T17:20:30.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3e270700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fda38062740 0x7fda3813f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:30.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3e270700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fda380b8d20 0x7fda3813e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:30.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3e270700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fda3814e530 0x7fda3813ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:30.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3e270700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda380b2220 con 0x7fda3814e530 2021-02-12T17:20:30.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3e270700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda38160d00 con 0x7fda380b8d20 2021-02-12T17:20:30.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3e270700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda38160fa0 con 0x7fda38062740 2021-02-12T17:20:30.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3c80d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fda3814e530 0x7fda3813ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:30.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3c80d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fda3814e530 0x7fda3813ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46978/0 (socket says 172.21.2.102:46978) 2021-02-12T17:20:30.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3c80d700 1 -- 172.21.2.102:0/2965966289 learned_addr learned my addr 172.21.2.102:0/2965966289 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:30.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda377fe700 1 --2- 172.21.2.102:0/2965966289 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fda380b8d20 0x7fda3813e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:30.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3c80d700 1 -- 172.21.2.102:0/2965966289 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fda38062740 msgr2=0x7fda3813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:30.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3c80d700 1 --2- 172.21.2.102:0/2965966289 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fda38062740 0x7fda3813f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:30.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3c80d700 1 -- 172.21.2.102:0/2965966289 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fda380b8d20 msgr2=0x7fda3813e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:30.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3c80d700 1 --2- 172.21.2.102:0/2965966289 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fda380b8d20 0x7fda3813e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:30.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3c80d700 1 -- 172.21.2.102:0/2965966289 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda38161240 con 0x7fda3814e530 2021-02-12T17:20:30.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda377fe700 1 --2- 172.21.2.102:0/2965966289 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fda380b8d20 0x7fda3813e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:20:30.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3c80d700 1 --2- 172.21.2.102:0/2965966289 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fda3814e530 0x7fda3813ee90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fda3000ecf0 tx=0x7fda30009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:30.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda2ffff700 1 -- 172.21.2.102:0/2965966289 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000cbe0 con 0x7fda3814e530 2021-02-12T17:20:30.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda2ffff700 1 -- 172.21.2.102:0/2965966289 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3000cd40 con 0x7fda3814e530 2021-02-12T17:20:30.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3e270700 1 -- 172.21.2.102:0/2965966289 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda381614e0 con 0x7fda3814e530 2021-02-12T17:20:30.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda2ffff700 1 -- 172.21.2.102:0/2965966289 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30012620 con 0x7fda3814e530 2021-02-12T17:20:30.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.135+0000 7fda3e270700 1 -- 172.21.2.102:0/2965966289 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3813fd00 con 0x7fda3814e530 2021-02-12T17:20:30.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.136+0000 7fda3e270700 1 -- 172.21.2.102:0/2965966289 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda38161940 con 0x7fda3814e530 2021-02-12T17:20:30.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.136+0000 7fda2ffff700 1 -- 172.21.2.102:0/2965966289 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fda30022070 con 0x7fda3814e530 2021-02-12T17:20:30.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.137+0000 7fda2ffff700 1 --2- 172.21.2.102:0/2965966289 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fda1c059d30 0x7fda1c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:30.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.137+0000 7fda2ffff700 1 -- 172.21.2.102:0/2965966289 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7193+0+0 (secure 0 0 0) 0x7fda30074500 con 0x7fda3814e530 2021-02-12T17:20:30.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.137+0000 7fda37fff700 1 --2- 172.21.2.102:0/2965966289 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fda1c059d30 0x7fda1c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:30.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.137+0000 7fda37fff700 1 --2- 172.21.2.102:0/2965966289 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fda1c059d30 0x7fda1c05c1f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fda380b7220 tx=0x7fda28016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:30.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.140+0000 7fda2ffff700 1 -- 172.21.2.102:0/2965966289 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fda30047be0 con 0x7fda3814e530 2021-02-12T17:20:30.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.301+0000 7fda3e270700 1 -- 172.21.2.102:0/2965966289 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda38045460 con 0x7fda3814e530 2021-02-12T17:20:30.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.301+0000 7fda2ffff700 1 -- 172.21.2.102:0/2965966289 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3753 (secure 0 0 0) 0x7fda30016070 con 0x7fda3814e530 2021-02-12T17:20:30.302 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:30.302 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":4744,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:19:49.306514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":19,"addr":"172.21.2.102:6837/115463068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":115463068},{"type":"v1","addr":"172.21.2.102:6837","nonce":115463068}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:30.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.302+0000 7fda3e270700 1 -- 172.21.2.102:0/2965966289 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fda1c059d30 msgr2=0x7fda1c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:30.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.302+0000 7fda3e270700 1 --2- 172.21.2.102:0/2965966289 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fda1c059d30 0x7fda1c05c1f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fda380b7220 tx=0x7fda28016000).stop 2021-02-12T17:20:30.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.302+0000 7fda3e270700 1 -- 172.21.2.102:0/2965966289 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fda3814e530 msgr2=0x7fda3813ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:30.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.302+0000 7fda3e270700 1 --2- 172.21.2.102:0/2965966289 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fda3814e530 0x7fda3813ee90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fda3000ecf0 tx=0x7fda30009290).stop 2021-02-12T17:20:30.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.302+0000 7fda3e270700 1 -- 172.21.2.102:0/2965966289 shutdown_connections 2021-02-12T17:20:30.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.302+0000 7fda3e270700 1 --2- 172.21.2.102:0/2965966289 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fda1c059d30 0x7fda1c05c1f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:30.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.302+0000 7fda3e270700 1 --2- 172.21.2.102:0/2965966289 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fda3814e530 0x7fda3813ee90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:30.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.302+0000 7fda3e270700 1 --2- 172.21.2.102:0/2965966289 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fda38062740 0x7fda3813f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:30.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.302+0000 7fda3e270700 1 --2- 172.21.2.102:0/2965966289 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fda380b8d20 0x7fda3813e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:30.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.302+0000 7fda3e270700 1 -- 172.21.2.102:0/2965966289 >> 172.21.2.102:0/2965966289 conn(0x7fda380bc480 msgr2=0x7fda3814cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:30.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.303+0000 7fda3e270700 1 -- 172.21.2.102:0/2965966289 shutdown_connections 2021-02-12T17:20:30.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:30.303+0000 7fda3e270700 1 -- 172.21.2.102:0/2965966289 wait complete. 2021-02-12T17:20:30.305 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 30 2021-02-12T17:20:30.315 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:20:32.316 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:32.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.404+0000 7f027b914700 1 Processor -- start 2021-02-12T17:20:32.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.405+0000 7f027b914700 1 -- start start 2021-02-12T17:20:32.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.405+0000 7f027b914700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f027414e530 0x7f0274068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:32.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.405+0000 7f027b914700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02740b7960 con 0x7f0274062740 2021-02-12T17:20:32.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.405+0000 7f027b914700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02740622a0 con 0x7f02740b8d20 2021-02-12T17:20:32.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.405+0000 7f027b914700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0274068d20 con 0x7f027414e530 2021-02-12T17:20:32.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.405+0000 7f0279eb1700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f0274062740 0x7f0274062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55628/0 (socket says 172.21.2.102:55628) 2021-02-12T17:20:32.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.405+0000 7f0279eb1700 1 -- 172.21.2.102:0/3386659610 learned_addr learned my addr 172.21.2.102:0/3386659610 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:20:32.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 -- 172.21.2.102:0/3386659610 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003994210 0 0) 0x7f02740b7960 con 0x7f0274062740 2021-02-12T17:20:32.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 -- 172.21.2.102:0/3386659610 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f025c003230 con 0x7f0274062740 2021-02-12T17:20:32.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 -- 172.21.2.102:0/3386659610 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 13744037 0 0) 0x7f025c003230 con 0x7f0274062740 2021-02-12T17:20:32.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 -- 172.21.2.102:0/3386659610 >> v2:172.21.2.104:3300/0 conn(0x7f027414e530 msgr2=0x7f0274068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:32.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 --2- 172.21.2.102:0/3386659610 >> v2:172.21.2.104:3300/0 conn(0x7f027414e530 0x7f0274068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:32.410 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 -- 172.21.2.102:0/3386659610 >> v1:172.21.2.104:6789/0 conn(0x7f02740b8d20 legacy=0x7f02740b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:32.410 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 -- 172.21.2.102:0/3386659610 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027414ea10 con 0x7f0274062740 2021-02-12T17:20:32.410 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 -- 172.21.2.102:0/3386659610 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f026c001860 con 0x7f0274062740 2021-02-12T17:20:32.410 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 -- 172.21.2.102:0/3386659610 >> v1:172.21.2.102:6789/0 conn(0x7f0274062740 legacy=0x7f0274062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:32.410 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 --2- 172.21.2.102:0/3386659610 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f025c0037f0 0x7f025c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:32.410 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 --2- 172.21.2.102:0/3386659610 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c0044d0 0x7f025c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:32.410 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 --2- 172.21.2.102:0/3386659610 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f025c004e40 0x7f025c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:32.410 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 -- 172.21.2.102:0/3386659610 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0274068d20 con 0x7f025c0044d0 2021-02-12T17:20:32.410 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 -- 172.21.2.102:0/3386659610 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c0053a0 con 0x7f025c004e40 2021-02-12T17:20:32.410 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0267fff700 1 -- 172.21.2.102:0/3386659610 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c00bc60 con 0x7f025c0037f0 2021-02-12T17:20:32.410 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0279eb1700 1 --2- 172.21.2.102:0/3386659610 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f025c004e40 0x7f025c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:32.410 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0278eaf700 1 --2- 172.21.2.102:0/3386659610 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c0044d0 0x7f025c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:32.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f02796b0700 1 --2- 172.21.2.102:0/3386659610 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f025c0037f0 0x7f025c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:32.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0278eaf700 1 -- 172.21.2.102:0/3386659610 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f025c0037f0 msgr2=0x7f025c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:32.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0278eaf700 1 --2- 172.21.2.102:0/3386659610 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f025c0037f0 0x7f025c003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:32.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0278eaf700 1 -- 172.21.2.102:0/3386659610 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f025c004e40 msgr2=0x7f025c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:32.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0278eaf700 1 --2- 172.21.2.102:0/3386659610 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f025c004e40 0x7f025c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:32.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0278eaf700 1 -- 172.21.2.102:0/3386659610 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c003230 con 0x7f025c0044d0 2021-02-12T17:20:32.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0279eb1700 1 --2- 172.21.2.102:0/3386659610 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f025c004e40 0x7f025c00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:20:32.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.406+0000 7f0279eb1700 1 -- 172.21.2.102:0/3386659610 reap_dead start 2021-02-12T17:20:32.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.407+0000 7f0278eaf700 1 --2- 172.21.2.102:0/3386659610 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c0044d0 0x7f025c004950 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f026800b980 tx=0x7f0268006e20).ready entity=mon.0 client_cookie=e8d5cff5373c3cc9 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:32.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.407+0000 7f0267fff700 1 -- 172.21.2.102:0/3386659610 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02680097a0 con 0x7f025c0044d0 2021-02-12T17:20:32.411 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.407+0000 7f0267fff700 1 -- 172.21.2.102:0/3386659610 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0268000e90 con 0x7f025c0044d0 2021-02-12T17:20:32.412 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.407+0000 7f0267fff700 1 -- 172.21.2.102:0/3386659610 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0268009b50 con 0x7f025c0044d0 2021-02-12T17:20:32.412 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.407+0000 7f027b914700 1 -- 172.21.2.102:0/3386659610 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c0044d0 msgr2=0x7f025c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:32.412 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.407+0000 7f027b914700 1 --2- 172.21.2.102:0/3386659610 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c0044d0 0x7f025c004950 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f026800b980 tx=0x7f0268006e20).stop 2021-02-12T17:20:32.412 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.407+0000 7f027b914700 1 -- 172.21.2.102:0/3386659610 shutdown_connections 2021-02-12T17:20:32.412 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.407+0000 7f027b914700 1 --2- 172.21.2.102:0/3386659610 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f025c0044d0 0x7f025c004950 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:32.412 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.407+0000 7f027b914700 1 -- 172.21.2.102:0/3386659610 >> 172.21.2.102:0/3386659610 conn(0x7f02740bc480 msgr2=0x7f02740b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:32.412 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.407+0000 7f027b914700 1 -- 172.21.2.102:0/3386659610 shutdown_connections 2021-02-12T17:20:32.412 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.407+0000 7f027b914700 1 -- 172.21.2.102:0/3386659610 wait complete. 2021-02-12T17:20:32.412 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.408+0000 7f027b914700 1 Processor -- start 2021-02-12T17:20:32.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.408+0000 7f027b914700 1 -- start start 2021-02-12T17:20:32.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.408+0000 7f027b914700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f025c0044d0 0x7f0274152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:32.415 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.408+0000 7f027b914700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0274150390 0x7f02740af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:32.415 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.408+0000 7f027b914700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f027414f150 0x7f02740af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:32.415 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.408+0000 7f027b914700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027414f5c0 con 0x7f027414f150 2021-02-12T17:20:32.415 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.408+0000 7f027b914700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0274160c30 con 0x7f025c0044d0 2021-02-12T17:20:32.415 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f027b914700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0274150830 con 0x7f0274150390 2021-02-12T17:20:32.415 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f0279eb1700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f027414f150 0x7f02740af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:32.415 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f0279eb1700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f027414f150 0x7f02740af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:46996/0 (socket says 172.21.2.102:46996) 2021-02-12T17:20:32.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f0279eb1700 1 -- 172.21.2.102:0/3723979303 learned_addr learned my addr 172.21.2.102:0/3723979303 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:32.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f02796b0700 1 --2- 172.21.2.102:0/3723979303 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f025c0044d0 0x7f0274152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:32.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f0279eb1700 1 -- 172.21.2.102:0/3723979303 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0274150390 msgr2=0x7f02740af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:32.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f0279eb1700 1 --2- 172.21.2.102:0/3723979303 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0274150390 0x7f02740af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:32.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f0279eb1700 1 -- 172.21.2.102:0/3723979303 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f025c0044d0 msgr2=0x7f0274152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:32.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f0279eb1700 1 --2- 172.21.2.102:0/3723979303 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f025c0044d0 0x7f0274152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:32.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f0279eb1700 1 -- 172.21.2.102:0/3723979303 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740ad2a0 con 0x7f027414f150 2021-02-12T17:20:32.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f0279eb1700 1 --2- 172.21.2.102:0/3723979303 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f027414f150 0x7f02740af850 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f0274065550 tx=0x7f027414eba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:32.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f02657fa700 1 -- 172.21.2.102:0/3723979303 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c00e860 con 0x7f027414f150 2021-02-12T17:20:32.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f02657fa700 1 -- 172.21.2.102:0/3723979303 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c00e9c0 con 0x7f027414f150 2021-02-12T17:20:32.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f027b914700 1 -- 172.21.2.102:0/3723979303 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027414f7b0 con 0x7f027414f150 2021-02-12T17:20:32.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f02657fa700 1 -- 172.21.2.102:0/3723979303 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c00ed40 con 0x7f027414f150 2021-02-12T17:20:32.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.409+0000 7f027b914700 1 -- 172.21.2.102:0/3723979303 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02740baf30 con 0x7f027414f150 2021-02-12T17:20:32.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.410+0000 7f027b914700 1 -- 172.21.2.102:0/3723979303 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027414f940 con 0x7f027414f150 2021-02-12T17:20:32.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.410+0000 7f02657fa700 1 -- 172.21.2.102:0/3723979303 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f026c014640 con 0x7f027414f150 2021-02-12T17:20:32.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.410+0000 7f02657fa700 1 --2- 172.21.2.102:0/3723979303 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0254059d30 0x7f025405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:32.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.411+0000 7f02657fa700 1 -- 172.21.2.102:0/3723979303 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7279+0+0 (secure 0 0 0) 0x7f026c073c10 con 0x7f027414f150 2021-02-12T17:20:32.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.411+0000 7f02796b0700 1 --2- 172.21.2.102:0/3723979303 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0254059d30 0x7f025405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:32.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.411+0000 7f02796b0700 1 --2- 172.21.2.102:0/3723979303 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0254059d30 0x7f025405c1f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f0270007fd0 tx=0x7f0270009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:32.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.413+0000 7f02657fa700 1 -- 172.21.2.102:0/3723979303 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f026c046580 con 0x7f027414f150 2021-02-12T17:20:32.577 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.576+0000 7f027b914700 1 -- 172.21.2.102:0/3723979303 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0274150c20 con 0x7f027414f150 2021-02-12T17:20:32.578 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.576+0000 7f02657fa700 1 -- 172.21.2.102:0/3723979303 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3405 (secure 0 0 0) 0x7f026c047130 con 0x7f027414f150 2021-02-12T17:20:32.578 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:32.578 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:20:32.312555+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4744":{"gid":4744,"name":"d","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":5,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:32.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.578+0000 7f027b914700 1 -- 172.21.2.102:0/3723979303 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0254059d30 msgr2=0x7f025405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:32.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.578+0000 7f027b914700 1 --2- 172.21.2.102:0/3723979303 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0254059d30 0x7f025405c1f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f0270007fd0 tx=0x7f0270009040).stop 2021-02-12T17:20:32.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.578+0000 7f027b914700 1 -- 172.21.2.102:0/3723979303 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f027414f150 msgr2=0x7f02740af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:32.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.578+0000 7f027b914700 1 --2- 172.21.2.102:0/3723979303 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f027414f150 0x7f02740af850 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f0274065550 tx=0x7f027414eba0).stop 2021-02-12T17:20:32.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.578+0000 7f027b914700 1 -- 172.21.2.102:0/3723979303 shutdown_connections 2021-02-12T17:20:32.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.578+0000 7f027b914700 1 --2- 172.21.2.102:0/3723979303 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0254059d30 0x7f025405c1f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:32.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.578+0000 7f027b914700 1 --2- 172.21.2.102:0/3723979303 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f027414f150 0x7f02740af850 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:32.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.578+0000 7f027b914700 1 --2- 172.21.2.102:0/3723979303 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f025c0044d0 0x7f0274152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:32.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.578+0000 7f027b914700 1 --2- 172.21.2.102:0/3723979303 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0274150390 0x7f02740af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:32.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.578+0000 7f027b914700 1 -- 172.21.2.102:0/3723979303 >> 172.21.2.102:0/3723979303 conn(0x7f02740bc480 msgr2=0x7f027414cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:32.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.578+0000 7f027b914700 1 -- 172.21.2.102:0/3723979303 shutdown_connections 2021-02-12T17:20:32.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.578+0000 7f027b914700 1 -- 172.21.2.102:0/3723979303 wait complete. 2021-02-12T17:20:32.580 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 32 2021-02-12T17:20:32.587 INFO:tasks.mds_thrash.fs.[a]:mds.c down, removed from mdsmap 2021-02-12T17:20:32.587 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2021-02-12T17:20:32.588 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:32.677 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.676+0000 7f7b3965a700 1 Processor -- start 2021-02-12T17:20:32.677 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.676+0000 7f7b3965a700 1 -- start start 2021-02-12T17:20:32.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.676+0000 7f7b3965a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b340b8d20 0x7f7b34068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:32.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.676+0000 7f7b3965a700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f7b34062740 0x7f7b34062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:32.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.676+0000 7f7b3965a700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b340b7960 con 0x7f7b3414e530 2021-02-12T17:20:32.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.676+0000 7f7b3965a700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b34068d20 con 0x7f7b34062740 2021-02-12T17:20:32.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.676+0000 7f7b3965a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340622a0 con 0x7f7b340b8d20 2021-02-12T17:20:32.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.676+0000 7f7b337fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f7b34062740 0x7f7b34062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:32.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.676+0000 7f7b337fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f7b34062740 0x7f7b34062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47006/0 (socket says 172.21.2.102:47006) 2021-02-12T17:20:32.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.676+0000 7f7b337fe700 1 -- 172.21.2.102:0/2067324332 learned_addr learned my addr 172.21.2.102:0/2067324332 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:32.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b337fe700 1 -- 172.21.2.102:0/2067324332 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b340b8d20 msgr2=0x7f7b34068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:20:32.678 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b337fe700 1 --2- 172.21.2.102:0/2067324332 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b340b8d20 0x7f7b34068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:32.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b337fe700 1 -- 172.21.2.102:0/2067324332 >> v1:172.21.2.104:6789/0 conn(0x7f7b3414e530 legacy=0x7f7b340b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:20:32.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b337fe700 1 -- 172.21.2.102:0/2067324332 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3414ea10 con 0x7f7b34062740 2021-02-12T17:20:32.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b337fe700 1 --2- 172.21.2.102:0/2067324332 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b34062740 0x7f7b34062bf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f7b2c009d50 tx=0x7f7b2c009290).ready entity=mon.0 client_cookie=7e4bdcabd3db9783 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:32.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b31ffb700 1 -- 172.21.2.102:0/2067324332 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c00bbb0 con 0x7f7b34062740 2021-02-12T17:20:32.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b31ffb700 1 -- 172.21.2.102:0/2067324332 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c00bd10 con 0x7f7b34062740 2021-02-12T17:20:32.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b31ffb700 1 -- 172.21.2.102:0/2067324332 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c011610 con 0x7f7b34062740 2021-02-12T17:20:32.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b3965a700 1 -- 172.21.2.102:0/2067324332 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b34062740 msgr2=0x7f7b34062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:32.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b3965a700 1 --2- 172.21.2.102:0/2067324332 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b34062740 0x7f7b34062bf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f7b2c009d50 tx=0x7f7b2c009290).stop 2021-02-12T17:20:32.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b3965a700 1 -- 172.21.2.102:0/2067324332 shutdown_connections 2021-02-12T17:20:32.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b3965a700 1 --2- 172.21.2.102:0/2067324332 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b34062740 0x7f7b34062bf0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:32.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b3965a700 1 --2- 172.21.2.102:0/2067324332 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b340b8d20 0x7f7b34068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:32.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b3965a700 1 -- 172.21.2.102:0/2067324332 >> 172.21.2.102:0/2067324332 conn(0x7f7b340bc480 msgr2=0x7f7b340b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:32.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b3965a700 1 -- 172.21.2.102:0/2067324332 shutdown_connections 2021-02-12T17:20:32.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.677+0000 7f7b3965a700 1 -- 172.21.2.102:0/2067324332 wait complete. 2021-02-12T17:20:32.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.678+0000 7f7b3965a700 1 Processor -- start 2021-02-12T17:20:32.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.678+0000 7f7b3965a700 1 -- start start 2021-02-12T17:20:32.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.678+0000 7f7b3965a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b34062740 0x7f7b340b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:32.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.678+0000 7f7b3965a700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7b340b8d20 0x7f7b340aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:32.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.678+0000 7f7b3965a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b3414e530 0x7f7b3414a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:32.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.678+0000 7f7b3965a700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340b0090 con 0x7f7b3414e530 2021-02-12T17:20:32.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.678+0000 7f7b3965a700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3415e7d0 con 0x7f7b340b8d20 2021-02-12T17:20:32.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.678+0000 7f7b3965a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340b10f0 con 0x7f7b34062740 2021-02-12T17:20:32.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.679+0000 7f7b337fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b3414e530 0x7f7b3414a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:32.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.679+0000 7f7b337fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b3414e530 0x7f7b3414a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47010/0 (socket says 172.21.2.102:47010) 2021-02-12T17:20:32.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.679+0000 7f7b337fe700 1 -- 172.21.2.102:0/2972154597 learned_addr learned my addr 172.21.2.102:0/2972154597 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:32.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.679+0000 7f7b337fe700 1 -- 172.21.2.102:0/2972154597 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b34062740 msgr2=0x7f7b340b5830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:20:32.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.679+0000 7f7b337fe700 1 --2- 172.21.2.102:0/2972154597 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b34062740 0x7f7b340b5830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:32.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.679+0000 7f7b337fe700 1 -- 172.21.2.102:0/2972154597 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7b340b8d20 msgr2=0x7f7b340aeb10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:20:32.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.679+0000 7f7b337fe700 1 --2- 172.21.2.102:0/2972154597 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7b340b8d20 0x7f7b340aeb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:32.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.679+0000 7f7b337fe700 1 -- 172.21.2.102:0/2972154597 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3415db50 con 0x7f7b3414e530 2021-02-12T17:20:32.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.679+0000 7f7b337fe700 1 --2- 172.21.2.102:0/2972154597 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b3414e530 0x7f7b3414a9f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f7b340653c0 tx=0x7f7b2c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:32.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.679+0000 7f7b2affd700 1 -- 172.21.2.102:0/2972154597 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c011e70 con 0x7f7b3414e530 2021-02-12T17:20:32.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.679+0000 7f7b2affd700 1 -- 172.21.2.102:0/2972154597 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c00be80 con 0x7f7b3414e530 2021-02-12T17:20:32.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.679+0000 7f7b3965a700 1 -- 172.21.2.102:0/2972154597 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3415ddf0 con 0x7f7b3414e530 2021-02-12T17:20:32.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.679+0000 7f7b2affd700 1 -- 172.21.2.102:0/2972154597 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c010dd0 con 0x7f7b3414e530 2021-02-12T17:20:32.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.679+0000 7f7b3965a700 1 -- 172.21.2.102:0/2972154597 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b340b5d20 con 0x7f7b3414e530 2021-02-12T17:20:32.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.680+0000 7f7b3965a700 1 -- 172.21.2.102:0/2972154597 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b34065b00 con 0x7f7b3414e530 2021-02-12T17:20:32.684 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.680+0000 7f7b2affd700 1 -- 172.21.2.102:0/2972154597 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f7b2c00f070 con 0x7f7b3414e530 2021-02-12T17:20:32.684 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.680+0000 7f7b2affd700 1 --2- 172.21.2.102:0/2972154597 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b18059d80 0x7f7b1805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:32.684 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.680+0000 7f7b2affd700 1 -- 172.21.2.102:0/2972154597 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7279+0+0 (secure 0 0 0) 0x7f7b2c076140 con 0x7f7b3414e530 2021-02-12T17:20:32.684 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.680+0000 7f7b32ffd700 1 --2- 172.21.2.102:0/2972154597 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b18059d80 0x7f7b1805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:32.684 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.681+0000 7f7b32ffd700 1 --2- 172.21.2.102:0/2972154597 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b18059d80 0x7f7b1805c240 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f7b340baca0 tx=0x7f7b24006920).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:32.684 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.683+0000 7f7b2affd700 1 -- 172.21.2.102:0/2972154597 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f7b2c049720 con 0x7f7b3414e530 2021-02-12T17:20:32.842 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.841+0000 7f7b3965a700 1 -- 172.21.2.102:0/2972154597 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b34063340 con 0x7f7b3414e530 2021-02-12T17:20:32.843 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.841+0000 7f7b2affd700 1 -- 172.21.2.102:0/2972154597 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3405 (secure 0 0 0) 0x7f7b2c04cd40 con 0x7f7b3414e530 2021-02-12T17:20:32.843 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:32.843 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:20:32.312555+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4744":{"gid":4744,"name":"d","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":5,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:32.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.842+0000 7f7b3965a700 1 -- 172.21.2.102:0/2972154597 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b18059d80 msgr2=0x7f7b1805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:32.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.842+0000 7f7b3965a700 1 --2- 172.21.2.102:0/2972154597 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b18059d80 0x7f7b1805c240 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f7b340baca0 tx=0x7f7b24006920).stop 2021-02-12T17:20:32.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.843+0000 7f7b3965a700 1 -- 172.21.2.102:0/2972154597 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b3414e530 msgr2=0x7f7b3414a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:32.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.843+0000 7f7b3965a700 1 --2- 172.21.2.102:0/2972154597 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b3414e530 0x7f7b3414a9f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f7b340653c0 tx=0x7f7b2c017000).stop 2021-02-12T17:20:32.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.843+0000 7f7b3965a700 1 -- 172.21.2.102:0/2972154597 shutdown_connections 2021-02-12T17:20:32.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.843+0000 7f7b3965a700 1 --2- 172.21.2.102:0/2972154597 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b18059d80 0x7f7b1805c240 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:32.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.843+0000 7f7b3965a700 1 --2- 172.21.2.102:0/2972154597 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b3414e530 0x7f7b3414a9f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:32.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.843+0000 7f7b3965a700 1 --2- 172.21.2.102:0/2972154597 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b34062740 0x7f7b340b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:32.844 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.843+0000 7f7b3965a700 1 --2- 172.21.2.102:0/2972154597 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7b340b8d20 0x7f7b340aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:32.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.843+0000 7f7b3965a700 1 -- 172.21.2.102:0/2972154597 >> 172.21.2.102:0/2972154597 conn(0x7f7b340bc480 msgr2=0x7f7b340bb100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:32.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.843+0000 7f7b3965a700 1 -- 172.21.2.102:0/2972154597 shutdown_connections 2021-02-12T17:20:32.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:32.843+0000 7f7b3965a700 1 -- 172.21.2.102:0/2972154597 wait complete. 2021-02-12T17:20:32.845 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 32 2021-02-12T17:20:32.853 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 32, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:01.991560+0000", "damaged": [], "data_pools": [ 4 ], "enabled": true, "epoch": 32, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "a", "in": [ 0 ], "info": { "gid_4744": { "addr": "172.21.2.104:6835/3304354058", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6833", "nonce": 3304354058, "type": "v2" }, { "addr": "172.21.2.104:6835", "nonce": 3304354058, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4744, "incarnation": 31, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:reconnect", "state_seq": 5 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2021-02-12T17:20:32.312555+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4744 } } }, { "id": 2, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:08.529588+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 29, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "b", "in": [ 0 ], "info": { "gid_5280": { "addr": "172.21.2.102:6835/277624455", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6834", "nonce": 277624455, "type": "v2" }, { "addr": "172.21.2.102:6835", "nonce": 277624455, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5280, "incarnation": 26, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 7 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 5, "modified": "2021-02-12T17:20:09.310778+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5280 } } } ], "standbys": [ { "addr": "172.21.2.104:6834/3149030842", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6832", "nonce": 3149030842, "type": "v2" }, { "addr": "172.21.2.104:6834", "nonce": 3149030842, "type": "v1" } ] }, "epoch": 5, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4243, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 2 } ] } 2021-02-12T17:20:34.530 INFO:tasks.ceph.mds.d.gibba004.stderr:2021-02-12T17:20:34.528+0000 7f1984332700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-02-12T17:20:34.854 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:34.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.943+0000 7f262752b700 1 Processor -- start 2021-02-12T17:20:34.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.944+0000 7f262752b700 1 -- start start 2021-02-12T17:20:34.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.944+0000 7f262752b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f26200b8d20 0x7f2620068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:34.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.944+0000 7f262752b700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f262014e530 0x7f26200b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:34.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.944+0000 7f262752b700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26200622a0 con 0x7f2620062740 2021-02-12T17:20:34.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.944+0000 7f262752b700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2620068d20 con 0x7f26200b8d20 2021-02-12T17:20:34.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.944+0000 7f262752b700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262014ea10 con 0x7f262014e530 2021-02-12T17:20:34.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.944+0000 7f26252c7700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f26200b8d20 0x7f2620068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:34.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.944+0000 7f26252c7700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f26200b8d20 0x7f2620068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47016/0 (socket says 172.21.2.102:47016) 2021-02-12T17:20:34.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.944+0000 7f26252c7700 1 -- 172.21.2.102:0/2061355981 learned_addr learned my addr 172.21.2.102:0/2061355981 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:34.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f26252c7700 1 -- 172.21.2.102:0/2061355981 >> v2:172.21.2.104:3300/0 conn(0x7f262014e530 msgr2=0x7f26200b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:20:34.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f26252c7700 1 --2- 172.21.2.102:0/2061355981 >> v2:172.21.2.104:3300/0 conn(0x7f262014e530 0x7f26200b7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:34.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f26252c7700 1 -- 172.21.2.102:0/2061355981 >> v1:172.21.2.102:6789/0 conn(0x7f2620062740 legacy=0x7f2620062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:34.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f26252c7700 1 -- 172.21.2.102:0/2061355981 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26200b63f0 con 0x7f26200b8d20 2021-02-12T17:20:34.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f26252c7700 1 --2- 172.21.2.102:0/2061355981 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f26200b8d20 0x7f2620068830 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f26200654b0 tx=0x7f261c006ea0).ready entity=mon.0 client_cookie=9be53ae05d6651d9 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:34.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f2613fff700 1 -- 172.21.2.102:0/2061355981 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c009840 con 0x7f26200b8d20 2021-02-12T17:20:34.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f2613fff700 1 -- 172.21.2.102:0/2061355981 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c0099a0 con 0x7f26200b8d20 2021-02-12T17:20:34.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f2613fff700 1 -- 172.21.2.102:0/2061355981 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c009d20 con 0x7f26200b8d20 2021-02-12T17:20:34.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f262752b700 1 -- 172.21.2.102:0/2061355981 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f26200b8d20 msgr2=0x7f2620068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:34.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f262752b700 1 --2- 172.21.2.102:0/2061355981 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f26200b8d20 0x7f2620068830 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f26200654b0 tx=0x7f261c006ea0).stop 2021-02-12T17:20:34.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f262752b700 1 -- 172.21.2.102:0/2061355981 shutdown_connections 2021-02-12T17:20:34.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f262752b700 1 --2- 172.21.2.102:0/2061355981 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f26200b8d20 0x7f2620068830 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:34.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f262752b700 1 --2- 172.21.2.102:0/2061355981 >> v2:172.21.2.104:3300/0 conn(0x7f262014e530 0x7f26200b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:34.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f262752b700 1 -- 172.21.2.102:0/2061355981 >> 172.21.2.102:0/2061355981 conn(0x7f26200bc480 msgr2=0x7f26200b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:34.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f262752b700 1 -- 172.21.2.102:0/2061355981 shutdown_connections 2021-02-12T17:20:34.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.945+0000 7f262752b700 1 -- 172.21.2.102:0/2061355981 wait complete. 2021-02-12T17:20:34.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.946+0000 7f262752b700 1 Processor -- start 2021-02-12T17:20:34.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.946+0000 7f262752b700 1 -- start start 2021-02-12T17:20:34.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f262752b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2620062740 0x7f26200aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:34.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f262752b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f26200b8d20 0x7f262015e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:34.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f262752b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f262014e530 0x7f26200b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:34.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f262752b700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26200ae520 con 0x7f2620062740 2021-02-12T17:20:34.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f262752b700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262015e5e0 con 0x7f262014e530 2021-02-12T17:20:34.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f262752b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26200ae750 con 0x7f26200b8d20 2021-02-12T17:20:34.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f26252c7700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2620062740 0x7f26200aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:34.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f26252c7700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2620062740 0x7f26200aff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47026/0 (socket says 172.21.2.102:47026) 2021-02-12T17:20:34.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f26252c7700 1 -- 172.21.2.102:0/3492045871 learned_addr learned my addr 172.21.2.102:0/3492045871 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:34.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f26252c7700 1 -- 172.21.2.102:0/3492045871 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f26200b8d20 msgr2=0x7f262015e0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:20:34.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f26252c7700 1 --2- 172.21.2.102:0/3492045871 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f26200b8d20 0x7f262015e0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:34.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f26252c7700 1 -- 172.21.2.102:0/3492045871 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f262014e530 msgr2=0x7f26200b4de0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:20:34.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f26252c7700 1 --2- 172.21.2.102:0/3492045871 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f262014e530 0x7f26200b4de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:34.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f26252c7700 1 -- 172.21.2.102:0/3492045871 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26200ae9f0 con 0x7f2620062740 2021-02-12T17:20:34.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.947+0000 7f26252c7700 1 --2- 172.21.2.102:0/3492045871 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2620062740 0x7f26200aff80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f26200653c0 tx=0x7f261c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:34.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.948+0000 7f26117fa700 1 -- 172.21.2.102:0/3492045871 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c006880 con 0x7f2620062740 2021-02-12T17:20:34.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.948+0000 7f26117fa700 1 -- 172.21.2.102:0/3492045871 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c01d430 con 0x7f2620062740 2021-02-12T17:20:34.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.948+0000 7f26117fa700 1 -- 172.21.2.102:0/3492045871 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c01d7d0 con 0x7f2620062740 2021-02-12T17:20:34.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.948+0000 7f262752b700 1 -- 172.21.2.102:0/3492045871 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26200ad020 con 0x7f2620062740 2021-02-12T17:20:34.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.948+0000 7f262752b700 1 -- 172.21.2.102:0/3492045871 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26200b52d0 con 0x7f2620062740 2021-02-12T17:20:34.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.948+0000 7f262752b700 1 -- 172.21.2.102:0/3492045871 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2620064520 con 0x7f2620062740 2021-02-12T17:20:34.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.949+0000 7f26117fa700 1 -- 172.21.2.102:0/3492045871 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f261c024030 con 0x7f2620062740 2021-02-12T17:20:34.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.949+0000 7f26117fa700 1 --2- 172.21.2.102:0/3492045871 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2600059d60 0x7f260005c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:34.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.949+0000 7f26117fa700 1 -- 172.21.2.102:0/3492045871 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7279+0+0 (secure 0 0 0) 0x7f261c075060 con 0x7f2620062740 2021-02-12T17:20:34.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.949+0000 7f2624ac6700 1 --2- 172.21.2.102:0/3492045871 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2600059d60 0x7f260005c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:34.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.949+0000 7f2624ac6700 1 --2- 172.21.2.102:0/3492045871 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2600059d60 0x7f260005c220 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f262014f510 tx=0x7f2614006880).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:34.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:34.952+0000 7f26117fa700 1 -- 172.21.2.102:0/3492045871 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f261c048690 con 0x7f2620062740 2021-02-12T17:20:35.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:35.113+0000 7f262752b700 1 -- 172.21.2.102:0/3492045871 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26200ad480 con 0x7f2620062740 2021-02-12T17:20:35.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:35.113+0000 7f26117fa700 1 -- 172.21.2.102:0/3492045871 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3402 (secure 0 0 0) 0x7f261c022090 con 0x7f2620062740 2021-02-12T17:20:35.115 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:35.115 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:20:34.320425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4744":{"gid":4744,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:35.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:35.114+0000 7f262752b700 1 -- 172.21.2.102:0/3492045871 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2600059d60 msgr2=0x7f260005c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:35.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:35.114+0000 7f262752b700 1 --2- 172.21.2.102:0/3492045871 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2600059d60 0x7f260005c220 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f262014f510 tx=0x7f2614006880).stop 2021-02-12T17:20:35.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:35.114+0000 7f262752b700 1 -- 172.21.2.102:0/3492045871 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2620062740 msgr2=0x7f26200aff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:35.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:35.114+0000 7f262752b700 1 --2- 172.21.2.102:0/3492045871 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2620062740 0x7f26200aff80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f26200653c0 tx=0x7f261c016000).stop 2021-02-12T17:20:35.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:35.115+0000 7f262752b700 1 -- 172.21.2.102:0/3492045871 shutdown_connections 2021-02-12T17:20:35.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:35.115+0000 7f262752b700 1 --2- 172.21.2.102:0/3492045871 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f262014e530 0x7f26200b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:35.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:35.115+0000 7f262752b700 1 --2- 172.21.2.102:0/3492045871 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2600059d60 0x7f260005c220 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:35.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:35.115+0000 7f262752b700 1 --2- 172.21.2.102:0/3492045871 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2620062740 0x7f26200aff80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:35.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:35.115+0000 7f262752b700 1 --2- 172.21.2.102:0/3492045871 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f26200b8d20 0x7f262015e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:35.116 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:35.115+0000 7f262752b700 1 -- 172.21.2.102:0/3492045871 >> 172.21.2.102:0/3492045871 conn(0x7f26200bc480 msgr2=0x7f26200b7420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:35.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:35.115+0000 7f262752b700 1 -- 172.21.2.102:0/3492045871 shutdown_connections 2021-02-12T17:20:35.117 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:35.115+0000 7f262752b700 1 -- 172.21.2.102:0/3492045871 wait complete. 2021-02-12T17:20:35.117 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 34 2021-02-12T17:20:35.125 INFO:tasks.mds_thrash.fs.[a]:mds.d has gained rank=0, replacing gid=5157 2021-02-12T17:20:35.125 INFO:tasks.mds_thrash.fs.[a]:waiting for 7 secs before reviving mds.c 2021-02-12T17:20:40.927 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:20:40.930 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:20:42.125 INFO:tasks.mds_thrash.fs.[a]:reviving mds.c 2021-02-12T17:20:42.126 INFO:tasks.ceph.mds.c:Restarting daemon 2021-02-12T17:20:42.126 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-02-12T17:20:42.129 INFO:tasks.ceph.mds.c:Started 2021-02-12T17:20:42.129 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:42.186 INFO:tasks.ceph.mds.c.gibba002.stdout:starting mds.c at 2021-02-12T17:20:42.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.219+0000 7f870a2dc700 1 Processor -- start 2021-02-12T17:20:42.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.219+0000 7f870a2dc700 1 -- start start 2021-02-12T17:20:42.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.219+0000 7f870a2dc700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f870414e530 0x7f8704068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:42.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.219+0000 7f870a2dc700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8704062740 0x7f8704062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:42.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.219+0000 7f870a2dc700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87040b7960 con 0x7f87040b8d20 2021-02-12T17:20:42.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.219+0000 7f870a2dc700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8704068d20 con 0x7f870414e530 2021-02-12T17:20:42.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.219+0000 7f870a2dc700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87040622a0 con 0x7f8704062740 2021-02-12T17:20:42.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.219+0000 7f8703fff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f87040b8d20 0x7f87040b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55692/0 (socket says 172.21.2.102:55692) 2021-02-12T17:20:42.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.219+0000 7f8703fff700 1 -- 172.21.2.102:0/1646719971 learned_addr learned my addr 172.21.2.102:0/1646719971 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:20:42.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 -- 172.21.2.102:0/1646719971 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174482063 0 0) 0x7f87040b7960 con 0x7f87040b8d20 2021-02-12T17:20:42.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 -- 172.21.2.102:0/1646719971 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86e4003230 con 0x7f87040b8d20 2021-02-12T17:20:42.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 -- 172.21.2.102:0/1646719971 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2719010054 0 0) 0x7f86e4003230 con 0x7f87040b8d20 2021-02-12T17:20:42.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 -- 172.21.2.102:0/1646719971 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8704062740 msgr2=0x7f8704062bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:20:42.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 --2- 172.21.2.102:0/1646719971 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8704062740 0x7f8704062bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:42.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 -- 172.21.2.102:0/1646719971 >> v2:172.21.2.104:3300/0 conn(0x7f870414e530 msgr2=0x7f8704068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:20:42.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 --2- 172.21.2.102:0/1646719971 >> v2:172.21.2.104:3300/0 conn(0x7f870414e530 0x7f8704068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:42.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 -- 172.21.2.102:0/1646719971 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870414ea10 con 0x7f87040b8d20 2021-02-12T17:20:42.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 -- 172.21.2.102:0/1646719971 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f86ec0014e0 con 0x7f87040b8d20 2021-02-12T17:20:42.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 -- 172.21.2.102:0/1646719971 >> v1:172.21.2.102:6789/0 conn(0x7f87040b8d20 legacy=0x7f87040b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:42.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 --2- 172.21.2.102:0/1646719971 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8704062740 0x7f86e4003740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:42.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 --2- 172.21.2.102:0/1646719971 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f86e4003c50 0x7f86e40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:42.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 --2- 172.21.2.102:0/1646719971 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f86e40049c0 0x7f86e4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:42.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 -- 172.21.2.102:0/1646719971 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8704068d20 con 0x7f86e40049c0 2021-02-12T17:20:42.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 -- 172.21.2.102:0/1646719971 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87040622a0 con 0x7f86e4003c50 2021-02-12T17:20:42.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 -- 172.21.2.102:0/1646719971 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4004210 con 0x7f8704062740 2021-02-12T17:20:42.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8708879700 1 --2- 172.21.2.102:0/1646719971 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f86e40049c0 0x7f86e4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:42.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8708879700 1 -- 172.21.2.102:0/1646719971 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8704062740 msgr2=0x7f86e4003740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:42.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8708879700 1 --2- 172.21.2.102:0/1646719971 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8704062740 0x7f86e4003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:42.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8708879700 1 -- 172.21.2.102:0/1646719971 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f86e4003c50 msgr2=0x7f86e40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:20:42.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8708879700 1 --2- 172.21.2.102:0/1646719971 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f86e4003c50 0x7f86e40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:42.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8708879700 1 -- 172.21.2.102:0/1646719971 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e4003230 con 0x7f86e40049c0 2021-02-12T17:20:42.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8708879700 1 --2- 172.21.2.102:0/1646719971 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f86e40049c0 0x7f86e4004e40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f86fc009b90 tx=0x7f86fc009120).ready entity=mon.0 client_cookie=b1031e9ec394f9b9 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:42.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 -- 172.21.2.102:0/1646719971 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc00b930 con 0x7f86e40049c0 2021-02-12T17:20:42.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 -- 172.21.2.102:0/1646719971 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc00bad0 con 0x7f86e40049c0 2021-02-12T17:20:42.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.220+0000 7f8702ffd700 1 -- 172.21.2.102:0/1646719971 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc00be90 con 0x7f86e40049c0 2021-02-12T17:20:42.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.221+0000 7f870a2dc700 1 -- 172.21.2.102:0/1646719971 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f86e40049c0 msgr2=0x7f86e4004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:42.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.221+0000 7f870a2dc700 1 --2- 172.21.2.102:0/1646719971 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f86e40049c0 0x7f86e4004e40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f86fc009b90 tx=0x7f86fc009120).stop 2021-02-12T17:20:42.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.221+0000 7f8708879700 1 -- 172.21.2.102:0/1646719971 reap_dead start 2021-02-12T17:20:42.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.221+0000 7f870a2dc700 1 -- 172.21.2.102:0/1646719971 shutdown_connections 2021-02-12T17:20:42.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.221+0000 7f870a2dc700 1 -- 172.21.2.102:0/1646719971 >> 172.21.2.102:0/1646719971 conn(0x7f87040bc480 msgr2=0x7f87040b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:42.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.221+0000 7f870a2dc700 1 -- 172.21.2.102:0/1646719971 shutdown_connections 2021-02-12T17:20:42.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.221+0000 7f870a2dc700 1 -- 172.21.2.102:0/1646719971 wait complete. 2021-02-12T17:20:42.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f870a2dc700 1 Processor -- start 2021-02-12T17:20:42.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f870a2dc700 1 -- start start 2021-02-12T17:20:42.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f870a2dc700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f87040b9a70 0x7f8704160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:42.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f870a2dc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87040acf10 0x7f870415cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:42.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f870a2dc700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f870415d400 0x7f87040b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:42.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f870a2dc700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87040b1a10 con 0x7f87040acf10 2021-02-12T17:20:42.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f870a2dc700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87041521a0 con 0x7f87040b9a70 2021-02-12T17:20:42.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f870a2dc700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8704151700 con 0x7f870415d400 2021-02-12T17:20:42.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f87037fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87040acf10 0x7f870415cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:42.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f87037fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87040acf10 0x7f870415cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47060/0 (socket says 172.21.2.102:47060) 2021-02-12T17:20:42.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f87037fe700 1 -- 172.21.2.102:0/2068485279 learned_addr learned my addr 172.21.2.102:0/2068485279 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:42.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f87037fe700 1 -- 172.21.2.102:0/2068485279 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f870415d400 msgr2=0x7f87040b08d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:20:42.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f87037fe700 1 --2- 172.21.2.102:0/2068485279 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f870415d400 0x7f87040b08d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:42.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f87037fe700 1 -- 172.21.2.102:0/2068485279 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f87040b9a70 msgr2=0x7f8704160f20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:20:42.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f87037fe700 1 --2- 172.21.2.102:0/2068485279 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f87040b9a70 0x7f8704160f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:42.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f87037fe700 1 -- 172.21.2.102:0/2068485279 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87041519a0 con 0x7f87040acf10 2021-02-12T17:20:42.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.222+0000 7f87037fe700 1 --2- 172.21.2.102:0/2068485279 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87040acf10 0x7f870415cf10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f86f40096b0 tx=0x7f86f4006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:42.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.223+0000 7f86fbfff700 1 -- 172.21.2.102:0/2068485279 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f400d500 con 0x7f87040acf10 2021-02-12T17:20:42.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.223+0000 7f86fbfff700 1 -- 172.21.2.102:0/2068485279 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f400d680 con 0x7f87040acf10 2021-02-12T17:20:42.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.223+0000 7f870a2dc700 1 -- 172.21.2.102:0/2068485279 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8704151c40 con 0x7f87040acf10 2021-02-12T17:20:42.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.223+0000 7f86fbfff700 1 -- 172.21.2.102:0/2068485279 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f400da40 con 0x7f87040acf10 2021-02-12T17:20:42.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.223+0000 7f870a2dc700 1 -- 172.21.2.102:0/2068485279 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87040b20a0 con 0x7f87040acf10 2021-02-12T17:20:42.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.223+0000 7f870a2dc700 1 -- 172.21.2.102:0/2068485279 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8704045460 con 0x7f87040acf10 2021-02-12T17:20:42.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.224+0000 7f86fbfff700 1 -- 172.21.2.102:0/2068485279 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f86f4012420 con 0x7f87040acf10 2021-02-12T17:20:42.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.224+0000 7f86fbfff700 1 --2- 172.21.2.102:0/2068485279 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f86e8059d30 0x7f86e805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:42.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.224+0000 7f86fbfff700 1 -- 172.21.2.102:0/2068485279 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7279+0+0 (secure 0 0 0) 0x7f86f4073e50 con 0x7f87040acf10 2021-02-12T17:20:42.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.224+0000 7f8703fff700 1 --2- 172.21.2.102:0/2068485279 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f86e8059d30 0x7f86e805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:42.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.224+0000 7f8703fff700 1 --2- 172.21.2.102:0/2068485279 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f86e8059d30 0x7f86e805c1f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f86ec0011a0 tx=0x7f870414eba0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:42.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.227+0000 7f86fbfff700 1 -- 172.21.2.102:0/2068485279 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f86f4047370 con 0x7f87040acf10 2021-02-12T17:20:42.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.391+0000 7f870a2dc700 1 -- 172.21.2.102:0/2068485279 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8704063670 con 0x7f87040acf10 2021-02-12T17:20:42.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.392+0000 7f86fbfff700 1 -- 172.21.2.102:0/2068485279 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3402 (secure 0 0 0) 0x7f86f4075070 con 0x7f87040acf10 2021-02-12T17:20:42.393 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:42.393 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:20:34.320425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4744":{"gid":4744,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:42.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.393+0000 7f870a2dc700 1 -- 172.21.2.102:0/2068485279 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f86e8059d30 msgr2=0x7f86e805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:42.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.393+0000 7f870a2dc700 1 --2- 172.21.2.102:0/2068485279 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f86e8059d30 0x7f86e805c1f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f86ec0011a0 tx=0x7f870414eba0).stop 2021-02-12T17:20:42.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.393+0000 7f870a2dc700 1 -- 172.21.2.102:0/2068485279 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87040acf10 msgr2=0x7f870415cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:42.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.393+0000 7f870a2dc700 1 --2- 172.21.2.102:0/2068485279 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87040acf10 0x7f870415cf10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f86f40096b0 tx=0x7f86f4006de0).stop 2021-02-12T17:20:42.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.393+0000 7f870a2dc700 1 -- 172.21.2.102:0/2068485279 shutdown_connections 2021-02-12T17:20:42.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.393+0000 7f870a2dc700 1 --2- 172.21.2.102:0/2068485279 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f870415d400 0x7f87040b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:42.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.393+0000 7f870a2dc700 1 --2- 172.21.2.102:0/2068485279 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f87040b9a70 0x7f8704160f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:42.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.393+0000 7f870a2dc700 1 --2- 172.21.2.102:0/2068485279 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f86e8059d30 0x7f86e805c1f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:42.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.393+0000 7f870a2dc700 1 --2- 172.21.2.102:0/2068485279 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f87040acf10 0x7f870415cf10 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:42.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.393+0000 7f870a2dc700 1 -- 172.21.2.102:0/2068485279 >> 172.21.2.102:0/2068485279 conn(0x7f87040bc480 msgr2=0x7f870414ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:42.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.393+0000 7f870a2dc700 1 -- 172.21.2.102:0/2068485279 shutdown_connections 2021-02-12T17:20:42.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:42.393+0000 7f870a2dc700 1 -- 172.21.2.102:0/2068485279 wait complete. 2021-02-12T17:20:42.395 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 34 2021-02-12T17:20:42.408 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2021-02-12T17:20:44.409 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:44.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.497+0000 7f9ce8f7b700 1 Processor -- start 2021-02-12T17:20:44.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.497+0000 7f9ce8f7b700 1 -- start start 2021-02-12T17:20:44.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.497+0000 7f9ce8f7b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f9ce40b71a0 0x7f9ce40b7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:44.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.497+0000 7f9ce8f7b700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f9ce40b12b0 0x7f9ce4150430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:44.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.497+0000 7f9ce8f7b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9ce4150920 0x7f9ce409cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:44.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.497+0000 7f9ce8f7b700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce409c410 con 0x7f9ce40b71a0 2021-02-12T17:20:44.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.497+0000 7f9ce8f7b700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce40b22a0 con 0x7f9ce40b12b0 2021-02-12T17:20:44.499 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.497+0000 7f9ce8f7b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40b2540 con 0x7f9ce4150920 2021-02-12T17:20:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce37fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f9ce40b71a0 0x7f9ce40b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce37fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f9ce40b71a0 0x7f9ce40b7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47072/0 (socket says 172.21.2.102:47072) 2021-02-12T17:20:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce37fe700 1 -- 172.21.2.102:0/1437106465 learned_addr learned my addr 172.21.2.102:0/1437106465 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce37fe700 1 -- 172.21.2.102:0/1437106465 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9ce4150920 msgr2=0x7f9ce409cd80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:20:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce37fe700 1 --2- 172.21.2.102:0/1437106465 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9ce4150920 0x7f9ce409cd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce37fe700 1 -- 172.21.2.102:0/1437106465 >> v2:172.21.2.104:3300/0 conn(0x7f9ce40b12b0 msgr2=0x7f9ce4150430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:20:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce37fe700 1 --2- 172.21.2.102:0/1437106465 >> v2:172.21.2.104:3300/0 conn(0x7f9ce40b12b0 0x7f9ce4150430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce37fe700 1 -- 172.21.2.102:0/1437106465 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce409c640 con 0x7f9ce40b71a0 2021-02-12T17:20:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce37fe700 1 --2- 172.21.2.102:0/1437106465 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9ce40b71a0 0x7f9ce40b7580 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f9ce40b8dd0 tx=0x7f9cd4006ea0).ready entity=mon.0 client_cookie=4371460a7596ea50 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce27fc700 1 -- 172.21.2.102:0/1437106465 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd40098d0 con 0x7f9ce40b71a0 2021-02-12T17:20:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce27fc700 1 -- 172.21.2.102:0/1437106465 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd4009a30 con 0x7f9ce40b71a0 2021-02-12T17:20:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce27fc700 1 -- 172.21.2.102:0/1437106465 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4009db0 con 0x7f9ce40b71a0 2021-02-12T17:20:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/1437106465 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9ce40b71a0 msgr2=0x7f9ce40b7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce8f7b700 1 --2- 172.21.2.102:0/1437106465 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9ce40b71a0 0x7f9ce40b7580 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f9ce40b8dd0 tx=0x7f9cd4006ea0).stop 2021-02-12T17:20:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/1437106465 shutdown_connections 2021-02-12T17:20:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce8f7b700 1 --2- 172.21.2.102:0/1437106465 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9ce4150920 0x7f9ce409cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce8f7b700 1 --2- 172.21.2.102:0/1437106465 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9ce40b71a0 0x7f9ce40b7580 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce8f7b700 1 --2- 172.21.2.102:0/1437106465 >> v2:172.21.2.104:3300/0 conn(0x7f9ce40b12b0 0x7f9ce4150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.498+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/1437106465 >> 172.21.2.102:0/1437106465 conn(0x7f9ce40b8290 msgr2=0x7f9ce40b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.499+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/1437106465 shutdown_connections 2021-02-12T17:20:44.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.499+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/1437106465 wait complete. 2021-02-12T17:20:44.503 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.499+0000 7f9ce8f7b700 1 Processor -- start 2021-02-12T17:20:44.503 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.499+0000 7f9ce8f7b700 1 -- start start 2021-02-12T17:20:44.503 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce8f7b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9ce40b12b0 0x7f9ce4068280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:44.503 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce8f7b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9ce40b71a0 0x7f9ce4065d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:44.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce8f7b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9ce4150920 0x7f9ce409f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:44.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce8f7b700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce414c3e0 con 0x7f9ce40b71a0 2021-02-12T17:20:44.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce8f7b700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40a1010 con 0x7f9ce40b12b0 2021-02-12T17:20:44.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce8f7b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40a12b0 con 0x7f9ce4150920 2021-02-12T17:20:44.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce2ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9ce40b71a0 0x7f9ce4065d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:44.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce2ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9ce40b71a0 0x7f9ce4065d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47076/0 (socket says 172.21.2.102:47076) 2021-02-12T17:20:44.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce2ffd700 1 -- 172.21.2.102:0/7901884 learned_addr learned my addr 172.21.2.102:0/7901884 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:44.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce2ffd700 1 -- 172.21.2.102:0/7901884 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9ce4150920 msgr2=0x7f9ce409f880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:20:44.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce2ffd700 1 --2- 172.21.2.102:0/7901884 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9ce4150920 0x7f9ce409f880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:44.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce2ffd700 1 -- 172.21.2.102:0/7901884 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9ce40b12b0 msgr2=0x7f9ce4068280 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:20:44.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce2ffd700 1 --2- 172.21.2.102:0/7901884 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9ce40b12b0 0x7f9ce4068280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:44.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce2ffd700 1 -- 172.21.2.102:0/7901884 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce40a1550 con 0x7f9ce40b71a0 2021-02-12T17:20:44.504 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9ce2ffd700 1 --2- 172.21.2.102:0/7901884 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9ce40b71a0 0x7f9ce4065d50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f9ccc0096b0 tx=0x7f9ccc006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:44.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.500+0000 7f9cdb7fe700 1 -- 172.21.2.102:0/7901884 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc00d590 con 0x7f9ce40b71a0 2021-02-12T17:20:44.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.501+0000 7f9cdb7fe700 1 -- 172.21.2.102:0/7901884 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ccc00d710 con 0x7f9ce40b71a0 2021-02-12T17:20:44.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.501+0000 7f9cdb7fe700 1 -- 172.21.2.102:0/7901884 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc00dad0 con 0x7f9ce40b71a0 2021-02-12T17:20:44.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.501+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/7901884 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce4067b40 con 0x7f9ce40b71a0 2021-02-12T17:20:44.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.501+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/7901884 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce4066240 con 0x7f9ce40b71a0 2021-02-12T17:20:44.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.501+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/7901884 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce4067fa0 con 0x7f9ce40b71a0 2021-02-12T17:20:44.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.501+0000 7f9cdb7fe700 1 -- 172.21.2.102:0/7901884 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f9ccc017030 con 0x7f9ce40b71a0 2021-02-12T17:20:44.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.502+0000 7f9cdb7fe700 1 --2- 172.21.2.102:0/7901884 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9cc8059d30 0x7f9cc805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:44.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.502+0000 7f9cdb7fe700 1 -- 172.21.2.102:0/7901884 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7279+0+0 (secure 0 0 0) 0x7f9ccc0730e0 con 0x7f9ce40b71a0 2021-02-12T17:20:44.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.502+0000 7f9ce37fe700 1 --2- 172.21.2.102:0/7901884 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9cc8059d30 0x7f9cc805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:44.505 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.502+0000 7f9ce37fe700 1 --2- 172.21.2.102:0/7901884 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9cc8059d30 0x7f9cc805c1f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f9cd4006ee0 tx=0x7f9cd4016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:44.506 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.505+0000 7f9cdb7fe700 1 -- 172.21.2.102:0/7901884 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f9ccc04a250 con 0x7f9ce40b71a0 2021-02-12T17:20:44.665 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.663+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/7901884 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ce405cf60 con 0x7f9ce40b71a0 2021-02-12T17:20:44.665 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.664+0000 7f9cdb7fe700 1 -- 172.21.2.102:0/7901884 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3402 (secure 0 0 0) 0x7f9ccc049e40 con 0x7f9ce40b71a0 2021-02-12T17:20:44.665 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:44.666 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:20:34.320425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4744":{"gid":4744,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:44.666 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.665+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/7901884 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9cc8059d30 msgr2=0x7f9cc805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:44.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.665+0000 7f9ce8f7b700 1 --2- 172.21.2.102:0/7901884 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9cc8059d30 0x7f9cc805c1f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f9cd4006ee0 tx=0x7f9cd4016000).stop 2021-02-12T17:20:44.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.665+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/7901884 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9ce40b71a0 msgr2=0x7f9ce4065d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:44.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.665+0000 7f9ce8f7b700 1 --2- 172.21.2.102:0/7901884 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9ce40b71a0 0x7f9ce4065d50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f9ccc0096b0 tx=0x7f9ccc006de0).stop 2021-02-12T17:20:44.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.665+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/7901884 shutdown_connections 2021-02-12T17:20:44.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.665+0000 7f9ce8f7b700 1 --2- 172.21.2.102:0/7901884 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9ce4150920 0x7f9ce409f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:44.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.665+0000 7f9ce8f7b700 1 --2- 172.21.2.102:0/7901884 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9ce40b12b0 0x7f9ce4068280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:44.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.665+0000 7f9ce8f7b700 1 --2- 172.21.2.102:0/7901884 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9cc8059d30 0x7f9cc805c1f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:44.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.665+0000 7f9ce8f7b700 1 --2- 172.21.2.102:0/7901884 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9ce40b71a0 0x7f9ce4065d50 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:44.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.665+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/7901884 >> 172.21.2.102:0/7901884 conn(0x7f9ce40b8290 msgr2=0x7f9ce40b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:44.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.665+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/7901884 shutdown_connections 2021-02-12T17:20:44.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:44.665+0000 7f9ce8f7b700 1 -- 172.21.2.102:0/7901884 wait complete. 2021-02-12T17:20:44.668 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 34 2021-02-12T17:20:44.675 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2021-02-12T17:20:46.676 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:20:46.766 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.765+0000 7f342e8e5700 1 Processor -- start 2021-02-12T17:20:46.767 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.765+0000 7f342e8e5700 1 -- start start 2021-02-12T17:20:46.768 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.766+0000 7f342e8e5700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f342814e530 0x7f3428068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:46.768 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.766+0000 7f342e8e5700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3428062740 0x7f3428062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:46.768 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.766+0000 7f342e8e5700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34280b7960 con 0x7f34280b8d20 2021-02-12T17:20:46.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.766+0000 7f342e8e5700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3428068d20 con 0x7f3428062740 2021-02-12T17:20:46.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.766+0000 7f342e8e5700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34280622a0 con 0x7f342814e530 2021-02-12T17:20:46.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.766+0000 7f3427fff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f34280b8d20 0x7f34280b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55730/0 (socket says 172.21.2.102:55730) 2021-02-12T17:20:46.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.766+0000 7f3427fff700 1 -- 172.21.2.102:0/157003220 learned_addr learned my addr 172.21.2.102:0/157003220 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:20:46.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.766+0000 7f342ce82700 1 --2- 172.21.2.102:0/157003220 >> v2:172.21.2.102:3300/0 conn(0x7f3428062740 0x7f3428062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:46.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.766+0000 7f3426ffd700 1 -- 172.21.2.102:0/157003220 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296395440 0 0) 0x7f34280b7960 con 0x7f34280b8d20 2021-02-12T17:20:46.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.766+0000 7f342ce82700 1 -- 172.21.2.102:0/157003220 >> v2:172.21.2.104:3300/0 conn(0x7f342814e530 msgr2=0x7f3428068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:20:46.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.766+0000 7f342ce82700 1 --2- 172.21.2.102:0/157003220 >> v2:172.21.2.104:3300/0 conn(0x7f342814e530 0x7f3428068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:46.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.766+0000 7f342ce82700 1 -- 172.21.2.102:0/157003220 >> v1:172.21.2.102:6789/0 conn(0x7f34280b8d20 legacy=0x7f34280b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:46.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.766+0000 7f342ce82700 1 -- 172.21.2.102:0/157003220 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342814ea10 con 0x7f3428062740 2021-02-12T17:20:46.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.767+0000 7f342ce82700 1 --2- 172.21.2.102:0/157003220 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3428062740 0x7f3428062bf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f34280654b0 tx=0x7f34200091d0).ready entity=mon.0 client_cookie=c3d6e56513845791 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:46.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.767+0000 7f3426ffd700 1 -- 172.21.2.102:0/157003220 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420009e70 con 0x7f3428062740 2021-02-12T17:20:46.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.767+0000 7f3426ffd700 1 -- 172.21.2.102:0/157003220 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342000bbf0 con 0x7f3428062740 2021-02-12T17:20:46.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.767+0000 7f3426ffd700 1 -- 172.21.2.102:0/157003220 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420011400 con 0x7f3428062740 2021-02-12T17:20:46.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.767+0000 7f342e8e5700 1 -- 172.21.2.102:0/157003220 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3428062740 msgr2=0x7f3428062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:46.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.767+0000 7f342e8e5700 1 --2- 172.21.2.102:0/157003220 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3428062740 0x7f3428062bf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f34280654b0 tx=0x7f34200091d0).stop 2021-02-12T17:20:46.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.767+0000 7f342e8e5700 1 -- 172.21.2.102:0/157003220 shutdown_connections 2021-02-12T17:20:46.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.767+0000 7f342e8e5700 1 --2- 172.21.2.102:0/157003220 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3428062740 0x7f3428062bf0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:46.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.767+0000 7f342e8e5700 1 --2- 172.21.2.102:0/157003220 >> v2:172.21.2.104:3300/0 conn(0x7f342814e530 0x7f3428068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:20:46.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.767+0000 7f342e8e5700 1 -- 172.21.2.102:0/157003220 >> 172.21.2.102:0/157003220 conn(0x7f34280bc480 msgr2=0x7f34280b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:46.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.767+0000 7f342e8e5700 1 -- 172.21.2.102:0/157003220 shutdown_connections 2021-02-12T17:20:46.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.767+0000 7f342e8e5700 1 -- 172.21.2.102:0/157003220 wait complete. 2021-02-12T17:20:46.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.768+0000 7f342e8e5700 1 Processor -- start 2021-02-12T17:20:46.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.768+0000 7f342e8e5700 1 -- start start 2021-02-12T17:20:46.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f342e8e5700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3428062740 0x7f34280b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:46.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f342e8e5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f34280b8d20 0x7f3428062ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:46.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f342e8e5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342814e530 0x7f34280b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:46.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f342e8e5700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3428160630 con 0x7f342814e530 2021-02-12T17:20:46.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f342e8e5700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280b46d0 con 0x7f3428062740 2021-02-12T17:20:46.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f342e8e5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3428160860 con 0x7f34280b8d20 2021-02-12T17:20:46.773 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f342ce82700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342814e530 0x7f34280b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:46.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f342ce82700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342814e530 0x7f34280b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47094/0 (socket says 172.21.2.102:47094) 2021-02-12T17:20:46.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f342ce82700 1 -- 172.21.2.102:0/3985152138 learned_addr learned my addr 172.21.2.102:0/3985152138 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:20:46.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f3427fff700 1 --2- 172.21.2.102:0/3985152138 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3428062740 0x7f34280b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:46.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f34277fe700 1 --2- 172.21.2.102:0/3985152138 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f34280b8d20 0x7f3428062ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:46.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f342ce82700 1 -- 172.21.2.102:0/3985152138 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f34280b8d20 msgr2=0x7f3428062ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:46.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f342ce82700 1 --2- 172.21.2.102:0/3985152138 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f34280b8d20 0x7f3428062ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:46.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f342ce82700 1 -- 172.21.2.102:0/3985152138 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3428062740 msgr2=0x7f34280b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:46.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f342ce82700 1 --2- 172.21.2.102:0/3985152138 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3428062740 0x7f34280b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:46.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.769+0000 7f342ce82700 1 -- 172.21.2.102:0/3985152138 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3428160b00 con 0x7f342814e530 2021-02-12T17:20:46.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.770+0000 7f342ce82700 1 --2- 172.21.2.102:0/3985152138 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342814e530 0x7f34280b2ad0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f34280653c0 tx=0x7f3420017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:46.774 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.770+0000 7f341ffff700 1 -- 172.21.2.102:0/3985152138 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342001b6f0 con 0x7f342814e530 2021-02-12T17:20:46.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.770+0000 7f341ffff700 1 -- 172.21.2.102:0/3985152138 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342001b850 con 0x7f342814e530 2021-02-12T17:20:46.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.770+0000 7f342e8e5700 1 -- 172.21.2.102:0/3985152138 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3428160da0 con 0x7f342814e530 2021-02-12T17:20:46.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.770+0000 7f342e8e5700 1 -- 172.21.2.102:0/3985152138 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34280631d0 con 0x7f342814e530 2021-02-12T17:20:46.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.770+0000 7f341ffff700 1 -- 172.21.2.102:0/3985152138 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342001bbf0 con 0x7f342814e530 2021-02-12T17:20:46.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.771+0000 7f342e8e5700 1 -- 172.21.2.102:0/3985152138 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3428045460 con 0x7f342814e530 2021-02-12T17:20:46.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.771+0000 7f341ffff700 1 -- 172.21.2.102:0/3985152138 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f342000f070 con 0x7f342814e530 2021-02-12T17:20:46.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.771+0000 7f341ffff700 1 --2- 172.21.2.102:0/3985152138 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f340c059d30 0x7f340c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:20:46.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.771+0000 7f341ffff700 1 -- 172.21.2.102:0/3985152138 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7279+0+0 (secure 0 0 0) 0x7f34200763c0 con 0x7f342814e530 2021-02-12T17:20:46.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.771+0000 7f3427fff700 1 --2- 172.21.2.102:0/3985152138 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f340c059d30 0x7f340c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:20:46.775 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.771+0000 7f3427fff700 1 --2- 172.21.2.102:0/3985152138 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f340c059d30 0x7f340c05c1f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f34180011a0 tx=0x7f3418009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:20:46.776 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.774+0000 7f341ffff700 1 -- 172.21.2.102:0/3985152138 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f34200499f0 con 0x7f342814e530 2021-02-12T17:20:46.934 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.933+0000 7f342e8e5700 1 -- 172.21.2.102:0/3985152138 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3428160f30 con 0x7f342814e530 2021-02-12T17:20:46.935 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.934+0000 7f341ffff700 1 -- 172.21.2.102:0/3985152138 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3755 (secure 0 0 0) 0x7f342004d010 con 0x7f342814e530 2021-02-12T17:20:46.935 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:20:46.935 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:20:34.320425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4744":{"gid":4744,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:20:46.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.935+0000 7f342e8e5700 1 -- 172.21.2.102:0/3985152138 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f340c059d30 msgr2=0x7f340c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:46.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.935+0000 7f342e8e5700 1 --2- 172.21.2.102:0/3985152138 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f340c059d30 0x7f340c05c1f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f34180011a0 tx=0x7f3418009040).stop 2021-02-12T17:20:46.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.935+0000 7f342e8e5700 1 -- 172.21.2.102:0/3985152138 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342814e530 msgr2=0x7f34280b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:20:46.936 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.935+0000 7f342e8e5700 1 --2- 172.21.2.102:0/3985152138 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342814e530 0x7f34280b2ad0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f34280653c0 tx=0x7f3420017000).stop 2021-02-12T17:20:46.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.935+0000 7f342e8e5700 1 -- 172.21.2.102:0/3985152138 shutdown_connections 2021-02-12T17:20:46.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.935+0000 7f342e8e5700 1 --2- 172.21.2.102:0/3985152138 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f340c059d30 0x7f340c05c1f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:46.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.935+0000 7f342e8e5700 1 --2- 172.21.2.102:0/3985152138 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f342814e530 0x7f34280b2ad0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:46.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.935+0000 7f342e8e5700 1 --2- 172.21.2.102:0/3985152138 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3428062740 0x7f34280b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:46.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.935+0000 7f342e8e5700 1 --2- 172.21.2.102:0/3985152138 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f34280b8d20 0x7f3428062ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:20:46.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.935+0000 7f342e8e5700 1 -- 172.21.2.102:0/3985152138 >> 172.21.2.102:0/3985152138 conn(0x7f34280bc480 msgr2=0x7f3428151770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:20:46.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.935+0000 7f342e8e5700 1 -- 172.21.2.102:0/3985152138 shutdown_connections 2021-02-12T17:20:46.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:20:46.935+0000 7f342e8e5700 1 -- 172.21.2.102:0/3985152138 wait complete. 2021-02-12T17:20:46.937 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 35 2021-02-12T17:20:46.945 INFO:tasks.mds_thrash.fs.[a]:mds.c reported in up:standby state 2021-02-12T17:20:46.945 INFO:tasks.mds_thrash.fs.[a]:waiting for 21 secs before thrashing 2021-02-12T17:21:07.946 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:08.035 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.034+0000 7fa11d5da700 1 Processor -- start 2021-02-12T17:21:08.035 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.034+0000 7fa11d5da700 1 -- start start 2021-02-12T17:21:08.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.034+0000 7fa11d5da700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1180b8d20 0x7fa118068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:08.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.034+0000 7fa11d5da700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa11814e530 0x7fa1180b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:08.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.034+0000 7fa11d5da700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1180622a0 con 0x7fa118062740 2021-02-12T17:21:08.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.034+0000 7fa11d5da700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa118068d20 con 0x7fa11814e530 2021-02-12T17:21:08.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.034+0000 7fa11d5da700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11814ea10 con 0x7fa1180b8d20 2021-02-12T17:21:08.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.035+0000 7fa1177fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fa118062740 0x7fa118062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55744/0 (socket says 172.21.2.102:55744) 2021-02-12T17:21:08.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.035+0000 7fa1177fe700 1 -- 172.21.2.102:0/1468495507 learned_addr learned my addr 172.21.2.102:0/1468495507 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:21:08.037 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.035+0000 7fa1167fc700 1 --2- 172.21.2.102:0/1468495507 >> v2:172.21.2.102:3300/0 conn(0x7fa11814e530 0x7fa1180b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:08.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.035+0000 7fa116ffd700 1 --2- 172.21.2.102:0/1468495507 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1180b8d20 0x7fa118068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:08.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.035+0000 7fa1167fc700 1 -- 172.21.2.102:0/1468495507 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1180b8d20 msgr2=0x7fa118068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:08.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.035+0000 7fa1167fc700 1 --2- 172.21.2.102:0/1468495507 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1180b8d20 0x7fa118068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:08.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.035+0000 7fa1167fc700 1 -- 172.21.2.102:0/1468495507 >> v1:172.21.2.102:6789/0 conn(0x7fa118062740 legacy=0x7fa118062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:08.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.035+0000 7fa1167fc700 1 -- 172.21.2.102:0/1468495507 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1180b63f0 con 0x7fa11814e530 2021-02-12T17:21:08.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.035+0000 7fa1167fc700 1 --2- 172.21.2.102:0/1468495507 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa11814e530 0x7fa1180b7250 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fa10000b980 tx=0x7fa100006de0).ready entity=mon.0 client_cookie=cea93bf6569ddd3a server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:08.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.035+0000 7fa115ffb700 1 -- 172.21.2.102:0/1468495507 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1000097e0 con 0x7fa11814e530 2021-02-12T17:21:08.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.035+0000 7fa115ffb700 1 -- 172.21.2.102:0/1468495507 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa100009940 con 0x7fa11814e530 2021-02-12T17:21:08.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.035+0000 7fa115ffb700 1 -- 172.21.2.102:0/1468495507 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa100009cc0 con 0x7fa11814e530 2021-02-12T17:21:08.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.036+0000 7fa11d5da700 1 -- 172.21.2.102:0/1468495507 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa11814e530 msgr2=0x7fa1180b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:08.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.036+0000 7fa11d5da700 1 --2- 172.21.2.102:0/1468495507 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa11814e530 0x7fa1180b7250 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fa10000b980 tx=0x7fa100006de0).stop 2021-02-12T17:21:08.038 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.036+0000 7fa11d5da700 1 -- 172.21.2.102:0/1468495507 shutdown_connections 2021-02-12T17:21:08.039 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.036+0000 7fa11d5da700 1 --2- 172.21.2.102:0/1468495507 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1180b8d20 0x7fa118068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:08.039 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.036+0000 7fa11d5da700 1 --2- 172.21.2.102:0/1468495507 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa11814e530 0x7fa1180b7250 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:08.039 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.036+0000 7fa11d5da700 1 -- 172.21.2.102:0/1468495507 >> 172.21.2.102:0/1468495507 conn(0x7fa1180bc480 msgr2=0x7fa1180b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:08.039 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.036+0000 7fa11d5da700 1 -- 172.21.2.102:0/1468495507 shutdown_connections 2021-02-12T17:21:08.039 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.036+0000 7fa11d5da700 1 -- 172.21.2.102:0/1468495507 wait complete. 2021-02-12T17:21:08.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.037+0000 7fa11d5da700 1 Processor -- start 2021-02-12T17:21:08.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.037+0000 7fa11d5da700 1 -- start start 2021-02-12T17:21:08.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.037+0000 7fa11d5da700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa118062740 0x7fa11815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:08.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.037+0000 7fa11d5da700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa1180b8d20 0x7fa1180b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:08.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.037+0000 7fa11d5da700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa11814e530 0x7fa1180b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:08.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.037+0000 7fa11d5da700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11815d8d0 con 0x7fa118062740 2021-02-12T17:21:08.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.037+0000 7fa11d5da700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11815daf0 con 0x7fa1180b8d20 2021-02-12T17:21:08.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.037+0000 7fa11d5da700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11815dd90 con 0x7fa11814e530 2021-02-12T17:21:08.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.038+0000 7fa116ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa118062740 0x7fa11815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:08.041 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.038+0000 7fa116ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa118062740 0x7fa11815d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47104/0 (socket says 172.21.2.102:47104) 2021-02-12T17:21:08.042 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.038+0000 7fa116ffd700 1 -- 172.21.2.102:0/4146075952 learned_addr learned my addr 172.21.2.102:0/4146075952 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:08.042 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.038+0000 7fa116ffd700 1 -- 172.21.2.102:0/4146075952 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa11814e530 msgr2=0x7fa1180b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:08.042 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.038+0000 7fa116ffd700 1 --2- 172.21.2.102:0/4146075952 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa11814e530 0x7fa1180b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:08.042 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.038+0000 7fa116ffd700 1 -- 172.21.2.102:0/4146075952 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa1180b8d20 msgr2=0x7fa1180b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:08.042 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.038+0000 7fa116ffd700 1 --2- 172.21.2.102:0/4146075952 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa1180b8d20 0x7fa1180b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:08.042 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.038+0000 7fa116ffd700 1 -- 172.21.2.102:0/4146075952 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11815e030 con 0x7fa118062740 2021-02-12T17:21:08.042 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.038+0000 7fa116ffd700 1 --2- 172.21.2.102:0/4146075952 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa118062740 0x7fa11815d3e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fa10800db60 tx=0x7fa108008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:08.042 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.038+0000 7fa10effd700 1 -- 172.21.2.102:0/4146075952 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108009790 con 0x7fa118062740 2021-02-12T17:21:08.042 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.038+0000 7fa10effd700 1 -- 172.21.2.102:0/4146075952 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1080098f0 con 0x7fa118062740 2021-02-12T17:21:08.042 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.038+0000 7fa11d5da700 1 -- 172.21.2.102:0/4146075952 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11815e2d0 con 0x7fa118062740 2021-02-12T17:21:08.042 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.038+0000 7fa10effd700 1 -- 172.21.2.102:0/4146075952 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108009c70 con 0x7fa118062740 2021-02-12T17:21:08.043 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.038+0000 7fa11d5da700 1 -- 172.21.2.102:0/4146075952 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1180b01c0 con 0x7fa118062740 2021-02-12T17:21:08.043 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.039+0000 7fa11d5da700 1 -- 172.21.2.102:0/4146075952 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1180b4e30 con 0x7fa118062740 2021-02-12T17:21:08.043 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.039+0000 7fa10effd700 1 -- 172.21.2.102:0/4146075952 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fa108013480 con 0x7fa118062740 2021-02-12T17:21:08.043 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.039+0000 7fa10effd700 1 --2- 172.21.2.102:0/4146075952 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa0fc059d60 0x7fa0fc05c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:08.043 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.039+0000 7fa10effd700 1 -- 172.21.2.102:0/4146075952 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7279+0+0 (secure 0 0 0) 0x7fa108073f40 con 0x7fa118062740 2021-02-12T17:21:08.043 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.039+0000 7fa1167fc700 1 --2- 172.21.2.102:0/4146075952 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa0fc059d60 0x7fa0fc05c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:08.043 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.040+0000 7fa1167fc700 1 --2- 172.21.2.102:0/4146075952 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa0fc059d60 0x7fa0fc05c220 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fa10000b980 tx=0x7fa100016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:08.043 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.042+0000 7fa10effd700 1 -- 172.21.2.102:0/4146075952 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fa1180b4e30 con 0x7fa118062740 2021-02-12T17:21:08.200 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.199+0000 7fa11d5da700 1 -- 172.21.2.102:0/4146075952 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1180b01c0 con 0x7fa118062740 2021-02-12T17:21:08.200 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.199+0000 7fa10effd700 1 -- 172.21.2.102:0/4146075952 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3755 (secure 0 0 0) 0x7fa1180b01c0 con 0x7fa118062740 2021-02-12T17:21:08.201 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:08.201 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:20:34.320425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4744":{"gid":4744,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:08.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.200+0000 7fa11d5da700 1 -- 172.21.2.102:0/4146075952 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa0fc059d60 msgr2=0x7fa0fc05c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:08.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.200+0000 7fa11d5da700 1 --2- 172.21.2.102:0/4146075952 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa0fc059d60 0x7fa0fc05c220 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fa10000b980 tx=0x7fa100016000).stop 2021-02-12T17:21:08.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.200+0000 7fa11d5da700 1 -- 172.21.2.102:0/4146075952 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa118062740 msgr2=0x7fa11815d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:08.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.200+0000 7fa11d5da700 1 --2- 172.21.2.102:0/4146075952 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa118062740 0x7fa11815d3e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fa10800db60 tx=0x7fa108008040).stop 2021-02-12T17:21:08.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.200+0000 7fa11d5da700 1 -- 172.21.2.102:0/4146075952 shutdown_connections 2021-02-12T17:21:08.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.200+0000 7fa11d5da700 1 --2- 172.21.2.102:0/4146075952 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa11814e530 0x7fa1180b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:08.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.200+0000 7fa11d5da700 1 --2- 172.21.2.102:0/4146075952 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa0fc059d60 0x7fa0fc05c220 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:08.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.200+0000 7fa11d5da700 1 --2- 172.21.2.102:0/4146075952 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa118062740 0x7fa11815d3e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:08.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.200+0000 7fa11d5da700 1 --2- 172.21.2.102:0/4146075952 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa1180b8d20 0x7fa1180b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:08.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.200+0000 7fa11d5da700 1 -- 172.21.2.102:0/4146075952 >> 172.21.2.102:0/4146075952 conn(0x7fa1180bc480 msgr2=0x7fa11814ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:08.202 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.201+0000 7fa11d5da700 1 -- 172.21.2.102:0/4146075952 shutdown_connections 2021-02-12T17:21:08.203 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.201+0000 7fa11d5da700 1 -- 172.21.2.102:0/4146075952 wait complete. 2021-02-12T17:21:08.203 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 35 2021-02-12T17:21:08.210 INFO:tasks.mds_thrash.fs.[a]:kill mds.d (rank=0) 2021-02-12T17:21:08.210 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2021-02-12T17:21:08.210 INFO:teuthology.orchestra.run:waiting for 300 2021-02-12T17:21:08.217 INFO:tasks.ceph.mds.d:Stopped 2021-02-12T17:21:08.217 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:08.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.305+0000 7fef571dc700 1 Processor -- start 2021-02-12T17:21:08.306 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.305+0000 7fef571dc700 1 -- start start 2021-02-12T17:21:08.309 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.305+0000 7fef571dc700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fef5014e530 0x7fef50068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:08.309 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef571dc700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef500b7960 con 0x7fef500b8d20 2021-02-12T17:21:08.309 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef571dc700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef500622a0 con 0x7fef50062740 2021-02-12T17:21:08.309 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef571dc700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef50068d20 con 0x7fef5014e530 2021-02-12T17:21:08.309 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef54f78700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fef500b8d20 0x7fef500b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55760/0 (socket says 172.21.2.102:55760) 2021-02-12T17:21:08.309 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef54f78700 1 -- 172.21.2.102:0/1447547347 learned_addr learned my addr 172.21.2.102:0/1447547347 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:21:08.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 -- 172.21.2.102:0/1447547347 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117900654 0 0) 0x7fef500b7960 con 0x7fef500b8d20 2021-02-12T17:21:08.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 -- 172.21.2.102:0/1447547347 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef30003230 con 0x7fef500b8d20 2021-02-12T17:21:08.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 -- 172.21.2.102:0/1447547347 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1212257535 0 0) 0x7fef30003230 con 0x7fef500b8d20 2021-02-12T17:21:08.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 -- 172.21.2.102:0/1447547347 >> v2:172.21.2.104:3300/0 conn(0x7fef5014e530 msgr2=0x7fef50068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:08.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 --2- 172.21.2.102:0/1447547347 >> v2:172.21.2.104:3300/0 conn(0x7fef5014e530 0x7fef50068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:08.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 -- 172.21.2.102:0/1447547347 >> v1:172.21.2.104:6789/0 conn(0x7fef50062740 legacy=0x7fef50062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:08.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 -- 172.21.2.102:0/1447547347 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5014ea10 con 0x7fef500b8d20 2021-02-12T17:21:08.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 -- 172.21.2.102:0/1447547347 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fef380014e0 con 0x7fef500b8d20 2021-02-12T17:21:08.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 -- 172.21.2.102:0/1447547347 >> v1:172.21.2.102:6789/0 conn(0x7fef500b8d20 legacy=0x7fef500b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:08.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 --2- 172.21.2.102:0/1447547347 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef300037f0 0x7fef30003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:08.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 --2- 172.21.2.102:0/1447547347 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef300044d0 0x7fef30004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:08.310 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 --2- 172.21.2.102:0/1447547347 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef30004e40 0x7fef3000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:08.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 -- 172.21.2.102:0/1447547347 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef50068d20 con 0x7fef300037f0 2021-02-12T17:21:08.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 -- 172.21.2.102:0/1447547347 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef300053a0 con 0x7fef30004e40 2021-02-12T17:21:08.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef4f7fe700 1 -- 172.21.2.102:0/1447547347 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3000bc60 con 0x7fef300044d0 2021-02-12T17:21:08.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.306+0000 7fef54f78700 1 --2- 172.21.2.102:0/1447547347 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef300037f0 0x7fef30003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:08.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef55779700 1 --2- 172.21.2.102:0/1447547347 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef30004e40 0x7fef3000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:08.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef54f78700 1 -- 172.21.2.102:0/1447547347 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef300044d0 msgr2=0x7fef30004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:08.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef54f78700 1 --2- 172.21.2.102:0/1447547347 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef300044d0 0x7fef30004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:08.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef54f78700 1 -- 172.21.2.102:0/1447547347 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef30004e40 msgr2=0x7fef3000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:08.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef54f78700 1 --2- 172.21.2.102:0/1447547347 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef30004e40 0x7fef3000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:08.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef54f78700 1 -- 172.21.2.102:0/1447547347 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30003230 con 0x7fef300037f0 2021-02-12T17:21:08.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef55779700 1 --2- 172.21.2.102:0/1447547347 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef30004e40 0x7fef3000b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:21:08.311 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef55779700 1 -- 172.21.2.102:0/1447547347 reap_dead start 2021-02-12T17:21:08.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef54f78700 1 --2- 172.21.2.102:0/1447547347 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef300037f0 0x7fef30003bf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fef3800c260 tx=0x7fef5014eba0).ready entity=mon.0 client_cookie=46c0a000858fd0d1 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:08.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef4f7fe700 1 -- 172.21.2.102:0/1447547347 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef380070d0 con 0x7fef300037f0 2021-02-12T17:21:08.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef4f7fe700 1 -- 172.21.2.102:0/1447547347 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef38007230 con 0x7fef300037f0 2021-02-12T17:21:08.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef4f7fe700 1 -- 172.21.2.102:0/1447547347 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef380055e0 con 0x7fef300037f0 2021-02-12T17:21:08.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef571dc700 1 -- 172.21.2.102:0/1447547347 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef300037f0 msgr2=0x7fef30003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:08.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef571dc700 1 --2- 172.21.2.102:0/1447547347 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef300037f0 0x7fef30003bf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fef3800c260 tx=0x7fef5014eba0).stop 2021-02-12T17:21:08.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef571dc700 1 -- 172.21.2.102:0/1447547347 shutdown_connections 2021-02-12T17:21:08.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef571dc700 1 --2- 172.21.2.102:0/1447547347 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef300037f0 0x7fef30003bf0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:08.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef571dc700 1 -- 172.21.2.102:0/1447547347 >> 172.21.2.102:0/1447547347 conn(0x7fef500bc480 msgr2=0x7fef500b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:08.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef571dc700 1 -- 172.21.2.102:0/1447547347 shutdown_connections 2021-02-12T17:21:08.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.307+0000 7fef571dc700 1 -- 172.21.2.102:0/1447547347 wait complete. 2021-02-12T17:21:08.312 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.308+0000 7fef571dc700 1 Processor -- start 2021-02-12T17:21:08.313 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.308+0000 7fef571dc700 1 -- start start 2021-02-12T17:21:08.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef571dc700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef300037f0 0x7fef500b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:08.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef571dc700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef5015dd70 0x7fef500b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:08.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef571dc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef500acf10 0x7fef500afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:08.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef571dc700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef50153030 con 0x7fef500acf10 2021-02-12T17:21:08.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef571dc700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5015d390 con 0x7fef300037f0 2021-02-12T17:21:08.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef571dc700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5015d630 con 0x7fef5015dd70 2021-02-12T17:21:08.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef55779700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef500acf10 0x7fef500afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:08.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef55779700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef500acf10 0x7fef500afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47128/0 (socket says 172.21.2.102:47128) 2021-02-12T17:21:08.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef55779700 1 -- 172.21.2.102:0/2552114102 learned_addr learned my addr 172.21.2.102:0/2552114102 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:08.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef54f78700 1 --2- 172.21.2.102:0/2552114102 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef300037f0 0x7fef500b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:08.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef55779700 1 -- 172.21.2.102:0/2552114102 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef5015dd70 msgr2=0x7fef500b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:08.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef55779700 1 --2- 172.21.2.102:0/2552114102 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef5015dd70 0x7fef500b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:08.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef55779700 1 -- 172.21.2.102:0/2552114102 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef300037f0 msgr2=0x7fef500b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:08.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef55779700 1 --2- 172.21.2.102:0/2552114102 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef300037f0 0x7fef500b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:08.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef55779700 1 -- 172.21.2.102:0/2552114102 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5015d8d0 con 0x7fef500acf10 2021-02-12T17:21:08.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef54f78700 1 --2- 172.21.2.102:0/2552114102 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef300037f0 0x7fef500b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:21:08.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef55779700 1 --2- 172.21.2.102:0/2552114102 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef500acf10 0x7fef500afe20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fef500657f0 tx=0x7fef48009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:08.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef4cff9700 1 -- 172.21.2.102:0/2552114102 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480032e0 con 0x7fef500acf10 2021-02-12T17:21:08.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef4cff9700 1 -- 172.21.2.102:0/2552114102 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef48013420 con 0x7fef500acf10 2021-02-12T17:21:08.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef571dc700 1 -- 172.21.2.102:0/2552114102 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef50153dd0 con 0x7fef500acf10 2021-02-12T17:21:08.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef4cff9700 1 -- 172.21.2.102:0/2552114102 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480137a0 con 0x7fef500acf10 2021-02-12T17:21:08.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.309+0000 7fef571dc700 1 -- 172.21.2.102:0/2552114102 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5015d080 con 0x7fef500acf10 2021-02-12T17:21:08.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.310+0000 7fef571dc700 1 -- 172.21.2.102:0/2552114102 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef50045460 con 0x7fef500acf10 2021-02-12T17:21:08.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.310+0000 7fef4cff9700 1 -- 172.21.2.102:0/2552114102 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fef4801d070 con 0x7fef500acf10 2021-02-12T17:21:08.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.310+0000 7fef4cff9700 1 --2- 172.21.2.102:0/2552114102 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fef34059d30 0x7fef3405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:08.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.310+0000 7fef4cff9700 1 -- 172.21.2.102:0/2552114102 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7279+0+0 (secure 0 0 0) 0x7fef480731b0 con 0x7fef500acf10 2021-02-12T17:21:08.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.311+0000 7fef54f78700 1 --2- 172.21.2.102:0/2552114102 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fef34059d30 0x7fef3405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:08.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.311+0000 7fef54f78700 1 --2- 172.21.2.102:0/2552114102 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fef34059d30 0x7fef3405c1f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fef380075d0 tx=0x7fef38013000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:08.317 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.313+0000 7fef4cff9700 1 -- 172.21.2.102:0/2552114102 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fef48046840 con 0x7fef500acf10 2021-02-12T17:21:08.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.473+0000 7fef571dc700 1 -- 172.21.2.102:0/2552114102 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef50063670 con 0x7fef500acf10 2021-02-12T17:21:08.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.473+0000 7fef4cff9700 1 -- 172.21.2.102:0/2552114102 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3755 (secure 0 0 0) 0x7fef48049e60 con 0x7fef500acf10 2021-02-12T17:21:08.474 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:08.474 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:20:34.320425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4744":{"gid":4744,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:08.475 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.474+0000 7fef571dc700 1 -- 172.21.2.102:0/2552114102 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fef34059d30 msgr2=0x7fef3405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:08.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.474+0000 7fef571dc700 1 --2- 172.21.2.102:0/2552114102 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fef34059d30 0x7fef3405c1f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fef380075d0 tx=0x7fef38013000).stop 2021-02-12T17:21:08.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.474+0000 7fef571dc700 1 -- 172.21.2.102:0/2552114102 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef500acf10 msgr2=0x7fef500afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:08.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.474+0000 7fef571dc700 1 --2- 172.21.2.102:0/2552114102 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef500acf10 0x7fef500afe20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fef500657f0 tx=0x7fef48009040).stop 2021-02-12T17:21:08.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.474+0000 7fef571dc700 1 -- 172.21.2.102:0/2552114102 shutdown_connections 2021-02-12T17:21:08.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.474+0000 7fef571dc700 1 --2- 172.21.2.102:0/2552114102 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fef34059d30 0x7fef3405c1f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:08.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.474+0000 7fef571dc700 1 --2- 172.21.2.102:0/2552114102 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef500acf10 0x7fef500afe20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:08.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.474+0000 7fef571dc700 1 --2- 172.21.2.102:0/2552114102 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef300037f0 0x7fef500b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:08.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.474+0000 7fef571dc700 1 --2- 172.21.2.102:0/2552114102 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef5015dd70 0x7fef500b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:08.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.474+0000 7fef571dc700 1 -- 172.21.2.102:0/2552114102 >> 172.21.2.102:0/2552114102 conn(0x7fef500bc480 msgr2=0x7fef5014ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:08.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.475+0000 7fef571dc700 1 -- 172.21.2.102:0/2552114102 shutdown_connections 2021-02-12T17:21:08.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:08.475+0000 7fef571dc700 1 -- 172.21.2.102:0/2552114102 wait complete. 2021-02-12T17:21:08.477 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 35 2021-02-12T17:21:08.484 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:21:10.485 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:10.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.573+0000 7f99ebc71700 1 Processor -- start 2021-02-12T17:21:10.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.573+0000 7f99ebc71700 1 -- start start 2021-02-12T17:21:10.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.574+0000 7f99ebc71700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f99e40b8d20 0x7f99e4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:10.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.574+0000 7f99ebc71700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f99e414e530 0x7f99e40b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:10.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.574+0000 7f99ebc71700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e40622a0 con 0x7f99e4062740 2021-02-12T17:21:10.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.574+0000 7f99ebc71700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e4068d20 con 0x7f99e414e530 2021-02-12T17:21:10.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.574+0000 7f99ebc71700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e414ea10 con 0x7f99e40b8d20 2021-02-12T17:21:10.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.574+0000 7f99ea20e700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f99e4062740 0x7f99e4062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55788/0 (socket says 172.21.2.102:55788) 2021-02-12T17:21:10.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.574+0000 7f99ea20e700 1 -- 172.21.2.102:0/242670237 learned_addr learned my addr 172.21.2.102:0/242670237 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:21:10.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.574+0000 7f99e8a0b700 1 -- 172.21.2.102:0/242670237 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574714007 0 0) 0x7f99e40622a0 con 0x7f99e4062740 2021-02-12T17:21:10.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.574+0000 7f99e8a0b700 1 -- 172.21.2.102:0/242670237 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99cc003230 con 0x7f99e4062740 2021-02-12T17:21:10.579 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.574+0000 7f99e9a0d700 1 --2- 172.21.2.102:0/242670237 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f99e40b8d20 0x7f99e4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:10.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.574+0000 7f99e920c700 1 --2- 172.21.2.102:0/242670237 >> v2:172.21.2.104:3300/0 conn(0x7f99e414e530 0x7f99e40b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:10.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 -- 172.21.2.102:0/242670237 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2905242577 0 0) 0x7f99cc003230 con 0x7f99e4062740 2021-02-12T17:21:10.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 -- 172.21.2.102:0/242670237 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f99e40b8d20 msgr2=0x7f99e4068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:10.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 --2- 172.21.2.102:0/242670237 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f99e40b8d20 0x7f99e4068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:10.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 -- 172.21.2.102:0/242670237 >> v2:172.21.2.104:3300/0 conn(0x7f99e414e530 msgr2=0x7f99e40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:10.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 --2- 172.21.2.102:0/242670237 >> v2:172.21.2.104:3300/0 conn(0x7f99e414e530 0x7f99e40b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:10.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 -- 172.21.2.102:0/242670237 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e40b63f0 con 0x7f99e4062740 2021-02-12T17:21:10.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 -- 172.21.2.102:0/242670237 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f99dc001860 con 0x7f99e4062740 2021-02-12T17:21:10.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 -- 172.21.2.102:0/242670237 >> v1:172.21.2.102:6789/0 conn(0x7f99e4062740 legacy=0x7f99e4062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:10.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 --2- 172.21.2.102:0/242670237 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f99cc003720 0x7f99cc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:10.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 --2- 172.21.2.102:0/242670237 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f99e40b8d20 0x7f99cc0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:10.580 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 --2- 172.21.2.102:0/242670237 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f99cc0049c0 0x7f99cc004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:10.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 -- 172.21.2.102:0/242670237 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4068d20 con 0x7f99cc0049c0 2021-02-12T17:21:10.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 -- 172.21.2.102:0/242670237 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e414ea10 con 0x7f99cc003720 2021-02-12T17:21:10.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 -- 172.21.2.102:0/242670237 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0041c0 con 0x7f99e40b8d20 2021-02-12T17:21:10.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99ea20e700 1 --2- 172.21.2.102:0/242670237 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f99cc0049c0 0x7f99cc004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:10.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99ea20e700 1 -- 172.21.2.102:0/242670237 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f99e40b8d20 msgr2=0x7f99cc0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:10.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99ea20e700 1 --2- 172.21.2.102:0/242670237 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f99e40b8d20 0x7f99cc0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:10.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99ea20e700 1 -- 172.21.2.102:0/242670237 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f99cc003720 msgr2=0x7f99cc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:10.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e9a0d700 1 --2- 172.21.2.102:0/242670237 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f99cc003720 0x7f99cc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:10.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99ea20e700 1 --2- 172.21.2.102:0/242670237 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f99cc003720 0x7f99cc003b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:10.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99ea20e700 1 -- 172.21.2.102:0/242670237 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc003230 con 0x7f99cc0049c0 2021-02-12T17:21:10.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99ea20e700 1 --2- 172.21.2.102:0/242670237 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f99cc0049c0 0x7f99cc004e40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f99dc00c840 tx=0x7f99e40b6580).ready entity=mon.0 client_cookie=213719564be4fa3a server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:10.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 -- 172.21.2.102:0/242670237 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc005b70 con 0x7f99cc0049c0 2021-02-12T17:21:10.581 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 -- 172.21.2.102:0/242670237 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc005cd0 con 0x7f99cc0049c0 2021-02-12T17:21:10.582 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.575+0000 7f99e8a0b700 1 -- 172.21.2.102:0/242670237 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc007320 con 0x7f99cc0049c0 2021-02-12T17:21:10.582 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.576+0000 7f99ebc71700 1 -- 172.21.2.102:0/242670237 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f99cc0049c0 msgr2=0x7f99cc004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:10.582 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.576+0000 7f99ebc71700 1 --2- 172.21.2.102:0/242670237 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f99cc0049c0 0x7f99cc004e40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f99dc00c840 tx=0x7f99e40b6580).stop 2021-02-12T17:21:10.582 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.576+0000 7f99ea20e700 1 -- 172.21.2.102:0/242670237 reap_dead start 2021-02-12T17:21:10.582 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.576+0000 7f99ebc71700 1 -- 172.21.2.102:0/242670237 shutdown_connections 2021-02-12T17:21:10.582 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.576+0000 7f99ebc71700 1 -- 172.21.2.102:0/242670237 >> 172.21.2.102:0/242670237 conn(0x7f99e40bc480 msgr2=0x7f99e40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:10.582 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.576+0000 7f99ebc71700 1 -- 172.21.2.102:0/242670237 shutdown_connections 2021-02-12T17:21:10.582 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.576+0000 7f99ebc71700 1 -- 172.21.2.102:0/242670237 wait complete. 2021-02-12T17:21:10.582 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.577+0000 7f99ebc71700 1 Processor -- start 2021-02-12T17:21:10.582 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.577+0000 7f99ebc71700 1 -- start start 2021-02-12T17:21:10.582 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.577+0000 7f99ebc71700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f99cc0049c0 0x7f99e40b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:10.582 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.577+0000 7f99ebc71700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f99e40acf10 0x7f99e4152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:10.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.577+0000 7f99ebc71700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f99e40af280 0x7f99e40af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:10.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.577+0000 7f99ebc71700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40b4520 con 0x7f99e40acf10 2021-02-12T17:21:10.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.577+0000 7f99ebc71700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40b7580 con 0x7f99e40af280 2021-02-12T17:21:10.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.577+0000 7f99ebc71700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40b4740 con 0x7f99cc0049c0 2021-02-12T17:21:10.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.577+0000 7f99e920c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f99e40acf10 0x7f99e4152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:10.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.577+0000 7f99e920c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f99e40acf10 0x7f99e4152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47154/0 (socket says 172.21.2.102:47154) 2021-02-12T17:21:10.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.578+0000 7f99e920c700 1 -- 172.21.2.102:0/2227059865 learned_addr learned my addr 172.21.2.102:0/2227059865 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:10.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.578+0000 7f99e9a0d700 1 --2- 172.21.2.102:0/2227059865 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f99cc0049c0 0x7f99e40b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:10.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.578+0000 7f99ea20e700 1 --2- 172.21.2.102:0/2227059865 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f99e40af280 0x7f99e40af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:10.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.578+0000 7f99e920c700 1 -- 172.21.2.102:0/2227059865 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f99cc0049c0 msgr2=0x7f99e40b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:10.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.578+0000 7f99e920c700 1 --2- 172.21.2.102:0/2227059865 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f99cc0049c0 0x7f99e40b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:10.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.578+0000 7f99e920c700 1 -- 172.21.2.102:0/2227059865 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f99e40af280 msgr2=0x7f99e40af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:10.583 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.578+0000 7f99e920c700 1 --2- 172.21.2.102:0/2227059865 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f99e40af280 0x7f99e40af700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:10.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.578+0000 7f99e920c700 1 -- 172.21.2.102:0/2227059865 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e40b50d0 con 0x7f99e40acf10 2021-02-12T17:21:10.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.578+0000 7f99e920c700 1 --2- 172.21.2.102:0/2227059865 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f99e40acf10 0x7f99e4152640 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f99d8009740 tx=0x7f99d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:10.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.578+0000 7f99d5ffb700 1 -- 172.21.2.102:0/2227059865 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d800f490 con 0x7f99e40acf10 2021-02-12T17:21:10.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.578+0000 7f99d5ffb700 1 -- 172.21.2.102:0/2227059865 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d800f040 con 0x7f99e40acf10 2021-02-12T17:21:10.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.578+0000 7f99ebc71700 1 -- 172.21.2.102:0/2227059865 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e40b5370 con 0x7f99e40acf10 2021-02-12T17:21:10.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.578+0000 7f99d5ffb700 1 -- 172.21.2.102:0/2227059865 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d800f840 con 0x7f99e40acf10 2021-02-12T17:21:10.584 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.578+0000 7f99ebc71700 1 -- 172.21.2.102:0/2227059865 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e40afbf0 con 0x7f99e40acf10 2021-02-12T17:21:10.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.579+0000 7f99ebc71700 1 -- 172.21.2.102:0/2227059865 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e4045460 con 0x7f99e40acf10 2021-02-12T17:21:10.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.579+0000 7f99d5ffb700 1 -- 172.21.2.102:0/2227059865 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f99d800fbb0 con 0x7f99e40acf10 2021-02-12T17:21:10.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.579+0000 7f99d5ffb700 1 --2- 172.21.2.102:0/2227059865 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f99c4059d30 0x7f99c405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:10.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.579+0000 7f99d5ffb700 1 -- 172.21.2.102:0/2227059865 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7279+0+0 (secure 0 0 0) 0x7f99d8073d60 con 0x7f99e40acf10 2021-02-12T17:21:10.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.580+0000 7f99e9a0d700 1 --2- 172.21.2.102:0/2227059865 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f99c4059d30 0x7f99c405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:10.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.580+0000 7f99e9a0d700 1 --2- 172.21.2.102:0/2227059865 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f99c4059d30 0x7f99c405c1f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f99e0006900 tx=0x7f99e0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:10.585 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.582+0000 7f99d5ffb700 1 -- 172.21.2.102:0/2227059865 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f99d80473f0 con 0x7f99e40acf10 2021-02-12T17:21:10.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.743+0000 7f99ebc71700 1 -- 172.21.2.102:0/2227059865 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99e4063670 con 0x7f99e40acf10 2021-02-12T17:21:10.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.743+0000 7f99d5ffb700 1 -- 172.21.2.102:0/2227059865 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3755 (secure 0 0 0) 0x7f99d804aa10 con 0x7f99e40acf10 2021-02-12T17:21:10.744 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:10.745 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:20:34.320425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4744":{"gid":4744,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:10.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.744+0000 7f99ebc71700 1 -- 172.21.2.102:0/2227059865 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f99c4059d30 msgr2=0x7f99c405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:10.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.744+0000 7f99ebc71700 1 --2- 172.21.2.102:0/2227059865 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f99c4059d30 0x7f99c405c1f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f99e0006900 tx=0x7f99e0008040).stop 2021-02-12T17:21:10.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.744+0000 7f99ebc71700 1 -- 172.21.2.102:0/2227059865 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f99e40acf10 msgr2=0x7f99e4152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:10.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.744+0000 7f99ebc71700 1 --2- 172.21.2.102:0/2227059865 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f99e40acf10 0x7f99e4152640 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f99d8009740 tx=0x7f99d8008040).stop 2021-02-12T17:21:10.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.745+0000 7f99ebc71700 1 -- 172.21.2.102:0/2227059865 shutdown_connections 2021-02-12T17:21:10.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.745+0000 7f99ebc71700 1 --2- 172.21.2.102:0/2227059865 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f99e40af280 0x7f99e40af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:10.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.745+0000 7f99ebc71700 1 --2- 172.21.2.102:0/2227059865 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f99cc0049c0 0x7f99e40b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:10.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.745+0000 7f99ebc71700 1 --2- 172.21.2.102:0/2227059865 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f99c4059d30 0x7f99c405c1f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:10.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.745+0000 7f99ebc71700 1 --2- 172.21.2.102:0/2227059865 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f99e40acf10 0x7f99e4152640 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:10.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.745+0000 7f99ebc71700 1 -- 172.21.2.102:0/2227059865 >> 172.21.2.102:0/2227059865 conn(0x7f99e40bc480 msgr2=0x7f99e414cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:10.747 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.745+0000 7f99ebc71700 1 -- 172.21.2.102:0/2227059865 shutdown_connections 2021-02-12T17:21:10.747 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:10.745+0000 7f99ebc71700 1 -- 172.21.2.102:0/2227059865 wait complete. 2021-02-12T17:21:10.747 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 35 2021-02-12T17:21:10.754 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:21:10.979 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:21:10.982 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:21:12.755 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:12.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.844+0000 7fe9e5a57700 1 Processor -- start 2021-02-12T17:21:12.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.844+0000 7fe9e5a57700 1 -- start start 2021-02-12T17:21:12.845 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.844+0000 7fe9e5a57700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fe9e014e530 0x7fe9e0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:12.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.844+0000 7fe9e5a57700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe9e0062740 0x7fe9e0062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:12.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.844+0000 7fe9e5a57700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e00b7960 con 0x7fe9e00b8d20 2021-02-12T17:21:12.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.845+0000 7fe9e5a57700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e0068d20 con 0x7fe9e014e530 2021-02-12T17:21:12.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.845+0000 7fe9e5a57700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00622a0 con 0x7fe9e0062740 2021-02-12T17:21:12.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.846+0000 7fe9df7fe700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe9e0062740 0x7fe9e0062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:12.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.846+0000 7fe9de7fc700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fe9e014e530 0x7fe9e0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:12.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.846+0000 7fe9deffd700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7fe9e00b8d20 0x7fe9e00b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:38176/0 (socket says 172.21.2.102:38176) 2021-02-12T17:21:12.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.846+0000 7fe9deffd700 1 -- 172.21.2.102:0/1773544602 learned_addr learned my addr 172.21.2.102:0/1773544602 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:21:12.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.847+0000 7fe9df7fe700 1 -- 172.21.2.102:0/1773544602 >> v2:172.21.2.104:3300/0 conn(0x7fe9e014e530 msgr2=0x7fe9e0068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:12.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.847+0000 7fe9df7fe700 1 --2- 172.21.2.102:0/1773544602 >> v2:172.21.2.104:3300/0 conn(0x7fe9e014e530 0x7fe9e0068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:12.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.847+0000 7fe9df7fe700 1 -- 172.21.2.102:0/1773544602 >> v1:172.21.2.104:6789/0 conn(0x7fe9e00b8d20 legacy=0x7fe9e00b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:12.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.847+0000 7fe9df7fe700 1 -- 172.21.2.102:0/1773544602 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e014ea10 con 0x7fe9e0062740 2021-02-12T17:21:12.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.847+0000 7fe9df7fe700 1 --2- 172.21.2.102:0/1773544602 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe9e0062740 0x7fe9e0062bc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fe9d8009c90 tx=0x7fe9d80091d0).ready entity=mon.2 client_cookie=d0904af3a013ab4f server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:12.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.847+0000 7fe9ddffb700 1 -- 172.21.2.102:0/1773544602 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d800b9e0 con 0x7fe9e0062740 2021-02-12T17:21:12.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.847+0000 7fe9ddffb700 1 -- 172.21.2.102:0/1773544602 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d800bb40 con 0x7fe9e0062740 2021-02-12T17:21:12.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.847+0000 7fe9ddffb700 1 -- 172.21.2.102:0/1773544602 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8011400 con 0x7fe9e0062740 2021-02-12T17:21:12.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.848+0000 7fe9e5a57700 1 -- 172.21.2.102:0/1773544602 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe9e0062740 msgr2=0x7fe9e0062bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:12.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.848+0000 7fe9e5a57700 1 --2- 172.21.2.102:0/1773544602 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe9e0062740 0x7fe9e0062bc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fe9d8009c90 tx=0x7fe9d80091d0).stop 2021-02-12T17:21:12.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.848+0000 7fe9e5a57700 1 -- 172.21.2.102:0/1773544602 shutdown_connections 2021-02-12T17:21:12.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.848+0000 7fe9e5a57700 1 --2- 172.21.2.102:0/1773544602 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe9e0062740 0x7fe9e0062bc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:12.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.848+0000 7fe9e5a57700 1 --2- 172.21.2.102:0/1773544602 >> v2:172.21.2.104:3300/0 conn(0x7fe9e014e530 0x7fe9e0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:12.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.848+0000 7fe9e5a57700 1 -- 172.21.2.102:0/1773544602 >> 172.21.2.102:0/1773544602 conn(0x7fe9e00bc480 msgr2=0x7fe9e00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:12.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.848+0000 7fe9e5a57700 1 -- 172.21.2.102:0/1773544602 shutdown_connections 2021-02-12T17:21:12.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.848+0000 7fe9e5a57700 1 -- 172.21.2.102:0/1773544602 wait complete. 2021-02-12T17:21:12.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.849+0000 7fe9e5a57700 1 Processor -- start 2021-02-12T17:21:12.850 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.849+0000 7fe9e5a57700 1 -- start start 2021-02-12T17:21:12.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9e5a57700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe9e0062740 0x7fe9e00af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:12.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9e5a57700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe9e00b8d20 0x7fe9e015d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:12.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9e5a57700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe9e014e530 0x7fe9e015d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:12.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9e5a57700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00b0d00 con 0x7fe9e00b8d20 2021-02-12T17:21:12.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9e5a57700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00b0fa0 con 0x7fe9e014e530 2021-02-12T17:21:12.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9e5a57700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00b1240 con 0x7fe9e0062740 2021-02-12T17:21:12.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9de7fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe9e00b8d20 0x7fe9e015d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:12.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9de7fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe9e00b8d20 0x7fe9e015d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47168/0 (socket says 172.21.2.102:47168) 2021-02-12T17:21:12.851 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9de7fc700 1 -- 172.21.2.102:0/235822549 learned_addr learned my addr 172.21.2.102:0/235822549 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:12.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9df7fe700 1 --2- 172.21.2.102:0/235822549 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe9e014e530 0x7fe9e015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:12.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9deffd700 1 --2- 172.21.2.102:0/235822549 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe9e0062740 0x7fe9e00af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:12.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9de7fc700 1 -- 172.21.2.102:0/235822549 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe9e0062740 msgr2=0x7fe9e00af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:12.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9de7fc700 1 --2- 172.21.2.102:0/235822549 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe9e0062740 0x7fe9e00af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:12.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9de7fc700 1 -- 172.21.2.102:0/235822549 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe9e014e530 msgr2=0x7fe9e015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:12.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9de7fc700 1 --2- 172.21.2.102:0/235822549 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe9e014e530 0x7fe9e015d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:12.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.850+0000 7fe9de7fc700 1 -- 172.21.2.102:0/235822549 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e00b14e0 con 0x7fe9e00b8d20 2021-02-12T17:21:12.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.851+0000 7fe9de7fc700 1 --2- 172.21.2.102:0/235822549 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe9e00b8d20 0x7fe9e015d450 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fe9d000ebd0 tx=0x7fe9d0006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:12.853 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.851+0000 7fe9d6ffd700 1 -- 172.21.2.102:0/235822549 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d000b840 con 0x7fe9e00b8d20 2021-02-12T17:21:12.854 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.851+0000 7fe9d6ffd700 1 -- 172.21.2.102:0/235822549 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d000b9a0 con 0x7fe9e00b8d20 2021-02-12T17:21:12.854 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.851+0000 7fe9e5a57700 1 -- 172.21.2.102:0/235822549 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e00b1960 con 0x7fe9e00b8d20 2021-02-12T17:21:12.854 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.851+0000 7fe9e5a57700 1 -- 172.21.2.102:0/235822549 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e00ad0e0 con 0x7fe9e00b8d20 2021-02-12T17:21:12.854 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.851+0000 7fe9d6ffd700 1 -- 172.21.2.102:0/235822549 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d000bd20 con 0x7fe9e00b8d20 2021-02-12T17:21:12.854 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.851+0000 7fe9e5a57700 1 -- 172.21.2.102:0/235822549 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e00ad5f0 con 0x7fe9e00b8d20 2021-02-12T17:21:12.854 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.852+0000 7fe9d6ffd700 1 -- 172.21.2.102:0/235822549 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fe9d0012600 con 0x7fe9e00b8d20 2021-02-12T17:21:12.854 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.852+0000 7fe9d6ffd700 1 --2- 172.21.2.102:0/235822549 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe9c4059d30 0x7fe9c405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:12.854 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.852+0000 7fe9d6ffd700 1 -- 172.21.2.102:0/235822549 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7279+0+0 (secure 0 0 0) 0x7fe9d0074290 con 0x7fe9e00b8d20 2021-02-12T17:21:12.854 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.852+0000 7fe9deffd700 1 --2- 172.21.2.102:0/235822549 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe9c4059d30 0x7fe9c405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:12.854 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.852+0000 7fe9deffd700 1 --2- 172.21.2.102:0/235822549 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe9c4059d30 0x7fe9c405c1f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fe9c80014b0 tx=0x7fe9c8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:12.856 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:12.855+0000 7fe9d6ffd700 1 -- 172.21.2.102:0/235822549 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fe9e00ad5f0 con 0x7fe9e00b8d20 2021-02-12T17:21:13.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:13.013+0000 7fe9e5a57700 1 -- 172.21.2.102:0/235822549 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9e00ad5f0 con 0x7fe9e00b8d20 2021-02-12T17:21:13.015 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:13.014+0000 7fe9d6ffd700 1 -- 172.21.2.102:0/235822549 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3755 (secure 0 0 0) 0x7fe9e00ad5f0 con 0x7fe9e00b8d20 2021-02-12T17:21:13.015 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:13.015 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:20:34.320425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4744":{"gid":4744,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:13.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:13.015+0000 7fe9e5a57700 1 -- 172.21.2.102:0/235822549 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe9c4059d30 msgr2=0x7fe9c405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:13.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:13.015+0000 7fe9e5a57700 1 --2- 172.21.2.102:0/235822549 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe9c4059d30 0x7fe9c405c1f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fe9c80014b0 tx=0x7fe9c8009040).stop 2021-02-12T17:21:13.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:13.015+0000 7fe9e5a57700 1 -- 172.21.2.102:0/235822549 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe9e00b8d20 msgr2=0x7fe9e015d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:13.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:13.015+0000 7fe9e5a57700 1 --2- 172.21.2.102:0/235822549 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe9e00b8d20 0x7fe9e015d450 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fe9d000ebd0 tx=0x7fe9d0006de0).stop 2021-02-12T17:21:13.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:13.015+0000 7fe9e5a57700 1 -- 172.21.2.102:0/235822549 shutdown_connections 2021-02-12T17:21:13.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:13.015+0000 7fe9e5a57700 1 --2- 172.21.2.102:0/235822549 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe9e014e530 0x7fe9e015d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:13.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:13.015+0000 7fe9e5a57700 1 --2- 172.21.2.102:0/235822549 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe9e0062740 0x7fe9e00af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:13.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:13.015+0000 7fe9e5a57700 1 --2- 172.21.2.102:0/235822549 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe9c4059d30 0x7fe9c405c1f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:13.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:13.015+0000 7fe9e5a57700 1 --2- 172.21.2.102:0/235822549 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe9e00b8d20 0x7fe9e015d450 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:13.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:13.015+0000 7fe9e5a57700 1 -- 172.21.2.102:0/235822549 >> 172.21.2.102:0/235822549 conn(0x7fe9e00bc480 msgr2=0x7fe9e01519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:13.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:13.015+0000 7fe9e5a57700 1 -- 172.21.2.102:0/235822549 shutdown_connections 2021-02-12T17:21:13.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:13.015+0000 7fe9e5a57700 1 -- 172.21.2.102:0/235822549 wait complete. 2021-02-12T17:21:13.018 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 35 2021-02-12T17:21:13.025 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:21:15.026 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:15.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.113+0000 7f6cbe194700 1 Processor -- start 2021-02-12T17:21:15.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.113+0000 7f6cbe194700 1 -- start start 2021-02-12T17:21:15.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.113+0000 7f6cbe194700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f6cb8062e50 0x7f6cb8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:15.114 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.113+0000 7f6cbe194700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb80b7960 con 0x7f6cb80b8d20 2021-02-12T17:21:15.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.113+0000 7f6cbe194700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb80622a0 con 0x7f6cb814e530 2021-02-12T17:21:15.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.113+0000 7f6cbe194700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb8068d20 con 0x7f6cb8062e50 2021-02-12T17:21:15.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.113+0000 7f6cb77fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f6cb80b8d20 0x7f6cb80b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55826/0 (socket says 172.21.2.102:55826) 2021-02-12T17:21:15.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.113+0000 7f6cb77fe700 1 -- 172.21.2.102:0/1292660552 learned_addr learned my addr 172.21.2.102:0/1292660552 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:21:15.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb7fff700 1 --2- 172.21.2.102:0/1292660552 >> v2:172.21.2.104:3300/0 conn(0x7f6cb8062e50 0x7f6cb8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:15.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 -- 172.21.2.102:0/1292660552 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074860274 0 0) 0x7f6cb80b7960 con 0x7f6cb80b8d20 2021-02-12T17:21:15.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 -- 172.21.2.102:0/1292660552 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ca4003230 con 0x7f6cb80b8d20 2021-02-12T17:21:15.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 -- 172.21.2.102:0/1292660552 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2504335388 0 0) 0x7f6ca4003230 con 0x7f6cb80b8d20 2021-02-12T17:21:15.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 -- 172.21.2.102:0/1292660552 >> v2:172.21.2.104:3300/0 conn(0x7f6cb8062e50 msgr2=0x7f6cb8068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:15.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 --2- 172.21.2.102:0/1292660552 >> v2:172.21.2.104:3300/0 conn(0x7f6cb8062e50 0x7f6cb8068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:15.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 -- 172.21.2.102:0/1292660552 >> v1:172.21.2.104:6789/0 conn(0x7f6cb814e530 legacy=0x7f6cb8062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:15.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 -- 172.21.2.102:0/1292660552 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb814ea10 con 0x7f6cb80b8d20 2021-02-12T17:21:15.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 -- 172.21.2.102:0/1292660552 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f6cac0014e0 con 0x7f6cb80b8d20 2021-02-12T17:21:15.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 -- 172.21.2.102:0/1292660552 >> v1:172.21.2.102:6789/0 conn(0x7f6cb80b8d20 legacy=0x7f6cb80b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:15.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 --2- 172.21.2.102:0/1292660552 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6ca4003720 0x7f6ca4003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:15.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 --2- 172.21.2.102:0/1292660552 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6ca40044d0 0x7f6ca4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:15.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 --2- 172.21.2.102:0/1292660552 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6ca4004e40 0x7f6ca400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:15.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 -- 172.21.2.102:0/1292660552 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb8068d20 con 0x7f6ca4004e40 2021-02-12T17:21:15.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 -- 172.21.2.102:0/1292660552 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40041c0 con 0x7f6ca4003720 2021-02-12T17:21:15.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb67fc700 1 -- 172.21.2.102:0/1292660552 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca400bc10 con 0x7f6ca40044d0 2021-02-12T17:21:15.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb7fff700 1 --2- 172.21.2.102:0/1292660552 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6ca4004e40 0x7f6ca400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:15.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.114+0000 7f6cb77fe700 1 --2- 172.21.2.102:0/1292660552 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6ca4003720 0x7f6ca4003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:15.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cb6ffd700 1 --2- 172.21.2.102:0/1292660552 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6ca40044d0 0x7f6ca4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:15.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cb7fff700 1 -- 172.21.2.102:0/1292660552 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6ca40044d0 msgr2=0x7f6ca4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:15.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cb7fff700 1 --2- 172.21.2.102:0/1292660552 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6ca40044d0 0x7f6ca4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:15.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cb7fff700 1 -- 172.21.2.102:0/1292660552 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6ca4003720 msgr2=0x7f6ca4003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:15.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cb7fff700 1 --2- 172.21.2.102:0/1292660552 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6ca4003720 0x7f6ca4003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:15.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cb7fff700 1 -- 172.21.2.102:0/1292660552 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca4003230 con 0x7f6ca4004e40 2021-02-12T17:21:15.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cb6ffd700 1 --2- 172.21.2.102:0/1292660552 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6ca40044d0 0x7f6ca4004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:21:15.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cb77fe700 1 --2- 172.21.2.102:0/1292660552 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6ca4003720 0x7f6ca4003b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:21:15.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cb7fff700 1 -- 172.21.2.102:0/1292660552 reap_dead start 2021-02-12T17:21:15.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cb7fff700 1 --2- 172.21.2.102:0/1292660552 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6ca4004e40 0x7f6ca400b720 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f6cb0009e90 tx=0x7f6cb00091d0).ready entity=mon.0 client_cookie=5b0eee82f65f5ede server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:15.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cb67fc700 1 -- 172.21.2.102:0/1292660552 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb000ed30 con 0x7f6ca4004e40 2021-02-12T17:21:15.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cb67fc700 1 -- 172.21.2.102:0/1292660552 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb000ee90 con 0x7f6ca4004e40 2021-02-12T17:21:15.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cb67fc700 1 -- 172.21.2.102:0/1292660552 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0012640 con 0x7f6ca4004e40 2021-02-12T17:21:15.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cbe194700 1 -- 172.21.2.102:0/1292660552 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6ca4004e40 msgr2=0x7f6ca400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:15.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cbe194700 1 --2- 172.21.2.102:0/1292660552 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6ca4004e40 0x7f6ca400b720 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f6cb0009e90 tx=0x7f6cb00091d0).stop 2021-02-12T17:21:15.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cbe194700 1 -- 172.21.2.102:0/1292660552 shutdown_connections 2021-02-12T17:21:15.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cbe194700 1 --2- 172.21.2.102:0/1292660552 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6ca4004e40 0x7f6ca400b720 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:15.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cbe194700 1 -- 172.21.2.102:0/1292660552 >> 172.21.2.102:0/1292660552 conn(0x7f6cb80bc480 msgr2=0x7f6cb80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:15.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cbe194700 1 -- 172.21.2.102:0/1292660552 shutdown_connections 2021-02-12T17:21:15.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.115+0000 7f6cbe194700 1 -- 172.21.2.102:0/1292660552 wait complete. 2021-02-12T17:21:15.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.116+0000 7f6cbe194700 1 Processor -- start 2021-02-12T17:21:15.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.116+0000 7f6cbe194700 1 -- start start 2021-02-12T17:21:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cbe194700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6ca4004e40 0x7f6cb80bad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cbe194700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6cb8153470 0x7f6cb81538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cbe194700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6cb8160bd0 0x7f6cb8161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cbe194700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb80aec30 con 0x7f6cb8160bd0 2021-02-12T17:21:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cbe194700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb8153de0 con 0x7f6ca4004e40 2021-02-12T17:21:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cbe194700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb80aee20 con 0x7f6cb8153470 2021-02-12T17:21:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cb7fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6cb8160bd0 0x7f6cb8161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cb7fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6cb8160bd0 0x7f6cb8161030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47194/0 (socket says 172.21.2.102:47194) 2021-02-12T17:21:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cb7fff700 1 -- 172.21.2.102:0/2276118600 learned_addr learned my addr 172.21.2.102:0/2276118600 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cb7fff700 1 -- 172.21.2.102:0/2276118600 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6cb8153470 msgr2=0x7f6cb81538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cb7fff700 1 --2- 172.21.2.102:0/2276118600 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6cb8153470 0x7f6cb81538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cb77fe700 1 --2- 172.21.2.102:0/2276118600 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6ca4004e40 0x7f6cb80bad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cb7fff700 1 -- 172.21.2.102:0/2276118600 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6ca4004e40 msgr2=0x7f6cb80bad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cb7fff700 1 --2- 172.21.2.102:0/2276118600 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6ca4004e40 0x7f6cb80bad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cb7fff700 1 -- 172.21.2.102:0/2276118600 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb80af080 con 0x7f6cb8160bd0 2021-02-12T17:21:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cb7fff700 1 --2- 172.21.2.102:0/2276118600 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6cb8160bd0 0x7f6cb8161030 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f6cb0008000 tx=0x7f6cb0019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6c9f7fe700 1 -- 172.21.2.102:0/2276118600 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0012e10 con 0x7f6cb8160bd0 2021-02-12T17:21:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6c9f7fe700 1 -- 172.21.2.102:0/2276118600 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb001c650 con 0x7f6cb8160bd0 2021-02-12T17:21:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cbe194700 1 -- 172.21.2.102:0/2276118600 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb80af320 con 0x7f6cb8160bd0 2021-02-12T17:21:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6c9f7fe700 1 -- 172.21.2.102:0/2276118600 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb001c9d0 con 0x7f6cb8160bd0 2021-02-12T17:21:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.117+0000 7f6cbe194700 1 -- 172.21.2.102:0/2276118600 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb815d2a0 con 0x7f6cb8160bd0 2021-02-12T17:21:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.118+0000 7f6cbe194700 1 -- 172.21.2.102:0/2276118600 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb80b22b0 con 0x7f6cb8160bd0 2021-02-12T17:21:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.118+0000 7f6c9f7fe700 1 -- 172.21.2.102:0/2276118600 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f6cb002c070 con 0x7f6cb8160bd0 2021-02-12T17:21:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.119+0000 7f6c9f7fe700 1 --2- 172.21.2.102:0/2276118600 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6c98059d30 0x7f6c9805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.119+0000 7f6c9f7fe700 1 -- 172.21.2.102:0/2276118600 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7279+0+0 (secure 0 0 0) 0x7f6cb0075c50 con 0x7f6cb8160bd0 2021-02-12T17:21:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.119+0000 7f6cb77fe700 1 --2- 172.21.2.102:0/2276118600 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6c98059d30 0x7f6c9805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:15.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.119+0000 7f6cb77fe700 1 --2- 172.21.2.102:0/2276118600 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6c98059d30 0x7f6c9805c1f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f6cac001610 tx=0x7f6cb814eba0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:15.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.122+0000 7f6c9f7fe700 1 -- 172.21.2.102:0/2276118600 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f6cb00491d0 con 0x7f6cb8160bd0 2021-02-12T17:21:15.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.281+0000 7f6cbe194700 1 -- 172.21.2.102:0/2276118600 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cb80af780 con 0x7f6cb8160bd0 2021-02-12T17:21:15.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.281+0000 7f6c9f7fe700 1 -- 172.21.2.102:0/2276118600 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3755 (secure 0 0 0) 0x7f6cb0016020 con 0x7f6cb8160bd0 2021-02-12T17:21:15.282 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:15.283 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:20:34.320425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4744":{"gid":4744,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:15.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.283+0000 7f6cbe194700 1 -- 172.21.2.102:0/2276118600 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6c98059d30 msgr2=0x7f6c9805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:15.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.283+0000 7f6cbe194700 1 --2- 172.21.2.102:0/2276118600 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6c98059d30 0x7f6c9805c1f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f6cac001610 tx=0x7f6cb814eba0).stop 2021-02-12T17:21:15.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.283+0000 7f6cbe194700 1 -- 172.21.2.102:0/2276118600 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6cb8160bd0 msgr2=0x7f6cb8161030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:15.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.283+0000 7f6cbe194700 1 --2- 172.21.2.102:0/2276118600 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6cb8160bd0 0x7f6cb8161030 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f6cb0008000 tx=0x7f6cb0019000).stop 2021-02-12T17:21:15.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.283+0000 7f6cbe194700 1 -- 172.21.2.102:0/2276118600 shutdown_connections 2021-02-12T17:21:15.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.283+0000 7f6cbe194700 1 --2- 172.21.2.102:0/2276118600 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6c98059d30 0x7f6c9805c1f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:15.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.283+0000 7f6cbe194700 1 --2- 172.21.2.102:0/2276118600 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6cb8160bd0 0x7f6cb8161030 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:15.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.283+0000 7f6cbe194700 1 --2- 172.21.2.102:0/2276118600 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6ca4004e40 0x7f6cb80bad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:15.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.283+0000 7f6cbe194700 1 --2- 172.21.2.102:0/2276118600 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6cb8153470 0x7f6cb81538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:15.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.283+0000 7f6cbe194700 1 -- 172.21.2.102:0/2276118600 >> 172.21.2.102:0/2276118600 conn(0x7f6cb80bc480 msgr2=0x7f6cb814ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:15.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.283+0000 7f6cbe194700 1 -- 172.21.2.102:0/2276118600 shutdown_connections 2021-02-12T17:21:15.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:15.283+0000 7f6cbe194700 1 -- 172.21.2.102:0/2276118600 wait complete. 2021-02-12T17:21:15.286 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 35 2021-02-12T17:21:15.293 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:21:17.294 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:17.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.383+0000 7fecf948f700 1 Processor -- start 2021-02-12T17:21:17.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.383+0000 7fecf948f700 1 -- start start 2021-02-12T17:21:17.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.384+0000 7fecf948f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecf4061430 0x7fecf4061810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:17.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.384+0000 7fecf948f700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fecf4081c00 0x7fecf40b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:17.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.384+0000 7fecf948f700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fecf4143490 0x7fecf4143900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:17.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.384+0000 7fecf948f700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf4143df0 con 0x7fecf4081c00 2021-02-12T17:21:17.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.384+0000 7fecf948f700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf414d040 con 0x7fecf4143490 2021-02-12T17:21:17.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.384+0000 7fecf948f700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf414d2e0 con 0x7fecf4061430 2021-02-12T17:21:17.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.384+0000 7fecf27fc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fecf4081c00 0x7fecf40b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:17.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.384+0000 7fecf27fc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fecf4081c00 0x7fecf40b6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47198/0 (socket says 172.21.2.102:47198) 2021-02-12T17:21:17.386 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.384+0000 7fecf27fc700 1 -- 172.21.2.102:0/2106136669 learned_addr learned my addr 172.21.2.102:0/2106136669 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:17.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf27fc700 1 -- 172.21.2.102:0/2106136669 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecf4061430 msgr2=0x7fecf4061810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:17.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf27fc700 1 --2- 172.21.2.102:0/2106136669 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecf4061430 0x7fecf4061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:17.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf27fc700 1 -- 172.21.2.102:0/2106136669 >> v2:172.21.2.104:3300/0 conn(0x7fecf4143490 msgr2=0x7fecf4143900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:17.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf27fc700 1 --2- 172.21.2.102:0/2106136669 >> v2:172.21.2.104:3300/0 conn(0x7fecf4143490 0x7fecf4143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:17.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf27fc700 1 -- 172.21.2.102:0/2106136669 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf414d580 con 0x7fecf4081c00 2021-02-12T17:21:17.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf27fc700 1 --2- 172.21.2.102:0/2106136669 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecf4081c00 0x7fecf40b6300 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fecf40bc820 tx=0x7fece8006ea0).ready entity=mon.0 client_cookie=48ca6d10205407e3 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:17.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf1ffb700 1 -- 172.21.2.102:0/2106136669 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece80098d0 con 0x7fecf4081c00 2021-02-12T17:21:17.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf1ffb700 1 -- 172.21.2.102:0/2106136669 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece8009a30 con 0x7fecf4081c00 2021-02-12T17:21:17.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf1ffb700 1 -- 172.21.2.102:0/2106136669 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8009db0 con 0x7fecf4081c00 2021-02-12T17:21:17.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf948f700 1 -- 172.21.2.102:0/2106136669 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecf4081c00 msgr2=0x7fecf40b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:17.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf948f700 1 --2- 172.21.2.102:0/2106136669 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecf4081c00 0x7fecf40b6300 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fecf40bc820 tx=0x7fece8006ea0).stop 2021-02-12T17:21:17.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf948f700 1 -- 172.21.2.102:0/2106136669 shutdown_connections 2021-02-12T17:21:17.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf948f700 1 --2- 172.21.2.102:0/2106136669 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecf4061430 0x7fecf4061810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:17.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf948f700 1 --2- 172.21.2.102:0/2106136669 >> v2:172.21.2.104:3300/0 conn(0x7fecf4143490 0x7fecf4143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:17.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf948f700 1 --2- 172.21.2.102:0/2106136669 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecf4081c00 0x7fecf40b6300 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:17.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf948f700 1 -- 172.21.2.102:0/2106136669 >> 172.21.2.102:0/2106136669 conn(0x7fecf406a2c0 msgr2=0x7fecf40bfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:17.388 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.385+0000 7fecf948f700 1 -- 172.21.2.102:0/2106136669 shutdown_connections 2021-02-12T17:21:17.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.386+0000 7fecf948f700 1 -- 172.21.2.102:0/2106136669 wait complete. 2021-02-12T17:21:17.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.386+0000 7fecf948f700 1 Processor -- start 2021-02-12T17:21:17.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.386+0000 7fecf948f700 1 -- start start 2021-02-12T17:21:17.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf948f700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fecf4061430 0x7fecf4148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:17.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf948f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecf4081c00 0x7fecf415d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:17.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf948f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecf4143490 0x7fecf4064280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:17.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf948f700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf41491d0 con 0x7fecf4143490 2021-02-12T17:21:17.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf948f700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf415e270 con 0x7fecf4061430 2021-02-12T17:21:17.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf948f700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf415d800 con 0x7fecf4081c00 2021-02-12T17:21:17.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf37fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecf4143490 0x7fecf4064280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:17.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf37fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecf4143490 0x7fecf4064280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47206/0 (socket says 172.21.2.102:47206) 2021-02-12T17:21:17.391 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf37fe700 1 -- 172.21.2.102:0/1692312769 learned_addr learned my addr 172.21.2.102:0/1692312769 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:17.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf27fc700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecf4081c00 0x7fecf415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:17.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf37fe700 1 -- 172.21.2.102:0/1692312769 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecf4081c00 msgr2=0x7fecf415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:17.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf37fe700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecf4081c00 0x7fecf415d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:17.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf2ffd700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fecf4061430 0x7fecf4148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:17.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf37fe700 1 -- 172.21.2.102:0/1692312769 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fecf4061430 msgr2=0x7fecf4148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:17.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf37fe700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fecf4061430 0x7fecf4148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:17.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf37fe700 1 -- 172.21.2.102:0/1692312769 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf415da90 con 0x7fecf4143490 2021-02-12T17:21:17.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf27fc700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecf4081c00 0x7fecf415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:21:17.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.387+0000 7fecf2ffd700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fecf4061430 0x7fecf4148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:21:17.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.388+0000 7fecf37fe700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecf4143490 0x7fecf4064280 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fecec00bae0 tx=0x7fecec0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:17.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.388+0000 7fecdaffd700 1 -- 172.21.2.102:0/1692312769 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec00c830 con 0x7fecf4143490 2021-02-12T17:21:17.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.388+0000 7fecdaffd700 1 -- 172.21.2.102:0/1692312769 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec00c990 con 0x7fecf4143490 2021-02-12T17:21:17.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.388+0000 7fecf948f700 1 -- 172.21.2.102:0/1692312769 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf415dd30 con 0x7fecf4143490 2021-02-12T17:21:17.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.388+0000 7fecdaffd700 1 -- 172.21.2.102:0/1692312769 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec00cb40 con 0x7fecf4143490 2021-02-12T17:21:17.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.388+0000 7fecf948f700 1 -- 172.21.2.102:0/1692312769 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf4064770 con 0x7fecf4143490 2021-02-12T17:21:17.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.389+0000 7fecf948f700 1 -- 172.21.2.102:0/1692312769 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf40812d0 con 0x7fecf4143490 2021-02-12T17:21:17.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.389+0000 7fecdaffd700 1 -- 172.21.2.102:0/1692312769 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fecec01c070 con 0x7fecf4143490 2021-02-12T17:21:17.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.389+0000 7fecdaffd700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fecd4059d60 0x7fecd405c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:17.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.389+0000 7fecdaffd700 1 -- 172.21.2.102:0/1692312769 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7279+0+0 (secure 0 0 0) 0x7fecec073610 con 0x7fecf4143490 2021-02-12T17:21:17.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.389+0000 7fecf2ffd700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fecd4059d60 0x7fecd405c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:17.393 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.389+0000 7fecf2ffd700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fecd4059d60 0x7fecd405c220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fece400a7a0 tx=0x7fece4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:17.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.392+0000 7fecdaffd700 1 -- 172.21.2.102:0/1692312769 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fecec046b90 con 0x7fecf4143490 2021-02-12T17:21:17.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.550+0000 7fecf948f700 1 -- 172.21.2.102:0/1692312769 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecf4149310 con 0x7fecf4143490 2021-02-12T17:21:17.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.551+0000 7fecdaffd700 1 -- 172.21.2.102:0/1692312769 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3755 (secure 0 0 0) 0x7fecec04a1b0 con 0x7fecf4143490 2021-02-12T17:21:17.552 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:17.552 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:20:34.320425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4744":{"gid":4744,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:17.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.552+0000 7fecf948f700 1 -- 172.21.2.102:0/1692312769 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fecd4059d60 msgr2=0x7fecd405c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:17.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.552+0000 7fecf948f700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fecd4059d60 0x7fecd405c220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fece400a7a0 tx=0x7fece4008040).stop 2021-02-12T17:21:17.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.552+0000 7fecf948f700 1 -- 172.21.2.102:0/1692312769 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecf4143490 msgr2=0x7fecf4064280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:17.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.552+0000 7fecf948f700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecf4143490 0x7fecf4064280 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fecec00bae0 tx=0x7fecec0090f0).stop 2021-02-12T17:21:17.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.552+0000 7fecf948f700 1 -- 172.21.2.102:0/1692312769 shutdown_connections 2021-02-12T17:21:17.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.552+0000 7fecf948f700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fecd4059d60 0x7fecd405c220 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:17.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.552+0000 7fecf948f700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fecf4143490 0x7fecf4064280 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:17.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.552+0000 7fecf948f700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fecf4061430 0x7fecf4148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:17.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.552+0000 7fecf948f700 1 --2- 172.21.2.102:0/1692312769 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fecf4081c00 0x7fecf415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:17.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.552+0000 7fecf948f700 1 -- 172.21.2.102:0/1692312769 >> 172.21.2.102:0/1692312769 conn(0x7fecf406a2c0 msgr2=0x7fecf40be1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:17.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.552+0000 7fecf948f700 1 -- 172.21.2.102:0/1692312769 shutdown_connections 2021-02-12T17:21:17.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:17.552+0000 7fecf948f700 1 -- 172.21.2.102:0/1692312769 wait complete. 2021-02-12T17:21:17.554 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 35 2021-02-12T17:21:17.562 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:21:19.563 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:19.652 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.651+0000 7f970c3c1700 1 Processor -- start 2021-02-12T17:21:19.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.651+0000 7f970c3c1700 1 -- start start 2021-02-12T17:21:19.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.652+0000 7f970c3c1700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f97040b2cb0 0x7f97040b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:19.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.652+0000 7f970c3c1700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f97040b3090 0x7f97040b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:19.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.652+0000 7f970c3c1700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97040b54d0 con 0x7f97040b8bd0 2021-02-12T17:21:19.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.652+0000 7f970c3c1700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97040b40f0 con 0x7f97040b2cb0 2021-02-12T17:21:19.653 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.652+0000 7f970c3c1700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97040b4f90 con 0x7f97040b3090 2021-02-12T17:21:19.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.653+0000 7f970995c700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f97040b8bd0 0x7f9704147cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:38226/0 (socket says 172.21.2.102:38226) 2021-02-12T17:21:19.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.653+0000 7f970995c700 1 -- 172.21.2.102:0/2415465984 learned_addr learned my addr 172.21.2.102:0/2415465984 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:21:19.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.653+0000 7f970a95e700 1 --2- 172.21.2.102:0/2415465984 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f97040b3090 0x7f97040b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:19.654 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.653+0000 7f970a15d700 1 --2- 172.21.2.102:0/2415465984 >> v2:172.21.2.104:3300/0 conn(0x7f97040b2cb0 0x7f97040b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:19.655 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.654+0000 7f970a15d700 1 -- 172.21.2.102:0/2415465984 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f97040b3090 msgr2=0x7f97040b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:19.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.654+0000 7f970a15d700 1 --2- 172.21.2.102:0/2415465984 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f97040b3090 0x7f97040b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:19.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.654+0000 7f970a15d700 1 -- 172.21.2.102:0/2415465984 >> v1:172.21.2.104:6789/0 conn(0x7f97040b8bd0 legacy=0x7f9704147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:19.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.654+0000 7f970a15d700 1 -- 172.21.2.102:0/2415465984 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97040b5230 con 0x7f97040b2cb0 2021-02-12T17:21:19.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.654+0000 7f970a15d700 1 --2- 172.21.2.102:0/2415465984 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f97040b2cb0 0x7f97040b7010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f970000b980 tx=0x7f9700006de0).ready entity=mon.1 client_cookie=317bf3d13b99651e server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:19.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.654+0000 7f970915b700 1 -- 172.21.2.102:0/2415465984 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970000be70 con 0x7f97040b2cb0 2021-02-12T17:21:19.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.654+0000 7f970915b700 1 -- 172.21.2.102:0/2415465984 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97000097e0 con 0x7f97040b2cb0 2021-02-12T17:21:19.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.654+0000 7f970915b700 1 -- 172.21.2.102:0/2415465984 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700009b60 con 0x7f97040b2cb0 2021-02-12T17:21:19.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.654+0000 7f970c3c1700 1 -- 172.21.2.102:0/2415465984 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f97040b2cb0 msgr2=0x7f97040b7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:19.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.654+0000 7f970c3c1700 1 --2- 172.21.2.102:0/2415465984 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f97040b2cb0 0x7f97040b7010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f970000b980 tx=0x7f9700006de0).stop 2021-02-12T17:21:19.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.654+0000 7f970c3c1700 1 -- 172.21.2.102:0/2415465984 shutdown_connections 2021-02-12T17:21:19.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.654+0000 7f970c3c1700 1 --2- 172.21.2.102:0/2415465984 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f97040b3090 0x7f97040b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:19.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.654+0000 7f970c3c1700 1 --2- 172.21.2.102:0/2415465984 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f97040b2cb0 0x7f97040b7010 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:19.656 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.654+0000 7f970c3c1700 1 -- 172.21.2.102:0/2415465984 >> 172.21.2.102:0/2415465984 conn(0x7f97040bc480 msgr2=0x7f97040b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:19.657 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.655+0000 7f970c3c1700 1 -- 172.21.2.102:0/2415465984 shutdown_connections 2021-02-12T17:21:19.657 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.655+0000 7f970c3c1700 1 -- 172.21.2.102:0/2415465984 wait complete. 2021-02-12T17:21:19.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.655+0000 7f970c3c1700 1 Processor -- start 2021-02-12T17:21:19.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.655+0000 7f970c3c1700 1 -- start start 2021-02-12T17:21:19.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.656+0000 7f970c3c1700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f97040b2cb0 0x7f970413b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:19.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.656+0000 7f970c3c1700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97040b3090 0x7f970413a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:19.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.656+0000 7f970c3c1700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f97040b8bd0 0x7f970413a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:19.658 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.656+0000 7f970c3c1700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9704146430 con 0x7f97040b3090 2021-02-12T17:21:19.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.656+0000 7f970c3c1700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9704146660 con 0x7f97040b2cb0 2021-02-12T17:21:19.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.656+0000 7f970c3c1700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9704146900 con 0x7f97040b8bd0 2021-02-12T17:21:19.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.656+0000 7f970995c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97040b3090 0x7f970413a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:19.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.656+0000 7f970995c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97040b3090 0x7f970413a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47216/0 (socket says 172.21.2.102:47216) 2021-02-12T17:21:19.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.656+0000 7f970995c700 1 -- 172.21.2.102:0/1246082400 learned_addr learned my addr 172.21.2.102:0/1246082400 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:19.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.656+0000 7f970a15d700 1 --2- 172.21.2.102:0/1246082400 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f97040b2cb0 0x7f970413b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:19.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.656+0000 7f970a95e700 1 --2- 172.21.2.102:0/1246082400 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f97040b8bd0 0x7f970413a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:19.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.657+0000 7f970995c700 1 -- 172.21.2.102:0/1246082400 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f97040b8bd0 msgr2=0x7f970413a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:19.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.657+0000 7f970995c700 1 --2- 172.21.2.102:0/1246082400 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f97040b8bd0 0x7f970413a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:19.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.657+0000 7f970995c700 1 -- 172.21.2.102:0/1246082400 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f97040b2cb0 msgr2=0x7f970413b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:19.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.657+0000 7f970995c700 1 --2- 172.21.2.102:0/1246082400 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f97040b2cb0 0x7f970413b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:19.659 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.657+0000 7f970995c700 1 -- 172.21.2.102:0/1246082400 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9704146ba0 con 0x7f97040b3090 2021-02-12T17:21:19.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.657+0000 7f970995c700 1 --2- 172.21.2.102:0/1246082400 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97040b3090 0x7f970413a0d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f96f800c710 tx=0x7f96f8007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:19.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.657+0000 7f96f67fc700 1 -- 172.21.2.102:0/1246082400 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f8007320 con 0x7f97040b3090 2021-02-12T17:21:19.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.657+0000 7f96f67fc700 1 -- 172.21.2.102:0/1246082400 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f8007480 con 0x7f97040b3090 2021-02-12T17:21:19.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.657+0000 7f970c3c1700 1 -- 172.21.2.102:0/1246082400 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9704146e40 con 0x7f97040b3090 2021-02-12T17:21:19.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.657+0000 7f96f67fc700 1 -- 172.21.2.102:0/1246082400 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f80057f0 con 0x7f97040b3090 2021-02-12T17:21:19.660 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.657+0000 7f970c3c1700 1 -- 172.21.2.102:0/1246082400 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9704145f60 con 0x7f97040b3090 2021-02-12T17:21:19.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.658+0000 7f970c3c1700 1 -- 172.21.2.102:0/1246082400 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9704045460 con 0x7f97040b3090 2021-02-12T17:21:19.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.658+0000 7f96f67fc700 1 -- 172.21.2.102:0/1246082400 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f96f8010030 con 0x7f97040b3090 2021-02-12T17:21:19.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.658+0000 7f96f67fc700 1 --2- 172.21.2.102:0/1246082400 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f96e4059db0 0x7f96e405c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:19.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.658+0000 7f96f67fc700 1 -- 172.21.2.102:0/1246082400 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7279+0+0 (secure 0 0 0) 0x7f96f8073b00 con 0x7f97040b3090 2021-02-12T17:21:19.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.658+0000 7f970a15d700 1 --2- 172.21.2.102:0/1246082400 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f96e4059db0 0x7f96e405c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:19.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.659+0000 7f970a15d700 1 --2- 172.21.2.102:0/1246082400 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f96e4059db0 0x7f96e405c270 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f970000b130 tx=0x7f9700016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:19.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.661+0000 7f96f67fc700 1 -- 172.21.2.102:0/1246082400 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f96f80470a0 con 0x7f97040b3090 2021-02-12T17:21:19.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.824+0000 7f970c3c1700 1 -- 172.21.2.102:0/1246082400 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9704068d00 con 0x7f97040b3090 2021-02-12T17:21:19.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.824+0000 7f96f67fc700 1 -- 172.21.2.102:0/1246082400 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3755 (secure 0 0 0) 0x7f96f804a6c0 con 0x7f97040b3090 2021-02-12T17:21:19.825 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:19.826 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:20:34.320425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4744":{"gid":4744,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.2.104:6835/3304354058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":3304354058},{"type":"v1","addr":"172.21.2.104:6835","nonce":3304354058}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:19.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.825+0000 7f970c3c1700 1 -- 172.21.2.102:0/1246082400 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f96e4059db0 msgr2=0x7f96e405c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:19.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.825+0000 7f970c3c1700 1 --2- 172.21.2.102:0/1246082400 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f96e4059db0 0x7f96e405c270 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f970000b130 tx=0x7f9700016000).stop 2021-02-12T17:21:19.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.825+0000 7f970c3c1700 1 -- 172.21.2.102:0/1246082400 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97040b3090 msgr2=0x7f970413a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:19.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.825+0000 7f970c3c1700 1 --2- 172.21.2.102:0/1246082400 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97040b3090 0x7f970413a0d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f96f800c710 tx=0x7f96f8007c30).stop 2021-02-12T17:21:19.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.826+0000 7f970c3c1700 1 -- 172.21.2.102:0/1246082400 shutdown_connections 2021-02-12T17:21:19.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.826+0000 7f970c3c1700 1 --2- 172.21.2.102:0/1246082400 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f97040b8bd0 0x7f970413a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:19.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.826+0000 7f970c3c1700 1 --2- 172.21.2.102:0/1246082400 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f97040b2cb0 0x7f970413b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:19.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.826+0000 7f970c3c1700 1 --2- 172.21.2.102:0/1246082400 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f96e4059db0 0x7f96e405c270 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:19.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.826+0000 7f970c3c1700 1 --2- 172.21.2.102:0/1246082400 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f97040b3090 0x7f970413a0d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:19.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.826+0000 7f970c3c1700 1 -- 172.21.2.102:0/1246082400 >> 172.21.2.102:0/1246082400 conn(0x7f97040bc480 msgr2=0x7f9704062d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:19.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.826+0000 7f970c3c1700 1 -- 172.21.2.102:0/1246082400 shutdown_connections 2021-02-12T17:21:19.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:19.826+0000 7f970c3c1700 1 -- 172.21.2.102:0/1246082400 wait complete. 2021-02-12T17:21:19.828 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 35 2021-02-12T17:21:19.836 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:21:21.836 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:21.925 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.924+0000 7f7b4f318700 1 Processor -- start 2021-02-12T17:21:21.926 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.925+0000 7f7b4f318700 1 -- start start 2021-02-12T17:21:21.927 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.925+0000 7f7b4f318700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f7b480b6350 0x7f7b481463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:21.927 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.925+0000 7f7b4f318700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f7b48144ea0 0x7f7b48145330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:21.927 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.925+0000 7f7b4f318700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b480b2930 con 0x7f7b48067720 2021-02-12T17:21:21.927 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.925+0000 7f7b4f318700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b48068980 con 0x7f7b48144ea0 2021-02-12T17:21:21.927 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.925+0000 7f7b4f318700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b480b67b0 con 0x7f7b480b6350 2021-02-12T17:21:21.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.925+0000 7f7b4d8b5700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f7b48144ea0 0x7f7b48145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:21.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.925+0000 7f7b4d8b5700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f7b48144ea0 0x7f7b48145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47236/0 (socket says 172.21.2.102:47236) 2021-02-12T17:21:21.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.925+0000 7f7b4d8b5700 1 -- 172.21.2.102:0/200410455 learned_addr learned my addr 172.21.2.102:0/200410455 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:21.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b4d8b5700 1 -- 172.21.2.102:0/200410455 >> v2:172.21.2.104:3300/0 conn(0x7f7b480b6350 msgr2=0x7f7b481463a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:21:21.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b4d8b5700 1 --2- 172.21.2.102:0/200410455 >> v2:172.21.2.104:3300/0 conn(0x7f7b480b6350 0x7f7b481463a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:21.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b4d8b5700 1 -- 172.21.2.102:0/200410455 >> v1:172.21.2.104:6789/0 conn(0x7f7b48067720 legacy=0x7f7b48062580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:21:21.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b4d8b5700 1 -- 172.21.2.102:0/200410455 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b48066db0 con 0x7f7b48144ea0 2021-02-12T17:21:21.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b4d8b5700 1 --2- 172.21.2.102:0/200410455 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b48144ea0 0x7f7b48145330 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f7b48065c50 tx=0x7f7b4000b530).ready entity=mon.0 client_cookie=2fc922febd0d0d61 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:21.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b3bfff700 1 -- 172.21.2.102:0/200410455 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4000de20 con 0x7f7b48144ea0 2021-02-12T17:21:21.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b3bfff700 1 -- 172.21.2.102:0/200410455 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b40010680 con 0x7f7b48144ea0 2021-02-12T17:21:21.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b3bfff700 1 -- 172.21.2.102:0/200410455 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40010a00 con 0x7f7b48144ea0 2021-02-12T17:21:21.928 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b4f318700 1 -- 172.21.2.102:0/200410455 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b48144ea0 msgr2=0x7f7b48145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:21.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b4f318700 1 --2- 172.21.2.102:0/200410455 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b48144ea0 0x7f7b48145330 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f7b48065c50 tx=0x7f7b4000b530).stop 2021-02-12T17:21:21.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b4f318700 1 -- 172.21.2.102:0/200410455 shutdown_connections 2021-02-12T17:21:21.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b4f318700 1 --2- 172.21.2.102:0/200410455 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b48144ea0 0x7f7b48145330 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:21.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b4f318700 1 --2- 172.21.2.102:0/200410455 >> v2:172.21.2.104:3300/0 conn(0x7f7b480b6350 0x7f7b481463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:21.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b4f318700 1 -- 172.21.2.102:0/200410455 >> 172.21.2.102:0/200410455 conn(0x7f7b480bc480 msgr2=0x7f7b480b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:21.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b4f318700 1 -- 172.21.2.102:0/200410455 shutdown_connections 2021-02-12T17:21:21.929 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.926+0000 7f7b4f318700 1 -- 172.21.2.102:0/200410455 wait complete. 2021-02-12T17:21:21.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.927+0000 7f7b4f318700 1 Processor -- start 2021-02-12T17:21:21.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.927+0000 7f7b4f318700 1 -- start start 2021-02-12T17:21:21.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4f318700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b48067720 0x7f7b4814df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:21.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4f318700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7b480b6350 0x7f7b4814e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:21.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4f318700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b48144ea0 0x7f7b48142e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:21.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4f318700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48158c10 con 0x7f7b48067720 2021-02-12T17:21:21.931 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4f318700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48158e30 con 0x7f7b480b6350 2021-02-12T17:21:21.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4f318700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48147000 con 0x7f7b48144ea0 2021-02-12T17:21:21.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4d0b4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b48067720 0x7f7b4814df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:21.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4d0b4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b48067720 0x7f7b4814df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47244/0 (socket says 172.21.2.102:47244) 2021-02-12T17:21:21.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4d0b4700 1 -- 172.21.2.102:0/1906742732 learned_addr learned my addr 172.21.2.102:0/1906742732 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:21.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4d0b4700 1 -- 172.21.2.102:0/1906742732 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b48144ea0 msgr2=0x7f7b48142e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:21.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4d0b4700 1 --2- 172.21.2.102:0/1906742732 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b48144ea0 0x7f7b48142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:21.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4d0b4700 1 -- 172.21.2.102:0/1906742732 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7b480b6350 msgr2=0x7f7b4814e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:21.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4d0b4700 1 --2- 172.21.2.102:0/1906742732 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7b480b6350 0x7f7b4814e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:21.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4d0b4700 1 -- 172.21.2.102:0/1906742732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b481472a0 con 0x7f7b48067720 2021-02-12T17:21:21.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b4d0b4700 1 --2- 172.21.2.102:0/1906742732 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b48067720 0x7f7b4814df10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f7b3c0096b0 tx=0x7f7b3c006dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:21.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.928+0000 7f7b397fa700 1 -- 172.21.2.102:0/1906742732 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c00d500 con 0x7f7b48067720 2021-02-12T17:21:21.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.929+0000 7f7b397fa700 1 -- 172.21.2.102:0/1906742732 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c00d680 con 0x7f7b48067720 2021-02-12T17:21:21.932 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.929+0000 7f7b397fa700 1 -- 172.21.2.102:0/1906742732 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c00da40 con 0x7f7b48067720 2021-02-12T17:21:21.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.929+0000 7f7b4f318700 1 -- 172.21.2.102:0/1906742732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b48147540 con 0x7f7b48067720 2021-02-12T17:21:21.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.929+0000 7f7b4f318700 1 -- 172.21.2.102:0/1906742732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b48149950 con 0x7f7b48067720 2021-02-12T17:21:21.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.929+0000 7f7b4f318700 1 -- 172.21.2.102:0/1906742732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b48149c00 con 0x7f7b48067720 2021-02-12T17:21:21.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.930+0000 7f7b397fa700 1 -- 172.21.2.102:0/1906742732 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f7b3c012420 con 0x7f7b48067720 2021-02-12T17:21:21.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.930+0000 7f7b397fa700 1 --2- 172.21.2.102:0/1906742732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b28059d60 0x7f7b2805c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:21.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.930+0000 7f7b397fa700 1 -- 172.21.2.102:0/1906742732 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7365+0+0 (secure 0 0 0) 0x7f7b3c073d70 con 0x7f7b48067720 2021-02-12T17:21:21.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.930+0000 7f7b4c8b3700 1 --2- 172.21.2.102:0/1906742732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b28059d60 0x7f7b2805c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:21.933 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.930+0000 7f7b4c8b3700 1 --2- 172.21.2.102:0/1906742732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b28059d60 0x7f7b2805c220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f7b48148870 tx=0x7f7b440069a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:21.934 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:21.933+0000 7f7b397fa700 1 -- 172.21.2.102:0/1906742732 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f7b3c04ad70 con 0x7f7b48067720 2021-02-12T17:21:22.092 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.091+0000 7f7b4f318700 1 -- 172.21.2.102:0/1906742732 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b481476d0 con 0x7f7b48067720 2021-02-12T17:21:22.093 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.092+0000 7f7b397fa700 1 -- 172.21.2.102:0/1906742732 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3402 (secure 0 0 0) 0x7f7b3c00ddb0 con 0x7f7b48067720 2021-02-12T17:21:22.093 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:22.093 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:21.317790+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:replay","state_seq":2,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:22.093 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.093+0000 7f7b4f318700 1 -- 172.21.2.102:0/1906742732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b28059d60 msgr2=0x7f7b2805c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:22.094 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.093+0000 7f7b4f318700 1 --2- 172.21.2.102:0/1906742732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b28059d60 0x7f7b2805c220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f7b48148870 tx=0x7f7b440069a0).stop 2021-02-12T17:21:22.094 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.093+0000 7f7b4f318700 1 -- 172.21.2.102:0/1906742732 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b48067720 msgr2=0x7f7b4814df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:22.094 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.093+0000 7f7b4f318700 1 --2- 172.21.2.102:0/1906742732 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b48067720 0x7f7b4814df10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f7b3c0096b0 tx=0x7f7b3c006dd0).stop 2021-02-12T17:21:22.094 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.093+0000 7f7b4f318700 1 -- 172.21.2.102:0/1906742732 shutdown_connections 2021-02-12T17:21:22.094 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.093+0000 7f7b4f318700 1 --2- 172.21.2.102:0/1906742732 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7b48144ea0 0x7f7b48142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.093+0000 7f7b4f318700 1 --2- 172.21.2.102:0/1906742732 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7b28059d60 0x7f7b2805c220 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.093+0000 7f7b4f318700 1 --2- 172.21.2.102:0/1906742732 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7b48067720 0x7f7b4814df10 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.093+0000 7f7b4f318700 1 --2- 172.21.2.102:0/1906742732 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f7b480b6350 0x7f7b4814e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.093+0000 7f7b4f318700 1 -- 172.21.2.102:0/1906742732 >> 172.21.2.102:0/1906742732 conn(0x7f7b480bc480 msgr2=0x7f7b481462c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.093+0000 7f7b4f318700 1 -- 172.21.2.102:0/1906742732 shutdown_connections 2021-02-12T17:21:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.093+0000 7f7b4f318700 1 -- 172.21.2.102:0/1906742732 wait complete. 2021-02-12T17:21:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 36 2021-02-12T17:21:22.103 INFO:tasks.mds_thrash.fs.[a]:mds.d down, removed from mdsmap 2021-02-12T17:21:22.103 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2021-02-12T17:21:22.103 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:22.191 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.190+0000 7f9fa1b3f700 1 Processor -- start 2021-02-12T17:21:22.191 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.190+0000 7f9fa1b3f700 1 -- start start 2021-02-12T17:21:22.193 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.191+0000 7f9fa1b3f700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f9f9c149af0 0x7f9f9c149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:22.193 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.191+0000 7f9fa1b3f700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f9f9c147f40 0x7f9f9c14a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:22.193 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.191+0000 7f9fa1b3f700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c068550 con 0x7f9f9c0b8bd0 2021-02-12T17:21:22.193 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.191+0000 7f9fa1b3f700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9c067630 con 0x7f9f9c149af0 2021-02-12T17:21:22.194 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.191+0000 7f9fa1b3f700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9c0678d0 con 0x7f9f9c147f40 2021-02-12T17:21:22.194 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.191+0000 7f9f9affd700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f9f9c0b8bd0 0x7f9f9c147830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55894/0 (socket says 172.21.2.102:55894) 2021-02-12T17:21:22.194 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.191+0000 7f9f9affd700 1 -- 172.21.2.102:0/2575613024 learned_addr learned my addr 172.21.2.102:0/2575613024 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:21:22.194 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.191+0000 7f9f9b7fe700 1 --2- 172.21.2.102:0/2575613024 >> v2:172.21.2.102:3300/0 conn(0x7f9f9c149af0 0x7f9f9c149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:22.194 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.191+0000 7f9f9b7fe700 1 -- 172.21.2.102:0/2575613024 >> v2:172.21.2.104:3300/0 conn(0x7f9f9c147f40 msgr2=0x7f9f9c14a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:22.194 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.191+0000 7f9f9b7fe700 1 --2- 172.21.2.102:0/2575613024 >> v2:172.21.2.104:3300/0 conn(0x7f9f9c147f40 0x7f9f9c14a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:22.194 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.191+0000 7f9f9b7fe700 1 -- 172.21.2.102:0/2575613024 >> v1:172.21.2.102:6789/0 conn(0x7f9f9c0b8bd0 legacy=0x7f9f9c147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:22.194 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.191+0000 7f9f9b7fe700 1 -- 172.21.2.102:0/2575613024 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c067b70 con 0x7f9f9c149af0 2021-02-12T17:21:22.194 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.191+0000 7f9f9a7fc700 1 -- 172.21.2.102:0/2575613024 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332926350 0 0) 0x7f9f9c068550 con 0x7f9f9c0b8bd0 2021-02-12T17:21:22.194 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.192+0000 7f9f9b7fe700 1 --2- 172.21.2.102:0/2575613024 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9f9c149af0 0x7f9f9c149ed0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f9f9c064720 tx=0x7f9f8c006de0).ready entity=mon.0 client_cookie=72c6705cb8ddcfdc server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:22.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.192+0000 7f9f9a7fc700 1 -- 172.21.2.102:0/2575613024 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c009870 con 0x7f9f9c149af0 2021-02-12T17:21:22.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.192+0000 7f9f9a7fc700 1 -- 172.21.2.102:0/2575613024 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c0099d0 con 0x7f9f9c149af0 2021-02-12T17:21:22.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.192+0000 7f9f9a7fc700 1 -- 172.21.2.102:0/2575613024 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c009d50 con 0x7f9f9c149af0 2021-02-12T17:21:22.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.192+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/2575613024 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9f9c149af0 msgr2=0x7f9f9c149ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:22.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.192+0000 7f9fa1b3f700 1 --2- 172.21.2.102:0/2575613024 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9f9c149af0 0x7f9f9c149ed0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f9f9c064720 tx=0x7f9f8c006de0).stop 2021-02-12T17:21:22.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.192+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/2575613024 shutdown_connections 2021-02-12T17:21:22.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.192+0000 7f9fa1b3f700 1 --2- 172.21.2.102:0/2575613024 >> v2:172.21.2.104:3300/0 conn(0x7f9f9c147f40 0x7f9f9c14a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:22.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.192+0000 7f9fa1b3f700 1 --2- 172.21.2.102:0/2575613024 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9f9c149af0 0x7f9f9c149ed0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:22.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.192+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/2575613024 >> 172.21.2.102:0/2575613024 conn(0x7f9f9c0bc480 msgr2=0x7f9f9c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:22.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.192+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/2575613024 shutdown_connections 2021-02-12T17:21:22.195 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.192+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/2575613024 wait complete. 2021-02-12T17:21:22.197 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.193+0000 7f9fa1b3f700 1 Processor -- start 2021-02-12T17:21:22.197 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.193+0000 7f9fa1b3f700 1 -- start start 2021-02-12T17:21:22.197 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.193+0000 7f9fa1b3f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9f9c0b8bd0 0x7f9f9c0b7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:22.197 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.193+0000 7f9fa1b3f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9f9c147f40 0x7f9f9c14f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:22.198 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.193+0000 7f9fa1b3f700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9f9c149af0 0x7f9f9c158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:22.198 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.193+0000 7f9fa1b3f700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0627b0 con 0x7f9f9c147f40 2021-02-12T17:21:22.198 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.193+0000 7f9fa1b3f700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c062a50 con 0x7f9f9c149af0 2021-02-12T17:21:22.198 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.193+0000 7f9fa1b3f700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c062cf0 con 0x7f9f9c0b8bd0 2021-02-12T17:21:22.198 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.194+0000 7f9f9affd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9f9c147f40 0x7f9f9c14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:22.198 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.194+0000 7f9f9affd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9f9c147f40 0x7f9f9c14f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47256/0 (socket says 172.21.2.102:47256) 2021-02-12T17:21:22.198 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.194+0000 7f9f9affd700 1 -- 172.21.2.102:0/1202605015 learned_addr learned my addr 172.21.2.102:0/1202605015 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:22.198 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.194+0000 7f9f9affd700 1 -- 172.21.2.102:0/1202605015 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9f9c0b8bd0 msgr2=0x7f9f9c0b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:22.198 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.194+0000 7f9f9affd700 1 --2- 172.21.2.102:0/1202605015 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9f9c0b8bd0 0x7f9f9c0b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:22.198 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.194+0000 7f9f9affd700 1 -- 172.21.2.102:0/1202605015 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9f9c149af0 msgr2=0x7f9f9c158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:22.198 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.194+0000 7f9f9affd700 1 --2- 172.21.2.102:0/1202605015 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9f9c149af0 0x7f9f9c158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:22.198 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.194+0000 7f9f9affd700 1 -- 172.21.2.102:0/1202605015 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c0b6df0 con 0x7f9f9c147f40 2021-02-12T17:21:22.199 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.194+0000 7f9f9affd700 1 --2- 172.21.2.102:0/1202605015 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9f9c147f40 0x7f9f9c14f870 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f9f8400c760 tx=0x7f9f84007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:22.199 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.194+0000 7f9f937fe700 1 -- 172.21.2.102:0/1202605015 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84007320 con 0x7f9f9c147f40 2021-02-12T17:21:22.199 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.194+0000 7f9f937fe700 1 -- 172.21.2.102:0/1202605015 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84007480 con 0x7f9f9c147f40 2021-02-12T17:21:22.199 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.194+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/1202605015 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c0b7090 con 0x7f9f9c147f40 2021-02-12T17:21:22.199 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.194+0000 7f9f937fe700 1 -- 172.21.2.102:0/1202605015 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840057f0 con 0x7f9f9c147f40 2021-02-12T17:21:22.199 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.194+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/1202605015 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c062430 con 0x7f9f9c147f40 2021-02-12T17:21:22.199 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.195+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/1202605015 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c0b7220 con 0x7f9f9c147f40 2021-02-12T17:21:22.199 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.195+0000 7f9f937fe700 1 -- 172.21.2.102:0/1202605015 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f9f84010030 con 0x7f9f9c147f40 2021-02-12T17:21:22.199 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.195+0000 7f9f937fe700 1 --2- 172.21.2.102:0/1202605015 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9f80059d30 0x7f9f8005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:22.199 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.195+0000 7f9f937fe700 1 -- 172.21.2.102:0/1202605015 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7365+0+0 (secure 0 0 0) 0x7f9f84073b50 con 0x7f9f9c147f40 2021-02-12T17:21:22.199 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.195+0000 7f9f9b7fe700 1 --2- 172.21.2.102:0/1202605015 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9f80059d30 0x7f9f8005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:22.199 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.195+0000 7f9f9b7fe700 1 --2- 172.21.2.102:0/1202605015 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9f80059d30 0x7f9f8005c1f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f9f8c006e20 tx=0x7f9f8c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:22.200 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.198+0000 7f9f937fe700 1 -- 172.21.2.102:0/1202605015 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f9f84047180 con 0x7f9f9c147f40 2021-02-12T17:21:22.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.358+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/1202605015 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f9c045460 con 0x7f9f9c147f40 2021-02-12T17:21:22.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.358+0000 7f9f937fe700 1 -- 172.21.2.102:0/1202605015 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3402 (secure 0 0 0) 0x7f9f8404a7a0 con 0x7f9f9c147f40 2021-02-12T17:21:22.360 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:22.360 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:21.317790+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:replay","state_seq":2,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:22.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.359+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/1202605015 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9f80059d30 msgr2=0x7f9f8005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:22.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.359+0000 7f9fa1b3f700 1 --2- 172.21.2.102:0/1202605015 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9f80059d30 0x7f9f8005c1f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f9f8c006e20 tx=0x7f9f8c016000).stop 2021-02-12T17:21:22.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.359+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/1202605015 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9f9c147f40 msgr2=0x7f9f9c14f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:22.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.359+0000 7f9fa1b3f700 1 --2- 172.21.2.102:0/1202605015 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9f9c147f40 0x7f9f9c14f870 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f9f8400c760 tx=0x7f9f84007ca0).stop 2021-02-12T17:21:22.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.360+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/1202605015 shutdown_connections 2021-02-12T17:21:22.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.360+0000 7f9fa1b3f700 1 --2- 172.21.2.102:0/1202605015 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9f9c149af0 0x7f9f9c158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:22.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.360+0000 7f9fa1b3f700 1 --2- 172.21.2.102:0/1202605015 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9f9c0b8bd0 0x7f9f9c0b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:22.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.360+0000 7f9fa1b3f700 1 --2- 172.21.2.102:0/1202605015 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9f80059d30 0x7f9f8005c1f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:22.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.360+0000 7f9fa1b3f700 1 --2- 172.21.2.102:0/1202605015 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9f9c147f40 0x7f9f9c14f870 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:22.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.360+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/1202605015 >> 172.21.2.102:0/1202605015 conn(0x7f9f9c0bc480 msgr2=0x7f9f9c0b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:22.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.360+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/1202605015 shutdown_connections 2021-02-12T17:21:22.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:22.360+0000 7f9fa1b3f700 1 -- 172.21.2.102:0/1202605015 wait complete. 2021-02-12T17:21:22.362 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 36 2021-02-12T17:21:22.369 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 36, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:01.991560+0000", "damaged": [], "data_pools": [ 4 ], "enabled": true, "epoch": 36, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "a", "in": [ 0 ], "info": { "gid_5451": { "addr": "172.21.2.102:6837/2121955587", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6836", "nonce": 2121955587, "type": "v2" }, { "addr": "172.21.2.102:6837", "nonce": 2121955587, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5451, "incarnation": 36, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:replay", "state_seq": 2 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2021-02-12T17:21:21.317790+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5451 } } }, { "id": 2, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:08.529588+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 29, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "b", "in": [ 0 ], "info": { "gid_5280": { "addr": "172.21.2.102:6835/277624455", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6834", "nonce": 277624455, "type": "v2" }, { "addr": "172.21.2.102:6835", "nonce": 277624455, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5280, "incarnation": 26, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 7 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 5, "modified": "2021-02-12T17:20:09.310778+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5280 } } } ], "standbys": [ { "addr": "172.21.2.104:6834/3149030842", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6832", "nonce": 3149030842, "type": "v2" }, { "addr": "172.21.2.104:6834", "nonce": 3149030842, "type": "v1" } ] }, "epoch": 5, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4243, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 2 } ] } 2021-02-12T17:21:24.371 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:24.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.459+0000 7fb61e7b0700 1 Processor -- start 2021-02-12T17:21:24.460 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.459+0000 7fb61e7b0700 1 -- start start 2021-02-12T17:21:24.462 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.460+0000 7fb61e7b0700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb6180b8d20 0x7fb618068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:24.462 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.460+0000 7fb61e7b0700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fb61814e530 0x7fb6180b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:24.462 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.460+0000 7fb61e7b0700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6180622a0 con 0x7fb618062740 2021-02-12T17:21:24.462 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.460+0000 7fb61e7b0700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb618068d20 con 0x7fb6180b8d20 2021-02-12T17:21:24.462 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.460+0000 7fb61e7b0700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61814ea10 con 0x7fb61814e530 2021-02-12T17:21:24.462 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.460+0000 7fb617fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb6180b8d20 0x7fb618068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:24.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.460+0000 7fb617fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb6180b8d20 0x7fb618068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47266/0 (socket says 172.21.2.102:47266) 2021-02-12T17:21:24.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.460+0000 7fb617fff700 1 -- 172.21.2.102:0/34267882 learned_addr learned my addr 172.21.2.102:0/34267882 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:24.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.460+0000 7fb617fff700 1 -- 172.21.2.102:0/34267882 >> v2:172.21.2.104:3300/0 conn(0x7fb61814e530 msgr2=0x7fb6180b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:24.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.460+0000 7fb617fff700 1 --2- 172.21.2.102:0/34267882 >> v2:172.21.2.104:3300/0 conn(0x7fb61814e530 0x7fb6180b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:24.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.460+0000 7fb617fff700 1 -- 172.21.2.102:0/34267882 >> v1:172.21.2.104:6789/0 conn(0x7fb618062740 legacy=0x7fb618062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:24.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.460+0000 7fb617fff700 1 -- 172.21.2.102:0/34267882 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6180b63f0 con 0x7fb6180b8d20 2021-02-12T17:21:24.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.460+0000 7fb617fff700 1 --2- 172.21.2.102:0/34267882 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb6180b8d20 0x7fb618068830 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fb6180654b0 tx=0x7fb608006ea0).ready entity=mon.0 client_cookie=658a0f4a7fbd3b6f server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:24.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.461+0000 7fb616ffd700 1 -- 172.21.2.102:0/34267882 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608009800 con 0x7fb6180b8d20 2021-02-12T17:21:24.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.461+0000 7fb616ffd700 1 -- 172.21.2.102:0/34267882 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb608009960 con 0x7fb6180b8d20 2021-02-12T17:21:24.463 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.461+0000 7fb616ffd700 1 -- 172.21.2.102:0/34267882 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608009ce0 con 0x7fb6180b8d20 2021-02-12T17:21:24.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.461+0000 7fb61e7b0700 1 -- 172.21.2.102:0/34267882 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb6180b8d20 msgr2=0x7fb618068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:24.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.461+0000 7fb61e7b0700 1 --2- 172.21.2.102:0/34267882 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb6180b8d20 0x7fb618068830 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fb6180654b0 tx=0x7fb608006ea0).stop 2021-02-12T17:21:24.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.461+0000 7fb61e7b0700 1 -- 172.21.2.102:0/34267882 shutdown_connections 2021-02-12T17:21:24.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.461+0000 7fb61e7b0700 1 --2- 172.21.2.102:0/34267882 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb6180b8d20 0x7fb618068830 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:24.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.461+0000 7fb61e7b0700 1 --2- 172.21.2.102:0/34267882 >> v2:172.21.2.104:3300/0 conn(0x7fb61814e530 0x7fb6180b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:24.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.461+0000 7fb61e7b0700 1 -- 172.21.2.102:0/34267882 >> 172.21.2.102:0/34267882 conn(0x7fb6180bc480 msgr2=0x7fb6180b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:24.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.461+0000 7fb61e7b0700 1 -- 172.21.2.102:0/34267882 shutdown_connections 2021-02-12T17:21:24.464 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.461+0000 7fb61e7b0700 1 -- 172.21.2.102:0/34267882 wait complete. 2021-02-12T17:21:24.466 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.462+0000 7fb61e7b0700 1 Processor -- start 2021-02-12T17:21:24.466 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.462+0000 7fb61e7b0700 1 -- start start 2021-02-12T17:21:24.466 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb61e7b0700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb618062740 0x7fb6180ba240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:24.466 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb61e7b0700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb6180b8d20 0x7fb6180b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:24.466 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb61e7b0700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb61814e530 0x7fb6180b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:24.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb61e7b0700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61815d800 con 0x7fb61814e530 2021-02-12T17:21:24.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb61e7b0700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6180b0c10 con 0x7fb618062740 2021-02-12T17:21:24.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb61e7b0700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61815d9f0 con 0x7fb6180b8d20 2021-02-12T17:21:24.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb61cd4d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb61814e530 0x7fb6180b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:24.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb61cd4d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb61814e530 0x7fb6180b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47276/0 (socket says 172.21.2.102:47276) 2021-02-12T17:21:24.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb61cd4d700 1 -- 172.21.2.102:0/518670501 learned_addr learned my addr 172.21.2.102:0/518670501 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:24.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb617fff700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb618062740 0x7fb6180ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:24.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb6177fe700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb6180b8d20 0x7fb6180b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:24.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb61cd4d700 1 -- 172.21.2.102:0/518670501 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb6180b8d20 msgr2=0x7fb6180b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:24.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb61cd4d700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb6180b8d20 0x7fb6180b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:24.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb61cd4d700 1 -- 172.21.2.102:0/518670501 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb618062740 msgr2=0x7fb6180ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:24.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb61cd4d700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb618062740 0x7fb6180ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:24.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb61cd4d700 1 -- 172.21.2.102:0/518670501 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61815dc90 con 0x7fb61814e530 2021-02-12T17:21:24.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.463+0000 7fb6177fe700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb6180b8d20 0x7fb6180b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:21:24.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.464+0000 7fb61cd4d700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb61814e530 0x7fb6180b4140 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fb61000bae0 tx=0x7fb6100091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:24.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.464+0000 7fb60ffff700 1 -- 172.21.2.102:0/518670501 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61000c880 con 0x7fb61814e530 2021-02-12T17:21:24.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.464+0000 7fb60ffff700 1 -- 172.21.2.102:0/518670501 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61000ca20 con 0x7fb61814e530 2021-02-12T17:21:24.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.464+0000 7fb61e7b0700 1 -- 172.21.2.102:0/518670501 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61815df30 con 0x7fb61814e530 2021-02-12T17:21:24.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.464+0000 7fb60ffff700 1 -- 172.21.2.102:0/518670501 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61000cbd0 con 0x7fb61814e530 2021-02-12T17:21:24.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.464+0000 7fb61e7b0700 1 -- 172.21.2.102:0/518670501 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61815e670 con 0x7fb61814e530 2021-02-12T17:21:24.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.465+0000 7fb61e7b0700 1 -- 172.21.2.102:0/518670501 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb618045460 con 0x7fb61814e530 2021-02-12T17:21:24.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.465+0000 7fb60ffff700 1 -- 172.21.2.102:0/518670501 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fb61001c070 con 0x7fb61814e530 2021-02-12T17:21:24.469 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.465+0000 7fb60ffff700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb5fc059d80 0x7fb5fc05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:24.469 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.465+0000 7fb60ffff700 1 -- 172.21.2.102:0/518670501 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7365+0+0 (secure 0 0 0) 0x7fb6100736b0 con 0x7fb61814e530 2021-02-12T17:21:24.469 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.465+0000 7fb617fff700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb5fc059d80 0x7fb5fc05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:24.469 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.466+0000 7fb617fff700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb5fc059d80 0x7fb5fc05c240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fb608006ee0 tx=0x7fb608016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:24.469 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.468+0000 7fb60ffff700 1 -- 172.21.2.102:0/518670501 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fb610046c50 con 0x7fb61814e530 2021-02-12T17:21:24.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.635+0000 7fb61e7b0700 1 -- 172.21.2.102:0/518670501 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb618063670 con 0x7fb61814e530 2021-02-12T17:21:24.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.636+0000 7fb60ffff700 1 -- 172.21.2.102:0/518670501 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+3403 (secure 0 0 0) 0x7fb61004a270 con 0x7fb61814e530 2021-02-12T17:21:24.637 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:24.637 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.637+0000 7fb61e7b0700 1 -- 172.21.2.102:0/518670501 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb5fc059d80 msgr2=0x7fb5fc05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.637+0000 7fb61e7b0700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb5fc059d80 0x7fb5fc05c240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fb608006ee0 tx=0x7fb608016000).stop 2021-02-12T17:21:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.637+0000 7fb61e7b0700 1 -- 172.21.2.102:0/518670501 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb61814e530 msgr2=0x7fb6180b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.637+0000 7fb61e7b0700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb61814e530 0x7fb6180b4140 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fb61000bae0 tx=0x7fb6100091a0).stop 2021-02-12T17:21:24.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.637+0000 7fb61e7b0700 1 -- 172.21.2.102:0/518670501 shutdown_connections 2021-02-12T17:21:24.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.637+0000 7fb61e7b0700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb5fc059d80 0x7fb5fc05c240 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:24.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.637+0000 7fb61e7b0700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb61814e530 0x7fb6180b4140 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:24.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.637+0000 7fb61e7b0700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb618062740 0x7fb6180ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:24.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.637+0000 7fb61e7b0700 1 --2- 172.21.2.102:0/518670501 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb6180b8d20 0x7fb6180b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.637+0000 7fb61e7b0700 1 -- 172.21.2.102:0/518670501 >> 172.21.2.102:0/518670501 conn(0x7fb6180bc480 msgr2=0x7fb618062bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.637+0000 7fb61e7b0700 1 -- 172.21.2.102:0/518670501 shutdown_connections 2021-02-12T17:21:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:24.637+0000 7fb61e7b0700 1 -- 172.21.2.102:0/518670501 wait complete. 2021-02-12T17:21:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 39 2021-02-12T17:21:24.647 INFO:tasks.mds_thrash.fs.[a]:mds.c has gained rank=0, replacing gid=4744 2021-02-12T17:21:24.647 INFO:tasks.mds_thrash.fs.[a]:waiting for 1 secs before reviving mds.d 2021-02-12T17:21:25.648 INFO:tasks.mds_thrash.fs.[a]:reviving mds.d 2021-02-12T17:21:25.648 INFO:tasks.ceph.mds.d:Restarting daemon 2021-02-12T17:21:25.649 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2021-02-12T17:21:25.651 INFO:tasks.ceph.mds.d:Started 2021-02-12T17:21:25.652 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:25.706 INFO:tasks.ceph.mds.d.gibba004.stdout:starting mds.d at 2021-02-12T17:21:25.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.739+0000 7fa867908700 1 Processor -- start 2021-02-12T17:21:25.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.739+0000 7fa867908700 1 -- start start 2021-02-12T17:21:25.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.740+0000 7fa867908700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fa8600b8d20 0x7fa860068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:25.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.740+0000 7fa867908700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa86014e530 0x7fa8600b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:25.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.740+0000 7fa867908700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8600622a0 con 0x7fa860062740 2021-02-12T17:21:25.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.740+0000 7fa867908700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa860068d20 con 0x7fa86014e530 2021-02-12T17:21:25.742 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.740+0000 7fa867908700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86014ea10 con 0x7fa8600b8d20 2021-02-12T17:21:25.747 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.740+0000 7fa865ea5700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fa860062740 0x7fa860062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55926/0 (socket says 172.21.2.102:55926) 2021-02-12T17:21:25.747 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.740+0000 7fa865ea5700 1 -- 172.21.2.102:0/2259461763 learned_addr learned my addr 172.21.2.102:0/2259461763 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:21:25.747 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.740+0000 7fa864ea3700 1 --2- 172.21.2.102:0/2259461763 >> v2:172.21.2.102:3300/0 conn(0x7fa86014e530 0x7fa8600b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:25.747 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.740+0000 7fa864ea3700 1 -- 172.21.2.102:0/2259461763 >> v2:172.21.2.104:3300/0 conn(0x7fa8600b8d20 msgr2=0x7fa860068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:25.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.740+0000 7fa864ea3700 1 --2- 172.21.2.102:0/2259461763 >> v2:172.21.2.104:3300/0 conn(0x7fa8600b8d20 0x7fa860068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:25.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.740+0000 7fa864ea3700 1 -- 172.21.2.102:0/2259461763 >> v1:172.21.2.102:6789/0 conn(0x7fa860062740 legacy=0x7fa860062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:25.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.740+0000 7fa853fff700 1 -- 172.21.2.102:0/2259461763 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069090080 0 0) 0x7fa8600622a0 con 0x7fa860062740 2021-02-12T17:21:25.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.740+0000 7fa864ea3700 1 -- 172.21.2.102:0/2259461763 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600b63f0 con 0x7fa86014e530 2021-02-12T17:21:25.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.741+0000 7fa864ea3700 1 --2- 172.21.2.102:0/2259461763 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa86014e530 0x7fa8600b7250 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fa86006abc0 tx=0x7fa85c006de0).ready entity=mon.0 client_cookie=94a97d353412f600 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:25.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.741+0000 7fa853fff700 1 -- 172.21.2.102:0/2259461763 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0097e0 con 0x7fa86014e530 2021-02-12T17:21:25.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.741+0000 7fa853fff700 1 -- 172.21.2.102:0/2259461763 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85c009940 con 0x7fa86014e530 2021-02-12T17:21:25.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.741+0000 7fa853fff700 1 -- 172.21.2.102:0/2259461763 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c009cc0 con 0x7fa86014e530 2021-02-12T17:21:25.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.741+0000 7fa867908700 1 -- 172.21.2.102:0/2259461763 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa86014e530 msgr2=0x7fa8600b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:25.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.741+0000 7fa867908700 1 --2- 172.21.2.102:0/2259461763 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa86014e530 0x7fa8600b7250 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fa86006abc0 tx=0x7fa85c006de0).stop 2021-02-12T17:21:25.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.741+0000 7fa867908700 1 -- 172.21.2.102:0/2259461763 shutdown_connections 2021-02-12T17:21:25.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.741+0000 7fa867908700 1 --2- 172.21.2.102:0/2259461763 >> v2:172.21.2.104:3300/0 conn(0x7fa8600b8d20 0x7fa860068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:25.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.741+0000 7fa867908700 1 --2- 172.21.2.102:0/2259461763 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa86014e530 0x7fa8600b7250 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:25.750 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.741+0000 7fa867908700 1 -- 172.21.2.102:0/2259461763 >> 172.21.2.102:0/2259461763 conn(0x7fa8600bc480 msgr2=0x7fa8600b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:25.750 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.741+0000 7fa867908700 1 -- 172.21.2.102:0/2259461763 shutdown_connections 2021-02-12T17:21:25.750 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.741+0000 7fa867908700 1 -- 172.21.2.102:0/2259461763 wait complete. 2021-02-12T17:21:25.750 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.742+0000 7fa867908700 1 Processor -- start 2021-02-12T17:21:25.750 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.742+0000 7fa867908700 1 -- start start 2021-02-12T17:21:25.750 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa867908700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa860062740 0x7fa86014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:25.750 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa867908700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa8600b8d20 0x7fa8600b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:25.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa867908700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa86014e530 0x7fa8600b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:25.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa867908700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600b2aa0 con 0x7fa860062740 2021-02-12T17:21:25.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa867908700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86014feb0 con 0x7fa8600b8d20 2021-02-12T17:21:25.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa867908700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86015e3c0 con 0x7fa86014e530 2021-02-12T17:21:25.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa8656a4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa860062740 0x7fa86014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:25.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa8656a4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa860062740 0x7fa86014f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47288/0 (socket says 172.21.2.102:47288) 2021-02-12T17:21:25.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa8656a4700 1 -- 172.21.2.102:0/230455635 learned_addr learned my addr 172.21.2.102:0/230455635 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:25.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa8656a4700 1 -- 172.21.2.102:0/230455635 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa86014e530 msgr2=0x7fa8600b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:25.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa8656a4700 1 --2- 172.21.2.102:0/230455635 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa86014e530 0x7fa8600b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:25.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa8656a4700 1 -- 172.21.2.102:0/230455635 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa8600b8d20 msgr2=0x7fa8600b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:25.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa8656a4700 1 --2- 172.21.2.102:0/230455635 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa8600b8d20 0x7fa8600b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:25.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa8656a4700 1 -- 172.21.2.102:0/230455635 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600b3060 con 0x7fa860062740 2021-02-12T17:21:25.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.743+0000 7fa8656a4700 1 --2- 172.21.2.102:0/230455635 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa860062740 0x7fa86014f9c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fa854009790 tx=0x7fa854006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:25.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.744+0000 7fa8517fa700 1 -- 172.21.2.102:0/230455635 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85400d5a0 con 0x7fa860062740 2021-02-12T17:21:25.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.744+0000 7fa867908700 1 -- 172.21.2.102:0/230455635 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8600b3300 con 0x7fa860062740 2021-02-12T17:21:25.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.744+0000 7fa867908700 1 -- 172.21.2.102:0/230455635 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86015e070 con 0x7fa860062740 2021-02-12T17:21:25.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.744+0000 7fa8517fa700 1 -- 172.21.2.102:0/230455635 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa854000e90 con 0x7fa860062740 2021-02-12T17:21:25.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.744+0000 7fa8517fa700 1 -- 172.21.2.102:0/230455635 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85400d950 con 0x7fa860062740 2021-02-12T17:21:25.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.744+0000 7fa867908700 1 -- 172.21.2.102:0/230455635 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa838004f60 con 0x7fa860062740 2021-02-12T17:21:25.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.745+0000 7fa8517fa700 1 -- 172.21.2.102:0/230455635 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fa854017030 con 0x7fa860062740 2021-02-12T17:21:25.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.745+0000 7fa8517fa700 1 --2- 172.21.2.102:0/230455635 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa840059d30 0x7fa84005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:25.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.745+0000 7fa8517fa700 1 -- 172.21.2.102:0/230455635 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7365+0+0 (secure 0 0 0) 0x7fa8540730f0 con 0x7fa860062740 2021-02-12T17:21:25.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.745+0000 7fa864ea3700 1 --2- 172.21.2.102:0/230455635 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa840059d30 0x7fa84005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:25.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.745+0000 7fa864ea3700 1 --2- 172.21.2.102:0/230455635 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa840059d30 0x7fa84005c1f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fa8600b2840 tx=0x7fa85c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:25.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.748+0000 7fa8517fa700 1 -- 172.21.2.102:0/230455635 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fa85404a1a0 con 0x7fa860062740 2021-02-12T17:21:25.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.908+0000 7fa867908700 1 -- 172.21.2.102:0/230455635 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa838005790 con 0x7fa860062740 2021-02-12T17:21:25.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.908+0000 7fa8517fa700 1 -- 172.21.2.102:0/230455635 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+3403 (secure 0 0 0) 0x7fa854049d90 con 0x7fa860062740 2021-02-12T17:21:25.909 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:25.909 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:25.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.909+0000 7fa867908700 1 -- 172.21.2.102:0/230455635 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa840059d30 msgr2=0x7fa84005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:25.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.909+0000 7fa867908700 1 --2- 172.21.2.102:0/230455635 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa840059d30 0x7fa84005c1f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fa8600b2840 tx=0x7fa85c016000).stop 2021-02-12T17:21:25.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.909+0000 7fa867908700 1 -- 172.21.2.102:0/230455635 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa860062740 msgr2=0x7fa86014f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:25.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.909+0000 7fa867908700 1 --2- 172.21.2.102:0/230455635 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa860062740 0x7fa86014f9c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fa854009790 tx=0x7fa854006eb0).stop 2021-02-12T17:21:25.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.909+0000 7fa867908700 1 -- 172.21.2.102:0/230455635 shutdown_connections 2021-02-12T17:21:25.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.909+0000 7fa867908700 1 --2- 172.21.2.102:0/230455635 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa86014e530 0x7fa8600b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:25.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.909+0000 7fa867908700 1 --2- 172.21.2.102:0/230455635 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa840059d30 0x7fa84005c1f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:25.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.909+0000 7fa867908700 1 --2- 172.21.2.102:0/230455635 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa860062740 0x7fa86014f9c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:25.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.909+0000 7fa867908700 1 --2- 172.21.2.102:0/230455635 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa8600b8d20 0x7fa8600b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:25.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.909+0000 7fa867908700 1 -- 172.21.2.102:0/230455635 >> 172.21.2.102:0/230455635 conn(0x7fa8600bc480 msgr2=0x7fa860153620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:25.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.910+0000 7fa867908700 1 -- 172.21.2.102:0/230455635 shutdown_connections 2021-02-12T17:21:25.911 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:25.910+0000 7fa867908700 1 -- 172.21.2.102:0/230455635 wait complete. 2021-02-12T17:21:25.912 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 39 2021-02-12T17:21:25.919 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2021-02-12T17:21:26.370 INFO:tasks.ceph.mds.c.gibba002.stderr:2021-02-12T17:21:26.369+0000 7f658ab66700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-02-12T17:21:27.920 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:28.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.009+0000 7f13969d0700 1 Processor -- start 2021-02-12T17:21:28.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.009+0000 7f13969d0700 1 -- start start 2021-02-12T17:21:28.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.009+0000 7f13969d0700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f13900b71a0 0x7f13900b7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:28.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.009+0000 7f13969d0700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f13900b12b0 0x7f1390150430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:28.011 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.009+0000 7f13969d0700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139009c410 con 0x7f1390150920 2021-02-12T17:21:28.011 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.009+0000 7f13969d0700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13900b22a0 con 0x7f13900b12b0 2021-02-12T17:21:28.011 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.009+0000 7f13969d0700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13900b2540 con 0x7f13900b71a0 2021-02-12T17:21:28.011 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.010+0000 7f13951cd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f13900b12b0 0x7f1390150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:28.011 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.010+0000 7f13961cf700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f1390150920 0x7f139009cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55940/0 (socket says 172.21.2.102:55940) 2021-02-12T17:21:28.011 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.010+0000 7f13961cf700 1 -- 172.21.2.102:0/2742525961 learned_addr learned my addr 172.21.2.102:0/2742525961 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:21:28.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.010+0000 7f13951cd700 1 -- 172.21.2.102:0/2742525961 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f13900b71a0 msgr2=0x7f13900b7580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:21:28.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.010+0000 7f13951cd700 1 --2- 172.21.2.102:0/2742525961 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f13900b71a0 0x7f13900b7580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:28.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.010+0000 7f13951cd700 1 -- 172.21.2.102:0/2742525961 >> v1:172.21.2.102:6789/0 conn(0x7f1390150920 legacy=0x7f139009cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:28.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.010+0000 7f13951cd700 1 -- 172.21.2.102:0/2742525961 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139009c640 con 0x7f13900b12b0 2021-02-12T17:21:28.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.010+0000 7f13951cd700 1 --2- 172.21.2.102:0/2742525961 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f13900b12b0 0x7f1390150430 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f138c00b980 tx=0x7f138c006de0).ready entity=mon.0 client_cookie=e0d4757f358dac77 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:28.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.010+0000 7f13949cc700 1 -- 172.21.2.102:0/2742525961 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c009870 con 0x7f13900b12b0 2021-02-12T17:21:28.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.010+0000 7f13949cc700 1 -- 172.21.2.102:0/2742525961 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c0099d0 con 0x7f13900b12b0 2021-02-12T17:21:28.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.010+0000 7f13949cc700 1 -- 172.21.2.102:0/2742525961 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c009d50 con 0x7f13900b12b0 2021-02-12T17:21:28.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.011+0000 7f13969d0700 1 -- 172.21.2.102:0/2742525961 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f13900b12b0 msgr2=0x7f1390150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:28.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.011+0000 7f13969d0700 1 --2- 172.21.2.102:0/2742525961 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f13900b12b0 0x7f1390150430 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f138c00b980 tx=0x7f138c006de0).stop 2021-02-12T17:21:28.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.011+0000 7f13969d0700 1 -- 172.21.2.102:0/2742525961 shutdown_connections 2021-02-12T17:21:28.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.011+0000 7f13969d0700 1 --2- 172.21.2.102:0/2742525961 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f13900b71a0 0x7f13900b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:28.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.011+0000 7f13969d0700 1 --2- 172.21.2.102:0/2742525961 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f13900b12b0 0x7f1390150430 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:28.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.011+0000 7f13969d0700 1 -- 172.21.2.102:0/2742525961 >> 172.21.2.102:0/2742525961 conn(0x7f13900b8290 msgr2=0x7f13900b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:28.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.011+0000 7f13969d0700 1 -- 172.21.2.102:0/2742525961 shutdown_connections 2021-02-12T17:21:28.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.011+0000 7f13969d0700 1 -- 172.21.2.102:0/2742525961 wait complete. 2021-02-12T17:21:28.015 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.012+0000 7f13969d0700 1 Processor -- start 2021-02-12T17:21:28.015 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.012+0000 7f13969d0700 1 -- start start 2021-02-12T17:21:28.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.012+0000 7f13969d0700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f13900b12b0 0x7f1390067840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:28.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.012+0000 7f13969d0700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f13900b71a0 0x7f13900b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:28.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.012+0000 7f13969d0700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1390150920 0x7f139009fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:28.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.012+0000 7f13969d0700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13900b5550 con 0x7f1390150920 2021-02-12T17:21:28.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.012+0000 7f13969d0700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1390068730 con 0x7f13900b71a0 2021-02-12T17:21:28.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.012+0000 7f13969d0700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13900689d0 con 0x7f13900b12b0 2021-02-12T17:21:28.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f13961cf700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1390150920 0x7f139009fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:28.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f13961cf700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1390150920 0x7f139009fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47304/0 (socket says 172.21.2.102:47304) 2021-02-12T17:21:28.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f13961cf700 1 -- 172.21.2.102:0/2266815672 learned_addr learned my addr 172.21.2.102:0/2266815672 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:28.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f13959ce700 1 --2- 172.21.2.102:0/2266815672 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f13900b12b0 0x7f1390067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:28.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f13951cd700 1 --2- 172.21.2.102:0/2266815672 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f13900b71a0 0x7f13900b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:28.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f13961cf700 1 -- 172.21.2.102:0/2266815672 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f13900b12b0 msgr2=0x7f1390067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:28.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f13961cf700 1 --2- 172.21.2.102:0/2266815672 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f13900b12b0 0x7f1390067840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:28.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f13961cf700 1 -- 172.21.2.102:0/2266815672 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f13900b71a0 msgr2=0x7f13900b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:28.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f13961cf700 1 --2- 172.21.2.102:0/2266815672 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f13900b71a0 0x7f13900b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:28.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f13961cf700 1 -- 172.21.2.102:0/2266815672 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1390068c70 con 0x7f1390150920 2021-02-12T17:21:28.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f13961cf700 1 --2- 172.21.2.102:0/2266815672 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1390150920 0x7f139009fab0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f138800ca90 tx=0x7f1388001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:28.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f1381ffb700 1 -- 172.21.2.102:0/2266815672 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388005b70 con 0x7f1390150920 2021-02-12T17:21:28.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f1381ffb700 1 -- 172.21.2.102:0/2266815672 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1388005cd0 con 0x7f1390150920 2021-02-12T17:21:28.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f13969d0700 1 -- 172.21.2.102:0/2266815672 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13900b47f0 con 0x7f1390150920 2021-02-12T17:21:28.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f1381ffb700 1 -- 172.21.2.102:0/2266815672 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388007320 con 0x7f1390150920 2021-02-12T17:21:28.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.013+0000 7f13969d0700 1 -- 172.21.2.102:0/2266815672 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13900643d0 con 0x7f1390150920 2021-02-12T17:21:28.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.014+0000 7f13969d0700 1 -- 172.21.2.102:0/2266815672 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1390068560 con 0x7f1390150920 2021-02-12T17:21:28.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.014+0000 7f1381ffb700 1 -- 172.21.2.102:0/2266815672 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f1388010030 con 0x7f1390150920 2021-02-12T17:21:28.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.015+0000 7f1381ffb700 1 --2- 172.21.2.102:0/2266815672 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1370059d80 0x7f137005c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:28.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.015+0000 7f1381ffb700 1 -- 172.21.2.102:0/2266815672 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7365+0+0 (secure 0 0 0) 0x7f1388073e00 con 0x7f1390150920 2021-02-12T17:21:28.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.015+0000 7f13959ce700 1 --2- 172.21.2.102:0/2266815672 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1370059d80 0x7f137005c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:28.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.015+0000 7f13959ce700 1 --2- 172.21.2.102:0/2266815672 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1370059d80 0x7f137005c240 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f13900a1570 tx=0x7f1384008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:28.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.018+0000 7f1381ffb700 1 -- 172.21.2.102:0/2266815672 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f13880473a0 con 0x7f1390150920 2021-02-12T17:21:28.176 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.175+0000 7f13969d0700 1 -- 172.21.2.102:0/2266815672 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f139009f8b0 con 0x7f1390150920 2021-02-12T17:21:28.176 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.175+0000 7f1381ffb700 1 -- 172.21.2.102:0/2266815672 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3757 (secure 0 0 0) 0x7f138804a9c0 con 0x7f1390150920 2021-02-12T17:21:28.176 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:28.177 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34514,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":40}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:28.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.176+0000 7f13969d0700 1 -- 172.21.2.102:0/2266815672 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1370059d80 msgr2=0x7f137005c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:28.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.176+0000 7f13969d0700 1 --2- 172.21.2.102:0/2266815672 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1370059d80 0x7f137005c240 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f13900a1570 tx=0x7f1384008040).stop 2021-02-12T17:21:28.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.176+0000 7f13969d0700 1 -- 172.21.2.102:0/2266815672 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1390150920 msgr2=0x7f139009fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:28.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.176+0000 7f13969d0700 1 --2- 172.21.2.102:0/2266815672 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1390150920 0x7f139009fab0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f138800ca90 tx=0x7f1388001360).stop 2021-02-12T17:21:28.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.176+0000 7f13969d0700 1 -- 172.21.2.102:0/2266815672 shutdown_connections 2021-02-12T17:21:28.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.176+0000 7f13969d0700 1 --2- 172.21.2.102:0/2266815672 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1370059d80 0x7f137005c240 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0x7f13900a1570 tx=0x7f1384008040).stop 2021-02-12T17:21:28.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.176+0000 7f13969d0700 1 --2- 172.21.2.102:0/2266815672 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1390150920 0x7f139009fab0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:28.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.176+0000 7f13969d0700 1 --2- 172.21.2.102:0/2266815672 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f13900b12b0 0x7f1390067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:28.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.176+0000 7f13969d0700 1 --2- 172.21.2.102:0/2266815672 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f13900b71a0 0x7f13900b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:28.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.176+0000 7f13969d0700 1 -- 172.21.2.102:0/2266815672 >> 172.21.2.102:0/2266815672 conn(0x7f13900b8290 msgr2=0x7f13900b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:28.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.177+0000 7f13969d0700 1 -- 172.21.2.102:0/2266815672 shutdown_connections 2021-02-12T17:21:28.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:28.177+0000 7f13969d0700 1 -- 172.21.2.102:0/2266815672 wait complete. 2021-02-12T17:21:28.179 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 40 2021-02-12T17:21:28.186 INFO:tasks.mds_thrash.fs.[a]:mds.d reported in up:standby state 2021-02-12T17:21:28.186 INFO:tasks.mds_thrash.fs.[a]:waiting for 88 secs before thrashing 2021-02-12T17:21:40.042 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:40.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.130+0000 7f8845520700 1 Processor -- start 2021-02-12T17:21:40.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.130+0000 7f8845520700 1 -- start start 2021-02-12T17:21:40.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.130+0000 7f8845520700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f884014e530 0x7f8840068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:40.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.130+0000 7f8845520700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88400b7960 con 0x7f8840062740 2021-02-12T17:21:40.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.130+0000 7f8845520700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88400622a0 con 0x7f88400b8d20 2021-02-12T17:21:40.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.130+0000 7f8845520700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8840068d20 con 0x7f884014e530 2021-02-12T17:21:40.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.130+0000 7f883e7fc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f884014e530 0x7f8840068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:40.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.130+0000 7f883f7fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f8840062740 0x7f8840062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55966/0 (socket says 172.21.2.102:55966) 2021-02-12T17:21:40.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.130+0000 7f883f7fe700 1 -- 172.21.2.102:0/664038258 learned_addr learned my addr 172.21.2.102:0/664038258 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:21:40.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.131+0000 7f883e7fc700 1 -- 172.21.2.102:0/664038258 >> v1:172.21.2.104:6789/0 conn(0x7f88400b8d20 legacy=0x7f88400b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:21:40.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.131+0000 7f883e7fc700 1 -- 172.21.2.102:0/664038258 >> v1:172.21.2.102:6789/0 conn(0x7f8840062740 legacy=0x7f8840062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:40.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.131+0000 7f883e7fc700 1 -- 172.21.2.102:0/664038258 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884014ea10 con 0x7f884014e530 2021-02-12T17:21:40.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.131+0000 7f883e7fc700 1 --2- 172.21.2.102:0/664038258 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f884014e530 0x7f8840068830 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f882800b980 tx=0x7f8828006de0).ready entity=mon.0 client_cookie=39d7bc579dbe3812 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:40.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.131+0000 7f883dffb700 1 -- 172.21.2.102:0/664038258 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88280097a0 con 0x7f884014e530 2021-02-12T17:21:40.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.131+0000 7f883dffb700 1 -- 172.21.2.102:0/664038258 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8828009900 con 0x7f884014e530 2021-02-12T17:21:40.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.131+0000 7f883dffb700 1 -- 172.21.2.102:0/664038258 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828009c80 con 0x7f884014e530 2021-02-12T17:21:40.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.132+0000 7f8845520700 1 -- 172.21.2.102:0/664038258 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f884014e530 msgr2=0x7f8840068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:40.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.132+0000 7f8845520700 1 --2- 172.21.2.102:0/664038258 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f884014e530 0x7f8840068830 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f882800b980 tx=0x7f8828006de0).stop 2021-02-12T17:21:40.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.132+0000 7f8845520700 1 -- 172.21.2.102:0/664038258 shutdown_connections 2021-02-12T17:21:40.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.132+0000 7f8845520700 1 --2- 172.21.2.102:0/664038258 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f884014e530 0x7f8840068830 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:40.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.132+0000 7f8845520700 1 -- 172.21.2.102:0/664038258 >> 172.21.2.102:0/664038258 conn(0x7f88400bc480 msgr2=0x7f88400b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:40.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.132+0000 7f8845520700 1 -- 172.21.2.102:0/664038258 shutdown_connections 2021-02-12T17:21:40.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.132+0000 7f8845520700 1 -- 172.21.2.102:0/664038258 wait complete. 2021-02-12T17:21:40.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.133+0000 7f8845520700 1 Processor -- start 2021-02-12T17:21:40.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.133+0000 7f8845520700 1 -- start start 2021-02-12T17:21:40.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.133+0000 7f8845520700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8840062740 0x7f8840151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:40.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.133+0000 7f8845520700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f88400b8d20 0x7f88400aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:40.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.133+0000 7f8845520700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f884014e530 0x7f88400aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:40.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.133+0000 7f8845520700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884011d840 con 0x7f88400b8d20 2021-02-12T17:21:40.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.133+0000 7f8845520700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884011dae0 con 0x7f884014e530 2021-02-12T17:21:40.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.133+0000 7f8845520700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884011dd80 con 0x7f8840062740 2021-02-12T17:21:40.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.134+0000 7f883e7fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f88400b8d20 0x7f88400aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:40.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.134+0000 7f883e7fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f88400b8d20 0x7f88400aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47326/0 (socket says 172.21.2.102:47326) 2021-02-12T17:21:40.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.134+0000 7f883e7fc700 1 -- 172.21.2.102:0/2807714814 learned_addr learned my addr 172.21.2.102:0/2807714814 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:40.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.134+0000 7f883e7fc700 1 -- 172.21.2.102:0/2807714814 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8840062740 msgr2=0x7f8840151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:40.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.134+0000 7f883e7fc700 1 --2- 172.21.2.102:0/2807714814 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8840062740 0x7f8840151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:40.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.134+0000 7f883e7fc700 1 -- 172.21.2.102:0/2807714814 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f884014e530 msgr2=0x7f88400aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:40.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.134+0000 7f883e7fc700 1 --2- 172.21.2.102:0/2807714814 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f884014e530 0x7f88400aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:40.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.134+0000 7f883e7fc700 1 -- 172.21.2.102:0/2807714814 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884011e020 con 0x7f88400b8d20 2021-02-12T17:21:40.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.134+0000 7f883e7fc700 1 --2- 172.21.2.102:0/2807714814 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f88400b8d20 0x7f88400aea30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f88400653c0 tx=0x7f8828016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:40.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.134+0000 7f8836ffd700 1 -- 172.21.2.102:0/2807714814 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828012e40 con 0x7f88400b8d20 2021-02-12T17:21:40.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.134+0000 7f8836ffd700 1 -- 172.21.2.102:0/2807714814 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882801c420 con 0x7f88400b8d20 2021-02-12T17:21:40.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.134+0000 7f8836ffd700 1 -- 172.21.2.102:0/2807714814 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882801c7a0 con 0x7f88400b8d20 2021-02-12T17:21:40.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.134+0000 7f8845520700 1 -- 172.21.2.102:0/2807714814 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884011e2c0 con 0x7f88400b8d20 2021-02-12T17:21:40.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.134+0000 7f8845520700 1 -- 172.21.2.102:0/2807714814 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88400acf10 con 0x7f88400b8d20 2021-02-12T17:21:40.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.135+0000 7f8845520700 1 -- 172.21.2.102:0/2807714814 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8840161330 con 0x7f88400b8d20 2021-02-12T17:21:40.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.135+0000 7f8836ffd700 1 -- 172.21.2.102:0/2807714814 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f882800f070 con 0x7f88400b8d20 2021-02-12T17:21:40.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.135+0000 7f8836ffd700 1 --2- 172.21.2.102:0/2807714814 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8818059d80 0x7f881805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:40.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.136+0000 7f8836ffd700 1 -- 172.21.2.102:0/2807714814 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7365+0+0 (secure 0 0 0) 0x7f8828075880 con 0x7f88400b8d20 2021-02-12T17:21:40.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.136+0000 7f883effd700 1 --2- 172.21.2.102:0/2807714814 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8818059d80 0x7f881805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:40.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.136+0000 7f883effd700 1 --2- 172.21.2.102:0/2807714814 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8818059d80 0x7f881805c240 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f8830009480 tx=0x7f88300069a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:40.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.139+0000 7f8836ffd700 1 -- 172.21.2.102:0/2807714814 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f8828048e20 con 0x7f88400b8d20 2021-02-12T17:21:40.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.296+0000 7f8845520700 1 -- 172.21.2.102:0/2807714814 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8840045460 con 0x7f88400b8d20 2021-02-12T17:21:40.298 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.297+0000 7f8836ffd700 1 -- 172.21.2.102:0/2807714814 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3757 (secure 0 0 0) 0x7f882804c440 con 0x7f88400b8d20 2021-02-12T17:21:40.298 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:40.298 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34514,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":40}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:40.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.298+0000 7f8845520700 1 -- 172.21.2.102:0/2807714814 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8818059d80 msgr2=0x7f881805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:40.299 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.298+0000 7f8845520700 1 --2- 172.21.2.102:0/2807714814 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8818059d80 0x7f881805c240 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f8830009480 tx=0x7f88300069a0).stop 2021-02-12T17:21:40.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.298+0000 7f8845520700 1 -- 172.21.2.102:0/2807714814 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f88400b8d20 msgr2=0x7f88400aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:40.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.298+0000 7f8845520700 1 --2- 172.21.2.102:0/2807714814 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f88400b8d20 0x7f88400aea30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f88400653c0 tx=0x7f8828016000).stop 2021-02-12T17:21:40.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.298+0000 7f8845520700 1 -- 172.21.2.102:0/2807714814 shutdown_connections 2021-02-12T17:21:40.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.298+0000 7f8845520700 1 --2- 172.21.2.102:0/2807714814 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f884014e530 0x7f88400aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:40.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.298+0000 7f8845520700 1 --2- 172.21.2.102:0/2807714814 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8840062740 0x7f8840151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:40.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.298+0000 7f8845520700 1 --2- 172.21.2.102:0/2807714814 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8818059d80 0x7f881805c240 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:40.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.298+0000 7f8845520700 1 --2- 172.21.2.102:0/2807714814 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f88400b8d20 0x7f88400aea30 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:40.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.298+0000 7f8845520700 1 -- 172.21.2.102:0/2807714814 >> 172.21.2.102:0/2807714814 conn(0x7f88400bc480 msgr2=0x7f88400b7250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:40.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.298+0000 7f8845520700 1 -- 172.21.2.102:0/2807714814 shutdown_connections 2021-02-12T17:21:40.300 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.298+0000 7f8845520700 1 -- 172.21.2.102:0/2807714814 wait complete. 2021-02-12T17:21:40.301 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 40 2021-02-12T17:21:40.308 INFO:tasks.mds_thrash.fs.[b]:kill mds.a (rank=0) 2021-02-12T17:21:40.308 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-12T17:21:40.308 INFO:teuthology.orchestra.run:waiting for 300 2021-02-12T17:21:40.315 INFO:tasks.ceph.mds.a:Stopped 2021-02-12T17:21:40.315 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:40.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.443+0000 7fc2b198e700 1 Processor -- start 2021-02-12T17:21:40.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.444+0000 7fc2b198e700 1 -- start start 2021-02-12T17:21:40.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.444+0000 7fc2b198e700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fc2ac14e530 0x7fc2ac068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:40.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.444+0000 7fc2b198e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc2ac062740 0x7fc2ac062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:40.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.444+0000 7fc2b198e700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ac0b7960 con 0x7fc2ac0b8d20 2021-02-12T17:21:40.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.444+0000 7fc2b198e700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ac068d20 con 0x7fc2ac14e530 2021-02-12T17:21:40.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.444+0000 7fc2b198e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac0622a0 con 0x7fc2ac062740 2021-02-12T17:21:40.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.444+0000 7fc2aaffd700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fc2ac0b8d20 0x7fc2ac0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:55980/0 (socket says 172.21.2.102:55980) 2021-02-12T17:21:40.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.444+0000 7fc2aaffd700 1 -- 172.21.2.102:0/3749494013 learned_addr learned my addr 172.21.2.102:0/3749494013 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:21:40.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.444+0000 7fc2a9ffb700 1 -- 172.21.2.102:0/3749494013 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282312142 0 0) 0x7fc2ac0b7960 con 0x7fc2ac0b8d20 2021-02-12T17:21:40.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.444+0000 7fc2a9ffb700 1 -- 172.21.2.102:0/3749494013 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc28c003230 con 0x7fc2ac0b8d20 2021-02-12T17:21:40.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 -- 172.21.2.102:0/3749494013 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 419307538 0 0) 0x7fc28c003230 con 0x7fc2ac0b8d20 2021-02-12T17:21:40.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 -- 172.21.2.102:0/3749494013 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc2ac062740 msgr2=0x7fc2ac062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:40.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 --2- 172.21.2.102:0/3749494013 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc2ac062740 0x7fc2ac062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:40.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 -- 172.21.2.102:0/3749494013 >> v2:172.21.2.104:3300/0 conn(0x7fc2ac14e530 msgr2=0x7fc2ac068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:40.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 --2- 172.21.2.102:0/3749494013 >> v2:172.21.2.104:3300/0 conn(0x7fc2ac14e530 0x7fc2ac068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:40.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 -- 172.21.2.102:0/3749494013 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac14ea10 con 0x7fc2ac0b8d20 2021-02-12T17:21:40.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 -- 172.21.2.102:0/3749494013 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fc29c0014e0 con 0x7fc2ac0b8d20 2021-02-12T17:21:40.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 -- 172.21.2.102:0/3749494013 >> v1:172.21.2.102:6789/0 conn(0x7fc2ac0b8d20 legacy=0x7fc2ac0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:40.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 --2- 172.21.2.102:0/3749494013 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc28c003720 0x7fc28c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:40.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 --2- 172.21.2.102:0/3749494013 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc28c0044d0 0x7fc28c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:40.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 --2- 172.21.2.102:0/3749494013 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc2ac062740 0x7fc28c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:40.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 -- 172.21.2.102:0/3749494013 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac068d20 con 0x7fc28c003720 2021-02-12T17:21:40.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 -- 172.21.2.102:0/3749494013 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac0622a0 con 0x7fc28c0044d0 2021-02-12T17:21:40.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 -- 172.21.2.102:0/3749494013 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c004260 con 0x7fc2ac062740 2021-02-12T17:21:40.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2aaffd700 1 --2- 172.21.2.102:0/3749494013 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc28c003720 0x7fc28c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:40.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2aaffd700 1 -- 172.21.2.102:0/3749494013 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc2ac062740 msgr2=0x7fc28c004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:40.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2aaffd700 1 --2- 172.21.2.102:0/3749494013 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc2ac062740 0x7fc28c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:40.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2aaffd700 1 -- 172.21.2.102:0/3749494013 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc28c0044d0 msgr2=0x7fc28c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:40.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2aaffd700 1 --2- 172.21.2.102:0/3749494013 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc28c0044d0 0x7fc28c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:40.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2aaffd700 1 -- 172.21.2.102:0/3749494013 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c003230 con 0x7fc28c003720 2021-02-12T17:21:40.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2aaffd700 1 --2- 172.21.2.102:0/3749494013 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc28c003720 0x7fc28c003b40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fc29c00c440 tx=0x7fc2ac14eba0).ready entity=mon.0 client_cookie=82e8cc2f77c9a60e server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:40.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 -- 172.21.2.102:0/3749494013 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c00ce20 con 0x7fc28c003720 2021-02-12T17:21:40.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 -- 172.21.2.102:0/3749494013 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c0072e0 con 0x7fc28c003720 2021-02-12T17:21:40.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.445+0000 7fc2a9ffb700 1 -- 172.21.2.102:0/3749494013 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c005830 con 0x7fc28c003720 2021-02-12T17:21:40.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.446+0000 7fc2b198e700 1 -- 172.21.2.102:0/3749494013 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc28c003720 msgr2=0x7fc28c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:40.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.446+0000 7fc2b198e700 1 --2- 172.21.2.102:0/3749494013 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc28c003720 0x7fc28c003b40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fc29c00c440 tx=0x7fc2ac14eba0).stop 2021-02-12T17:21:40.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.446+0000 7fc2ab7fe700 1 -- 172.21.2.102:0/3749494013 reap_dead start 2021-02-12T17:21:40.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.446+0000 7fc2b198e700 1 -- 172.21.2.102:0/3749494013 shutdown_connections 2021-02-12T17:21:40.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.446+0000 7fc2b198e700 1 -- 172.21.2.102:0/3749494013 >> 172.21.2.102:0/3749494013 conn(0x7fc2ac0bc480 msgr2=0x7fc2ac0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:40.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.446+0000 7fc2b198e700 1 -- 172.21.2.102:0/3749494013 shutdown_connections 2021-02-12T17:21:40.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.446+0000 7fc2b198e700 1 -- 172.21.2.102:0/3749494013 wait complete. 2021-02-12T17:21:40.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.447+0000 7fc2b198e700 1 Processor -- start 2021-02-12T17:21:40.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.447+0000 7fc2b198e700 1 -- start start 2021-02-12T17:21:40.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.447+0000 7fc2b198e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc2ac14ce60 0x7fc2ac0b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:40.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.447+0000 7fc2b198e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc2ac15e000 0x7fc2ac0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:40.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.447+0000 7fc2b198e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc2ac0b4bd0 0x7fc2ac0b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:40.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.447+0000 7fc2b198e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac0acf10 con 0x7fc2ac14ce60 2021-02-12T17:21:40.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.447+0000 7fc2b198e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac0ad140 con 0x7fc2ac0b4bd0 2021-02-12T17:21:40.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.447+0000 7fc2b198e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac15d620 con 0x7fc2ac15e000 2021-02-12T17:21:40.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.447+0000 7fc2aaffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc2ac14ce60 0x7fc2ac0b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:40.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.447+0000 7fc2aaffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc2ac14ce60 0x7fc2ac0b35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47348/0 (socket says 172.21.2.102:47348) 2021-02-12T17:21:40.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.447+0000 7fc2aaffd700 1 -- 172.21.2.102:0/3734027004 learned_addr learned my addr 172.21.2.102:0/3734027004 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:40.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.448+0000 7fc2ab7fe700 1 --2- 172.21.2.102:0/3734027004 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc2ac0b4bd0 0x7fc2ac0b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:40.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.448+0000 7fc2aa7fc700 1 --2- 172.21.2.102:0/3734027004 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc2ac15e000 0x7fc2ac0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:40.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.448+0000 7fc2aaffd700 1 -- 172.21.2.102:0/3734027004 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc2ac15e000 msgr2=0x7fc2ac0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:40.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.448+0000 7fc2aaffd700 1 --2- 172.21.2.102:0/3734027004 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc2ac15e000 0x7fc2ac0b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:40.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.448+0000 7fc2aaffd700 1 -- 172.21.2.102:0/3734027004 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc2ac0b4bd0 msgr2=0x7fc2ac0b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:40.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.448+0000 7fc2aaffd700 1 --2- 172.21.2.102:0/3734027004 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc2ac0b4bd0 0x7fc2ac0b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:40.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.448+0000 7fc2aaffd700 1 -- 172.21.2.102:0/3734027004 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac15d8c0 con 0x7fc2ac14ce60 2021-02-12T17:21:40.453 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.448+0000 7fc2aaffd700 1 --2- 172.21.2.102:0/3734027004 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc2ac14ce60 0x7fc2ac0b35c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fc28c005350 tx=0x7fc29c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:40.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.448+0000 7fc2a2ffd700 1 -- 172.21.2.102:0/3734027004 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c007520 con 0x7fc2ac14ce60 2021-02-12T17:21:40.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.448+0000 7fc2a2ffd700 1 -- 172.21.2.102:0/3734027004 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c005be0 con 0x7fc2ac14ce60 2021-02-12T17:21:40.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.448+0000 7fc2b198e700 1 -- 172.21.2.102:0/3734027004 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ac15db60 con 0x7fc2ac14ce60 2021-02-12T17:21:40.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.448+0000 7fc2a2ffd700 1 -- 172.21.2.102:0/3734027004 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c0148c0 con 0x7fc2ac14ce60 2021-02-12T17:21:40.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.448+0000 7fc2b198e700 1 -- 172.21.2.102:0/3734027004 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ac0b5200 con 0x7fc2ac14ce60 2021-02-12T17:21:40.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.449+0000 7fc2b198e700 1 -- 172.21.2.102:0/3734027004 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc284004f60 con 0x7fc2ac14ce60 2021-02-12T17:21:40.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.449+0000 7fc2a2ffd700 1 -- 172.21.2.102:0/3734027004 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fc29c025030 con 0x7fc2ac14ce60 2021-02-12T17:21:40.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.449+0000 7fc2a2ffd700 1 --2- 172.21.2.102:0/3734027004 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc290059d80 0x7fc29005c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:40.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.449+0000 7fc2a2ffd700 1 -- 172.21.2.102:0/3734027004 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7365+0+0 (secure 0 0 0) 0x7fc29c075000 con 0x7fc2ac14ce60 2021-02-12T17:21:40.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.449+0000 7fc2aa7fc700 1 --2- 172.21.2.102:0/3734027004 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc290059d80 0x7fc29005c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:40.454 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.450+0000 7fc2aa7fc700 1 --2- 172.21.2.102:0/3734027004 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc290059d80 0x7fc29005c240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fc2ac152310 tx=0x7fc294008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:40.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.452+0000 7fc2a2ffd700 1 -- 172.21.2.102:0/3734027004 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fc29c048650 con 0x7fc2ac14ce60 2021-02-12T17:21:40.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.611+0000 7fc2b198e700 1 -- 172.21.2.102:0/3734027004 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc284005790 con 0x7fc2ac14ce60 2021-02-12T17:21:40.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.611+0000 7fc2a2ffd700 1 -- 172.21.2.102:0/3734027004 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3757 (secure 0 0 0) 0x7fc29c023070 con 0x7fc2ac14ce60 2021-02-12T17:21:40.612 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:40.613 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34514,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":40}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:40.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.612+0000 7fc2b198e700 1 -- 172.21.2.102:0/3734027004 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc290059d80 msgr2=0x7fc29005c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:40.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.613+0000 7fc2b198e700 1 --2- 172.21.2.102:0/3734027004 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc290059d80 0x7fc29005c240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fc2ac152310 tx=0x7fc294008040).stop 2021-02-12T17:21:40.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.613+0000 7fc2b198e700 1 -- 172.21.2.102:0/3734027004 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc2ac14ce60 msgr2=0x7fc2ac0b35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:40.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.613+0000 7fc2b198e700 1 --2- 172.21.2.102:0/3734027004 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc2ac14ce60 0x7fc2ac0b35c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fc28c005350 tx=0x7fc29c015000).stop 2021-02-12T17:21:40.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.613+0000 7fc2b198e700 1 -- 172.21.2.102:0/3734027004 shutdown_connections 2021-02-12T17:21:40.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.613+0000 7fc2b198e700 1 --2- 172.21.2.102:0/3734027004 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc2ac0b4bd0 0x7fc2ac0b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:40.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.613+0000 7fc2b198e700 1 --2- 172.21.2.102:0/3734027004 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc290059d80 0x7fc29005c240 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:40.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.613+0000 7fc2b198e700 1 --2- 172.21.2.102:0/3734027004 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc2ac14ce60 0x7fc2ac0b35c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:40.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.613+0000 7fc2b198e700 1 --2- 172.21.2.102:0/3734027004 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc2ac15e000 0x7fc2ac0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:40.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.613+0000 7fc2b198e700 1 -- 172.21.2.102:0/3734027004 >> 172.21.2.102:0/3734027004 conn(0x7fc2ac0bc480 msgr2=0x7fc2ac0bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:40.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.613+0000 7fc2b198e700 1 -- 172.21.2.102:0/3734027004 shutdown_connections 2021-02-12T17:21:40.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:40.613+0000 7fc2b198e700 1 -- 172.21.2.102:0/3734027004 wait complete. 2021-02-12T17:21:40.615 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 40 2021-02-12T17:21:40.622 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:21:41.029 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:21:41.032 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:21:42.623 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:42.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.711+0000 7fb3e3b82700 1 Processor -- start 2021-02-12T17:21:42.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.712+0000 7fb3e3b82700 1 -- start start 2021-02-12T17:21:42.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.712+0000 7fb3e3b82700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fb3dc0b8d20 0x7fb3dc068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:42.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.712+0000 7fb3e3b82700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb3dc14e530 0x7fb3dc0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:42.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.712+0000 7fb3e3b82700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb3dc062740 0x7fb3dc062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:42.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.712+0000 7fb3e3b82700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc068d20 con 0x7fb3dc062740 2021-02-12T17:21:42.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.712+0000 7fb3e3b82700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0622a0 con 0x7fb3dc0b8d20 2021-02-12T17:21:42.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.712+0000 7fb3e3b82700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc14ea10 con 0x7fb3dc14e530 2021-02-12T17:21:42.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.712+0000 7fb3e211f700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb3dc062740 0x7fb3dc062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:42.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.712+0000 7fb3e211f700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fb3dc062740 0x7fb3dc062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47358/0 (socket says 172.21.2.102:47358) 2021-02-12T17:21:42.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.712+0000 7fb3e211f700 1 -- 172.21.2.102:0/3000147940 learned_addr learned my addr 172.21.2.102:0/3000147940 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:42.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e211f700 1 -- 172.21.2.102:0/3000147940 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb3dc14e530 msgr2=0x7fb3dc0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:42.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e211f700 1 --2- 172.21.2.102:0/3000147940 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb3dc14e530 0x7fb3dc0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:42.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e211f700 1 -- 172.21.2.102:0/3000147940 >> v2:172.21.2.104:3300/0 conn(0x7fb3dc0b8d20 msgr2=0x7fb3dc068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:42.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e211f700 1 --2- 172.21.2.102:0/3000147940 >> v2:172.21.2.104:3300/0 conn(0x7fb3dc0b8d20 0x7fb3dc068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:42.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e211f700 1 -- 172.21.2.102:0/3000147940 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc0b63f0 con 0x7fb3dc062740 2021-02-12T17:21:42.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e211f700 1 --2- 172.21.2.102:0/3000147940 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3dc062740 0x7fb3dc062bf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fb3dc06abc0 tx=0x7fb3d4009290).ready entity=mon.0 client_cookie=77beb4d133ab496 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:42.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e091c700 1 -- 172.21.2.102:0/3000147940 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d400bbf0 con 0x7fb3dc062740 2021-02-12T17:21:42.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e091c700 1 -- 172.21.2.102:0/3000147940 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d400bd50 con 0x7fb3dc062740 2021-02-12T17:21:42.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e091c700 1 -- 172.21.2.102:0/3000147940 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4011610 con 0x7fb3dc062740 2021-02-12T17:21:42.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3000147940 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3dc062740 msgr2=0x7fb3dc062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:42.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e3b82700 1 --2- 172.21.2.102:0/3000147940 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3dc062740 0x7fb3dc062bf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fb3dc06abc0 tx=0x7fb3d4009290).stop 2021-02-12T17:21:42.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3000147940 shutdown_connections 2021-02-12T17:21:42.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e3b82700 1 --2- 172.21.2.102:0/3000147940 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3dc062740 0x7fb3dc062bf0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:42.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e3b82700 1 --2- 172.21.2.102:0/3000147940 >> v2:172.21.2.104:3300/0 conn(0x7fb3dc0b8d20 0x7fb3dc068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:42.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e3b82700 1 --2- 172.21.2.102:0/3000147940 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb3dc14e530 0x7fb3dc0b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:42.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3000147940 >> 172.21.2.102:0/3000147940 conn(0x7fb3dc0bc480 msgr2=0x7fb3dc0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:42.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3000147940 shutdown_connections 2021-02-12T17:21:42.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.713+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3000147940 wait complete. 2021-02-12T17:21:42.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.714+0000 7fb3e3b82700 1 Processor -- start 2021-02-12T17:21:42.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.714+0000 7fb3e3b82700 1 -- start start 2021-02-12T17:21:42.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e3b82700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb3dc062740 0x7fb3dc0b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:42.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e3b82700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb3dc0b8d20 0x7fb3dc0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:42.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e3b82700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3dc14e530 0x7fb3dc0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:42.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e3b82700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0b17a0 con 0x7fb3dc14e530 2021-02-12T17:21:42.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e3b82700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc15d320 con 0x7fb3dc062740 2021-02-12T17:21:42.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e3b82700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc15d5c0 con 0x7fb3dc0b8d20 2021-02-12T17:21:42.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e211f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3dc14e530 0x7fb3dc0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:42.719 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e211f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3dc14e530 0x7fb3dc0b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47364/0 (socket says 172.21.2.102:47364) 2021-02-12T17:21:42.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e211f700 1 -- 172.21.2.102:0/3370796096 learned_addr learned my addr 172.21.2.102:0/3370796096 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:42.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e191e700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb3dc062740 0x7fb3dc0b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:42.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e111d700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb3dc0b8d20 0x7fb3dc0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:42.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e211f700 1 -- 172.21.2.102:0/3370796096 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb3dc0b8d20 msgr2=0x7fb3dc0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:42.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e211f700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb3dc0b8d20 0x7fb3dc0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:42.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e211f700 1 -- 172.21.2.102:0/3370796096 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb3dc062740 msgr2=0x7fb3dc0b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:42.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e211f700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb3dc062740 0x7fb3dc0b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:42.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e211f700 1 -- 172.21.2.102:0/3370796096 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc15d860 con 0x7fb3dc14e530 2021-02-12T17:21:42.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e191e700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb3dc062740 0x7fb3dc0b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:21:42.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e111d700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb3dc0b8d20 0x7fb3dc0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:21:42.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e211f700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3dc14e530 0x7fb3dc0b51b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fb3d40092d0 tx=0x7fb3d4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:42.720 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3cdffb700 1 -- 172.21.2.102:0/3370796096 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d401f070 con 0x7fb3dc14e530 2021-02-12T17:21:42.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3cdffb700 1 -- 172.21.2.102:0/3370796096 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d400bec0 con 0x7fb3dc14e530 2021-02-12T17:21:42.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3370796096 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc15db00 con 0x7fb3dc14e530 2021-02-12T17:21:42.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.715+0000 7fb3cdffb700 1 -- 172.21.2.102:0/3370796096 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4010e30 con 0x7fb3dc14e530 2021-02-12T17:21:42.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.716+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3370796096 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc15e040 con 0x7fb3dc14e530 2021-02-12T17:21:42.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.716+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3370796096 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc15e240 con 0x7fb3dc14e530 2021-02-12T17:21:42.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.717+0000 7fb3cdffb700 1 -- 172.21.2.102:0/3370796096 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fb3d400f070 con 0x7fb3dc14e530 2021-02-12T17:21:42.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.717+0000 7fb3cdffb700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb3bc059d30 0x7fb3bc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:42.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.717+0000 7fb3cdffb700 1 -- 172.21.2.102:0/3370796096 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7365+0+0 (secure 0 0 0) 0x7fb3d4075b20 con 0x7fb3dc14e530 2021-02-12T17:21:42.721 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.717+0000 7fb3e191e700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb3bc059d30 0x7fb3bc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:42.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.717+0000 7fb3e191e700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb3bc059d30 0x7fb3bc05c1f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fb3d800a7a0 tx=0x7fb3d8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:42.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.720+0000 7fb3cdffb700 1 -- 172.21.2.102:0/3370796096 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fb3d4049040 con 0x7fb3dc14e530 2021-02-12T17:21:42.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.877+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3370796096 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3dc045460 con 0x7fb3dc14e530 2021-02-12T17:21:42.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.877+0000 7fb3cdffb700 1 -- 172.21.2.102:0/3370796096 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3757 (secure 0 0 0) 0x7fb3d4009e60 con 0x7fb3dc14e530 2021-02-12T17:21:42.878 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:42.879 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34514,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":40}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:42.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.879+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3370796096 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb3bc059d30 msgr2=0x7fb3bc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:42.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.879+0000 7fb3e3b82700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb3bc059d30 0x7fb3bc05c1f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fb3d800a7a0 tx=0x7fb3d8008040).stop 2021-02-12T17:21:42.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.879+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3370796096 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3dc14e530 msgr2=0x7fb3dc0b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:42.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.879+0000 7fb3e3b82700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3dc14e530 0x7fb3dc0b51b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fb3d40092d0 tx=0x7fb3d4017000).stop 2021-02-12T17:21:42.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.879+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3370796096 shutdown_connections 2021-02-12T17:21:42.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.879+0000 7fb3e3b82700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb3bc059d30 0x7fb3bc05c1f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:42.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.879+0000 7fb3e3b82700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb3dc14e530 0x7fb3dc0b51b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:42.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.879+0000 7fb3e3b82700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb3dc062740 0x7fb3dc0b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:42.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.879+0000 7fb3e3b82700 1 --2- 172.21.2.102:0/3370796096 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb3dc0b8d20 0x7fb3dc0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:42.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.879+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3370796096 >> 172.21.2.102:0/3370796096 conn(0x7fb3dc0bc480 msgr2=0x7fb3dc151810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:42.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.879+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3370796096 shutdown_connections 2021-02-12T17:21:42.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:42.879+0000 7fb3e3b82700 1 -- 172.21.2.102:0/3370796096 wait complete. 2021-02-12T17:21:42.881 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 40 2021-02-12T17:21:42.888 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:21:44.890 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:44.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.978+0000 7fc518dd0700 1 Processor -- start 2021-02-12T17:21:44.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.978+0000 7fc518dd0700 1 -- start start 2021-02-12T17:21:44.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.979+0000 7fc518dd0700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fc514068710 0x7fc5140b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:44.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.979+0000 7fc518dd0700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fc514068af0 0x7fc5140622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:44.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.979+0000 7fc518dd0700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc5140b6350 0x7fc51414a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:44.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.979+0000 7fc518dd0700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5140b7680 con 0x7fc514068710 2021-02-12T17:21:44.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.979+0000 7fc518dd0700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5140b2360 con 0x7fc514068af0 2021-02-12T17:21:44.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.979+0000 7fc518dd0700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5140b2600 con 0x7fc5140b6350 2021-02-12T17:21:44.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.979+0000 7fc51259c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fc514068710 0x7fc5140b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:44.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.979+0000 7fc51259c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fc514068710 0x7fc5140b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47372/0 (socket says 172.21.2.102:47372) 2021-02-12T17:21:44.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.979+0000 7fc51259c700 1 -- 172.21.2.102:0/3854872576 learned_addr learned my addr 172.21.2.102:0/3854872576 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:44.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.980+0000 7fc51259c700 1 -- 172.21.2.102:0/3854872576 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc5140b6350 msgr2=0x7fc51414a020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:21:44.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.980+0000 7fc51259c700 1 --2- 172.21.2.102:0/3854872576 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc5140b6350 0x7fc51414a020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:44.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.980+0000 7fc51259c700 1 -- 172.21.2.102:0/3854872576 >> v2:172.21.2.104:3300/0 conn(0x7fc514068af0 msgr2=0x7fc5140622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:44.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.980+0000 7fc51259c700 1 --2- 172.21.2.102:0/3854872576 >> v2:172.21.2.104:3300/0 conn(0x7fc514068af0 0x7fc5140622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:44.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.980+0000 7fc51259c700 1 -- 172.21.2.102:0/3854872576 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5141498e0 con 0x7fc514068710 2021-02-12T17:21:44.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.980+0000 7fc51259c700 1 --2- 172.21.2.102:0/3854872576 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc514068710 0x7fc5140b1440 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fc514065d70 tx=0x7fc504006ea0).ready entity=mon.0 client_cookie=5340b5deadc6c9cf server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:44.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.980+0000 7fc51159a700 1 -- 172.21.2.102:0/3854872576 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504009840 con 0x7fc514068710 2021-02-12T17:21:44.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.980+0000 7fc51159a700 1 -- 172.21.2.102:0/3854872576 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5040099a0 con 0x7fc514068710 2021-02-12T17:21:44.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.980+0000 7fc51159a700 1 -- 172.21.2.102:0/3854872576 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504009d20 con 0x7fc514068710 2021-02-12T17:21:44.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.981+0000 7fc518dd0700 1 -- 172.21.2.102:0/3854872576 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc514068710 msgr2=0x7fc5140b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:44.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.981+0000 7fc518dd0700 1 --2- 172.21.2.102:0/3854872576 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc514068710 0x7fc5140b1440 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fc514065d70 tx=0x7fc504006ea0).stop 2021-02-12T17:21:44.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.981+0000 7fc518dd0700 1 -- 172.21.2.102:0/3854872576 shutdown_connections 2021-02-12T17:21:44.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.981+0000 7fc518dd0700 1 --2- 172.21.2.102:0/3854872576 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc5140b6350 0x7fc51414a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:44.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.981+0000 7fc518dd0700 1 --2- 172.21.2.102:0/3854872576 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc514068710 0x7fc5140b1440 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:44.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.981+0000 7fc518dd0700 1 --2- 172.21.2.102:0/3854872576 >> v2:172.21.2.104:3300/0 conn(0x7fc514068af0 0x7fc5140622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:44.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.981+0000 7fc518dd0700 1 -- 172.21.2.102:0/3854872576 >> 172.21.2.102:0/3854872576 conn(0x7fc5140bc480 msgr2=0x7fc5140b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:44.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.981+0000 7fc518dd0700 1 -- 172.21.2.102:0/3854872576 shutdown_connections 2021-02-12T17:21:44.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.981+0000 7fc518dd0700 1 -- 172.21.2.102:0/3854872576 wait complete. 2021-02-12T17:21:44.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.982+0000 7fc518dd0700 1 Processor -- start 2021-02-12T17:21:44.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.982+0000 7fc518dd0700 1 -- start start 2021-02-12T17:21:44.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.982+0000 7fc518dd0700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc514068710 0x7fc514142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:44.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.982+0000 7fc518dd0700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc514068af0 0x7fc51414b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:44.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.982+0000 7fc518dd0700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc5140b6350 0x7fc51414ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:44.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.982+0000 7fc518dd0700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51414ad90 con 0x7fc514068af0 2021-02-12T17:21:44.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.982+0000 7fc518dd0700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51414afc0 con 0x7fc5140b6350 2021-02-12T17:21:44.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.982+0000 7fc518dd0700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51414b260 con 0x7fc514068710 2021-02-12T17:21:44.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.983+0000 7fc511d9b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc514068af0 0x7fc51414b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:44.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.983+0000 7fc511d9b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc514068af0 0x7fc51414b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47382/0 (socket says 172.21.2.102:47382) 2021-02-12T17:21:44.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.983+0000 7fc511d9b700 1 -- 172.21.2.102:0/1632910900 learned_addr learned my addr 172.21.2.102:0/1632910900 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:44.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.983+0000 7fc51259c700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc514068710 0x7fc514142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:44.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.983+0000 7fc512d9d700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc5140b6350 0x7fc51414ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:44.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.983+0000 7fc511d9b700 1 -- 172.21.2.102:0/1632910900 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc514068710 msgr2=0x7fc514142bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:44.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.983+0000 7fc511d9b700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc514068710 0x7fc514142bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:44.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.983+0000 7fc511d9b700 1 -- 172.21.2.102:0/1632910900 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc5140b6350 msgr2=0x7fc51414ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:44.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.983+0000 7fc511d9b700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc5140b6350 0x7fc51414ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:44.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.983+0000 7fc511d9b700 1 -- 172.21.2.102:0/1632910900 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc514148390 con 0x7fc514068af0 2021-02-12T17:21:44.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.983+0000 7fc512d9d700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc5140b6350 0x7fc51414ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:21:44.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.983+0000 7fc511d9b700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc514068af0 0x7fc51414b530 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fc508009790 tx=0x7fc508006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:44.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.983+0000 7fc5027fc700 1 -- 172.21.2.102:0/1632910900 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50800d5a0 con 0x7fc514068af0 2021-02-12T17:21:44.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.984+0000 7fc5027fc700 1 -- 172.21.2.102:0/1632910900 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc508000e90 con 0x7fc514068af0 2021-02-12T17:21:44.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.984+0000 7fc518dd0700 1 -- 172.21.2.102:0/1632910900 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc514148630 con 0x7fc514068af0 2021-02-12T17:21:44.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.984+0000 7fc518dd0700 1 -- 172.21.2.102:0/1632910900 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc514143440 con 0x7fc514068af0 2021-02-12T17:21:44.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.984+0000 7fc5027fc700 1 -- 172.21.2.102:0/1632910900 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50800d950 con 0x7fc514068af0 2021-02-12T17:21:44.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.984+0000 7fc518dd0700 1 -- 172.21.2.102:0/1632910900 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5141487c0 con 0x7fc514068af0 2021-02-12T17:21:44.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.984+0000 7fc5027fc700 1 -- 172.21.2.102:0/1632910900 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fc508017030 con 0x7fc514068af0 2021-02-12T17:21:44.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.985+0000 7fc5027fc700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc4f0059d30 0x7fc4f005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:44.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.985+0000 7fc5027fc700 1 -- 172.21.2.102:0/1632910900 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7365+0+0 (secure 0 0 0) 0x7fc508073060 con 0x7fc514068af0 2021-02-12T17:21:44.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.985+0000 7fc51259c700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc4f0059d30 0x7fc4f005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:44.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.985+0000 7fc51259c700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc4f0059d30 0x7fc4f005c1f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc504006ee0 tx=0x7fc504016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:44.989 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:44.988+0000 7fc5027fc700 1 -- 172.21.2.102:0/1632910900 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fc50804a170 con 0x7fc514068af0 2021-02-12T17:21:45.144 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:45.144+0000 7fc518dd0700 1 -- 172.21.2.102:0/1632910900 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc514045460 con 0x7fc514068af0 2021-02-12T17:21:45.145 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:45.144+0000 7fc5027fc700 1 -- 172.21.2.102:0/1632910900 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3757 (secure 0 0 0) 0x7fc508015070 con 0x7fc514068af0 2021-02-12T17:21:45.145 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:45.145 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34514,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":40}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:45.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:45.145+0000 7fc518dd0700 1 -- 172.21.2.102:0/1632910900 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc4f0059d30 msgr2=0x7fc4f005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:45.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:45.145+0000 7fc518dd0700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc4f0059d30 0x7fc4f005c1f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc504006ee0 tx=0x7fc504016000).stop 2021-02-12T17:21:45.146 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:45.145+0000 7fc518dd0700 1 -- 172.21.2.102:0/1632910900 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc514068af0 msgr2=0x7fc51414b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:45.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:45.145+0000 7fc518dd0700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc514068af0 0x7fc51414b530 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fc508009790 tx=0x7fc508006eb0).stop 2021-02-12T17:21:45.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:45.145+0000 7fc518dd0700 1 -- 172.21.2.102:0/1632910900 shutdown_connections 2021-02-12T17:21:45.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:45.145+0000 7fc518dd0700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc5140b6350 0x7fc51414ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:45.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:45.145+0000 7fc518dd0700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc514068710 0x7fc514142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:45.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:45.145+0000 7fc518dd0700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc4f0059d30 0x7fc4f005c1f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:45.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:45.145+0000 7fc518dd0700 1 --2- 172.21.2.102:0/1632910900 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc514068af0 0x7fc51414b530 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:45.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:45.145+0000 7fc518dd0700 1 -- 172.21.2.102:0/1632910900 >> 172.21.2.102:0/1632910900 conn(0x7fc5140bc480 msgr2=0x7fc514143e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:45.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:45.145+0000 7fc518dd0700 1 -- 172.21.2.102:0/1632910900 shutdown_connections 2021-02-12T17:21:45.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:45.145+0000 7fc518dd0700 1 -- 172.21.2.102:0/1632910900 wait complete. 2021-02-12T17:21:45.148 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 40 2021-02-12T17:21:45.155 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:21:47.156 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:47.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.245+0000 7f4e9f3bb700 1 Processor -- start 2021-02-12T17:21:47.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.246+0000 7f4e9f3bb700 1 -- start start 2021-02-12T17:21:47.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.246+0000 7f4e9f3bb700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f4e980b2cb0 0x7f4e980b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:47.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.246+0000 7f4e9f3bb700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4e980b3090 0x7f4e980b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:47.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.246+0000 7f4e9f3bb700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e980b54d0 con 0x7f4e980b8bd0 2021-02-12T17:21:47.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.246+0000 7f4e9f3bb700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e980b40f0 con 0x7f4e980b2cb0 2021-02-12T17:21:47.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.246+0000 7f4e9f3bb700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980b4f90 con 0x7f4e980b3090 2021-02-12T17:21:47.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.247+0000 7f4e9d958700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4e980b3090 0x7f4e980b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:47.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.247+0000 7f4e9d157700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f4e980b2cb0 0x7f4e980b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:47.248 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.247+0000 7f4e9c956700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f4e980b8bd0 0x7f4e98147cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:38408/0 (socket says 172.21.2.102:38408) 2021-02-12T17:21:47.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.247+0000 7f4e9c956700 1 -- 172.21.2.102:0/3454640287 learned_addr learned my addr 172.21.2.102:0/3454640287 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:21:47.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.247+0000 7f4e9d958700 1 -- 172.21.2.102:0/3454640287 >> v2:172.21.2.104:3300/0 conn(0x7f4e980b2cb0 msgr2=0x7f4e980b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:47.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.247+0000 7f4e9d958700 1 --2- 172.21.2.102:0/3454640287 >> v2:172.21.2.104:3300/0 conn(0x7f4e980b2cb0 0x7f4e980b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:47.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.247+0000 7f4e9d958700 1 -- 172.21.2.102:0/3454640287 >> v1:172.21.2.104:6789/0 conn(0x7f4e980b8bd0 legacy=0x7f4e98147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:47.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.247+0000 7f4e8bfff700 1 -- 172.21.2.102:0/3454640287 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134053399 0 0) 0x7f4e980b54d0 con 0x7f4e980b8bd0 2021-02-12T17:21:47.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.248+0000 7f4e9d958700 1 -- 172.21.2.102:0/3454640287 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e980b5230 con 0x7f4e980b3090 2021-02-12T17:21:47.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.248+0000 7f4e9d157700 1 --2- 172.21.2.102:0/3454640287 >> v2:172.21.2.104:3300/0 conn(0x7f4e980b2cb0 0x7f4e980b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:21:47.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.248+0000 7f4e9d958700 1 --2- 172.21.2.102:0/3454640287 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4e980b3090 0x7f4e980b4680 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f4e90009c90 tx=0x7f4e900091d0).ready entity=mon.2 client_cookie=69dc480f528e362a server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:47.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.248+0000 7f4e8bfff700 1 -- 172.21.2.102:0/3454640287 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000b9e0 con 0x7f4e980b3090 2021-02-12T17:21:47.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.248+0000 7f4e8bfff700 1 -- 172.21.2.102:0/3454640287 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9000bb40 con 0x7f4e980b3090 2021-02-12T17:21:47.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.248+0000 7f4e8bfff700 1 -- 172.21.2.102:0/3454640287 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90011400 con 0x7f4e980b3090 2021-02-12T17:21:47.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.248+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/3454640287 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4e980b3090 msgr2=0x7f4e980b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:47.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.248+0000 7f4e9f3bb700 1 --2- 172.21.2.102:0/3454640287 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4e980b3090 0x7f4e980b4680 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f4e90009c90 tx=0x7f4e900091d0).stop 2021-02-12T17:21:47.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.248+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/3454640287 shutdown_connections 2021-02-12T17:21:47.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.248+0000 7f4e9f3bb700 1 --2- 172.21.2.102:0/3454640287 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4e980b3090 0x7f4e980b4680 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:47.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.248+0000 7f4e9f3bb700 1 --2- 172.21.2.102:0/3454640287 >> v2:172.21.2.104:3300/0 conn(0x7f4e980b2cb0 0x7f4e980b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:47.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.248+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/3454640287 >> 172.21.2.102:0/3454640287 conn(0x7f4e980bc480 msgr2=0x7f4e980b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:47.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.249+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/3454640287 shutdown_connections 2021-02-12T17:21:47.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.249+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/3454640287 wait complete. 2021-02-12T17:21:47.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.250+0000 7f4e9f3bb700 1 Processor -- start 2021-02-12T17:21:47.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.250+0000 7f4e9f3bb700 1 -- start start 2021-02-12T17:21:47.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.250+0000 7f4e9f3bb700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4e980b2cb0 0x7f4e980b9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:47.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.250+0000 7f4e9f3bb700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4e980b3090 0x7f4e9814a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:47.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.250+0000 7f4e9f3bb700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4e980b8bd0 0x7f4e9814acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:47.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.250+0000 7f4e9f3bb700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e98145880 con 0x7f4e980b8bd0 2021-02-12T17:21:47.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.250+0000 7f4e9f3bb700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9815b100 con 0x7f4e980b3090 2021-02-12T17:21:47.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.250+0000 7f4e9f3bb700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e981471d0 con 0x7f4e980b2cb0 2021-02-12T17:21:47.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.250+0000 7f4e9d958700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4e980b8bd0 0x7f4e9814acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:47.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.250+0000 7f4e9d958700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4e980b8bd0 0x7f4e9814acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47398/0 (socket says 172.21.2.102:47398) 2021-02-12T17:21:47.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.250+0000 7f4e9d958700 1 -- 172.21.2.102:0/930929041 learned_addr learned my addr 172.21.2.102:0/930929041 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:47.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.251+0000 7f4e9c956700 1 --2- 172.21.2.102:0/930929041 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4e980b3090 0x7f4e9814a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:47.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.251+0000 7f4e9d157700 1 --2- 172.21.2.102:0/930929041 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4e980b2cb0 0x7f4e980b9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:47.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.251+0000 7f4e9d958700 1 -- 172.21.2.102:0/930929041 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4e980b2cb0 msgr2=0x7f4e980b9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:47.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.251+0000 7f4e9d958700 1 --2- 172.21.2.102:0/930929041 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4e980b2cb0 0x7f4e980b9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:47.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.251+0000 7f4e9d958700 1 -- 172.21.2.102:0/930929041 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4e980b3090 msgr2=0x7f4e9814a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:47.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.251+0000 7f4e9d958700 1 --2- 172.21.2.102:0/930929041 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4e980b3090 0x7f4e9814a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:47.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.251+0000 7f4e9d958700 1 -- 172.21.2.102:0/930929041 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9815ae60 con 0x7f4e980b8bd0 2021-02-12T17:21:47.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.251+0000 7f4e9d958700 1 --2- 172.21.2.102:0/930929041 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4e980b8bd0 0x7f4e9814acf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f4e9000b470 tx=0x7f4e90017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:47.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.251+0000 7f4e897fa700 1 -- 172.21.2.102:0/930929041 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9001c630 con 0x7f4e980b8bd0 2021-02-12T17:21:47.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.251+0000 7f4e897fa700 1 -- 172.21.2.102:0/930929041 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9001c790 con 0x7f4e980b8bd0 2021-02-12T17:21:47.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.251+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/930929041 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e98145140 con 0x7f4e980b8bd0 2021-02-12T17:21:47.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.251+0000 7f4e897fa700 1 -- 172.21.2.102:0/930929041 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9001cb10 con 0x7f4e980b8bd0 2021-02-12T17:21:47.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.251+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/930929041 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9815ab60 con 0x7f4e980b8bd0 2021-02-12T17:21:47.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.252+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/930929041 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e98045460 con 0x7f4e980b8bd0 2021-02-12T17:21:47.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.252+0000 7f4e897fa700 1 -- 172.21.2.102:0/930929041 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f4e9002c070 con 0x7f4e980b8bd0 2021-02-12T17:21:47.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.252+0000 7f4e897fa700 1 --2- 172.21.2.102:0/930929041 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4e78059d30 0x7f4e7805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:47.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.252+0000 7f4e897fa700 1 -- 172.21.2.102:0/930929041 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7365+0+0 (secure 0 0 0) 0x7f4e900760b0 con 0x7f4e980b8bd0 2021-02-12T17:21:47.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.252+0000 7f4e9d157700 1 --2- 172.21.2.102:0/930929041 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4e78059d30 0x7f4e7805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:47.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.253+0000 7f4e9d157700 1 --2- 172.21.2.102:0/930929041 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4e78059d30 0x7f4e7805c1f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f4e8c00bdc0 tx=0x7f4e8c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:47.256 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.255+0000 7f4e897fa700 1 -- 172.21.2.102:0/930929041 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f4e900495d0 con 0x7f4e980b8bd0 2021-02-12T17:21:47.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.415+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/930929041 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e9814b240 con 0x7f4e980b8bd0 2021-02-12T17:21:47.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.416+0000 7f4e897fa700 1 -- 172.21.2.102:0/930929041 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3757 (secure 0 0 0) 0x7f4e90020030 con 0x7f4e980b8bd0 2021-02-12T17:21:47.417 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:47.417 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34514,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":40}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:47.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.417+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/930929041 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4e78059d30 msgr2=0x7f4e7805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:47.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.417+0000 7f4e9f3bb700 1 --2- 172.21.2.102:0/930929041 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4e78059d30 0x7f4e7805c1f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f4e8c00bdc0 tx=0x7f4e8c008040).stop 2021-02-12T17:21:47.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.417+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/930929041 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4e980b8bd0 msgr2=0x7f4e9814acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:47.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.417+0000 7f4e9f3bb700 1 --2- 172.21.2.102:0/930929041 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4e980b8bd0 0x7f4e9814acf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f4e9000b470 tx=0x7f4e90017000).stop 2021-02-12T17:21:47.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.417+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/930929041 shutdown_connections 2021-02-12T17:21:47.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.417+0000 7f4e9f3bb700 1 --2- 172.21.2.102:0/930929041 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4e78059d30 0x7f4e7805c1f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:47.419 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.417+0000 7f4e9f3bb700 1 --2- 172.21.2.102:0/930929041 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4e980b8bd0 0x7f4e9814acf0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:47.419 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.417+0000 7f4e9f3bb700 1 --2- 172.21.2.102:0/930929041 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4e980b2cb0 0x7f4e980b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:47.419 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.417+0000 7f4e9f3bb700 1 --2- 172.21.2.102:0/930929041 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4e980b3090 0x7f4e9814a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:47.419 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.417+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/930929041 >> 172.21.2.102:0/930929041 conn(0x7f4e980bc480 msgr2=0x7f4e98143d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:47.419 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.417+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/930929041 shutdown_connections 2021-02-12T17:21:47.419 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:47.417+0000 7f4e9f3bb700 1 -- 172.21.2.102:0/930929041 wait complete. 2021-02-12T17:21:47.419 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 40 2021-02-12T17:21:47.427 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:21:49.428 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:49.516 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.515+0000 7f433c666700 1 Processor -- start 2021-02-12T17:21:49.516 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.516+0000 7f433c666700 1 -- start start 2021-02-12T17:21:49.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.516+0000 7f433c666700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f43340b8d20 0x7f43340681b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:49.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.516+0000 7f433c666700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f4334146400 0x7f4334066aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:49.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.516+0000 7f433c666700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4334067290 con 0x7f43341477f0 2021-02-12T17:21:49.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.516+0000 7f433c666700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43340686a0 con 0x7f4334146400 2021-02-12T17:21:49.517 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.516+0000 7f433c666700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4334067530 con 0x7f43340b8d20 2021-02-12T17:21:49.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.516+0000 7f4339c01700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f4334146400 0x7f4334066aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:49.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.516+0000 7f4339c01700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f4334146400 0x7f4334066aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47406/0 (socket says 172.21.2.102:47406) 2021-02-12T17:21:49.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.516+0000 7f4339c01700 1 -- 172.21.2.102:0/4289200602 learned_addr learned my addr 172.21.2.102:0/4289200602 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:49.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.517+0000 7f4339c01700 1 -- 172.21.2.102:0/4289200602 >> v2:172.21.2.104:3300/0 conn(0x7f43340b8d20 msgr2=0x7f43340681b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:21:49.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.517+0000 7f4339c01700 1 --2- 172.21.2.102:0/4289200602 >> v2:172.21.2.104:3300/0 conn(0x7f43340b8d20 0x7f43340681b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:49.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.517+0000 7f4339c01700 1 -- 172.21.2.102:0/4289200602 >> v1:172.21.2.102:6789/0 conn(0x7f43341477f0 legacy=0x7f43341498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:49.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.517+0000 7f4339c01700 1 -- 172.21.2.102:0/4289200602 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43340677d0 con 0x7f4334146400 2021-02-12T17:21:49.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.517+0000 7f4339c01700 1 --2- 172.21.2.102:0/4289200602 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4334146400 0x7f4334066aa0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f433406abc0 tx=0x7f4330006ea0).ready entity=mon.0 client_cookie=800ba6ebf9cb1175 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:49.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.517+0000 7f4339400700 1 -- 172.21.2.102:0/4289200602 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43300098d0 con 0x7f4334146400 2021-02-12T17:21:49.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.517+0000 7f4339400700 1 -- 172.21.2.102:0/4289200602 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4330009a30 con 0x7f4334146400 2021-02-12T17:21:49.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.517+0000 7f4339400700 1 -- 172.21.2.102:0/4289200602 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4330009db0 con 0x7f4334146400 2021-02-12T17:21:49.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.517+0000 7f433c666700 1 -- 172.21.2.102:0/4289200602 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4334146400 msgr2=0x7f4334066aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:49.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.517+0000 7f433c666700 1 --2- 172.21.2.102:0/4289200602 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4334146400 0x7f4334066aa0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f433406abc0 tx=0x7f4330006ea0).stop 2021-02-12T17:21:49.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.518+0000 7f433c666700 1 -- 172.21.2.102:0/4289200602 shutdown_connections 2021-02-12T17:21:49.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.518+0000 7f433c666700 1 --2- 172.21.2.102:0/4289200602 >> v2:172.21.2.104:3300/0 conn(0x7f43340b8d20 0x7f43340681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:49.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.518+0000 7f433c666700 1 --2- 172.21.2.102:0/4289200602 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4334146400 0x7f4334066aa0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:49.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.518+0000 7f433c666700 1 -- 172.21.2.102:0/4289200602 >> 172.21.2.102:0/4289200602 conn(0x7f43340bc480 msgr2=0x7f43340b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:49.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.518+0000 7f433c666700 1 -- 172.21.2.102:0/4289200602 shutdown_connections 2021-02-12T17:21:49.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.518+0000 7f433c666700 1 -- 172.21.2.102:0/4289200602 wait complete. 2021-02-12T17:21:49.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.519+0000 7f433c666700 1 Processor -- start 2021-02-12T17:21:49.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.519+0000 7f433c666700 1 -- start start 2021-02-12T17:21:49.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.519+0000 7f433c666700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43340b8d20 0x7f4334148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:49.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.519+0000 7f433c666700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4334146400 0x7f4334149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:49.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.519+0000 7f433c666700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f43341477f0 0x7f433414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:49.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.519+0000 7f433c666700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433414a7a0 con 0x7f43341477f0 2021-02-12T17:21:49.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.519+0000 7f433c666700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43340b5b00 con 0x7f4334146400 2021-02-12T17:21:49.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.519+0000 7f433c666700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4334148100 con 0x7f43340b8d20 2021-02-12T17:21:49.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.519+0000 7f433ac03700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f43341477f0 0x7f433414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:49.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.519+0000 7f433ac03700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f43341477f0 0x7f433414a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47416/0 (socket says 172.21.2.102:47416) 2021-02-12T17:21:49.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.519+0000 7f433ac03700 1 -- 172.21.2.102:0/1120303438 learned_addr learned my addr 172.21.2.102:0/1120303438 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:49.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.520+0000 7f433ac03700 1 -- 172.21.2.102:0/1120303438 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43340b8d20 msgr2=0x7f4334148b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:21:49.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.520+0000 7f433ac03700 1 --2- 172.21.2.102:0/1120303438 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43340b8d20 0x7f4334148b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:49.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.520+0000 7f433ac03700 1 -- 172.21.2.102:0/1120303438 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4334146400 msgr2=0x7f4334149dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:21:49.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.520+0000 7f433ac03700 1 --2- 172.21.2.102:0/1120303438 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4334146400 0x7f4334149dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:49.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.520+0000 7f433ac03700 1 -- 172.21.2.102:0/1120303438 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43341483a0 con 0x7f43341477f0 2021-02-12T17:21:49.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.520+0000 7f433ac03700 1 --2- 172.21.2.102:0/1120303438 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f43341477f0 0x7f433414a2b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f432c00ca60 tx=0x7f432c007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:49.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.520+0000 7f43267fc700 1 -- 172.21.2.102:0/1120303438 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c003080 con 0x7f43341477f0 2021-02-12T17:21:49.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.520+0000 7f43267fc700 1 -- 172.21.2.102:0/1120303438 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c00a830 con 0x7f43341477f0 2021-02-12T17:21:49.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.520+0000 7f43267fc700 1 -- 172.21.2.102:0/1120303438 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c00abb0 con 0x7f43341477f0 2021-02-12T17:21:49.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.520+0000 7f433c666700 1 -- 172.21.2.102:0/1120303438 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4334148640 con 0x7f43341477f0 2021-02-12T17:21:49.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.520+0000 7f433c666700 1 -- 172.21.2.102:0/1120303438 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4334149920 con 0x7f43341477f0 2021-02-12T17:21:49.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.521+0000 7f433c666700 1 -- 172.21.2.102:0/1120303438 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4334149ae0 con 0x7f43341477f0 2021-02-12T17:21:49.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.521+0000 7f43267fc700 1 -- 172.21.2.102:0/1120303438 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f432c019030 con 0x7f43341477f0 2021-02-12T17:21:49.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.521+0000 7f43267fc700 1 --2- 172.21.2.102:0/1120303438 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4314059d80 0x7f431405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:49.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.521+0000 7f43267fc700 1 -- 172.21.2.102:0/1120303438 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7365+0+0 (secure 0 0 0) 0x7f432c073600 con 0x7f43341477f0 2021-02-12T17:21:49.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.521+0000 7f433a402700 1 --2- 172.21.2.102:0/1120303438 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4314059d80 0x7f431405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:49.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.522+0000 7f433a402700 1 --2- 172.21.2.102:0/1120303438 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4314059d80 0x7f431405c240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f432800b420 tx=0x7f4328006920).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:49.525 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.524+0000 7f43267fc700 1 -- 172.21.2.102:0/1120303438 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f432c045580 con 0x7f43341477f0 2021-02-12T17:21:49.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.682+0000 7f433c666700 1 -- 172.21.2.102:0/1120303438 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4334045460 con 0x7f43341477f0 2021-02-12T17:21:49.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.682+0000 7f43267fc700 1 -- 172.21.2.102:0/1120303438 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3757 (secure 0 0 0) 0x7f432c046c50 con 0x7f43341477f0 2021-02-12T17:21:49.684 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:49.684 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34514,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":40}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:20:09.310778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5280},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5280":{"gid":5280,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":7,"addr":"172.21.2.102:6835/277624455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":277624455},{"type":"v1","addr":"172.21.2.102:6835","nonce":277624455}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:49.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.684+0000 7f433c666700 1 -- 172.21.2.102:0/1120303438 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4314059d80 msgr2=0x7f431405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:49.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.684+0000 7f433c666700 1 --2- 172.21.2.102:0/1120303438 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4314059d80 0x7f431405c240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f432800b420 tx=0x7f4328006920).stop 2021-02-12T17:21:49.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.684+0000 7f433c666700 1 -- 172.21.2.102:0/1120303438 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f43341477f0 msgr2=0x7f433414a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:49.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.684+0000 7f433c666700 1 --2- 172.21.2.102:0/1120303438 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f43341477f0 0x7f433414a2b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f432c00ca60 tx=0x7f432c007f40).stop 2021-02-12T17:21:49.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.684+0000 7f433c666700 1 -- 172.21.2.102:0/1120303438 shutdown_connections 2021-02-12T17:21:49.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.684+0000 7f433c666700 1 --2- 172.21.2.102:0/1120303438 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4314059d80 0x7f431405c240 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:49.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.684+0000 7f433c666700 1 --2- 172.21.2.102:0/1120303438 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f43341477f0 0x7f433414a2b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:49.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.684+0000 7f433c666700 1 --2- 172.21.2.102:0/1120303438 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43340b8d20 0x7f4334148b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:49.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.684+0000 7f433c666700 1 --2- 172.21.2.102:0/1120303438 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4334146400 0x7f4334149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:49.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.684+0000 7f433c666700 1 -- 172.21.2.102:0/1120303438 >> 172.21.2.102:0/1120303438 conn(0x7f43340bc480 msgr2=0x7f43340b7960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:49.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.684+0000 7f433c666700 1 -- 172.21.2.102:0/1120303438 shutdown_connections 2021-02-12T17:21:49.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:49.684+0000 7f433c666700 1 -- 172.21.2.102:0/1120303438 wait complete. 2021-02-12T17:21:49.686 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 40 2021-02-12T17:21:49.693 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:21:51.694 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:51.781 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.780+0000 7f604d8da700 1 Processor -- start 2021-02-12T17:21:51.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.781+0000 7f604d8da700 1 -- start start 2021-02-12T17:21:51.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.781+0000 7f604d8da700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f60480b8d20 0x7f6048068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:51.782 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.781+0000 7f604d8da700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60480b7960 con 0x7f604814e530 2021-02-12T17:21:51.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.781+0000 7f604d8da700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60480622a0 con 0x7f6048062740 2021-02-12T17:21:51.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.781+0000 7f604d8da700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6048068d20 con 0x7f60480b8d20 2021-02-12T17:21:51.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.781+0000 7f60467fc700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f604814e530 0x7f60480b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56068/0 (socket says 172.21.2.102:56068) 2021-02-12T17:21:51.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.781+0000 7f60467fc700 1 -- 172.21.2.102:0/3168186624 learned_addr learned my addr 172.21.2.102:0/3168186624 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:21:51.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 -- 172.21.2.102:0/3168186624 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505449998 0 0) 0x7f60480b7960 con 0x7f604814e530 2021-02-12T17:21:51.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 -- 172.21.2.102:0/3168186624 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6028003230 con 0x7f604814e530 2021-02-12T17:21:51.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 -- 172.21.2.102:0/3168186624 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4271056820 0 0) 0x7f6028003230 con 0x7f604814e530 2021-02-12T17:21:51.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 -- 172.21.2.102:0/3168186624 >> v2:172.21.2.104:3300/0 conn(0x7f60480b8d20 msgr2=0x7f6048068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:51.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 --2- 172.21.2.102:0/3168186624 >> v2:172.21.2.104:3300/0 conn(0x7f60480b8d20 0x7f6048068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:51.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 -- 172.21.2.102:0/3168186624 >> v1:172.21.2.104:6789/0 conn(0x7f6048062740 legacy=0x7f6048062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:51.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 -- 172.21.2.102:0/3168186624 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604814ea10 con 0x7f604814e530 2021-02-12T17:21:51.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 -- 172.21.2.102:0/3168186624 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f60380014e0 con 0x7f604814e530 2021-02-12T17:21:51.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 -- 172.21.2.102:0/3168186624 >> v1:172.21.2.102:6789/0 conn(0x7f604814e530 legacy=0x7f60480b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:51.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 --2- 172.21.2.102:0/3168186624 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f60280037f0 0x7f6028003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:51.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 --2- 172.21.2.102:0/3168186624 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f60280044d0 0x7f6028004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:51.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 --2- 172.21.2.102:0/3168186624 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6028004e40 0x7f602800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:51.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 -- 172.21.2.102:0/3168186624 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6048068d20 con 0x7f60280044d0 2021-02-12T17:21:51.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 -- 172.21.2.102:0/3168186624 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60280053a0 con 0x7f60280037f0 2021-02-12T17:21:51.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f6045ffb700 1 -- 172.21.2.102:0/3168186624 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602800bc60 con 0x7f6028004e40 2021-02-12T17:21:51.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f60467fc700 1 --2- 172.21.2.102:0/3168186624 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f60280044d0 0x7f6028004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:51.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f60467fc700 1 -- 172.21.2.102:0/3168186624 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6028004e40 msgr2=0x7f602800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:51.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f60467fc700 1 --2- 172.21.2.102:0/3168186624 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6028004e40 0x7f602800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:51.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f60467fc700 1 -- 172.21.2.102:0/3168186624 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f60280037f0 msgr2=0x7f6028003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:51.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f60467fc700 1 --2- 172.21.2.102:0/3168186624 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f60280037f0 0x7f6028003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:21:51.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f60467fc700 1 -- 172.21.2.102:0/3168186624 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6028003230 con 0x7f60280044d0 2021-02-12T17:21:51.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.782+0000 7f60477fe700 1 -- 172.21.2.102:0/3168186624 reap_dead start 2021-02-12T17:21:51.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.783+0000 7f60467fc700 1 --2- 172.21.2.102:0/3168186624 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f60280044d0 0x7f6028004950 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f603800c260 tx=0x7f604814eba0).ready entity=mon.0 client_cookie=133b94c20c589b75 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:51.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.783+0000 7f6045ffb700 1 -- 172.21.2.102:0/3168186624 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60380070d0 con 0x7f60280044d0 2021-02-12T17:21:51.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.783+0000 7f6045ffb700 1 -- 172.21.2.102:0/3168186624 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6038007230 con 0x7f60280044d0 2021-02-12T17:21:51.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.783+0000 7f6045ffb700 1 -- 172.21.2.102:0/3168186624 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60380055e0 con 0x7f60280044d0 2021-02-12T17:21:51.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.783+0000 7f604d8da700 1 -- 172.21.2.102:0/3168186624 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f60280044d0 msgr2=0x7f6028004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:51.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.783+0000 7f604d8da700 1 --2- 172.21.2.102:0/3168186624 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f60280044d0 0x7f6028004950 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f603800c260 tx=0x7f604814eba0).stop 2021-02-12T17:21:51.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.783+0000 7f604d8da700 1 -- 172.21.2.102:0/3168186624 shutdown_connections 2021-02-12T17:21:51.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.783+0000 7f604d8da700 1 --2- 172.21.2.102:0/3168186624 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f60280044d0 0x7f6028004950 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:51.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.783+0000 7f604d8da700 1 -- 172.21.2.102:0/3168186624 >> 172.21.2.102:0/3168186624 conn(0x7f60480bc480 msgr2=0x7f60480b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:51.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.783+0000 7f604d8da700 1 -- 172.21.2.102:0/3168186624 shutdown_connections 2021-02-12T17:21:51.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.783+0000 7f604d8da700 1 -- 172.21.2.102:0/3168186624 wait complete. 2021-02-12T17:21:51.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.784+0000 7f604d8da700 1 Processor -- start 2021-02-12T17:21:51.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.784+0000 7f604d8da700 1 -- start start 2021-02-12T17:21:51.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f604d8da700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f60280044d0 0x7f6048160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:51.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f604d8da700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6048151680 0x7f60480b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:51.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f604d8da700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f60480b8280 0x7f604815d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:51.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f604d8da700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6048161410 con 0x7f6048151680 2021-02-12T17:21:51.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f604d8da700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6048151b20 con 0x7f60480b8280 2021-02-12T17:21:51.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f604d8da700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6048151dc0 con 0x7f60280044d0 2021-02-12T17:21:51.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f60467fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6048151680 0x7f60480b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:51.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f60467fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6048151680 0x7f60480b7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47434/0 (socket says 172.21.2.102:47434) 2021-02-12T17:21:51.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f60467fc700 1 -- 172.21.2.102:0/3724275084 learned_addr learned my addr 172.21.2.102:0/3724275084 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:51.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f60477fe700 1 --2- 172.21.2.102:0/3724275084 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f60480b8280 0x7f604815d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:51.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f6046ffd700 1 --2- 172.21.2.102:0/3724275084 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f60280044d0 0x7f6048160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:51.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f60467fc700 1 -- 172.21.2.102:0/3724275084 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f60280044d0 msgr2=0x7f6048160f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:51.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f60467fc700 1 --2- 172.21.2.102:0/3724275084 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f60280044d0 0x7f6048160f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:51.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f60467fc700 1 -- 172.21.2.102:0/3724275084 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f60480b8280 msgr2=0x7f604815d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:51.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f60467fc700 1 --2- 172.21.2.102:0/3724275084 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f60480b8280 0x7f604815d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:51.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f60467fc700 1 -- 172.21.2.102:0/3724275084 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6048152060 con 0x7f6048151680 2021-02-12T17:21:51.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.785+0000 7f60467fc700 1 --2- 172.21.2.102:0/3724275084 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6048151680 0x7f60480b7d90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f6038000bc0 tx=0x7f6038013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:51.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.786+0000 7f603effd700 1 -- 172.21.2.102:0/3724275084 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038008e50 con 0x7f6048151680 2021-02-12T17:21:51.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.786+0000 7f603effd700 1 -- 172.21.2.102:0/3724275084 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6038018070 con 0x7f6048151680 2021-02-12T17:21:51.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.786+0000 7f604d8da700 1 -- 172.21.2.102:0/3724275084 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604815cf60 con 0x7f6048151680 2021-02-12T17:21:51.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.786+0000 7f604d8da700 1 -- 172.21.2.102:0/3724275084 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60480b07b0 con 0x7f6048151680 2021-02-12T17:21:51.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.786+0000 7f603effd700 1 -- 172.21.2.102:0/3724275084 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038005470 con 0x7f6048151680 2021-02-12T17:21:51.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.786+0000 7f604d8da700 1 -- 172.21.2.102:0/3724275084 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604815d3c0 con 0x7f6048151680 2021-02-12T17:21:51.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.787+0000 7f603effd700 1 -- 172.21.2.102:0/3724275084 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f6038010070 con 0x7f6048151680 2021-02-12T17:21:51.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.787+0000 7f603effd700 1 --2- 172.21.2.102:0/3724275084 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f602c059d80 0x7f602c05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:51.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.787+0000 7f603effd700 1 -- 172.21.2.102:0/3724275084 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7451+0+0 (secure 0 0 0) 0x7f6038075020 con 0x7f6048151680 2021-02-12T17:21:51.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.787+0000 7f6046ffd700 1 --2- 172.21.2.102:0/3724275084 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f602c059d80 0x7f602c05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:51.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.787+0000 7f6046ffd700 1 --2- 172.21.2.102:0/3724275084 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f602c059d80 0x7f602c05c240 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f6030006fd0 tx=0x7f6030008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:51.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.790+0000 7f603effd700 1 -- 172.21.2.102:0/3724275084 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f6038048550 con 0x7f6048151680 2021-02-12T17:21:51.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.950+0000 7f604d8da700 1 -- 172.21.2.102:0/3724275084 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6048045460 con 0x7f6048151680 2021-02-12T17:21:51.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.951+0000 7f603effd700 1 -- 172.21.2.102:0/3724275084 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3409 (secure 0 0 0) 0x7f603804bb70 con 0x7f6048151680 2021-02-12T17:21:51.952 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:51.952 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:21:51.323904+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34514":{"gid":34514,"name":"d","rank":0,"incarnation":41,"state":"up:replay","state_seq":1,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:51.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.952+0000 7f604d8da700 1 -- 172.21.2.102:0/3724275084 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f602c059d80 msgr2=0x7f602c05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:51.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.952+0000 7f604d8da700 1 --2- 172.21.2.102:0/3724275084 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f602c059d80 0x7f602c05c240 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f6030006fd0 tx=0x7f6030008040).stop 2021-02-12T17:21:51.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.952+0000 7f604d8da700 1 -- 172.21.2.102:0/3724275084 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6048151680 msgr2=0x7f60480b7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:51.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.952+0000 7f604d8da700 1 --2- 172.21.2.102:0/3724275084 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6048151680 0x7f60480b7d90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f6038000bc0 tx=0x7f6038013000).stop 2021-02-12T17:21:51.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.952+0000 7f604d8da700 1 -- 172.21.2.102:0/3724275084 shutdown_connections 2021-02-12T17:21:51.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.952+0000 7f604d8da700 1 --2- 172.21.2.102:0/3724275084 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f60480b8280 0x7f604815d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:51.953 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.952+0000 7f604d8da700 1 --2- 172.21.2.102:0/3724275084 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f60280044d0 0x7f6048160f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:51.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.952+0000 7f604d8da700 1 --2- 172.21.2.102:0/3724275084 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f602c059d80 0x7f602c05c240 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:51.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.952+0000 7f604d8da700 1 --2- 172.21.2.102:0/3724275084 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6048151680 0x7f60480b7d90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:51.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.952+0000 7f604d8da700 1 -- 172.21.2.102:0/3724275084 >> 172.21.2.102:0/3724275084 conn(0x7f60480bc480 msgr2=0x7f60480b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:51.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.952+0000 7f604d8da700 1 -- 172.21.2.102:0/3724275084 shutdown_connections 2021-02-12T17:21:51.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:51.952+0000 7f604d8da700 1 -- 172.21.2.102:0/3724275084 wait complete. 2021-02-12T17:21:51.954 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 41 2021-02-12T17:21:51.962 INFO:tasks.mds_thrash.fs.[b]:mds.a down, removed from mdsmap 2021-02-12T17:21:51.962 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2021-02-12T17:21:51.962 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:52.048 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.048+0000 7f30d9c68700 1 Processor -- start 2021-02-12T17:21:52.049 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.048+0000 7f30d9c68700 1 -- start start 2021-02-12T17:21:52.049 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.048+0000 7f30d9c68700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30d40b8d20 0x7f30d4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:52.049 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.048+0000 7f30d9c68700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f30d414e530 0x7f30d40b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:52.049 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.048+0000 7f30d9c68700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f30d4062740 0x7f30d4062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:52.049 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.048+0000 7f30d9c68700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d4068d20 con 0x7f30d4062740 2021-02-12T17:21:52.049 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.048+0000 7f30d9c68700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d40622a0 con 0x7f30d414e530 2021-02-12T17:21:52.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.048+0000 7f30d9c68700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d414ea10 con 0x7f30d40b8d20 2021-02-12T17:21:52.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.048+0000 7f30d3fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f30d4062740 0x7f30d4062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:52.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.048+0000 7f30d3fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f30d4062740 0x7f30d4062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47440/0 (socket says 172.21.2.102:47440) 2021-02-12T17:21:52.050 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.048+0000 7f30d3fff700 1 -- 172.21.2.102:0/4089498297 learned_addr learned my addr 172.21.2.102:0/4089498297 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:52.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.049+0000 7f30d37fe700 1 --2- 172.21.2.102:0/4089498297 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30d40b8d20 0x7f30d4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:52.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.049+0000 7f30d3fff700 1 -- 172.21.2.102:0/4089498297 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30d40b8d20 msgr2=0x7f30d4068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:52.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.049+0000 7f30d2ffd700 1 --2- 172.21.2.102:0/4089498297 >> v2:172.21.2.104:3300/0 conn(0x7f30d414e530 0x7f30d40b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:52.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.049+0000 7f30d3fff700 1 --2- 172.21.2.102:0/4089498297 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30d40b8d20 0x7f30d4068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:52.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.049+0000 7f30d3fff700 1 -- 172.21.2.102:0/4089498297 >> v2:172.21.2.104:3300/0 conn(0x7f30d414e530 msgr2=0x7f30d40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:52.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.049+0000 7f30d3fff700 1 --2- 172.21.2.102:0/4089498297 >> v2:172.21.2.104:3300/0 conn(0x7f30d414e530 0x7f30d40b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:52.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.049+0000 7f30d3fff700 1 -- 172.21.2.102:0/4089498297 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d40b63f0 con 0x7f30d4062740 2021-02-12T17:21:52.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.049+0000 7f30d37fe700 1 --2- 172.21.2.102:0/4089498297 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30d40b8d20 0x7f30d4068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:21:52.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.049+0000 7f30d2ffd700 1 --2- 172.21.2.102:0/4089498297 >> v2:172.21.2.104:3300/0 conn(0x7f30d414e530 0x7f30d40b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:21:52.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.049+0000 7f30d3fff700 1 --2- 172.21.2.102:0/4089498297 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f30d4062740 0x7f30d4062bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f30d406aa60 tx=0x7f30cc009290).ready entity=mon.0 client_cookie=586db62133eb2b7d server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:52.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.049+0000 7f30d27fc700 1 -- 172.21.2.102:0/4089498297 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc00bbf0 con 0x7f30d4062740 2021-02-12T17:21:52.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.049+0000 7f30d27fc700 1 -- 172.21.2.102:0/4089498297 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30cc00bd50 con 0x7f30d4062740 2021-02-12T17:21:52.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.049+0000 7f30d27fc700 1 -- 172.21.2.102:0/4089498297 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc011610 con 0x7f30d4062740 2021-02-12T17:21:52.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.050+0000 7f30d9c68700 1 -- 172.21.2.102:0/4089498297 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f30d4062740 msgr2=0x7f30d4062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:52.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.050+0000 7f30d9c68700 1 --2- 172.21.2.102:0/4089498297 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f30d4062740 0x7f30d4062bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f30d406aa60 tx=0x7f30cc009290).stop 2021-02-12T17:21:52.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.050+0000 7f30d9c68700 1 -- 172.21.2.102:0/4089498297 shutdown_connections 2021-02-12T17:21:52.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.050+0000 7f30d9c68700 1 --2- 172.21.2.102:0/4089498297 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30d40b8d20 0x7f30d4068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:52.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.050+0000 7f30d9c68700 1 --2- 172.21.2.102:0/4089498297 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f30d4062740 0x7f30d4062bf0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:52.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.050+0000 7f30d9c68700 1 --2- 172.21.2.102:0/4089498297 >> v2:172.21.2.104:3300/0 conn(0x7f30d414e530 0x7f30d40b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:52.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.050+0000 7f30d9c68700 1 -- 172.21.2.102:0/4089498297 >> 172.21.2.102:0/4089498297 conn(0x7f30d40bc480 msgr2=0x7f30d40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:52.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.050+0000 7f30d9c68700 1 -- 172.21.2.102:0/4089498297 shutdown_connections 2021-02-12T17:21:52.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.050+0000 7f30d9c68700 1 -- 172.21.2.102:0/4089498297 wait complete. 2021-02-12T17:21:52.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.051+0000 7f30d9c68700 1 Processor -- start 2021-02-12T17:21:52.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.051+0000 7f30d9c68700 1 -- start start 2021-02-12T17:21:52.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.051+0000 7f30d9c68700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f30d4062740 0x7f30d4153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:52.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.051+0000 7f30d9c68700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f30d40b8d20 0x7f30d4160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:52.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.051+0000 7f30d9c68700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30d414e530 0x7f30d4160c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:52.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.051+0000 7f30d9c68700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d4161130 con 0x7f30d4062740 2021-02-12T17:21:52.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.051+0000 7f30d9c68700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d40ada40 con 0x7f30d40b8d20 2021-02-12T17:21:52.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.051+0000 7f30d9c68700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d40adce0 con 0x7f30d414e530 2021-02-12T17:21:52.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.051+0000 7f30d37fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f30d4062740 0x7f30d4153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:52.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30d37fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f30d4062740 0x7f30d4153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47448/0 (socket says 172.21.2.102:47448) 2021-02-12T17:21:52.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30d37fe700 1 -- 172.21.2.102:0/2643637261 learned_addr learned my addr 172.21.2.102:0/2643637261 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:52.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30d3fff700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30d414e530 0x7f30d4160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:52.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30d2ffd700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f30d40b8d20 0x7f30d4160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:52.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30d37fe700 1 -- 172.21.2.102:0/2643637261 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30d414e530 msgr2=0x7f30d4160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:52.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30d37fe700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30d414e530 0x7f30d4160c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:52.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30d37fe700 1 -- 172.21.2.102:0/2643637261 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f30d40b8d20 msgr2=0x7f30d4160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:52.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30d37fe700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f30d40b8d20 0x7f30d4160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:52.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30d37fe700 1 -- 172.21.2.102:0/2643637261 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d40b1a90 con 0x7f30d4062740 2021-02-12T17:21:52.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30d2ffd700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f30d40b8d20 0x7f30d4160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:21:52.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30d37fe700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f30d4062740 0x7f30d4153ad0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f30c400cb50 tx=0x7f30c4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:52.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30cb7fe700 1 -- 172.21.2.102:0/2643637261 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4007740 con 0x7f30d4062740 2021-02-12T17:21:52.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30cb7fe700 1 -- 172.21.2.102:0/2643637261 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c40078a0 con 0x7f30d4062740 2021-02-12T17:21:52.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30d9c68700 1 -- 172.21.2.102:0/2643637261 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d40b1d30 con 0x7f30d4062740 2021-02-12T17:21:52.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30cb7fe700 1 -- 172.21.2.102:0/2643637261 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4007c20 con 0x7f30d4062740 2021-02-12T17:21:52.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.052+0000 7f30d9c68700 1 -- 172.21.2.102:0/2643637261 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d4153fc0 con 0x7f30d4062740 2021-02-12T17:21:52.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.053+0000 7f30d9c68700 1 -- 172.21.2.102:0/2643637261 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d40b1740 con 0x7f30d4062740 2021-02-12T17:21:52.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.053+0000 7f30cb7fe700 1 -- 172.21.2.102:0/2643637261 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f30c401b460 con 0x7f30d4062740 2021-02-12T17:21:52.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.053+0000 7f30cb7fe700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f30b8059d80 0x7f30b805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:52.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.054+0000 7f30cb7fe700 1 -- 172.21.2.102:0/2643637261 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7451+0+0 (secure 0 0 0) 0x7f30c40740f0 con 0x7f30d4062740 2021-02-12T17:21:52.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.054+0000 7f30d2ffd700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f30b8059d80 0x7f30b805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:52.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.054+0000 7f30d2ffd700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f30b8059d80 0x7f30b805c240 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f30d40b0be0 tx=0x7f30bc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:52.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.056+0000 7f30cb7fe700 1 -- 172.21.2.102:0/2643637261 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f30c40475e0 con 0x7f30d4062740 2021-02-12T17:21:52.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.215+0000 7f30d9c68700 1 -- 172.21.2.102:0/2643637261 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30d40b18f0 con 0x7f30d4062740 2021-02-12T17:21:52.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.215+0000 7f30cb7fe700 1 -- 172.21.2.102:0/2643637261 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3409 (secure 0 0 0) 0x7f30d40b18f0 con 0x7f30d4062740 2021-02-12T17:21:52.216 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:52.216 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:21:51.323904+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34514":{"gid":34514,"name":"d","rank":0,"incarnation":41,"state":"up:replay","state_seq":1,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:52.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.216+0000 7f30d9c68700 1 -- 172.21.2.102:0/2643637261 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f30b8059d80 msgr2=0x7f30b805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:52.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.216+0000 7f30d9c68700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f30b8059d80 0x7f30b805c240 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f30d40b0be0 tx=0x7f30bc008040).stop 2021-02-12T17:21:52.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.216+0000 7f30d9c68700 1 -- 172.21.2.102:0/2643637261 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f30d4062740 msgr2=0x7f30d4153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:52.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.216+0000 7f30d9c68700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f30d4062740 0x7f30d4153ad0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f30c400cb50 tx=0x7f30c4008040).stop 2021-02-12T17:21:52.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.216+0000 7f30d9c68700 1 -- 172.21.2.102:0/2643637261 shutdown_connections 2021-02-12T17:21:52.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.216+0000 7f30d9c68700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30d414e530 0x7f30d4160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:52.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.216+0000 7f30d9c68700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f30b8059d80 0x7f30b805c240 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:52.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.216+0000 7f30d9c68700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f30d4062740 0x7f30d4153ad0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:52.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.216+0000 7f30d9c68700 1 --2- 172.21.2.102:0/2643637261 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f30d40b8d20 0x7f30d4160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:52.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.216+0000 7f30d9c68700 1 -- 172.21.2.102:0/2643637261 >> 172.21.2.102:0/2643637261 conn(0x7f30d40bc480 msgr2=0x7f30d414ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:52.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.216+0000 7f30d9c68700 1 -- 172.21.2.102:0/2643637261 shutdown_connections 2021-02-12T17:21:52.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:52.217+0000 7f30d9c68700 1 -- 172.21.2.102:0/2643637261 wait complete. 2021-02-12T17:21:52.221 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 41 2021-02-12T17:21:52.227 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 41, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:01.991560+0000", "damaged": [], "data_pools": [ 4 ], "enabled": true, "epoch": 39, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "a", "in": [ 0 ], "info": { "gid_5451": { "addr": "172.21.2.102:6837/2121955587", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6836", "nonce": 2121955587, "type": "v2" }, { "addr": "172.21.2.102:6837", "nonce": 2121955587, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5451, "incarnation": 36, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 13 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2021-02-12T17:21:24.488481+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5451 } } }, { "id": 2, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:08.529588+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 41, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "b", "in": [ 0 ], "info": { "gid_34514": { "addr": "172.21.2.104:6835/2864421012", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6833", "nonce": 2864421012, "type": "v2" }, { "addr": "172.21.2.104:6835", "nonce": 2864421012, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 34514, "incarnation": 41, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 34, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 5, "modified": "2021-02-12T17:21:51.323904+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 34514 } } } ], "standbys": [ { "addr": "172.21.2.104:6834/3149030842", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6832", "nonce": 3149030842, "type": "v2" }, { "addr": "172.21.2.104:6834", "nonce": 3149030842, "type": "v1" } ] }, "epoch": 5, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4243, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 2 } ] } 2021-02-12T17:21:54.228 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:21:54.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.314+0000 7f3a80cb5700 1 Processor -- start 2021-02-12T17:21:54.315 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.314+0000 7f3a80cb5700 1 -- start start 2021-02-12T17:21:54.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.315+0000 7f3a80cb5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a7c0b2cb0 0x7f3a7c0b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:54.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.315+0000 7f3a80cb5700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7c0b54d0 con 0x7f3a7c0b8bd0 2021-02-12T17:21:54.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.315+0000 7f3a80cb5700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7c0b4f90 con 0x7f3a7c0b3090 2021-02-12T17:21:54.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.315+0000 7f3a80cb5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0b40f0 con 0x7f3a7c0b2cb0 2021-02-12T17:21:54.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.315+0000 7f3a79d9b700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f3a7c0b8bd0 0x7f3a7c147cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56102/0 (socket says 172.21.2.102:56102) 2021-02-12T17:21:54.316 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.315+0000 7f3a79d9b700 1 -- 172.21.2.102:0/254460433 learned_addr learned my addr 172.21.2.102:0/254460433 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:21:54.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 -- 172.21.2.102:0/254460433 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121907605 0 0) 0x7f3a7c0b54d0 con 0x7f3a7c0b8bd0 2021-02-12T17:21:54.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 -- 172.21.2.102:0/254460433 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a5c003230 con 0x7f3a7c0b8bd0 2021-02-12T17:21:54.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7a59c700 1 --2- 172.21.2.102:0/254460433 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a7c0b2cb0 0x7f3a7c0b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:54.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 -- 172.21.2.102:0/254460433 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4177210718 0 0) 0x7f3a5c003230 con 0x7f3a7c0b8bd0 2021-02-12T17:21:54.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 -- 172.21.2.102:0/254460433 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a7c0b2cb0 msgr2=0x7f3a7c0b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:54.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 --2- 172.21.2.102:0/254460433 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a7c0b2cb0 0x7f3a7c0b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:54.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 -- 172.21.2.102:0/254460433 >> v1:172.21.2.104:6789/0 conn(0x7f3a7c0b3090 legacy=0x7f3a7c0b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:54.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 -- 172.21.2.102:0/254460433 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c0b5230 con 0x7f3a7c0b8bd0 2021-02-12T17:21:54.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 -- 172.21.2.102:0/254460433 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f3a6c0014e0 con 0x7f3a7c0b8bd0 2021-02-12T17:21:54.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7a59c700 1 --2- 172.21.2.102:0/254460433 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a7c0b2cb0 0x7f3a7c0b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:21:54.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 -- 172.21.2.102:0/254460433 >> v1:172.21.2.102:6789/0 conn(0x7f3a7c0b8bd0 legacy=0x7f3a7c147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:54.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 --2- 172.21.2.102:0/254460433 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3a5c0037d0 0x7f3a5c003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:54.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 --2- 172.21.2.102:0/254460433 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a5c0044d0 0x7f3a5c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:54.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 --2- 172.21.2.102:0/254460433 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a7c0b2cb0 0x7f3a5c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:54.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 -- 172.21.2.102:0/254460433 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0b40f0 con 0x7f3a5c0044d0 2021-02-12T17:21:54.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 -- 172.21.2.102:0/254460433 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c005330 con 0x7f3a5c0037d0 2021-02-12T17:21:54.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a7959a700 1 -- 172.21.2.102:0/254460433 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c00b720 con 0x7f3a7c0b2cb0 2021-02-12T17:21:54.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.316+0000 7f3a79d9b700 1 --2- 172.21.2.102:0/254460433 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a5c0044d0 0x7f3a5c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:54.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.317+0000 7f3a7a59c700 1 --2- 172.21.2.102:0/254460433 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3a5c0037d0 0x7f3a5c003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:54.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.317+0000 7f3a7ad9d700 1 --2- 172.21.2.102:0/254460433 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a7c0b2cb0 0x7f3a5c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:54.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.317+0000 7f3a79d9b700 1 -- 172.21.2.102:0/254460433 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a7c0b2cb0 msgr2=0x7f3a5c004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:54.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.317+0000 7f3a79d9b700 1 --2- 172.21.2.102:0/254460433 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a7c0b2cb0 0x7f3a5c004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:54.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.317+0000 7f3a79d9b700 1 -- 172.21.2.102:0/254460433 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3a5c0037d0 msgr2=0x7f3a5c003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:21:54.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.317+0000 7f3a79d9b700 1 --2- 172.21.2.102:0/254460433 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3a5c0037d0 0x7f3a5c003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:54.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.317+0000 7f3a79d9b700 1 -- 172.21.2.102:0/254460433 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c003230 con 0x7f3a5c0044d0 2021-02-12T17:21:54.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.317+0000 7f3a79d9b700 1 --2- 172.21.2.102:0/254460433 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a5c0044d0 0x7f3a5c004950 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f3a7c064740 tx=0x7f3a6c007740).ready entity=mon.0 client_cookie=5631a778d30eb2fd server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:54.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.317+0000 7f3a7959a700 1 -- 172.21.2.102:0/254460433 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c0077b0 con 0x7f3a5c0044d0 2021-02-12T17:21:54.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.317+0000 7f3a7959a700 1 -- 172.21.2.102:0/254460433 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c00cdf0 con 0x7f3a5c0044d0 2021-02-12T17:21:54.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.317+0000 7f3a7959a700 1 -- 172.21.2.102:0/254460433 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c007320 con 0x7f3a5c0044d0 2021-02-12T17:21:54.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.317+0000 7f3a80cb5700 1 -- 172.21.2.102:0/254460433 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a5c0044d0 msgr2=0x7f3a5c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:54.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.317+0000 7f3a80cb5700 1 --2- 172.21.2.102:0/254460433 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a5c0044d0 0x7f3a5c004950 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f3a7c064740 tx=0x7f3a6c007740).stop 2021-02-12T17:21:54.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.318+0000 7f3a7ad9d700 1 -- 172.21.2.102:0/254460433 reap_dead start 2021-02-12T17:21:54.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.318+0000 7f3a80cb5700 1 -- 172.21.2.102:0/254460433 shutdown_connections 2021-02-12T17:21:54.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.318+0000 7f3a80cb5700 1 -- 172.21.2.102:0/254460433 >> 172.21.2.102:0/254460433 conn(0x7f3a7c0bc480 msgr2=0x7f3a7c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:54.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.318+0000 7f3a80cb5700 1 -- 172.21.2.102:0/254460433 shutdown_connections 2021-02-12T17:21:54.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.318+0000 7f3a80cb5700 1 -- 172.21.2.102:0/254460433 wait complete. 2021-02-12T17:21:54.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.319+0000 7f3a80cb5700 1 Processor -- start 2021-02-12T17:21:54.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.319+0000 7f3a80cb5700 1 -- start start 2021-02-12T17:21:54.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.319+0000 7f3a80cb5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a5c0044d0 0x7f3a7c0b7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:54.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.319+0000 7f3a80cb5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a7c15ac20 0x7f3a7c1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:54.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.319+0000 7f3a80cb5700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3a7c0ae640 0x7f3a7c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:54.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.319+0000 7f3a80cb5700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c15a010 con 0x7f3a7c15ac20 2021-02-12T17:21:54.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.319+0000 7f3a80cb5700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0af8e0 con 0x7f3a7c0ae640 2021-02-12T17:21:54.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.319+0000 7f3a80cb5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c15a240 con 0x7f3a5c0044d0 2021-02-12T17:21:54.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.319+0000 7f3a79d9b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a7c15ac20 0x7f3a7c1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:54.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.319+0000 7f3a79d9b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a7c15ac20 0x7f3a7c1569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47472/0 (socket says 172.21.2.102:47472) 2021-02-12T17:21:54.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.319+0000 7f3a79d9b700 1 -- 172.21.2.102:0/2043635684 learned_addr learned my addr 172.21.2.102:0/2043635684 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:21:54.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.319+0000 7f3a7a59c700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a5c0044d0 0x7f3a7c0b7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:54.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.320+0000 7f3a7ad9d700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3a7c0ae640 0x7f3a7c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:54.325 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.320+0000 7f3a79d9b700 1 -- 172.21.2.102:0/2043635684 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a5c0044d0 msgr2=0x7f3a7c0b7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:54.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.320+0000 7f3a79d9b700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a5c0044d0 0x7f3a7c0b7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:54.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.320+0000 7f3a79d9b700 1 -- 172.21.2.102:0/2043635684 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3a7c0ae640 msgr2=0x7f3a7c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:54.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.320+0000 7f3a79d9b700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3a7c0ae640 0x7f3a7c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:54.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.320+0000 7f3a79d9b700 1 -- 172.21.2.102:0/2043635684 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c15a4e0 con 0x7f3a7c15ac20 2021-02-12T17:21:54.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.320+0000 7f3a7ad9d700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3a7c0ae640 0x7f3a7c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:21:54.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.320+0000 7f3a79d9b700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a7c15ac20 0x7f3a7c1569a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f3a5c004320 tx=0x7f3a6c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:54.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.320+0000 7f3a727fc700 1 -- 172.21.2.102:0/2043635684 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c007df0 con 0x7f3a7c15ac20 2021-02-12T17:21:54.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.320+0000 7f3a727fc700 1 -- 172.21.2.102:0/2043635684 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c005c50 con 0x7f3a7c15ac20 2021-02-12T17:21:54.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.320+0000 7f3a80cb5700 1 -- 172.21.2.102:0/2043635684 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7c15a780 con 0x7f3a7c15ac20 2021-02-12T17:21:54.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.320+0000 7f3a727fc700 1 -- 172.21.2.102:0/2043635684 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c013450 con 0x7f3a7c15ac20 2021-02-12T17:21:54.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.320+0000 7f3a80cb5700 1 -- 172.21.2.102:0/2043635684 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7c115e50 con 0x7f3a7c15ac20 2021-02-12T17:21:54.326 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.321+0000 7f3a80cb5700 1 -- 172.21.2.102:0/2043635684 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a7c15a910 con 0x7f3a7c15ac20 2021-02-12T17:21:54.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.321+0000 7f3a727fc700 1 -- 172.21.2.102:0/2043635684 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f3a6c01d070 con 0x7f3a7c15ac20 2021-02-12T17:21:54.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.321+0000 7f3a727fc700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3a60059d30 0x7f3a6005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:21:54.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.321+0000 7f3a727fc700 1 -- 172.21.2.102:0/2043635684 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7451+0+0 (secure 0 0 0) 0x7f3a6c074e70 con 0x7f3a7c15ac20 2021-02-12T17:21:54.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.321+0000 7f3a7a59c700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3a60059d30 0x7f3a6005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:21:54.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.322+0000 7f3a7a59c700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3a60059d30 0x7f3a6005c1f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f3a6400baf0 tx=0x7f3a64008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:21:54.327 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.324+0000 7f3a727fc700 1 -- 172.21.2.102:0/2043635684 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f3a6c048340 con 0x7f3a7c15ac20 2021-02-12T17:21:54.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.486+0000 7f3a80cb5700 1 -- 172.21.2.102:0/2043635684 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a7c045460 con 0x7f3a7c15ac20 2021-02-12T17:21:54.487 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.486+0000 7f3a727fc700 1 -- 172.21.2.102:0/2043635684 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3410 (secure 0 0 0) 0x7f3a6c01a020 con 0x7f3a7c15ac20 2021-02-12T17:21:54.487 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:21:54.487 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:21:54.333741+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34514":{"gid":34514,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":10,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:21:54.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.487+0000 7f3a80cb5700 1 -- 172.21.2.102:0/2043635684 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3a60059d30 msgr2=0x7f3a6005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:54.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.487+0000 7f3a80cb5700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3a60059d30 0x7f3a6005c1f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f3a6400baf0 tx=0x7f3a64008040).stop 2021-02-12T17:21:54.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.487+0000 7f3a80cb5700 1 -- 172.21.2.102:0/2043635684 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a7c15ac20 msgr2=0x7f3a7c1569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:21:54.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.487+0000 7f3a80cb5700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a7c15ac20 0x7f3a7c1569a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f3a5c004320 tx=0x7f3a6c015000).stop 2021-02-12T17:21:54.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.487+0000 7f3a80cb5700 1 -- 172.21.2.102:0/2043635684 shutdown_connections 2021-02-12T17:21:54.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.487+0000 7f3a80cb5700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3a7c0ae640 0x7f3a7c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:54.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.487+0000 7f3a80cb5700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3a5c0044d0 0x7f3a7c0b7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:54.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.487+0000 7f3a80cb5700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3a60059d30 0x7f3a6005c1f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:54.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.487+0000 7f3a80cb5700 1 --2- 172.21.2.102:0/2043635684 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3a7c15ac20 0x7f3a7c1569a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:21:54.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.488+0000 7f3a80cb5700 1 -- 172.21.2.102:0/2043635684 >> 172.21.2.102:0/2043635684 conn(0x7f3a7c0bc480 msgr2=0x7f3a7c144700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:21:54.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.488+0000 7f3a80cb5700 1 -- 172.21.2.102:0/2043635684 shutdown_connections 2021-02-12T17:21:54.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:21:54.488+0000 7f3a80cb5700 1 -- 172.21.2.102:0/2043635684 wait complete. 2021-02-12T17:21:54.490 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 44 2021-02-12T17:21:54.497 INFO:tasks.mds_thrash.fs.[b]:mds.d has gained rank=0, replacing gid=5280 2021-02-12T17:21:54.497 INFO:tasks.mds_thrash.fs.[b]:waiting for 7 secs before reviving mds.a 2021-02-12T17:21:56.507 INFO:tasks.ceph.mds.d.gibba004.stderr:2021-02-12T17:21:56.505+0000 7f5307f12700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-02-12T17:22:01.498 INFO:tasks.mds_thrash.fs.[b]:reviving mds.a 2021-02-12T17:22:01.499 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-12T17:22:01.499 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-12T17:22:01.502 INFO:tasks.ceph.mds.a:Started 2021-02-12T17:22:01.502 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:01.558 INFO:tasks.ceph.mds.a.gibba002.stdout:starting mds.a at 2021-02-12T17:22:01.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.593+0000 7fdc8a800700 1 Processor -- start 2021-02-12T17:22:01.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.593+0000 7fdc8a800700 1 -- start start 2021-02-12T17:22:01.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.593+0000 7fdc8a800700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fdc840b8d20 0x7fdc84068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:01.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.593+0000 7fdc8a800700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fdc8414e530 0x7fdc840b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:01.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.593+0000 7fdc8a800700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc840622a0 con 0x7fdc84062740 2021-02-12T17:22:01.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.593+0000 7fdc8a800700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc84068d20 con 0x7fdc8414e530 2021-02-12T17:22:01.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.593+0000 7fdc8a800700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8414ea10 con 0x7fdc840b8d20 2021-02-12T17:22:01.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.593+0000 7fdc88d9d700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fdc84062740 0x7fdc84062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56134/0 (socket says 172.21.2.102:56134) 2021-02-12T17:22:01.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.593+0000 7fdc88d9d700 1 -- 172.21.2.102:0/3557711891 learned_addr learned my addr 172.21.2.102:0/3557711891 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:22:01.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.593+0000 7fdc837fe700 1 --2- 172.21.2.102:0/3557711891 >> v2:172.21.2.102:3300/0 conn(0x7fdc8414e530 0x7fdc840b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:01.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc82ffd700 1 -- 172.21.2.102:0/3557711891 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654220783 0 0) 0x7fdc840622a0 con 0x7fdc84062740 2021-02-12T17:22:01.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc82ffd700 1 -- 172.21.2.102:0/3557711891 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc70003230 con 0x7fdc84062740 2021-02-12T17:22:01.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc837fe700 1 -- 172.21.2.102:0/3557711891 >> v2:172.21.2.104:3300/0 conn(0x7fdc840b8d20 msgr2=0x7fdc84068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:01.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc837fe700 1 --2- 172.21.2.102:0/3557711891 >> v2:172.21.2.104:3300/0 conn(0x7fdc840b8d20 0x7fdc84068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:01.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc837fe700 1 -- 172.21.2.102:0/3557711891 >> v1:172.21.2.102:6789/0 conn(0x7fdc84062740 legacy=0x7fdc84062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:01.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc837fe700 1 -- 172.21.2.102:0/3557711891 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840b63f0 con 0x7fdc8414e530 2021-02-12T17:22:01.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc837fe700 1 --2- 172.21.2.102:0/3557711891 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc8414e530 0x7fdc840b7250 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fdc8406abc0 tx=0x7fdc78006de0).ready entity=mon.0 client_cookie=3df661237cee019e server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:01.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc82ffd700 1 -- 172.21.2.102:0/3557711891 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78009630 con 0x7fdc8414e530 2021-02-12T17:22:01.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc82ffd700 1 -- 172.21.2.102:0/3557711891 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc78009790 con 0x7fdc8414e530 2021-02-12T17:22:01.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc82ffd700 1 -- 172.21.2.102:0/3557711891 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78009b10 con 0x7fdc8414e530 2021-02-12T17:22:01.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc8a800700 1 -- 172.21.2.102:0/3557711891 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc8414e530 msgr2=0x7fdc840b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:01.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc8a800700 1 --2- 172.21.2.102:0/3557711891 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc8414e530 0x7fdc840b7250 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fdc8406abc0 tx=0x7fdc78006de0).stop 2021-02-12T17:22:01.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc8a800700 1 -- 172.21.2.102:0/3557711891 shutdown_connections 2021-02-12T17:22:01.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc8a800700 1 --2- 172.21.2.102:0/3557711891 >> v2:172.21.2.104:3300/0 conn(0x7fdc840b8d20 0x7fdc84068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:01.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc8a800700 1 --2- 172.21.2.102:0/3557711891 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc8414e530 0x7fdc840b7250 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:01.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc8a800700 1 -- 172.21.2.102:0/3557711891 >> 172.21.2.102:0/3557711891 conn(0x7fdc840bc480 msgr2=0x7fdc840b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:01.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc8a800700 1 -- 172.21.2.102:0/3557711891 shutdown_connections 2021-02-12T17:22:01.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.594+0000 7fdc8a800700 1 -- 172.21.2.102:0/3557711891 wait complete. 2021-02-12T17:22:01.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.595+0000 7fdc8a800700 1 Processor -- start 2021-02-12T17:22:01.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.595+0000 7fdc8a800700 1 -- start start 2021-02-12T17:22:01.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc8a800700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdc84062740 0x7fdc840aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:01.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc8a800700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc840b8d20 0x7fdc840b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:01.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc8a800700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdc8414e530 0x7fdc840ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:01.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc8a800700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840b4ac0 con 0x7fdc840b8d20 2021-02-12T17:22:01.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc8a800700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840b4d60 con 0x7fdc84062740 2021-02-12T17:22:01.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc8a800700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840b5000 con 0x7fdc8414e530 2021-02-12T17:22:01.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc837fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc840b8d20 0x7fdc840b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:01.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc837fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc840b8d20 0x7fdc840b0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47496/0 (socket says 172.21.2.102:47496) 2021-02-12T17:22:01.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc837fe700 1 -- 172.21.2.102:0/3026534543 learned_addr learned my addr 172.21.2.102:0/3026534543 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:01.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc83fff700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdc84062740 0x7fdc840aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:01.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc88d9d700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdc8414e530 0x7fdc840ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:01.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc837fe700 1 -- 172.21.2.102:0/3026534543 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdc8414e530 msgr2=0x7fdc840ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:01.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc837fe700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdc8414e530 0x7fdc840ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:01.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc837fe700 1 -- 172.21.2.102:0/3026534543 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdc84062740 msgr2=0x7fdc840aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:01.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc837fe700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdc84062740 0x7fdc840aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:01.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc837fe700 1 -- 172.21.2.102:0/3026534543 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840b0da0 con 0x7fdc840b8d20 2021-02-12T17:22:01.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc83fff700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdc84062740 0x7fdc840aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:22:01.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc88d9d700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdc8414e530 0x7fdc840ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:22:01.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc837fe700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc840b8d20 0x7fdc840b0480 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fdc78006e20 tx=0x7fdc78016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:01.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc6bfff700 1 -- 172.21.2.102:0/3026534543 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7801b410 con 0x7fdc840b8d20 2021-02-12T17:22:01.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc6bfff700 1 -- 172.21.2.102:0/3026534543 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7801b570 con 0x7fdc840b8d20 2021-02-12T17:22:01.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc8a800700 1 -- 172.21.2.102:0/3026534543 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc840b09e0 con 0x7fdc840b8d20 2021-02-12T17:22:01.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc6bfff700 1 -- 172.21.2.102:0/3026534543 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7801b910 con 0x7fdc840b8d20 2021-02-12T17:22:01.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.596+0000 7fdc8a800700 1 -- 172.21.2.102:0/3026534543 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8415dde0 con 0x7fdc840b8d20 2021-02-12T17:22:01.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.597+0000 7fdc8a800700 1 -- 172.21.2.102:0/3026534543 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc840b0f30 con 0x7fdc840b8d20 2021-02-12T17:22:01.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.597+0000 7fdc6bfff700 1 -- 172.21.2.102:0/3026534543 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fdc7800f070 con 0x7fdc840b8d20 2021-02-12T17:22:01.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.597+0000 7fdc6bfff700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdc64059d30 0x7fdc6405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:01.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.597+0000 7fdc6bfff700 1 -- 172.21.2.102:0/3026534543 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7451+0+0 (secure 0 0 0) 0x7fdc78074f00 con 0x7fdc840b8d20 2021-02-12T17:22:01.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.598+0000 7fdc83fff700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdc64059d30 0x7fdc6405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:01.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.598+0000 7fdc83fff700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdc64059d30 0x7fdc6405c1f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fdc7400a7a0 tx=0x7fdc74008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:01.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.600+0000 7fdc6bfff700 1 -- 172.21.2.102:0/3026534543 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fdc780484e0 con 0x7fdc840b8d20 2021-02-12T17:22:01.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.760+0000 7fdc8a800700 1 -- 172.21.2.102:0/3026534543 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc84045460 con 0x7fdc840b8d20 2021-02-12T17:22:01.761 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.760+0000 7fdc6bfff700 1 -- 172.21.2.102:0/3026534543 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3410 (secure 0 0 0) 0x7fdc7801f070 con 0x7fdc840b8d20 2021-02-12T17:22:01.762 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:01.762 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:21:54.333741+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34514":{"gid":34514,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":10,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:01.762 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.761+0000 7fdc8a800700 1 -- 172.21.2.102:0/3026534543 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdc64059d30 msgr2=0x7fdc6405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:01.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.761+0000 7fdc8a800700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdc64059d30 0x7fdc6405c1f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fdc7400a7a0 tx=0x7fdc74008040).stop 2021-02-12T17:22:01.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.761+0000 7fdc8a800700 1 -- 172.21.2.102:0/3026534543 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc840b8d20 msgr2=0x7fdc840b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:01.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.761+0000 7fdc8a800700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc840b8d20 0x7fdc840b0480 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fdc78006e20 tx=0x7fdc78016000).stop 2021-02-12T17:22:01.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.762+0000 7fdc8a800700 1 -- 172.21.2.102:0/3026534543 shutdown_connections 2021-02-12T17:22:01.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.762+0000 7fdc8a800700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fdc8414e530 0x7fdc840ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:01.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.762+0000 7fdc8a800700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fdc84062740 0x7fdc840aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:01.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.762+0000 7fdc8a800700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdc64059d30 0x7fdc6405c1f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:01.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.762+0000 7fdc8a800700 1 --2- 172.21.2.102:0/3026534543 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fdc840b8d20 0x7fdc840b0480 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:01.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.762+0000 7fdc8a800700 1 -- 172.21.2.102:0/3026534543 >> 172.21.2.102:0/3026534543 conn(0x7fdc840bc480 msgr2=0x7fdc840baa10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:01.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.762+0000 7fdc8a800700 1 -- 172.21.2.102:0/3026534543 shutdown_connections 2021-02-12T17:22:01.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:01.762+0000 7fdc8a800700 1 -- 172.21.2.102:0/3026534543 wait complete. 2021-02-12T17:22:01.764 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 44 2021-02-12T17:22:01.771 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-02-12T17:22:03.772 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:03.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.860+0000 7f305f132700 1 Processor -- start 2021-02-12T17:22:03.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.860+0000 7f305f132700 1 -- start start 2021-02-12T17:22:03.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f305f132700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f30580b8d20 0x7f3058068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:03.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f305f132700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3058062740 0x7f3058062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:03.862 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f305f132700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580b7960 con 0x7f305814e530 2021-02-12T17:22:03.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f305f132700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3058068d20 con 0x7f3058062740 2021-02-12T17:22:03.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f305f132700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30580622a0 con 0x7f30580b8d20 2021-02-12T17:22:03.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f305d6cf700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3058062740 0x7f3058062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:03.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f305d6cf700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3058062740 0x7f3058062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47512/0 (socket says 172.21.2.102:47512) 2021-02-12T17:22:03.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f305d6cf700 1 -- 172.21.2.102:0/3186755859 learned_addr learned my addr 172.21.2.102:0/3186755859 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:03.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f305d6cf700 1 -- 172.21.2.102:0/3186755859 >> v2:172.21.2.104:3300/0 conn(0x7f30580b8d20 msgr2=0x7f3058068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:22:03.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f305d6cf700 1 --2- 172.21.2.102:0/3186755859 >> v2:172.21.2.104:3300/0 conn(0x7f30580b8d20 0x7f3058068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:03.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f305d6cf700 1 -- 172.21.2.102:0/3186755859 >> v1:172.21.2.104:6789/0 conn(0x7f305814e530 legacy=0x7f30580b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:22:03.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f305d6cf700 1 -- 172.21.2.102:0/3186755859 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305814ea10 con 0x7f3058062740 2021-02-12T17:22:03.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f305d6cf700 1 --2- 172.21.2.102:0/3186755859 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3058062740 0x7f3058062bf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f305806abc0 tx=0x7f3050009290).ready entity=mon.0 client_cookie=b1fe40028e428bfd server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:03.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f30577fe700 1 -- 172.21.2.102:0/3186755859 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305000bbb0 con 0x7f3058062740 2021-02-12T17:22:03.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f30577fe700 1 -- 172.21.2.102:0/3186755859 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305000bd10 con 0x7f3058062740 2021-02-12T17:22:03.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.861+0000 7f30577fe700 1 -- 172.21.2.102:0/3186755859 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050011610 con 0x7f3058062740 2021-02-12T17:22:03.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.862+0000 7f305f132700 1 -- 172.21.2.102:0/3186755859 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3058062740 msgr2=0x7f3058062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:03.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.862+0000 7f305f132700 1 --2- 172.21.2.102:0/3186755859 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3058062740 0x7f3058062bf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f305806abc0 tx=0x7f3050009290).stop 2021-02-12T17:22:03.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.862+0000 7f305f132700 1 -- 172.21.2.102:0/3186755859 shutdown_connections 2021-02-12T17:22:03.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.862+0000 7f305f132700 1 --2- 172.21.2.102:0/3186755859 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3058062740 0x7f3058062bf0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:03.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.862+0000 7f305f132700 1 --2- 172.21.2.102:0/3186755859 >> v2:172.21.2.104:3300/0 conn(0x7f30580b8d20 0x7f3058068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:03.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.862+0000 7f305f132700 1 -- 172.21.2.102:0/3186755859 >> 172.21.2.102:0/3186755859 conn(0x7f30580bc480 msgr2=0x7f30580b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:03.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.862+0000 7f305f132700 1 -- 172.21.2.102:0/3186755859 shutdown_connections 2021-02-12T17:22:03.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.862+0000 7f305f132700 1 -- 172.21.2.102:0/3186755859 wait complete. 2021-02-12T17:22:03.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.863+0000 7f305f132700 1 Processor -- start 2021-02-12T17:22:03.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.863+0000 7f305f132700 1 -- start start 2021-02-12T17:22:03.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.863+0000 7f305f132700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3058062740 0x7f30580b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:03.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.863+0000 7f305f132700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30580b8d20 0x7f3058151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:03.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.863+0000 7f305f132700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f305814e530 0x7f305815d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:03.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.863+0000 7f305f132700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305814d330 con 0x7f3058062740 2021-02-12T17:22:03.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f305f132700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30580ad970 con 0x7f305814e530 2021-02-12T17:22:03.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f305f132700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580adc10 con 0x7f30580b8d20 2021-02-12T17:22:03.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f305cece700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3058062740 0x7f30580b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:03.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f305cece700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3058062740 0x7f30580b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47514/0 (socket says 172.21.2.102:47514) 2021-02-12T17:22:03.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f305cece700 1 -- 172.21.2.102:0/611917601 learned_addr learned my addr 172.21.2.102:0/611917601 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:03.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f305cece700 1 -- 172.21.2.102:0/611917601 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30580b8d20 msgr2=0x7f3058151750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:22:03.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f305cece700 1 --2- 172.21.2.102:0/611917601 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30580b8d20 0x7f3058151750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:03.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f305cece700 1 -- 172.21.2.102:0/611917601 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f305814e530 msgr2=0x7f305815d170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:22:03.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f305cece700 1 --2- 172.21.2.102:0/611917601 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f305814e530 0x7f305815d170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:03.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f305cece700 1 -- 172.21.2.102:0/611917601 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580adeb0 con 0x7f3058062740 2021-02-12T17:22:03.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f305cece700 1 --2- 172.21.2.102:0/611917601 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3058062740 0x7f30580b0590 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f30400096b0 tx=0x7f3040006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:03.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f3054ff9700 1 -- 172.21.2.102:0/611917601 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304000d500 con 0x7f3058062740 2021-02-12T17:22:03.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f3054ff9700 1 -- 172.21.2.102:0/611917601 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304000d6c0 con 0x7f3058062740 2021-02-12T17:22:03.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f3054ff9700 1 -- 172.21.2.102:0/611917601 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304000da80 con 0x7f3058062740 2021-02-12T17:22:03.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f305f132700 1 -- 172.21.2.102:0/611917601 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30580b00f0 con 0x7f3058062740 2021-02-12T17:22:03.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.864+0000 7f305f132700 1 -- 172.21.2.102:0/611917601 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3058151c40 con 0x7f3058062740 2021-02-12T17:22:03.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.865+0000 7f305f132700 1 -- 172.21.2.102:0/611917601 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30580b0280 con 0x7f3058062740 2021-02-12T17:22:03.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.865+0000 7f3054ff9700 1 -- 172.21.2.102:0/611917601 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f3040012420 con 0x7f3058062740 2021-02-12T17:22:03.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.866+0000 7f3054ff9700 1 --2- 172.21.2.102:0/611917601 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f303c059d30 0x7f303c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:03.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.866+0000 7f3054ff9700 1 -- 172.21.2.102:0/611917601 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7451+0+0 (secure 0 0 0) 0x7f3040073da0 con 0x7f3058062740 2021-02-12T17:22:03.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.866+0000 7f3057fff700 1 --2- 172.21.2.102:0/611917601 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f303c059d30 0x7f303c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:03.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.866+0000 7f3057fff700 1 --2- 172.21.2.102:0/611917601 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f303c059d30 0x7f303c05c1f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f30580b0b10 tx=0x7f3048006880).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:03.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:03.869+0000 7f3054ff9700 1 -- 172.21.2.102:0/611917601 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f3040047320 con 0x7f3058062740 2021-02-12T17:22:04.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:04.026+0000 7f305f132700 1 -- 172.21.2.102:0/611917601 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3058045460 con 0x7f3058062740 2021-02-12T17:22:04.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:04.027+0000 7f3054ff9700 1 -- 172.21.2.102:0/611917601 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3763 (secure 0 0 0) 0x7f304004a940 con 0x7f3058062740 2021-02-12T17:22:04.028 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:04.028 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:21:54.333741+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34514":{"gid":34514,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":10,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:04.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:04.028+0000 7f305f132700 1 -- 172.21.2.102:0/611917601 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f303c059d30 msgr2=0x7f303c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:04.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:04.028+0000 7f305f132700 1 --2- 172.21.2.102:0/611917601 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f303c059d30 0x7f303c05c1f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f30580b0b10 tx=0x7f3048006880).stop 2021-02-12T17:22:04.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:04.028+0000 7f305f132700 1 -- 172.21.2.102:0/611917601 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3058062740 msgr2=0x7f30580b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:04.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:04.028+0000 7f305f132700 1 --2- 172.21.2.102:0/611917601 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3058062740 0x7f30580b0590 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f30400096b0 tx=0x7f3040006de0).stop 2021-02-12T17:22:04.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:04.028+0000 7f305f132700 1 -- 172.21.2.102:0/611917601 shutdown_connections 2021-02-12T17:22:04.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:04.028+0000 7f305f132700 1 --2- 172.21.2.102:0/611917601 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f305814e530 0x7f305815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:04.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:04.028+0000 7f305f132700 1 --2- 172.21.2.102:0/611917601 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f303c059d30 0x7f303c05c1f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:04.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:04.028+0000 7f305f132700 1 --2- 172.21.2.102:0/611917601 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3058062740 0x7f30580b0590 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:04.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:04.028+0000 7f305f132700 1 --2- 172.21.2.102:0/611917601 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f30580b8d20 0x7f3058151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:04.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:04.028+0000 7f305f132700 1 -- 172.21.2.102:0/611917601 >> 172.21.2.102:0/611917601 conn(0x7f30580bc480 msgr2=0x7f305814cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:04.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:04.028+0000 7f305f132700 1 -- 172.21.2.102:0/611917601 shutdown_connections 2021-02-12T17:22:04.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:04.028+0000 7f305f132700 1 -- 172.21.2.102:0/611917601 wait complete. 2021-02-12T17:22:04.030 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 45 2021-02-12T17:22:04.037 INFO:tasks.mds_thrash.fs.[b]:mds.a reported in up:standby state 2021-02-12T17:22:04.038 INFO:tasks.mds_thrash.fs.[b]:waiting for 11 secs before thrashing 2021-02-12T17:22:11.104 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:22:11.110 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:22:15.039 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:15.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.126+0000 7faae373a700 1 Processor -- start 2021-02-12T17:22:15.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.126+0000 7faae373a700 1 -- start start 2021-02-12T17:22:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae373a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7faadc0b8d20 0x7faadc068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:15.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae373a700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7faadc14e530 0x7faadc0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae373a700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7faadc062740 0x7faadc062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae373a700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc068d20 con 0x7faadc14e530 2021-02-12T17:22:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae373a700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc0622a0 con 0x7faadc062740 2021-02-12T17:22:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae373a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc14ea10 con 0x7faadc0b8d20 2021-02-12T17:22:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae0cd5700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7faadc14e530 0x7faadc0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae0cd5700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7faadc14e530 0x7faadc0b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47522/0 (socket says 172.21.2.102:47522) 2021-02-12T17:22:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae0cd5700 1 -- 172.21.2.102:0/3853715800 learned_addr learned my addr 172.21.2.102:0/3853715800 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae0cd5700 1 -- 172.21.2.102:0/3853715800 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7faadc0b8d20 msgr2=0x7faadc068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:22:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae0cd5700 1 --2- 172.21.2.102:0/3853715800 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7faadc0b8d20 0x7faadc068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae0cd5700 1 -- 172.21.2.102:0/3853715800 >> v2:172.21.2.104:3300/0 conn(0x7faadc062740 msgr2=0x7faadc062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:22:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae0cd5700 1 --2- 172.21.2.102:0/3853715800 >> v2:172.21.2.104:3300/0 conn(0x7faadc062740 0x7faadc062bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:15.129 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae0cd5700 1 -- 172.21.2.102:0/3853715800 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc0b63f0 con 0x7faadc14e530 2021-02-12T17:22:15.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faae0cd5700 1 --2- 172.21.2.102:0/3853715800 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7faadc14e530 0x7faadc0b7250 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7faadc067bb0 tx=0x7faacc006ea0).ready entity=mon.0 client_cookie=34eb4362af7ddd33 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:15.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.127+0000 7faacbfff700 1 -- 172.21.2.102:0/3853715800 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc009840 con 0x7faadc14e530 2021-02-12T17:22:15.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.128+0000 7faacbfff700 1 -- 172.21.2.102:0/3853715800 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc0099a0 con 0x7faadc14e530 2021-02-12T17:22:15.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.128+0000 7faacbfff700 1 -- 172.21.2.102:0/3853715800 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc009d20 con 0x7faadc14e530 2021-02-12T17:22:15.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.128+0000 7faae373a700 1 -- 172.21.2.102:0/3853715800 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7faadc14e530 msgr2=0x7faadc0b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:15.130 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.128+0000 7faae373a700 1 --2- 172.21.2.102:0/3853715800 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7faadc14e530 0x7faadc0b7250 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7faadc067bb0 tx=0x7faacc006ea0).stop 2021-02-12T17:22:15.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.128+0000 7faae373a700 1 -- 172.21.2.102:0/3853715800 shutdown_connections 2021-02-12T17:22:15.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.128+0000 7faae373a700 1 --2- 172.21.2.102:0/3853715800 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7faadc0b8d20 0x7faadc068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:15.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.128+0000 7faae373a700 1 --2- 172.21.2.102:0/3853715800 >> v2:172.21.2.104:3300/0 conn(0x7faadc062740 0x7faadc062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:15.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.128+0000 7faae373a700 1 --2- 172.21.2.102:0/3853715800 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7faadc14e530 0x7faadc0b7250 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:15.131 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.128+0000 7faae373a700 1 -- 172.21.2.102:0/3853715800 >> 172.21.2.102:0/3853715800 conn(0x7faadc0bc480 msgr2=0x7faadc0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:15.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.128+0000 7faae373a700 1 -- 172.21.2.102:0/3853715800 shutdown_connections 2021-02-12T17:22:15.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.128+0000 7faae373a700 1 -- 172.21.2.102:0/3853715800 wait complete. 2021-02-12T17:22:15.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.129+0000 7faae373a700 1 Processor -- start 2021-02-12T17:22:15.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.129+0000 7faae373a700 1 -- start start 2021-02-12T17:22:15.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.129+0000 7faae373a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7faadc062740 0x7faadc11d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:15.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.129+0000 7faae373a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7faadc0b8d20 0x7faadc13f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:15.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.129+0000 7faae373a700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7faadc14e530 0x7faadc13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:15.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.129+0000 7faae373a700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc15dbb0 con 0x7faadc0b8d20 2021-02-12T17:22:15.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.129+0000 7faae373a700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc15de50 con 0x7faadc14e530 2021-02-12T17:22:15.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.129+0000 7faae373a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc15e0f0 con 0x7faadc062740 2021-02-12T17:22:15.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.130+0000 7faae0cd5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7faadc0b8d20 0x7faadc13f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:15.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.130+0000 7faae0cd5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7faadc0b8d20 0x7faadc13f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47526/0 (socket says 172.21.2.102:47526) 2021-02-12T17:22:15.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.130+0000 7faae0cd5700 1 -- 172.21.2.102:0/3521500302 learned_addr learned my addr 172.21.2.102:0/3521500302 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:15.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.130+0000 7faae0cd5700 1 -- 172.21.2.102:0/3521500302 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7faadc062740 msgr2=0x7faadc11d570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:22:15.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.130+0000 7faae0cd5700 1 --2- 172.21.2.102:0/3521500302 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7faadc062740 0x7faadc11d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:15.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.130+0000 7faae0cd5700 1 -- 172.21.2.102:0/3521500302 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7faadc14e530 msgr2=0x7faadc13fa30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:22:15.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.130+0000 7faae0cd5700 1 --2- 172.21.2.102:0/3521500302 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7faadc14e530 0x7faadc13fa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:15.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.130+0000 7faae0cd5700 1 -- 172.21.2.102:0/3521500302 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc15e390 con 0x7faadc0b8d20 2021-02-12T17:22:15.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.130+0000 7faae0cd5700 1 --2- 172.21.2.102:0/3521500302 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7faadc0b8d20 0x7faadc13f540 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7faacc010000 tx=0x7faacc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:15.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.130+0000 7faac97fa700 1 -- 172.21.2.102:0/3521500302 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc01c420 con 0x7faadc0b8d20 2021-02-12T17:22:15.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.130+0000 7faac97fa700 1 -- 172.21.2.102:0/3521500302 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc01c580 con 0x7faadc0b8d20 2021-02-12T17:22:15.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.130+0000 7faac97fa700 1 -- 172.21.2.102:0/3521500302 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc01c900 con 0x7faadc0b8d20 2021-02-12T17:22:15.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.130+0000 7faae373a700 1 -- 172.21.2.102:0/3521500302 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc13ff20 con 0x7faadc0b8d20 2021-02-12T17:22:15.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.130+0000 7faae373a700 1 -- 172.21.2.102:0/3521500302 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc0b5220 con 0x7faadc0b8d20 2021-02-12T17:22:15.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.131+0000 7faae373a700 1 -- 172.21.2.102:0/3521500302 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc045460 con 0x7faadc0b8d20 2021-02-12T17:22:15.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.131+0000 7faac97fa700 1 -- 172.21.2.102:0/3521500302 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7faacc023030 con 0x7faadc0b8d20 2021-02-12T17:22:15.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.131+0000 7faac97fa700 1 --2- 172.21.2.102:0/3521500302 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7faabc059d80 0x7faabc05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:15.134 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.131+0000 7faac97fa700 1 -- 172.21.2.102:0/3521500302 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7451+0+0 (secure 0 0 0) 0x7faacc074c90 con 0x7faadc0b8d20 2021-02-12T17:22:15.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.131+0000 7faae14d6700 1 --2- 172.21.2.102:0/3521500302 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7faabc059d80 0x7faabc05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:15.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.132+0000 7faae14d6700 1 --2- 172.21.2.102:0/3521500302 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7faabc059d80 0x7faabc05c240 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7faad800b420 tx=0x7faad8006920).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:15.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.134+0000 7faac97fa700 1 -- 172.21.2.102:0/3521500302 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7faacc048290 con 0x7faadc0b8d20 2021-02-12T17:22:15.294 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.293+0000 7faae373a700 1 -- 172.21.2.102:0/3521500302 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faadc0b8910 con 0x7faadc0b8d20 2021-02-12T17:22:15.294 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.293+0000 7faac97fa700 1 -- 172.21.2.102:0/3521500302 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3763 (secure 0 0 0) 0x7faacc021030 con 0x7faadc0b8d20 2021-02-12T17:22:15.294 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:15.294 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:21:54.333741+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34514":{"gid":34514,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":10,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:15.295 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.295+0000 7faae373a700 1 -- 172.21.2.102:0/3521500302 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7faabc059d80 msgr2=0x7faabc05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:15.295 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.295+0000 7faae373a700 1 --2- 172.21.2.102:0/3521500302 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7faabc059d80 0x7faabc05c240 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7faad800b420 tx=0x7faad8006920).stop 2021-02-12T17:22:15.295 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.295+0000 7faae373a700 1 -- 172.21.2.102:0/3521500302 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7faadc0b8d20 msgr2=0x7faadc13f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:15.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.295+0000 7faae373a700 1 --2- 172.21.2.102:0/3521500302 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7faadc0b8d20 0x7faadc13f540 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7faacc010000 tx=0x7faacc016000).stop 2021-02-12T17:22:15.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.295+0000 7faae373a700 1 -- 172.21.2.102:0/3521500302 shutdown_connections 2021-02-12T17:22:15.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.295+0000 7faae373a700 1 --2- 172.21.2.102:0/3521500302 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7faadc14e530 0x7faadc13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:15.296 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.295+0000 7faae373a700 1 --2- 172.21.2.102:0/3521500302 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7faadc062740 0x7faadc11d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:15.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.295+0000 7faae373a700 1 --2- 172.21.2.102:0/3521500302 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7faabc059d80 0x7faabc05c240 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:15.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.295+0000 7faae373a700 1 --2- 172.21.2.102:0/3521500302 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7faadc0b8d20 0x7faadc13f540 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:15.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.295+0000 7faae373a700 1 -- 172.21.2.102:0/3521500302 >> 172.21.2.102:0/3521500302 conn(0x7faadc0bc480 msgr2=0x7faadc14ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:15.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.295+0000 7faae373a700 1 -- 172.21.2.102:0/3521500302 shutdown_connections 2021-02-12T17:22:15.297 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.295+0000 7faae373a700 1 -- 172.21.2.102:0/3521500302 wait complete. 2021-02-12T17:22:15.297 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 45 2021-02-12T17:22:15.304 INFO:tasks.mds_thrash.fs.[b]:kill mds.d (rank=0) 2021-02-12T17:22:15.305 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2021-02-12T17:22:15.305 INFO:teuthology.orchestra.run:waiting for 300 2021-02-12T17:22:15.311 INFO:tasks.ceph.mds.d:Stopped 2021-02-12T17:22:15.311 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:15.398 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.397+0000 7f35cf222700 1 Processor -- start 2021-02-12T17:22:15.398 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.397+0000 7f35cf222700 1 -- start start 2021-02-12T17:22:15.399 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.398+0000 7f35cf222700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f35c80626a0 0x7f35c80b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:15.399 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.398+0000 7f35cf222700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c80b8b60 0x7f35c8144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:15.399 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.398+0000 7f35cf222700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c8062b30 con 0x7f35c8067720 2021-02-12T17:22:15.399 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.398+0000 7f35cf222700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c80b6840 con 0x7f35c80626a0 2021-02-12T17:22:15.399 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.398+0000 7f35cf222700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8066ed0 con 0x7f35c80b8b60 2021-02-12T17:22:15.400 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.399+0000 7f35c7fff700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f35c80626a0 0x7f35c80b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:15.400 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.399+0000 7f35c7fff700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f35c80626a0 0x7f35c80b6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:45898/0 (socket says 172.21.2.102:45898) 2021-02-12T17:22:15.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.399+0000 7f35c7fff700 1 -- 172.21.2.102:0/3592966885 learned_addr learned my addr 172.21.2.102:0/3592966885 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:15.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.399+0000 7f35ccfbe700 1 --1- 172.21.2.102:0/3592966885 >> v1:172.21.2.104:6789/0 conn(0x7f35c8067720 0x7f35c8146480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:38550/0 (socket says 172.21.2.102:38550) 2021-02-12T17:22:15.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.400+0000 7f35cd7bf700 1 --2- 172.21.2.102:0/3592966885 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c80b8b60 0x7f35c8144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:15.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.400+0000 7f35c7fff700 1 -- 172.21.2.102:0/3592966885 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c80b8b60 msgr2=0x7f35c8144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:15.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.400+0000 7f35c7fff700 1 --2- 172.21.2.102:0/3592966885 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c80b8b60 0x7f35c8144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:15.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.400+0000 7f35c7fff700 1 -- 172.21.2.102:0/3592966885 >> v1:172.21.2.104:6789/0 conn(0x7f35c8067720 legacy=0x7f35c8146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:15.401 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.400+0000 7f35c7fff700 1 -- 172.21.2.102:0/3592966885 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c8067170 con 0x7f35c80626a0 2021-02-12T17:22:15.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.400+0000 7f35c7fff700 1 --2- 172.21.2.102:0/3592966885 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f35c80626a0 0x7f35c80b6350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f35b800b9e0 tx=0x7f35b8006ea0).ready entity=mon.1 client_cookie=5796eba80c387701 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:15.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.400+0000 7f35c77fe700 1 -- 172.21.2.102:0/3592966885 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8009840 con 0x7f35c80626a0 2021-02-12T17:22:15.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.400+0000 7f35c77fe700 1 -- 172.21.2.102:0/3592966885 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b80099a0 con 0x7f35c80626a0 2021-02-12T17:22:15.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.400+0000 7f35c77fe700 1 -- 172.21.2.102:0/3592966885 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8009d20 con 0x7f35c80626a0 2021-02-12T17:22:15.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.400+0000 7f35cf222700 1 -- 172.21.2.102:0/3592966885 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f35c80626a0 msgr2=0x7f35c80b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:15.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.400+0000 7f35cf222700 1 --2- 172.21.2.102:0/3592966885 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f35c80626a0 0x7f35c80b6350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f35b800b9e0 tx=0x7f35b8006ea0).stop 2021-02-12T17:22:15.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.401+0000 7f35cf222700 1 -- 172.21.2.102:0/3592966885 shutdown_connections 2021-02-12T17:22:15.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.401+0000 7f35cf222700 1 --2- 172.21.2.102:0/3592966885 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c80b8b60 0x7f35c8144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:15.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.401+0000 7f35cf222700 1 --2- 172.21.2.102:0/3592966885 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f35c80626a0 0x7f35c80b6350 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:15.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.401+0000 7f35cf222700 1 -- 172.21.2.102:0/3592966885 >> 172.21.2.102:0/3592966885 conn(0x7f35c80bc480 msgr2=0x7f35c80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:15.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.401+0000 7f35cf222700 1 -- 172.21.2.102:0/3592966885 shutdown_connections 2021-02-12T17:22:15.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.401+0000 7f35cf222700 1 -- 172.21.2.102:0/3592966885 wait complete. 2021-02-12T17:22:15.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.402+0000 7f35cf222700 1 Processor -- start 2021-02-12T17:22:15.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.402+0000 7f35cf222700 1 -- start start 2021-02-12T17:22:15.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.402+0000 7f35cf222700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c80626a0 0x7f35c81549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:15.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.402+0000 7f35cf222700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f35c8067720 0x7f35c8154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:15.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.402+0000 7f35cf222700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35c80b8b60 0x7f35c80ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:15.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.402+0000 7f35cf222700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8147540 con 0x7f35c80b8b60 2021-02-12T17:22:15.406 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.402+0000 7f35cf222700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8155510 con 0x7f35c8067720 2021-02-12T17:22:15.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.402+0000 7f35cf222700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c81557b0 con 0x7f35c80626a0 2021-02-12T17:22:15.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.402+0000 7f35cd7bf700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35c80b8b60 0x7f35c80ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:15.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.402+0000 7f35cd7bf700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35c80b8b60 0x7f35c80ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47544/0 (socket says 172.21.2.102:47544) 2021-02-12T17:22:15.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.402+0000 7f35cd7bf700 1 -- 172.21.2.102:0/998260681 learned_addr learned my addr 172.21.2.102:0/998260681 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:15.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.403+0000 7f35cd7bf700 1 -- 172.21.2.102:0/998260681 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c80626a0 msgr2=0x7f35c81549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:15.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.403+0000 7f35cd7bf700 1 --2- 172.21.2.102:0/998260681 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c80626a0 0x7f35c81549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:15.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.403+0000 7f35cd7bf700 1 -- 172.21.2.102:0/998260681 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f35c8067720 msgr2=0x7f35c8154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:15.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.403+0000 7f35cd7bf700 1 --2- 172.21.2.102:0/998260681 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f35c8067720 0x7f35c8154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:15.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.403+0000 7f35cd7bf700 1 -- 172.21.2.102:0/998260681 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c8147770 con 0x7f35c80b8b60 2021-02-12T17:22:15.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.403+0000 7f35cd7bf700 1 --2- 172.21.2.102:0/998260681 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35c80b8b60 0x7f35c80ae8e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f35c000ed20 tx=0x7f35c00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:15.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.403+0000 7f35c4ff9700 1 -- 172.21.2.102:0/998260681 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0009580 con 0x7f35c80b8b60 2021-02-12T17:22:15.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.403+0000 7f35c4ff9700 1 -- 172.21.2.102:0/998260681 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c000eed0 con 0x7f35c80b8b60 2021-02-12T17:22:15.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.403+0000 7f35c4ff9700 1 -- 172.21.2.102:0/998260681 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c000ce10 con 0x7f35c80b8b60 2021-02-12T17:22:15.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.403+0000 7f35cf222700 1 -- 172.21.2.102:0/998260681 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c8145a80 con 0x7f35c80b8b60 2021-02-12T17:22:15.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.403+0000 7f35cf222700 1 -- 172.21.2.102:0/998260681 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c80b5bb0 con 0x7f35c80b8b60 2021-02-12T17:22:15.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.404+0000 7f35cf222700 1 -- 172.21.2.102:0/998260681 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c8045460 con 0x7f35c80b8b60 2021-02-12T17:22:15.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.404+0000 7f35c4ff9700 1 -- 172.21.2.102:0/998260681 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f35c0022070 con 0x7f35c80b8b60 2021-02-12T17:22:15.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.404+0000 7f35c4ff9700 1 --2- 172.21.2.102:0/998260681 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f35ac059d80 0x7f35ac05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:15.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.404+0000 7f35c4ff9700 1 -- 172.21.2.102:0/998260681 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7451+0+0 (secure 0 0 0) 0x7f35c0074600 con 0x7f35c80b8b60 2021-02-12T17:22:15.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.404+0000 7f35ccfbe700 1 --2- 172.21.2.102:0/998260681 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f35ac059d80 0x7f35ac05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:15.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.405+0000 7f35ccfbe700 1 --2- 172.21.2.102:0/998260681 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f35ac059d80 0x7f35ac05c240 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f35b0001330 tx=0x7f35b00077f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:15.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.407+0000 7f35c4ff9700 1 -- 172.21.2.102:0/998260681 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f35c0047b50 con 0x7f35c80b8b60 2021-02-12T17:22:15.566 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.565+0000 7f35cf222700 1 -- 172.21.2.102:0/998260681 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35c8064100 con 0x7f35c80b8b60 2021-02-12T17:22:15.566 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.566+0000 7f35c4ff9700 1 -- 172.21.2.102:0/998260681 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3763 (secure 0 0 0) 0x7f35c0016020 con 0x7f35c80b8b60 2021-02-12T17:22:15.567 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:15.567 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:21:54.333741+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34514":{"gid":34514,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":10,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:15.567 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.567+0000 7f35cf222700 1 -- 172.21.2.102:0/998260681 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f35ac059d80 msgr2=0x7f35ac05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:15.567 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.567+0000 7f35cf222700 1 --2- 172.21.2.102:0/998260681 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f35ac059d80 0x7f35ac05c240 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f35b0001330 tx=0x7f35b00077f0).stop 2021-02-12T17:22:15.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.567+0000 7f35cf222700 1 -- 172.21.2.102:0/998260681 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35c80b8b60 msgr2=0x7f35c80ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:15.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.567+0000 7f35cf222700 1 --2- 172.21.2.102:0/998260681 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35c80b8b60 0x7f35c80ae8e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f35c000ed20 tx=0x7f35c00091d0).stop 2021-02-12T17:22:15.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.567+0000 7f35cf222700 1 -- 172.21.2.102:0/998260681 shutdown_connections 2021-02-12T17:22:15.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.567+0000 7f35cf222700 1 --2- 172.21.2.102:0/998260681 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f35ac059d80 0x7f35ac05c240 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:15.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.567+0000 7f35cf222700 1 --2- 172.21.2.102:0/998260681 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35c80b8b60 0x7f35c80ae8e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:15.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.567+0000 7f35cf222700 1 --2- 172.21.2.102:0/998260681 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c80626a0 0x7f35c81549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:15.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.567+0000 7f35cf222700 1 --2- 172.21.2.102:0/998260681 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f35c8067720 0x7f35c8154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:15.568 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.567+0000 7f35cf222700 1 -- 172.21.2.102:0/998260681 >> 172.21.2.102:0/998260681 conn(0x7f35c80bc480 msgr2=0x7f35c80b6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:15.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.567+0000 7f35cf222700 1 -- 172.21.2.102:0/998260681 shutdown_connections 2021-02-12T17:22:15.569 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:15.567+0000 7f35cf222700 1 -- 172.21.2.102:0/998260681 wait complete. 2021-02-12T17:22:15.569 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 45 2021-02-12T17:22:15.576 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:22:17.578 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:17.667 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.667+0000 7f500af13700 1 Processor -- start 2021-02-12T17:22:17.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.667+0000 7f500af13700 1 -- start start 2021-02-12T17:22:17.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.667+0000 7f500af13700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f5004062e50 0x7f5004068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:17.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.667+0000 7f500af13700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50040b7960 con 0x7f50040b8d20 2021-02-12T17:22:17.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.667+0000 7f500af13700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50040622a0 con 0x7f500414e530 2021-02-12T17:22:17.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.667+0000 7f500af13700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5004068d20 con 0x7f5004062e50 2021-02-12T17:22:17.668 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.668+0000 7f5008caf700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f50040b8d20 0x7f50040b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56196/0 (socket says 172.21.2.102:56196) 2021-02-12T17:22:17.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.668+0000 7f50094b0700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f5004062e50 0x7f5004068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:17.669 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.668+0000 7f5008caf700 1 -- 172.21.2.102:0/2491296465 learned_addr learned my addr 172.21.2.102:0/2491296465 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:22:17.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.668+0000 7f50094b0700 1 -- 172.21.2.102:0/2491296465 >> v1:172.21.2.104:6789/0 conn(0x7f500414e530 legacy=0x7f5004062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:17.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.668+0000 7f50094b0700 1 -- 172.21.2.102:0/2491296465 >> v1:172.21.2.102:6789/0 conn(0x7f50040b8d20 legacy=0x7f50040b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:17.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.668+0000 7f50094b0700 1 -- 172.21.2.102:0/2491296465 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500414ea10 con 0x7f5004062e50 2021-02-12T17:22:17.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.668+0000 7f50094b0700 1 --2- 172.21.2.102:0/2491296465 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5004062e50 0x7f5004068830 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f4ff400b980 tx=0x7f4ff4006de0).ready entity=mon.0 client_cookie=d2cc1f67e316b4c7 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:17.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.668+0000 7f50037fe700 1 -- 172.21.2.102:0/2491296465 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff40097a0 con 0x7f5004062e50 2021-02-12T17:22:17.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.668+0000 7f50037fe700 1 -- 172.21.2.102:0/2491296465 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff4009900 con 0x7f5004062e50 2021-02-12T17:22:17.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.669+0000 7f50037fe700 1 -- 172.21.2.102:0/2491296465 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4009c80 con 0x7f5004062e50 2021-02-12T17:22:17.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.669+0000 7f500af13700 1 -- 172.21.2.102:0/2491296465 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5004062e50 msgr2=0x7f5004068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:17.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.669+0000 7f500af13700 1 --2- 172.21.2.102:0/2491296465 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5004062e50 0x7f5004068830 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f4ff400b980 tx=0x7f4ff4006de0).stop 2021-02-12T17:22:17.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.669+0000 7f500af13700 1 -- 172.21.2.102:0/2491296465 shutdown_connections 2021-02-12T17:22:17.670 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.669+0000 7f500af13700 1 --2- 172.21.2.102:0/2491296465 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5004062e50 0x7f5004068830 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:17.671 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.669+0000 7f500af13700 1 -- 172.21.2.102:0/2491296465 >> 172.21.2.102:0/2491296465 conn(0x7f50040bc480 msgr2=0x7f50040b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:17.671 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.669+0000 7f500af13700 1 -- 172.21.2.102:0/2491296465 shutdown_connections 2021-02-12T17:22:17.671 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.669+0000 7f500af13700 1 -- 172.21.2.102:0/2491296465 wait complete. 2021-02-12T17:22:17.671 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.670+0000 7f500af13700 1 Processor -- start 2021-02-12T17:22:17.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.670+0000 7f500af13700 1 -- start start 2021-02-12T17:22:17.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f500af13700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5004062e50 0x7f50040b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:17.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f500af13700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f50040b8d20 0x7f5004153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:17.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f500af13700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f500414e530 0x7f500414ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:17.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f500af13700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50040acf10 con 0x7f5004062e50 2021-02-12T17:22:17.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f500af13700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500415d450 con 0x7f50040b8d20 2021-02-12T17:22:17.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f500af13700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5004153500 con 0x7f500414e530 2021-02-12T17:22:17.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f5008caf700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5004062e50 0x7f50040b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:17.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f5008caf700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5004062e50 0x7f50040b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47558/0 (socket says 172.21.2.102:47558) 2021-02-12T17:22:17.672 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f5008caf700 1 -- 172.21.2.102:0/208844999 learned_addr learned my addr 172.21.2.102:0/208844999 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:17.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f5008caf700 1 -- 172.21.2.102:0/208844999 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f500414e530 msgr2=0x7f500414ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:17.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f5008caf700 1 --2- 172.21.2.102:0/208844999 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f500414e530 0x7f500414ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:17.673 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f5008caf700 1 -- 172.21.2.102:0/208844999 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f50040b8d20 msgr2=0x7f5004153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:17.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f5008caf700 1 --2- 172.21.2.102:0/208844999 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f50040b8d20 0x7f5004153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:17.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f5008caf700 1 -- 172.21.2.102:0/208844999 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50040ad140 con 0x7f5004062e50 2021-02-12T17:22:17.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f5008caf700 1 --2- 172.21.2.102:0/208844999 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5004062e50 0x7f50040b2ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f4fec00c710 tx=0x7f4fec007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:17.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f5000ff9700 1 -- 172.21.2.102:0/208844999 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec007320 con 0x7f5004062e50 2021-02-12T17:22:17.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f5000ff9700 1 -- 172.21.2.102:0/208844999 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec007480 con 0x7f5004062e50 2021-02-12T17:22:17.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f500af13700 1 -- 172.21.2.102:0/208844999 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500415d680 con 0x7f5004062e50 2021-02-12T17:22:17.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.671+0000 7f5000ff9700 1 -- 172.21.2.102:0/208844999 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0057f0 con 0x7f5004062e50 2021-02-12T17:22:17.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.672+0000 7f500af13700 1 -- 172.21.2.102:0/208844999 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50040ad3e0 con 0x7f5004062e50 2021-02-12T17:22:17.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.672+0000 7f500af13700 1 -- 172.21.2.102:0/208844999 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500415d810 con 0x7f5004062e50 2021-02-12T17:22:17.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.672+0000 7f5000ff9700 1 -- 172.21.2.102:0/208844999 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f4fec010030 con 0x7f5004062e50 2021-02-12T17:22:17.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.673+0000 7f5000ff9700 1 --2- 172.21.2.102:0/208844999 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4fe8059d30 0x7f4fe805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:17.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.673+0000 7f5000ff9700 1 -- 172.21.2.102:0/208844999 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7451+0+0 (secure 0 0 0) 0x7f4fec073b40 con 0x7f5004062e50 2021-02-12T17:22:17.674 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.673+0000 7f5003fff700 1 --2- 172.21.2.102:0/208844999 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4fe8059d30 0x7f4fe805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:17.675 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.673+0000 7f5003fff700 1 --2- 172.21.2.102:0/208844999 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4fe8059d30 0x7f4fe805c1f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f50040b4510 tx=0x7f4ffc006c80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:17.677 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.676+0000 7f5000ff9700 1 -- 172.21.2.102:0/208844999 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f4fec047120 con 0x7f5004062e50 2021-02-12T17:22:17.837 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.836+0000 7f500af13700 1 -- 172.21.2.102:0/208844999 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5004045460 con 0x7f5004062e50 2021-02-12T17:22:17.837 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.837+0000 7f5000ff9700 1 -- 172.21.2.102:0/208844999 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3763 (secure 0 0 0) 0x7f4fec04a740 con 0x7f5004062e50 2021-02-12T17:22:17.838 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:17.838 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:21:54.333741+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34514":{"gid":34514,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":10,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:17.839 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.838+0000 7f500af13700 1 -- 172.21.2.102:0/208844999 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4fe8059d30 msgr2=0x7f4fe805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:17.839 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.838+0000 7f500af13700 1 --2- 172.21.2.102:0/208844999 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4fe8059d30 0x7f4fe805c1f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f50040b4510 tx=0x7f4ffc006c80).stop 2021-02-12T17:22:17.839 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.838+0000 7f500af13700 1 -- 172.21.2.102:0/208844999 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5004062e50 msgr2=0x7f50040b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:17.839 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.838+0000 7f500af13700 1 --2- 172.21.2.102:0/208844999 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5004062e50 0x7f50040b2ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f4fec00c710 tx=0x7f4fec007bf0).stop 2021-02-12T17:22:17.839 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.838+0000 7f500af13700 1 -- 172.21.2.102:0/208844999 shutdown_connections 2021-02-12T17:22:17.839 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.838+0000 7f500af13700 1 --2- 172.21.2.102:0/208844999 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f500414e530 0x7f500414ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:17.839 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.838+0000 7f500af13700 1 --2- 172.21.2.102:0/208844999 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4fe8059d30 0x7f4fe805c1f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:17.839 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.838+0000 7f500af13700 1 --2- 172.21.2.102:0/208844999 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5004062e50 0x7f50040b2ad0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:17.840 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.838+0000 7f500af13700 1 --2- 172.21.2.102:0/208844999 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f50040b8d20 0x7f5004153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:17.840 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.838+0000 7f500af13700 1 -- 172.21.2.102:0/208844999 >> 172.21.2.102:0/208844999 conn(0x7f50040bc480 msgr2=0x7f50040b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:17.840 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.838+0000 7f500af13700 1 -- 172.21.2.102:0/208844999 shutdown_connections 2021-02-12T17:22:17.840 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:17.838+0000 7f500af13700 1 -- 172.21.2.102:0/208844999 wait complete. 2021-02-12T17:22:17.840 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 45 2021-02-12T17:22:17.848 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:22:19.849 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:19.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.936+0000 7f437c3b4700 1 Processor -- start 2021-02-12T17:22:19.937 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.936+0000 7f437c3b4700 1 -- start start 2021-02-12T17:22:19.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.937+0000 7f437c3b4700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f4374068af0 0x7f43740b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:19.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.937+0000 7f437c3b4700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43740b6350 0x7f43740622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:19.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.937+0000 7f437c3b4700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43740b7680 con 0x7f4374068710 2021-02-12T17:22:19.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.937+0000 7f437c3b4700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43740b2360 con 0x7f4374068af0 2021-02-12T17:22:19.938 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.937+0000 7f437c3b4700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43740b2600 con 0x7f43740b6350 2021-02-12T17:22:19.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.939+0000 7f437994f700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f4374068af0 0x7f43740b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:19.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.939+0000 7f437a951700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43740b6350 0x7f43740622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:19.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.939+0000 7f437a150700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f4374068710 0x7f437414a020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:38582/0 (socket says 172.21.2.102:38582) 2021-02-12T17:22:19.939 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.939+0000 7f437a150700 1 -- 172.21.2.102:0/1376248062 learned_addr learned my addr 172.21.2.102:0/1376248062 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:22:19.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.939+0000 7f437a951700 1 -- 172.21.2.102:0/1376248062 >> v2:172.21.2.104:3300/0 conn(0x7f4374068af0 msgr2=0x7f43740b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:19.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.939+0000 7f437a951700 1 --2- 172.21.2.102:0/1376248062 >> v2:172.21.2.104:3300/0 conn(0x7f4374068af0 0x7f43740b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:19.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.939+0000 7f437a951700 1 -- 172.21.2.102:0/1376248062 >> v1:172.21.2.104:6789/0 conn(0x7f4374068710 legacy=0x7f437414a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:19.940 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.939+0000 7f437a951700 1 -- 172.21.2.102:0/1376248062 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43741498e0 con 0x7f43740b6350 2021-02-12T17:22:19.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.940+0000 7f437a951700 1 --2- 172.21.2.102:0/1376248062 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43740b6350 0x7f43740622a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f436c009c90 tx=0x7f436c0091d0).ready entity=mon.2 client_cookie=56d76f10581cebf2 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:19.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.940+0000 7f437914e700 1 -- 172.21.2.102:0/1376248062 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c00b9e0 con 0x7f43740b6350 2021-02-12T17:22:19.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.940+0000 7f437914e700 1 -- 172.21.2.102:0/1376248062 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c00bb40 con 0x7f43740b6350 2021-02-12T17:22:19.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.940+0000 7f437914e700 1 -- 172.21.2.102:0/1376248062 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c011400 con 0x7f43740b6350 2021-02-12T17:22:19.941 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.940+0000 7f437c3b4700 1 -- 172.21.2.102:0/1376248062 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43740b6350 msgr2=0x7f43740622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:19.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.940+0000 7f437c3b4700 1 --2- 172.21.2.102:0/1376248062 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43740b6350 0x7f43740622a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f436c009c90 tx=0x7f436c0091d0).stop 2021-02-12T17:22:19.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.940+0000 7f437c3b4700 1 -- 172.21.2.102:0/1376248062 shutdown_connections 2021-02-12T17:22:19.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.940+0000 7f437c3b4700 1 --2- 172.21.2.102:0/1376248062 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43740b6350 0x7f43740622a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:19.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.940+0000 7f437c3b4700 1 --2- 172.21.2.102:0/1376248062 >> v2:172.21.2.104:3300/0 conn(0x7f4374068af0 0x7f43740b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:19.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.940+0000 7f437c3b4700 1 -- 172.21.2.102:0/1376248062 >> 172.21.2.102:0/1376248062 conn(0x7f43740bc480 msgr2=0x7f43740b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:19.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.940+0000 7f437c3b4700 1 -- 172.21.2.102:0/1376248062 shutdown_connections 2021-02-12T17:22:19.942 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.940+0000 7f437c3b4700 1 -- 172.21.2.102:0/1376248062 wait complete. 2021-02-12T17:22:19.943 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.941+0000 7f437c3b4700 1 Processor -- start 2021-02-12T17:22:19.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.941+0000 7f437c3b4700 1 -- start start 2021-02-12T17:22:19.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437c3b4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4374068710 0x7f43740b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:19.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437c3b4700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4374068af0 0x7f4374138460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:19.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437c3b4700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43740b6350 0x7f4374138950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:19.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437c3b4700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4374138e40 con 0x7f4374068710 2021-02-12T17:22:19.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437c3b4700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437415d110 con 0x7f4374068af0 2021-02-12T17:22:19.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437c3b4700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43740b3740 con 0x7f43740b6350 2021-02-12T17:22:19.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437a150700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4374068710 0x7f43740b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:19.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437a150700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4374068710 0x7f43740b69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47574/0 (socket says 172.21.2.102:47574) 2021-02-12T17:22:19.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437a150700 1 -- 172.21.2.102:0/1614364066 learned_addr learned my addr 172.21.2.102:0/1614364066 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:19.944 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437a951700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43740b6350 0x7f4374138950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:19.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437994f700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4374068af0 0x7f4374138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:19.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437a150700 1 -- 172.21.2.102:0/1614364066 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43740b6350 msgr2=0x7f4374138950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:19.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437a150700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43740b6350 0x7f4374138950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:19.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437a150700 1 -- 172.21.2.102:0/1614364066 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4374068af0 msgr2=0x7f4374138460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:19.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437a150700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4374068af0 0x7f4374138460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:19.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437a150700 1 -- 172.21.2.102:0/1614364066 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43740b39e0 con 0x7f4374068710 2021-02-12T17:22:19.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.942+0000 7f437a951700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43740b6350 0x7f4374138950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:22:19.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.943+0000 7f437a150700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4374068710 0x7f43740b69f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f437000c710 tx=0x7f4370007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:19.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.943+0000 7f43667fc700 1 -- 172.21.2.102:0/1614364066 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370007320 con 0x7f4374068710 2021-02-12T17:22:19.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.943+0000 7f43667fc700 1 -- 172.21.2.102:0/1614364066 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4370007480 con 0x7f4374068710 2021-02-12T17:22:19.945 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.943+0000 7f43667fc700 1 -- 172.21.2.102:0/1614364066 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43700057f0 con 0x7f4374068710 2021-02-12T17:22:19.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.943+0000 7f437c3b4700 1 -- 172.21.2.102:0/1614364066 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43740b3c80 con 0x7f4374068710 2021-02-12T17:22:19.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.943+0000 7f437c3b4700 1 -- 172.21.2.102:0/1614364066 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43740b6ee0 con 0x7f4374068710 2021-02-12T17:22:19.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.944+0000 7f437c3b4700 1 -- 172.21.2.102:0/1614364066 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43740658c0 con 0x7f4374068710 2021-02-12T17:22:19.946 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.944+0000 7f43667fc700 1 -- 172.21.2.102:0/1614364066 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f4370010030 con 0x7f4374068710 2021-02-12T17:22:19.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.944+0000 7f43667fc700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4354059d80 0x7f435405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:19.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.944+0000 7f43667fc700 1 -- 172.21.2.102:0/1614364066 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7451+0+0 (secure 0 0 0) 0x7f4370073c10 con 0x7f4374068710 2021-02-12T17:22:19.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.944+0000 7f437994f700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4354059d80 0x7f435405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:19.947 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.944+0000 7f437994f700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4354059d80 0x7f435405c240 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f436800bb80 tx=0x7f4368008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:19.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:19.947+0000 7f43667fc700 1 -- 172.21.2.102:0/1614364066 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f4370047160 con 0x7f4374068710 2021-02-12T17:22:20.106 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:20.105+0000 7f437c3b4700 1 -- 172.21.2.102:0/1614364066 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4374045460 con 0x7f4374068710 2021-02-12T17:22:20.106 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:20.105+0000 7f43667fc700 1 -- 172.21.2.102:0/1614364066 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3763 (secure 0 0 0) 0x7f437004a780 con 0x7f4374068710 2021-02-12T17:22:20.106 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:20.107 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:21:54.333741+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34514":{"gid":34514,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":10,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:20.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:20.106+0000 7f437c3b4700 1 -- 172.21.2.102:0/1614364066 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4354059d80 msgr2=0x7f435405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:20.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:20.106+0000 7f437c3b4700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4354059d80 0x7f435405c240 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f436800bb80 tx=0x7f4368008040).stop 2021-02-12T17:22:20.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:20.106+0000 7f437c3b4700 1 -- 172.21.2.102:0/1614364066 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4374068710 msgr2=0x7f43740b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:20.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:20.106+0000 7f437c3b4700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4374068710 0x7f43740b69f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f437000c710 tx=0x7f4370007c30).stop 2021-02-12T17:22:20.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:20.106+0000 7f437c3b4700 1 -- 172.21.2.102:0/1614364066 shutdown_connections 2021-02-12T17:22:20.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:20.106+0000 7f437c3b4700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f43740b6350 0x7f4374138950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:20.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:20.106+0000 7f437c3b4700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4354059d80 0x7f435405c240 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:20.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:20.106+0000 7f437c3b4700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4374068710 0x7f43740b69f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:20.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:20.106+0000 7f437c3b4700 1 --2- 172.21.2.102:0/1614364066 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4374068af0 0x7f4374138460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:20.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:20.107+0000 7f437c3b4700 1 -- 172.21.2.102:0/1614364066 >> 172.21.2.102:0/1614364066 conn(0x7f43740bc480 msgr2=0x7f4374062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:20.108 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:20.107+0000 7f437c3b4700 1 -- 172.21.2.102:0/1614364066 shutdown_connections 2021-02-12T17:22:20.109 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:20.107+0000 7f437c3b4700 1 -- 172.21.2.102:0/1614364066 wait complete. 2021-02-12T17:22:20.109 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 45 2021-02-12T17:22:20.116 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:22:22.117 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:22.205 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.204+0000 7efd6989a700 1 Processor -- start 2021-02-12T17:22:22.205 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.204+0000 7efd6989a700 1 -- start start 2021-02-12T17:22:22.207 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.205+0000 7efd6989a700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7efd640b8d20 0x7efd64068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:22.207 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.205+0000 7efd6989a700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd640b7960 con 0x7efd64062740 2021-02-12T17:22:22.207 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.205+0000 7efd6989a700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd640622a0 con 0x7efd6414e530 2021-02-12T17:22:22.207 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.205+0000 7efd6989a700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd64068d20 con 0x7efd640b8d20 2021-02-12T17:22:22.207 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.205+0000 7efd637fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7efd64062740 0x7efd64062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56226/0 (socket says 172.21.2.102:56226) 2021-02-12T17:22:22.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.205+0000 7efd62ffd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7efd640b8d20 0x7efd64068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:22.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.205+0000 7efd637fe700 1 -- 172.21.2.102:0/715838490 learned_addr learned my addr 172.21.2.102:0/715838490 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:22:22.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.205+0000 7efd62ffd700 1 -- 172.21.2.102:0/715838490 >> v1:172.21.2.104:6789/0 conn(0x7efd6414e530 legacy=0x7efd640b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:22.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.205+0000 7efd62ffd700 1 -- 172.21.2.102:0/715838490 >> v1:172.21.2.102:6789/0 conn(0x7efd64062740 legacy=0x7efd64062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:22.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.205+0000 7efd61ffb700 1 -- 172.21.2.102:0/715838490 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838681684 0 0) 0x7efd640b7960 con 0x7efd64062740 2021-02-12T17:22:22.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.205+0000 7efd62ffd700 1 -- 172.21.2.102:0/715838490 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6414ea10 con 0x7efd640b8d20 2021-02-12T17:22:22.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.206+0000 7efd62ffd700 1 --2- 172.21.2.102:0/715838490 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd640b8d20 0x7efd64068830 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7efd5800b980 tx=0x7efd58006de0).ready entity=mon.0 client_cookie=6983bf16eadfb620 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:22.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.206+0000 7efd61ffb700 1 -- 172.21.2.102:0/715838490 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd580097a0 con 0x7efd640b8d20 2021-02-12T17:22:22.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.206+0000 7efd61ffb700 1 -- 172.21.2.102:0/715838490 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd58009900 con 0x7efd640b8d20 2021-02-12T17:22:22.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.206+0000 7efd61ffb700 1 -- 172.21.2.102:0/715838490 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd58009c80 con 0x7efd640b8d20 2021-02-12T17:22:22.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.206+0000 7efd6989a700 1 -- 172.21.2.102:0/715838490 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd640b8d20 msgr2=0x7efd64068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:22.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.206+0000 7efd6989a700 1 --2- 172.21.2.102:0/715838490 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd640b8d20 0x7efd64068830 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7efd5800b980 tx=0x7efd58006de0).stop 2021-02-12T17:22:22.208 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.206+0000 7efd6989a700 1 -- 172.21.2.102:0/715838490 shutdown_connections 2021-02-12T17:22:22.209 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.206+0000 7efd6989a700 1 --2- 172.21.2.102:0/715838490 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd640b8d20 0x7efd64068830 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:22.209 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.206+0000 7efd6989a700 1 -- 172.21.2.102:0/715838490 >> 172.21.2.102:0/715838490 conn(0x7efd640bc480 msgr2=0x7efd640b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:22.209 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.206+0000 7efd6989a700 1 -- 172.21.2.102:0/715838490 shutdown_connections 2021-02-12T17:22:22.209 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.206+0000 7efd6989a700 1 -- 172.21.2.102:0/715838490 wait complete. 2021-02-12T17:22:22.210 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.207+0000 7efd6989a700 1 Processor -- start 2021-02-12T17:22:22.210 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.207+0000 7efd6989a700 1 -- start start 2021-02-12T17:22:22.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd6989a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efd64062740 0x7efd641536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:22.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd6989a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd640b8d20 0x7efd6415e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:22.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd6989a700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7efd6414e530 0x7efd6415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:22.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd6989a700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6415da80 con 0x7efd640b8d20 2021-02-12T17:22:22.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd6989a700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6413dca0 con 0x7efd6414e530 2021-02-12T17:22:22.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd6989a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6413df40 con 0x7efd64062740 2021-02-12T17:22:22.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd627fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd640b8d20 0x7efd6415e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:22.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd627fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd640b8d20 0x7efd6415e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47586/0 (socket says 172.21.2.102:47586) 2021-02-12T17:22:22.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd627fc700 1 -- 172.21.2.102:0/2882833887 learned_addr learned my addr 172.21.2.102:0/2882833887 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:22.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd637fe700 1 --2- 172.21.2.102:0/2882833887 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7efd6414e530 0x7efd6415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:22.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd627fc700 1 -- 172.21.2.102:0/2882833887 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efd64062740 msgr2=0x7efd641536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:22.211 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd627fc700 1 --2- 172.21.2.102:0/2882833887 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efd64062740 0x7efd641536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:22.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd627fc700 1 -- 172.21.2.102:0/2882833887 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7efd6414e530 msgr2=0x7efd6415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:22.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd627fc700 1 --2- 172.21.2.102:0/2882833887 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7efd6414e530 0x7efd6415e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:22.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd627fc700 1 -- 172.21.2.102:0/2882833887 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6413e1e0 con 0x7efd640b8d20 2021-02-12T17:22:22.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd627fc700 1 --2- 172.21.2.102:0/2882833887 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd640b8d20 0x7efd6415e110 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7efd540096e0 tx=0x7efd54006d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:22.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd4affd700 1 -- 172.21.2.102:0/2882833887 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5400d4a0 con 0x7efd640b8d20 2021-02-12T17:22:22.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd4affd700 1 -- 172.21.2.102:0/2882833887 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd54000e90 con 0x7efd640b8d20 2021-02-12T17:22:22.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd6989a700 1 -- 172.21.2.102:0/2882833887 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6415dc70 con 0x7efd640b8d20 2021-02-12T17:22:22.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd4affd700 1 -- 172.21.2.102:0/2882833887 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5400d870 con 0x7efd640b8d20 2021-02-12T17:22:22.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.208+0000 7efd6989a700 1 -- 172.21.2.102:0/2882833887 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd64153f50 con 0x7efd640b8d20 2021-02-12T17:22:22.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.209+0000 7efd6989a700 1 -- 172.21.2.102:0/2882833887 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd64061cb0 con 0x7efd640b8d20 2021-02-12T17:22:22.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.209+0000 7efd4affd700 1 -- 172.21.2.102:0/2882833887 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7efd5400f030 con 0x7efd640b8d20 2021-02-12T17:22:22.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.209+0000 7efd4affd700 1 --2- 172.21.2.102:0/2882833887 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efd44059d30 0x7efd4405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:22.212 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.210+0000 7efd4affd700 1 -- 172.21.2.102:0/2882833887 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7451+0+0 (secure 0 0 0) 0x7efd54073c40 con 0x7efd640b8d20 2021-02-12T17:22:22.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.210+0000 7efd62ffd700 1 --2- 172.21.2.102:0/2882833887 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efd44059d30 0x7efd4405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:22.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.210+0000 7efd62ffd700 1 --2- 172.21.2.102:0/2882833887 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efd44059d30 0x7efd4405c1f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7efd5800b980 tx=0x7efd58016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:22.213 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.212+0000 7efd4affd700 1 -- 172.21.2.102:0/2882833887 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7efd54047110 con 0x7efd640b8d20 2021-02-12T17:22:22.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.369+0000 7efd6989a700 1 -- 172.21.2.102:0/2882833887 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd640b8790 con 0x7efd640b8d20 2021-02-12T17:22:22.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.370+0000 7efd4affd700 1 -- 172.21.2.102:0/2882833887 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3763 (secure 0 0 0) 0x7efd5404a730 con 0x7efd640b8d20 2021-02-12T17:22:22.371 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:22.371 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:21:54.333741+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34514":{"gid":34514,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":10,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:22.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.371+0000 7efd6989a700 1 -- 172.21.2.102:0/2882833887 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efd44059d30 msgr2=0x7efd4405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:22.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.371+0000 7efd6989a700 1 --2- 172.21.2.102:0/2882833887 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efd44059d30 0x7efd4405c1f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7efd5800b980 tx=0x7efd58016000).stop 2021-02-12T17:22:22.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.371+0000 7efd6989a700 1 -- 172.21.2.102:0/2882833887 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd640b8d20 msgr2=0x7efd6415e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:22.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.371+0000 7efd6989a700 1 --2- 172.21.2.102:0/2882833887 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd640b8d20 0x7efd6415e110 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7efd540096e0 tx=0x7efd54006d40).stop 2021-02-12T17:22:22.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.371+0000 7efd6989a700 1 -- 172.21.2.102:0/2882833887 shutdown_connections 2021-02-12T17:22:22.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.371+0000 7efd6989a700 1 --2- 172.21.2.102:0/2882833887 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7efd6414e530 0x7efd6415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:22.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.371+0000 7efd6989a700 1 --2- 172.21.2.102:0/2882833887 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7efd64062740 0x7efd641536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:22.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.371+0000 7efd6989a700 1 --2- 172.21.2.102:0/2882833887 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7efd44059d30 0x7efd4405c1f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:22.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.371+0000 7efd6989a700 1 --2- 172.21.2.102:0/2882833887 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7efd640b8d20 0x7efd6415e110 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:22.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.371+0000 7efd6989a700 1 -- 172.21.2.102:0/2882833887 >> 172.21.2.102:0/2882833887 conn(0x7efd640bc480 msgr2=0x7efd64151930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:22.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.371+0000 7efd6989a700 1 -- 172.21.2.102:0/2882833887 shutdown_connections 2021-02-12T17:22:22.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:22.371+0000 7efd6989a700 1 -- 172.21.2.102:0/2882833887 wait complete. 2021-02-12T17:22:22.373 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 45 2021-02-12T17:22:22.380 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:22:24.381 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:24.467 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.467+0000 7fddff4fc700 1 Processor -- start 2021-02-12T17:22:24.468 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.467+0000 7fddff4fc700 1 -- start start 2021-02-12T17:22:24.470 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.467+0000 7fddff4fc700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fddf80b8d20 0x7fddf8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:24.470 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.467+0000 7fddff4fc700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fddf8062740 0x7fddf8062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:24.470 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.467+0000 7fddff4fc700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf80b7960 con 0x7fddf814e530 2021-02-12T17:22:24.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.467+0000 7fddff4fc700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf8068d20 con 0x7fddf8062740 2021-02-12T17:22:24.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.467+0000 7fddff4fc700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80622a0 con 0x7fddf80b8d20 2021-02-12T17:22:24.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.467+0000 7fddfca97700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fddf814e530 0x7fddf80b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56238/0 (socket says 172.21.2.102:56238) 2021-02-12T17:22:24.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.467+0000 7fddfca97700 1 -- 172.21.2.102:0/4225889031 learned_addr learned my addr 172.21.2.102:0/4225889031 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:22:24.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 -- 172.21.2.102:0/4225889031 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840832774 0 0) 0x7fddf80b7960 con 0x7fddf814e530 2021-02-12T17:22:24.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 -- 172.21.2.102:0/4225889031 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddd8003230 con 0x7fddf814e530 2021-02-12T17:22:24.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddfda99700 1 --2- 172.21.2.102:0/4225889031 >> v2:172.21.2.104:3300/0 conn(0x7fddf8062740 0x7fddf8062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:24.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 -- 172.21.2.102:0/4225889031 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1509212629 0 0) 0x7fddd8003230 con 0x7fddf814e530 2021-02-12T17:22:24.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 -- 172.21.2.102:0/4225889031 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fddf80b8d20 msgr2=0x7fddf8068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:24.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 --2- 172.21.2.102:0/4225889031 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fddf80b8d20 0x7fddf8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:24.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 -- 172.21.2.102:0/4225889031 >> v2:172.21.2.104:3300/0 conn(0x7fddf8062740 msgr2=0x7fddf8062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:24.471 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 --2- 172.21.2.102:0/4225889031 >> v2:172.21.2.104:3300/0 conn(0x7fddf8062740 0x7fddf8062bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:24.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 -- 172.21.2.102:0/4225889031 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf814ea10 con 0x7fddf814e530 2021-02-12T17:22:24.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 -- 172.21.2.102:0/4225889031 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fdde80014e0 con 0x7fddf814e530 2021-02-12T17:22:24.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 -- 172.21.2.102:0/4225889031 >> v1:172.21.2.102:6789/0 conn(0x7fddf814e530 legacy=0x7fddf80b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:24.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 --2- 172.21.2.102:0/4225889031 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fddd80037a0 0x7fddd8003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:24.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 --2- 172.21.2.102:0/4225889031 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fddd80044d0 0x7fddd8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:24.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 --2- 172.21.2.102:0/4225889031 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fddf80b8d20 0x7fddd8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:24.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 -- 172.21.2.102:0/4225889031 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8068d20 con 0x7fddd80044d0 2021-02-12T17:22:24.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 -- 172.21.2.102:0/4225889031 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80622a0 con 0x7fddd80037a0 2021-02-12T17:22:24.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddf7fff700 1 -- 172.21.2.102:0/4225889031 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd8005330 con 0x7fddf80b8d20 2021-02-12T17:22:24.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddfda99700 1 --2- 172.21.2.102:0/4225889031 >> v2:172.21.2.104:3300/0 conn(0x7fddf8062740 0x7fddf8062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:22:24.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.468+0000 7fddfca97700 1 --2- 172.21.2.102:0/4225889031 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fddd80044d0 0x7fddd8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:24.472 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddfd298700 1 --2- 172.21.2.102:0/4225889031 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fddd80037a0 0x7fddd8003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:24.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddfca97700 1 -- 172.21.2.102:0/4225889031 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fddf80b8d20 msgr2=0x7fddd8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:24.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddfca97700 1 --2- 172.21.2.102:0/4225889031 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fddf80b8d20 0x7fddd8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:24.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddfca97700 1 -- 172.21.2.102:0/4225889031 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fddd80037a0 msgr2=0x7fddd8003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:24.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddfca97700 1 --2- 172.21.2.102:0/4225889031 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fddd80037a0 0x7fddd8003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:24.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddfca97700 1 -- 172.21.2.102:0/4225889031 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8003230 con 0x7fddd80044d0 2021-02-12T17:22:24.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddfd298700 1 --2- 172.21.2.102:0/4225889031 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fddd80037a0 0x7fddd8003bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:22:24.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddfca97700 1 --2- 172.21.2.102:0/4225889031 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fddd80044d0 0x7fddd8004950 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fddf806ac60 tx=0x7fddf814eba0).ready entity=mon.0 client_cookie=ea067320f2caecba server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:24.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddf7fff700 1 -- 172.21.2.102:0/4225889031 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde800cea0 con 0x7fddd80044d0 2021-02-12T17:22:24.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddf7fff700 1 -- 172.21.2.102:0/4225889031 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde80070d0 con 0x7fddd80044d0 2021-02-12T17:22:24.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddf7fff700 1 -- 172.21.2.102:0/4225889031 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8007470 con 0x7fddd80044d0 2021-02-12T17:22:24.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddff4fc700 1 -- 172.21.2.102:0/4225889031 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fddd80044d0 msgr2=0x7fddd8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:24.473 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddff4fc700 1 --2- 172.21.2.102:0/4225889031 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fddd80044d0 0x7fddd8004950 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fddf806ac60 tx=0x7fddf814eba0).stop 2021-02-12T17:22:24.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddfda99700 1 -- 172.21.2.102:0/4225889031 reap_dead start 2021-02-12T17:22:24.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddff4fc700 1 -- 172.21.2.102:0/4225889031 shutdown_connections 2021-02-12T17:22:24.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddff4fc700 1 -- 172.21.2.102:0/4225889031 >> 172.21.2.102:0/4225889031 conn(0x7fddf80bc480 msgr2=0x7fddf80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:24.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddff4fc700 1 -- 172.21.2.102:0/4225889031 shutdown_connections 2021-02-12T17:22:24.474 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.469+0000 7fddff4fc700 1 -- 172.21.2.102:0/4225889031 wait complete. 2021-02-12T17:22:24.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.470+0000 7fddff4fc700 1 Processor -- start 2021-02-12T17:22:24.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.470+0000 7fddff4fc700 1 -- start start 2021-02-12T17:22:24.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddff4fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fddd80044d0 0x7fddf80b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:24.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddff4fc700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fddf8160c70 0x7fddf80ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:24.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddff4fc700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fddf80ad820 0x7fddf8151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:24.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddff4fc700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80b51e0 con 0x7fddd80044d0 2021-02-12T17:22:24.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddff4fc700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8152570 con 0x7fddf80ad820 2021-02-12T17:22:24.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddff4fc700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8152810 con 0x7fddf8160c70 2021-02-12T17:22:24.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddfd298700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fddd80044d0 0x7fddf80b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:24.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddfd298700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fddd80044d0 0x7fddf80b8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47604/0 (socket says 172.21.2.102:47604) 2021-02-12T17:22:24.476 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddfd298700 1 -- 172.21.2.102:0/1159586414 learned_addr learned my addr 172.21.2.102:0/1159586414 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:24.477 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddfd298700 1 -- 172.21.2.102:0/1159586414 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fddf8160c70 msgr2=0x7fddf80ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:24.477 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddfd298700 1 --2- 172.21.2.102:0/1159586414 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fddf8160c70 0x7fddf80ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:24.477 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddfda99700 1 --2- 172.21.2.102:0/1159586414 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fddf80ad820 0x7fddf8151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:24.477 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddfd298700 1 -- 172.21.2.102:0/1159586414 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fddf80ad820 msgr2=0x7fddf8151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:24.477 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddfd298700 1 --2- 172.21.2.102:0/1159586414 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fddf80ad820 0x7fddf8151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:24.477 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddfd298700 1 -- 172.21.2.102:0/1159586414 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf8152ab0 con 0x7fddd80044d0 2021-02-12T17:22:24.477 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddfda99700 1 --2- 172.21.2.102:0/1159586414 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fddf80ad820 0x7fddf8151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:22:24.477 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.471+0000 7fddfd298700 1 --2- 172.21.2.102:0/1159586414 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fddd80044d0 0x7fddf80b8260 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fddf000c920 tx=0x7fddf0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:24.477 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.472+0000 7fddf57fa700 1 -- 172.21.2.102:0/1159586414 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf000cec0 con 0x7fddd80044d0 2021-02-12T17:22:24.477 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.472+0000 7fddf57fa700 1 -- 172.21.2.102:0/1159586414 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf0000e90 con 0x7fddd80044d0 2021-02-12T17:22:24.477 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.472+0000 7fddff4fc700 1 -- 172.21.2.102:0/1159586414 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf8152d50 con 0x7fddd80044d0 2021-02-12T17:22:24.477 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.472+0000 7fddf57fa700 1 -- 172.21.2.102:0/1159586414 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf00078f0 con 0x7fddd80044d0 2021-02-12T17:22:24.478 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.472+0000 7fddff4fc700 1 -- 172.21.2.102:0/1159586414 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf80b8750 con 0x7fddd80044d0 2021-02-12T17:22:24.478 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.472+0000 7fddff4fc700 1 -- 172.21.2.102:0/1159586414 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf8045460 con 0x7fddd80044d0 2021-02-12T17:22:24.478 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.473+0000 7fddf57fa700 1 -- 172.21.2.102:0/1159586414 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fddf0007ca0 con 0x7fddd80044d0 2021-02-12T17:22:24.478 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.473+0000 7fddf57fa700 1 --2- 172.21.2.102:0/1159586414 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdddc059d30 0x7fdddc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:24.478 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.473+0000 7fddf57fa700 1 -- 172.21.2.102:0/1159586414 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7451+0+0 (secure 0 0 0) 0x7fddf0073980 con 0x7fddd80044d0 2021-02-12T17:22:24.478 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.473+0000 7fddfca97700 1 --2- 172.21.2.102:0/1159586414 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdddc059d30 0x7fdddc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:24.478 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.473+0000 7fddfca97700 1 --2- 172.21.2.102:0/1159586414 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdddc059d30 0x7fdddc05c1f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fddf806ac60 tx=0x7fdde8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:24.478 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.476+0000 7fddf57fa700 1 -- 172.21.2.102:0/1159586414 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fddf0046f60 con 0x7fddd80044d0 2021-02-12T17:22:24.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.636+0000 7fddff4fc700 1 -- 172.21.2.102:0/1159586414 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddf8061cb0 con 0x7fddd80044d0 2021-02-12T17:22:24.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.636+0000 7fddf57fa700 1 -- 172.21.2.102:0/1159586414 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3763 (secure 0 0 0) 0x7fddf004a580 con 0x7fddd80044d0 2021-02-12T17:22:24.638 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:24.638 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:21:54.333741+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34514":{"gid":34514,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":10,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.638+0000 7fddff4fc700 1 -- 172.21.2.102:0/1159586414 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdddc059d30 msgr2=0x7fdddc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.638+0000 7fddff4fc700 1 --2- 172.21.2.102:0/1159586414 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdddc059d30 0x7fdddc05c1f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fddf806ac60 tx=0x7fdde8015000).stop 2021-02-12T17:22:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.638+0000 7fddff4fc700 1 -- 172.21.2.102:0/1159586414 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fddd80044d0 msgr2=0x7fddf80b8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.638+0000 7fddff4fc700 1 --2- 172.21.2.102:0/1159586414 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fddd80044d0 0x7fddf80b8260 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fddf000c920 tx=0x7fddf0008040).stop 2021-02-12T17:22:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.638+0000 7fddff4fc700 1 -- 172.21.2.102:0/1159586414 shutdown_connections 2021-02-12T17:22:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.638+0000 7fddff4fc700 1 --2- 172.21.2.102:0/1159586414 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fddf80ad820 0x7fddf8151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.638+0000 7fddff4fc700 1 --2- 172.21.2.102:0/1159586414 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fdddc059d30 0x7fdddc05c1f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.638+0000 7fddff4fc700 1 --2- 172.21.2.102:0/1159586414 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fddd80044d0 0x7fddf80b8260 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.638+0000 7fddff4fc700 1 --2- 172.21.2.102:0/1159586414 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fddf8160c70 0x7fddf80ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:24.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.638+0000 7fddff4fc700 1 -- 172.21.2.102:0/1159586414 >> 172.21.2.102:0/1159586414 conn(0x7fddf80bc480 msgr2=0x7fddf80b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:24.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.638+0000 7fddff4fc700 1 -- 172.21.2.102:0/1159586414 shutdown_connections 2021-02-12T17:22:24.640 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:24.638+0000 7fddff4fc700 1 -- 172.21.2.102:0/1159586414 wait complete. 2021-02-12T17:22:24.640 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 45 2021-02-12T17:22:24.647 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:22:26.649 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:26.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.736+0000 7f6a09ca3700 1 Processor -- start 2021-02-12T17:22:26.737 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.736+0000 7f6a09ca3700 1 -- start start 2021-02-12T17:22:26.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.737+0000 7f6a09ca3700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f6a040b8d20 0x7f6a04068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:26.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.737+0000 7f6a09ca3700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6a04062740 0x7f6a04062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:26.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.737+0000 7f6a09ca3700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a040b7960 con 0x7f6a0414e530 2021-02-12T17:22:26.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.737+0000 7f6a09ca3700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a04068d20 con 0x7f6a040b8d20 2021-02-12T17:22:26.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.737+0000 7f6a09ca3700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a040622a0 con 0x7f6a04062740 2021-02-12T17:22:26.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.737+0000 7f6a02ffd700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f6a0414e530 0x7f6a040b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56256/0 (socket says 172.21.2.102:56256) 2021-02-12T17:22:26.739 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.737+0000 7f6a02ffd700 1 -- 172.21.2.102:0/3835954354 learned_addr learned my addr 172.21.2.102:0/3835954354 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:22:26.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.737+0000 7f6a037fe700 1 --2- 172.21.2.102:0/3835954354 >> v2:172.21.2.102:3300/0 conn(0x7f6a040b8d20 0x7f6a04068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:26.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.737+0000 7f6a037fe700 1 -- 172.21.2.102:0/3835954354 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6a04062740 msgr2=0x7f6a04062bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:22:26.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.737+0000 7f6a037fe700 1 --2- 172.21.2.102:0/3835954354 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6a04062740 0x7f6a04062bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:26.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.737+0000 7f6a037fe700 1 -- 172.21.2.102:0/3835954354 >> v1:172.21.2.102:6789/0 conn(0x7f6a0414e530 legacy=0x7f6a040b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:26.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.737+0000 7f6a037fe700 1 -- 172.21.2.102:0/3835954354 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0414ea10 con 0x7f6a040b8d20 2021-02-12T17:22:26.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.737+0000 7f6a037fe700 1 --2- 172.21.2.102:0/3835954354 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6a040b8d20 0x7f6a04068830 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f69ec00b980 tx=0x7f69ec006de0).ready entity=mon.0 client_cookie=4d9cb5542017bc7d server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:26.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.738+0000 7f6a027fc700 1 -- 172.21.2.102:0/3835954354 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0097e0 con 0x7f6a040b8d20 2021-02-12T17:22:26.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.738+0000 7f6a027fc700 1 -- 172.21.2.102:0/3835954354 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec009940 con 0x7f6a040b8d20 2021-02-12T17:22:26.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.738+0000 7f6a027fc700 1 -- 172.21.2.102:0/3835954354 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec009cc0 con 0x7f6a040b8d20 2021-02-12T17:22:26.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.738+0000 7f6a09ca3700 1 -- 172.21.2.102:0/3835954354 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6a040b8d20 msgr2=0x7f6a04068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:26.740 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.738+0000 7f6a09ca3700 1 --2- 172.21.2.102:0/3835954354 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6a040b8d20 0x7f6a04068830 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f69ec00b980 tx=0x7f69ec006de0).stop 2021-02-12T17:22:26.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.738+0000 7f6a09ca3700 1 -- 172.21.2.102:0/3835954354 shutdown_connections 2021-02-12T17:22:26.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.738+0000 7f6a09ca3700 1 --2- 172.21.2.102:0/3835954354 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6a04062740 0x7f6a04062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:26.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.738+0000 7f6a09ca3700 1 --2- 172.21.2.102:0/3835954354 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6a040b8d20 0x7f6a04068830 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:26.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.738+0000 7f6a09ca3700 1 -- 172.21.2.102:0/3835954354 >> 172.21.2.102:0/3835954354 conn(0x7f6a040bc480 msgr2=0x7f6a040b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:26.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.738+0000 7f6a09ca3700 1 -- 172.21.2.102:0/3835954354 shutdown_connections 2021-02-12T17:22:26.741 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.738+0000 7f6a09ca3700 1 -- 172.21.2.102:0/3835954354 wait complete. 2021-02-12T17:22:26.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.739+0000 7f6a09ca3700 1 Processor -- start 2021-02-12T17:22:26.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.739+0000 7f6a09ca3700 1 -- start start 2021-02-12T17:22:26.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.739+0000 7f6a09ca3700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6a04062740 0x7f6a040ba330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:26.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.739+0000 7f6a09ca3700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6a040b8d20 0x7f6a0415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:26.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.739+0000 7f6a09ca3700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6a0414e530 0x7f6a0415e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:26.744 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.739+0000 7f6a09ca3700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a040b0d30 con 0x7f6a04062740 2021-02-12T17:22:26.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.739+0000 7f6a09ca3700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a040b0550 con 0x7f6a040b8d20 2021-02-12T17:22:26.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.739+0000 7f6a09ca3700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a040b07f0 con 0x7f6a0414e530 2021-02-12T17:22:26.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f6a037fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6a04062740 0x7f6a040ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:26.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f6a037fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6a04062740 0x7f6a040ba330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47618/0 (socket says 172.21.2.102:47618) 2021-02-12T17:22:26.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f6a037fe700 1 -- 172.21.2.102:0/575422541 learned_addr learned my addr 172.21.2.102:0/575422541 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:26.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f6a02ffd700 1 --2- 172.21.2.102:0/575422541 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6a040b8d20 0x7f6a0415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:26.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f6a03fff700 1 --2- 172.21.2.102:0/575422541 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6a0414e530 0x7f6a0415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:26.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f6a037fe700 1 -- 172.21.2.102:0/575422541 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6a0414e530 msgr2=0x7f6a0415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:26.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f6a037fe700 1 --2- 172.21.2.102:0/575422541 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6a0414e530 0x7f6a0415e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:26.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f6a037fe700 1 -- 172.21.2.102:0/575422541 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6a040b8d20 msgr2=0x7f6a0415dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:26.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f6a037fe700 1 --2- 172.21.2.102:0/575422541 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6a040b8d20 0x7f6a0415dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:26.745 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f6a037fe700 1 -- 172.21.2.102:0/575422541 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a040b0a90 con 0x7f6a04062740 2021-02-12T17:22:26.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f6a037fe700 1 --2- 172.21.2.102:0/575422541 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6a04062740 0x7f6a040ba330 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f6a040653c0 tx=0x7f69ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:26.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f69fb7fe700 1 -- 172.21.2.102:0/575422541 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec01c420 con 0x7f6a04062740 2021-02-12T17:22:26.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f69fb7fe700 1 -- 172.21.2.102:0/575422541 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec01c580 con 0x7f6a04062740 2021-02-12T17:22:26.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f6a09ca3700 1 -- 172.21.2.102:0/575422541 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0415d7f0 con 0x7f6a04062740 2021-02-12T17:22:26.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.740+0000 7f69fb7fe700 1 -- 172.21.2.102:0/575422541 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec01c940 con 0x7f6a04062740 2021-02-12T17:22:26.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.741+0000 7f6a09ca3700 1 -- 172.21.2.102:0/575422541 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a040b0160 con 0x7f6a04062740 2021-02-12T17:22:26.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.741+0000 7f6a09ca3700 1 -- 172.21.2.102:0/575422541 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a04045460 con 0x7f6a04062740 2021-02-12T17:22:26.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.741+0000 7f69fb7fe700 1 -- 172.21.2.102:0/575422541 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f69ec00f070 con 0x7f6a04062740 2021-02-12T17:22:26.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.742+0000 7f69fb7fe700 1 --2- 172.21.2.102:0/575422541 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f69e8059d30 0x7f69e805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:26.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.742+0000 7f69fb7fe700 1 -- 172.21.2.102:0/575422541 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7451+0+0 (secure 0 0 0) 0x7f69ec075890 con 0x7f6a04062740 2021-02-12T17:22:26.746 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.742+0000 7f6a02ffd700 1 --2- 172.21.2.102:0/575422541 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f69e8059d30 0x7f69e805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:26.747 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.742+0000 7f6a02ffd700 1 --2- 172.21.2.102:0/575422541 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f69e8059d30 0x7f69e805c1f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f6a04152f10 tx=0x7f69f4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:26.747 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.745+0000 7f69fb7fe700 1 -- 172.21.2.102:0/575422541 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f69ec048d60 con 0x7f6a04062740 2021-02-12T17:22:26.900 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.900+0000 7f6a09ca3700 1 -- 172.21.2.102:0/575422541 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a0414e310 con 0x7f6a04062740 2021-02-12T17:22:26.901 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.900+0000 7f69fb7fe700 1 -- 172.21.2.102:0/575422541 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3763 (secure 0 0 0) 0x7f69ec006970 con 0x7f6a04062740 2021-02-12T17:22:26.901 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:26.901 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:21:54.333741+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34514":{"gid":34514,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":10,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:26.902 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.901+0000 7f6a09ca3700 1 -- 172.21.2.102:0/575422541 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f69e8059d30 msgr2=0x7f69e805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:26.902 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.901+0000 7f6a09ca3700 1 --2- 172.21.2.102:0/575422541 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f69e8059d30 0x7f69e805c1f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f6a04152f10 tx=0x7f69f4009040).stop 2021-02-12T17:22:26.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.901+0000 7f6a09ca3700 1 -- 172.21.2.102:0/575422541 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6a04062740 msgr2=0x7f6a040ba330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:26.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.901+0000 7f6a09ca3700 1 --2- 172.21.2.102:0/575422541 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6a04062740 0x7f6a040ba330 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f6a040653c0 tx=0x7f69ec016000).stop 2021-02-12T17:22:26.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.901+0000 7f6a09ca3700 1 -- 172.21.2.102:0/575422541 shutdown_connections 2021-02-12T17:22:26.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.901+0000 7f6a09ca3700 1 --2- 172.21.2.102:0/575422541 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f6a0414e530 0x7f6a0415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:26.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.901+0000 7f6a09ca3700 1 --2- 172.21.2.102:0/575422541 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f69e8059d30 0x7f69e805c1f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:26.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.901+0000 7f6a09ca3700 1 --2- 172.21.2.102:0/575422541 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f6a04062740 0x7f6a040ba330 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:26.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.901+0000 7f6a09ca3700 1 --2- 172.21.2.102:0/575422541 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f6a040b8d20 0x7f6a0415dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:26.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.901+0000 7f6a09ca3700 1 -- 172.21.2.102:0/575422541 >> 172.21.2.102:0/575422541 conn(0x7f6a040bc480 msgr2=0x7f6a040b81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:26.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.902+0000 7f6a09ca3700 1 -- 172.21.2.102:0/575422541 shutdown_connections 2021-02-12T17:22:26.903 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:26.902+0000 7f6a09ca3700 1 -- 172.21.2.102:0/575422541 wait complete. 2021-02-12T17:22:26.904 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 45 2021-02-12T17:22:26.911 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:22:28.912 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:29.000 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.000+0000 7f735080c700 1 Processor -- start 2021-02-12T17:22:29.001 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.000+0000 7f735080c700 1 -- start start 2021-02-12T17:22:29.001 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.000+0000 7f735080c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f734c062e50 0x7f734c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:29.001 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.000+0000 7f735080c700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734c0b7960 con 0x7f734c0b8d20 2021-02-12T17:22:29.001 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.000+0000 7f735080c700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734c0622a0 con 0x7f734c14e530 2021-02-12T17:22:29.002 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.000+0000 7f735080c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734c068d20 con 0x7f734c062e50 2021-02-12T17:22:29.002 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.001+0000 7f734a59c700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f734c0b8d20 0x7f734c0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56274/0 (socket says 172.21.2.102:56274) 2021-02-12T17:22:29.002 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.001+0000 7f734a59c700 1 -- 172.21.2.102:0/552664521 learned_addr learned my addr 172.21.2.102:0/552664521 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:22:29.006 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.001+0000 7f734959a700 1 -- 172.21.2.102:0/552664521 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11501054 0 0) 0x7f734c0b7960 con 0x7f734c0b8d20 2021-02-12T17:22:29.006 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.001+0000 7f734959a700 1 -- 172.21.2.102:0/552664521 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7330003230 con 0x7f734c0b8d20 2021-02-12T17:22:29.006 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.001+0000 7f734ad9d700 1 --2- 172.21.2.102:0/552664521 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f734c062e50 0x7f734c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:29.006 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.001+0000 7f734959a700 1 -- 172.21.2.102:0/552664521 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1847132861 0 0) 0x7f7330003230 con 0x7f734c0b8d20 2021-02-12T17:22:29.006 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.001+0000 7f734959a700 1 -- 172.21.2.102:0/552664521 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f734c062e50 msgr2=0x7f734c068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:29.006 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.001+0000 7f734959a700 1 --2- 172.21.2.102:0/552664521 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f734c062e50 0x7f734c068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:29.006 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.001+0000 7f734959a700 1 -- 172.21.2.102:0/552664521 >> v1:172.21.2.104:6789/0 conn(0x7f734c14e530 legacy=0x7f734c062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:29.006 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.001+0000 7f734959a700 1 -- 172.21.2.102:0/552664521 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c14ea10 con 0x7f734c0b8d20 2021-02-12T17:22:29.006 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.001+0000 7f734959a700 1 -- 172.21.2.102:0/552664521 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f73400014e0 con 0x7f734c0b8d20 2021-02-12T17:22:29.006 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.001+0000 7f734959a700 1 -- 172.21.2.102:0/552664521 >> v1:172.21.2.102:6789/0 conn(0x7f734c0b8d20 legacy=0x7f734c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:29.006 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734959a700 1 --2- 172.21.2.102:0/552664521 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7330003750 0x7f7330003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:29.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734959a700 1 --2- 172.21.2.102:0/552664521 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73300044d0 0x7f7330004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:29.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734959a700 1 --2- 172.21.2.102:0/552664521 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f734c062e50 0x7f7330004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:29.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734959a700 1 -- 172.21.2.102:0/552664521 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c068d20 con 0x7f7330003750 2021-02-12T17:22:29.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734959a700 1 -- 172.21.2.102:0/552664521 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7330004330 con 0x7f73300044d0 2021-02-12T17:22:29.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734959a700 1 -- 172.21.2.102:0/552664521 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733000b720 con 0x7f734c062e50 2021-02-12T17:22:29.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734a59c700 1 --2- 172.21.2.102:0/552664521 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7330003750 0x7f7330003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:29.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734a59c700 1 -- 172.21.2.102:0/552664521 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f734c062e50 msgr2=0x7f7330004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:29.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734a59c700 1 --2- 172.21.2.102:0/552664521 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f734c062e50 0x7f7330004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:29.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734a59c700 1 -- 172.21.2.102:0/552664521 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73300044d0 msgr2=0x7f7330004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:29.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734a59c700 1 --2- 172.21.2.102:0/552664521 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f73300044d0 0x7f7330004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:29.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734a59c700 1 -- 172.21.2.102:0/552664521 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7330003230 con 0x7f7330003750 2021-02-12T17:22:29.007 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734a59c700 1 --2- 172.21.2.102:0/552664521 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7330003750 0x7f7330003b70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f734000c210 tx=0x7f734c14eba0).ready entity=mon.0 client_cookie=1e9fa26d0a435d38 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:29.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734959a700 1 -- 172.21.2.102:0/552664521 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73400070d0 con 0x7f7330003750 2021-02-12T17:22:29.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734959a700 1 -- 172.21.2.102:0/552664521 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7340007230 con 0x7f7330003750 2021-02-12T17:22:29.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734959a700 1 -- 172.21.2.102:0/552664521 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73400055e0 con 0x7f7330003750 2021-02-12T17:22:29.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f735080c700 1 -- 172.21.2.102:0/552664521 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7330003750 msgr2=0x7f7330003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:29.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f735080c700 1 --2- 172.21.2.102:0/552664521 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f7330003750 0x7f7330003b70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f734000c210 tx=0x7f734c14eba0).stop 2021-02-12T17:22:29.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f734ad9d700 1 -- 172.21.2.102:0/552664521 reap_dead start 2021-02-12T17:22:29.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f735080c700 1 -- 172.21.2.102:0/552664521 shutdown_connections 2021-02-12T17:22:29.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f735080c700 1 -- 172.21.2.102:0/552664521 >> 172.21.2.102:0/552664521 conn(0x7f734c0bc480 msgr2=0x7f734c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:29.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f735080c700 1 -- 172.21.2.102:0/552664521 shutdown_connections 2021-02-12T17:22:29.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.002+0000 7f735080c700 1 -- 172.21.2.102:0/552664521 wait complete. 2021-02-12T17:22:29.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.003+0000 7f735080c700 1 Processor -- start 2021-02-12T17:22:29.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.003+0000 7f735080c700 1 -- start start 2021-02-12T17:22:29.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f735080c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7330003750 0x7f734c0acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:29.008 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f735080c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f734c0b9ef0 0x7f734c152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:29.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f735080c700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f734c15dbe0 0x7f734c149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:29.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f735080c700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c153120 con 0x7f734c0b9ef0 2021-02-12T17:22:29.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f735080c700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c152be0 con 0x7f734c15dbe0 2021-02-12T17:22:29.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f735080c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734c152e80 con 0x7f7330003750 2021-02-12T17:22:29.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f7349d9b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f734c0b9ef0 0x7f734c152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:29.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f7349d9b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f734c0b9ef0 0x7f734c152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47644/0 (socket says 172.21.2.102:47644) 2021-02-12T17:22:29.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f7349d9b700 1 -- 172.21.2.102:0/3651502574 learned_addr learned my addr 172.21.2.102:0/3651502574 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:29.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f734ad9d700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f734c15dbe0 0x7f734c149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:29.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f7349d9b700 1 -- 172.21.2.102:0/3651502574 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7330003750 msgr2=0x7f734c0acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:29.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f734a59c700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7330003750 0x7f734c0acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:29.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f7349d9b700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7330003750 0x7f734c0acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:29.009 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f7349d9b700 1 -- 172.21.2.102:0/3651502574 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f734c15dbe0 msgr2=0x7f734c149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:29.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f7349d9b700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f734c15dbe0 0x7f734c149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:29.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f7349d9b700 1 -- 172.21.2.102:0/3651502574 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c15d4a0 con 0x7f734c0b9ef0 2021-02-12T17:22:29.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f734a59c700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7330003750 0x7f734c0acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:22:29.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f7349d9b700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f734c0b9ef0 0x7f734c152150 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f733c00c710 tx=0x7f733c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:29.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f733a7fc700 1 -- 172.21.2.102:0/3651502574 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c00a4b0 con 0x7f734c0b9ef0 2021-02-12T17:22:29.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f733a7fc700 1 -- 172.21.2.102:0/3651502574 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c00a610 con 0x7f734c0b9ef0 2021-02-12T17:22:29.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.004+0000 7f735080c700 1 -- 172.21.2.102:0/3651502574 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734c15d740 con 0x7f734c0b9ef0 2021-02-12T17:22:29.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.005+0000 7f733a7fc700 1 -- 172.21.2.102:0/3651502574 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c00a9b0 con 0x7f734c0b9ef0 2021-02-12T17:22:29.010 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.005+0000 7f735080c700 1 -- 172.21.2.102:0/3651502574 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734c152640 con 0x7f734c0b9ef0 2021-02-12T17:22:29.011 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.005+0000 7f735080c700 1 -- 172.21.2.102:0/3651502574 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734c061c30 con 0x7f734c0b9ef0 2021-02-12T17:22:29.011 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.005+0000 7f733a7fc700 1 -- 172.21.2.102:0/3651502574 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f733c010070 con 0x7f734c0b9ef0 2021-02-12T17:22:29.011 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.006+0000 7f733a7fc700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7328059d30 0x7f732805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:29.011 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.006+0000 7f733a7fc700 1 -- 172.21.2.102:0/3651502574 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7451+0+0 (secure 0 0 0) 0x7f733c073490 con 0x7f734c0b9ef0 2021-02-12T17:22:29.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.006+0000 7f734a59c700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7328059d30 0x7f732805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:29.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.006+0000 7f734a59c700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7328059d30 0x7f732805c1f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f734000cc90 tx=0x7f7340015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:29.012 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.009+0000 7f733a7fc700 1 -- 172.21.2.102:0/3651502574 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f733c046a10 con 0x7f734c0b9ef0 2021-02-12T17:22:29.173 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.172+0000 7f735080c700 1 -- 172.21.2.102:0/3651502574 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f734c15d8d0 con 0x7f734c0b9ef0 2021-02-12T17:22:29.173 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.172+0000 7f733a7fc700 1 -- 172.21.2.102:0/3651502574 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3763 (secure 0 0 0) 0x7f733c04a030 con 0x7f734c0b9ef0 2021-02-12T17:22:29.173 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:29.174 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":45}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:21:54.333741+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34514":{"gid":34514,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":10,"addr":"172.21.2.104:6835/2864421012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":2864421012},{"type":"v1","addr":"172.21.2.104:6835","nonce":2864421012}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:29.174 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.173+0000 7f735080c700 1 -- 172.21.2.102:0/3651502574 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7328059d30 msgr2=0x7f732805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:29.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.173+0000 7f735080c700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7328059d30 0x7f732805c1f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f734000cc90 tx=0x7f7340015000).stop 2021-02-12T17:22:29.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.173+0000 7f735080c700 1 -- 172.21.2.102:0/3651502574 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f734c0b9ef0 msgr2=0x7f734c152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:29.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.173+0000 7f735080c700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f734c0b9ef0 0x7f734c152150 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f733c00c710 tx=0x7f733c007c10).stop 2021-02-12T17:22:29.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.174+0000 7f735080c700 1 -- 172.21.2.102:0/3651502574 shutdown_connections 2021-02-12T17:22:29.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.174+0000 7f735080c700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f734c15dbe0 0x7f734c149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:29.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.174+0000 7f735080c700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f7330003750 0x7f734c0acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:29.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.174+0000 7f735080c700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f7328059d30 0x7f732805c1f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:29.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.174+0000 7f735080c700 1 --2- 172.21.2.102:0/3651502574 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f734c0b9ef0 0x7f734c152150 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:29.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.174+0000 7f735080c700 1 -- 172.21.2.102:0/3651502574 >> 172.21.2.102:0/3651502574 conn(0x7f734c0bc480 msgr2=0x7f734c14d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:29.175 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.174+0000 7f735080c700 1 -- 172.21.2.102:0/3651502574 shutdown_connections 2021-02-12T17:22:29.176 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:29.174+0000 7f735080c700 1 -- 172.21.2.102:0/3651502574 wait complete. 2021-02-12T17:22:29.176 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 45 2021-02-12T17:22:29.183 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:22:31.184 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:31.272 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.271+0000 7f1e75678700 1 Processor -- start 2021-02-12T17:22:31.272 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.271+0000 7f1e75678700 1 -- start start 2021-02-12T17:22:31.273 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.272+0000 7f1e75678700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1e700b71a0 0x7f1e700b7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:31.273 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.272+0000 7f1e75678700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f1e700b12b0 0x7f1e70150430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:31.273 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.272+0000 7f1e75678700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7009c410 con 0x7f1e70150920 2021-02-12T17:22:31.273 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.272+0000 7f1e75678700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e700b22a0 con 0x7f1e700b12b0 2021-02-12T17:22:31.273 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.272+0000 7f1e75678700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e700b2540 con 0x7f1e700b71a0 2021-02-12T17:22:31.273 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.272+0000 7f1e74e77700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f1e70150920 0x7f1e7009cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56292/0 (socket says 172.21.2.102:56292) 2021-02-12T17:22:31.273 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.272+0000 7f1e74e77700 1 -- 172.21.2.102:0/4207430567 learned_addr learned my addr 172.21.2.102:0/4207430567 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:22:31.273 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.272+0000 7f1e6f7fe700 1 --2- 172.21.2.102:0/4207430567 >> v2:172.21.2.102:3300/0 conn(0x7f1e700b12b0 0x7f1e70150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:31.274 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.272+0000 7f1e6f7fe700 1 -- 172.21.2.102:0/4207430567 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1e700b71a0 msgr2=0x7f1e700b7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:31.274 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.272+0000 7f1e6f7fe700 1 --2- 172.21.2.102:0/4207430567 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1e700b71a0 0x7f1e700b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:31.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.272+0000 7f1e6f7fe700 1 -- 172.21.2.102:0/4207430567 >> v1:172.21.2.102:6789/0 conn(0x7f1e70150920 legacy=0x7f1e7009cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:31.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.272+0000 7f1e6f7fe700 1 -- 172.21.2.102:0/4207430567 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7009c640 con 0x7f1e700b12b0 2021-02-12T17:22:31.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.273+0000 7f1e6f7fe700 1 --2- 172.21.2.102:0/4207430567 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1e700b12b0 0x7f1e70150430 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f1e6400b980 tx=0x7f1e64006de0).ready entity=mon.0 client_cookie=2e028dcc9b4d551b server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:31.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.273+0000 7f1e6effd700 1 -- 172.21.2.102:0/4207430567 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64009870 con 0x7f1e700b12b0 2021-02-12T17:22:31.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.273+0000 7f1e6effd700 1 -- 172.21.2.102:0/4207430567 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e640099d0 con 0x7f1e700b12b0 2021-02-12T17:22:31.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.273+0000 7f1e6effd700 1 -- 172.21.2.102:0/4207430567 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64009d50 con 0x7f1e700b12b0 2021-02-12T17:22:31.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.273+0000 7f1e75678700 1 -- 172.21.2.102:0/4207430567 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1e700b12b0 msgr2=0x7f1e70150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:31.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.273+0000 7f1e75678700 1 --2- 172.21.2.102:0/4207430567 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1e700b12b0 0x7f1e70150430 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f1e6400b980 tx=0x7f1e64006de0).stop 2021-02-12T17:22:31.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.273+0000 7f1e75678700 1 -- 172.21.2.102:0/4207430567 shutdown_connections 2021-02-12T17:22:31.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.273+0000 7f1e75678700 1 --2- 172.21.2.102:0/4207430567 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1e700b71a0 0x7f1e700b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:31.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.273+0000 7f1e75678700 1 --2- 172.21.2.102:0/4207430567 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1e700b12b0 0x7f1e70150430 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.273+0000 7f1e75678700 1 -- 172.21.2.102:0/4207430567 >> 172.21.2.102:0/4207430567 conn(0x7f1e700b8290 msgr2=0x7f1e700b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:31.275 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.273+0000 7f1e75678700 1 -- 172.21.2.102:0/4207430567 shutdown_connections 2021-02-12T17:22:31.276 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.273+0000 7f1e75678700 1 -- 172.21.2.102:0/4207430567 wait complete. 2021-02-12T17:22:31.277 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.274+0000 7f1e75678700 1 Processor -- start 2021-02-12T17:22:31.277 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.274+0000 7f1e75678700 1 -- start start 2021-02-12T17:22:31.277 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e75678700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1e700b12b0 0x7f1e7009ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:31.277 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e75678700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1e700b71a0 0x7f1e7014c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:31.277 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e75678700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1e70150920 0x7f1e700ba950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:31.277 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e75678700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e700a15d0 con 0x7f1e700b71a0 2021-02-12T17:22:31.277 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e75678700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7009f340 con 0x7f1e70150920 2021-02-12T17:22:31.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e75678700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e70067590 con 0x7f1e700b12b0 2021-02-12T17:22:31.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e6f7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1e700b71a0 0x7f1e7014c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:31.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e6f7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1e700b71a0 0x7f1e7014c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47654/0 (socket says 172.21.2.102:47654) 2021-02-12T17:22:31.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e6f7fe700 1 -- 172.21.2.102:0/2365627578 learned_addr learned my addr 172.21.2.102:0/2365627578 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:31.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e74e77700 1 --2- 172.21.2.102:0/2365627578 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1e70150920 0x7f1e700ba950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:31.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e6ffff700 1 --2- 172.21.2.102:0/2365627578 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1e700b12b0 0x7f1e7009ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:31.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e6f7fe700 1 -- 172.21.2.102:0/2365627578 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1e700b12b0 msgr2=0x7f1e7009ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:31.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e6f7fe700 1 --2- 172.21.2.102:0/2365627578 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1e700b12b0 0x7f1e7009ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e6f7fe700 1 -- 172.21.2.102:0/2365627578 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1e70150920 msgr2=0x7f1e700ba950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:31.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e6f7fe700 1 --2- 172.21.2.102:0/2365627578 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1e70150920 0x7f1e700ba950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e6f7fe700 1 -- 172.21.2.102:0/2365627578 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e70067830 con 0x7f1e700b71a0 2021-02-12T17:22:31.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.275+0000 7f1e6f7fe700 1 --2- 172.21.2.102:0/2365627578 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1e700b71a0 0x7f1e7014c240 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f1e64006e20 tx=0x7f1e64016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:31.279 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.276+0000 7f1e57fff700 1 -- 172.21.2.102:0/2365627578 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64012e80 con 0x7f1e700b71a0 2021-02-12T17:22:31.279 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.276+0000 7f1e57fff700 1 -- 172.21.2.102:0/2365627578 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6401c420 con 0x7f1e700b71a0 2021-02-12T17:22:31.279 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.276+0000 7f1e75678700 1 -- 172.21.2.102:0/2365627578 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e70067ad0 con 0x7f1e700b71a0 2021-02-12T17:22:31.279 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.276+0000 7f1e57fff700 1 -- 172.21.2.102:0/2365627578 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6401c7a0 con 0x7f1e700b71a0 2021-02-12T17:22:31.279 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.276+0000 7f1e75678700 1 -- 172.21.2.102:0/2365627578 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e700bae40 con 0x7f1e700b71a0 2021-02-12T17:22:31.279 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.276+0000 7f1e75678700 1 -- 172.21.2.102:0/2365627578 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7009fd90 con 0x7f1e700b71a0 2021-02-12T17:22:31.279 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.277+0000 7f1e57fff700 1 -- 172.21.2.102:0/2365627578 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f1e6400f070 con 0x7f1e700b71a0 2021-02-12T17:22:31.280 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.277+0000 7f1e57fff700 1 --2- 172.21.2.102:0/2365627578 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1e50059d30 0x7f1e5005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:31.280 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.277+0000 7f1e57fff700 1 -- 172.21.2.102:0/2365627578 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7451+0+0 (secure 0 0 0) 0x7f1e640757b0 con 0x7f1e700b71a0 2021-02-12T17:22:31.280 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.277+0000 7f1e6ffff700 1 --2- 172.21.2.102:0/2365627578 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1e50059d30 0x7f1e5005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:31.280 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.277+0000 7f1e6ffff700 1 --2- 172.21.2.102:0/2365627578 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1e50059d30 0x7f1e5005c1f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f1e7009d970 tx=0x7f1e60008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:31.281 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.280+0000 7f1e57fff700 1 -- 172.21.2.102:0/2365627578 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f1e64048c80 con 0x7f1e700b71a0 2021-02-12T17:22:31.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.445+0000 7f1e75678700 1 -- 172.21.2.102:0/2365627578 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e70044c00 con 0x7f1e700b71a0 2021-02-12T17:22:31.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.445+0000 7f1e57fff700 1 -- 172.21.2.102:0/2365627578 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+3406 (secure 0 0 0) 0x7f1e6404c2a0 con 0x7f1e700b71a0 2021-02-12T17:22:31.446 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:31.447 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:31.332466+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:replay","state_seq":1,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:31.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.446+0000 7f1e75678700 1 -- 172.21.2.102:0/2365627578 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1e50059d30 msgr2=0x7f1e5005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:31.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.446+0000 7f1e75678700 1 --2- 172.21.2.102:0/2365627578 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1e50059d30 0x7f1e5005c1f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f1e7009d970 tx=0x7f1e60008040).stop 2021-02-12T17:22:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.446+0000 7f1e75678700 1 -- 172.21.2.102:0/2365627578 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1e700b71a0 msgr2=0x7f1e7014c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.446+0000 7f1e75678700 1 --2- 172.21.2.102:0/2365627578 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1e700b71a0 0x7f1e7014c240 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f1e64006e20 tx=0x7f1e64016000).stop 2021-02-12T17:22:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.447+0000 7f1e75678700 1 -- 172.21.2.102:0/2365627578 shutdown_connections 2021-02-12T17:22:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.447+0000 7f1e75678700 1 --2- 172.21.2.102:0/2365627578 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1e70150920 0x7f1e700ba950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.447+0000 7f1e75678700 1 --2- 172.21.2.102:0/2365627578 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1e700b12b0 0x7f1e7009ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.447+0000 7f1e75678700 1 --2- 172.21.2.102:0/2365627578 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1e50059d30 0x7f1e5005c1f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.447+0000 7f1e75678700 1 --2- 172.21.2.102:0/2365627578 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1e700b71a0 0x7f1e7014c240 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.447+0000 7f1e75678700 1 -- 172.21.2.102:0/2365627578 >> 172.21.2.102:0/2365627578 conn(0x7f1e700b8290 msgr2=0x7f1e7014c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.447+0000 7f1e75678700 1 -- 172.21.2.102:0/2365627578 shutdown_connections 2021-02-12T17:22:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.447+0000 7f1e75678700 1 -- 172.21.2.102:0/2365627578 wait complete. 2021-02-12T17:22:31.449 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 46 2021-02-12T17:22:31.456 INFO:tasks.mds_thrash.fs.[b]:mds.d down, removed from mdsmap 2021-02-12T17:22:31.456 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2021-02-12T17:22:31.456 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:31.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.542+0000 7f2d814b2700 1 Processor -- start 2021-02-12T17:22:31.543 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.542+0000 7f2d814b2700 1 -- start start 2021-02-12T17:22:31.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d814b2700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2d7c0b8d20 0x7f2d7c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:31.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d814b2700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f2d7c062740 0x7f2d7c062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:31.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d814b2700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7c0b7960 con 0x7f2d7c14e530 2021-02-12T17:22:31.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d814b2700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7c068d20 con 0x7f2d7c062740 2021-02-12T17:22:31.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d814b2700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c0622a0 con 0x7f2d7c0b8d20 2021-02-12T17:22:31.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d7b7fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f2d7c062740 0x7f2d7c062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:31.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d7a7fc700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f2d7c14e530 0x7f2d7c0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56318/0 (socket says 172.21.2.102:56318) 2021-02-12T17:22:31.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d7a7fc700 1 -- 172.21.2.102:0/4076831786 learned_addr learned my addr 172.21.2.102:0/4076831786 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:22:31.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d7affd700 1 --2- 172.21.2.102:0/4076831786 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2d7c0b8d20 0x7f2d7c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:31.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d7b7fe700 1 -- 172.21.2.102:0/4076831786 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2d7c0b8d20 msgr2=0x7f2d7c068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:31.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d7b7fe700 1 --2- 172.21.2.102:0/4076831786 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2d7c0b8d20 0x7f2d7c068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.545 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d7b7fe700 1 -- 172.21.2.102:0/4076831786 >> v1:172.21.2.102:6789/0 conn(0x7f2d7c14e530 legacy=0x7f2d7c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:31.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d7b7fe700 1 -- 172.21.2.102:0/4076831786 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c14ea10 con 0x7f2d7c062740 2021-02-12T17:22:31.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d7affd700 1 --2- 172.21.2.102:0/4076831786 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2d7c0b8d20 0x7f2d7c068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:22:31.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d7b7fe700 1 --2- 172.21.2.102:0/4076831786 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2d7c062740 0x7f2d7c062bf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f2d74009c90 tx=0x7f2d740091d0).ready entity=mon.0 client_cookie=b1b6b6eade6de469 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:31.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d79ffb700 1 -- 172.21.2.102:0/4076831786 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74009ea0 con 0x7f2d7c062740 2021-02-12T17:22:31.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d79ffb700 1 -- 172.21.2.102:0/4076831786 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7400bbf0 con 0x7f2d7c062740 2021-02-12T17:22:31.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.543+0000 7f2d79ffb700 1 -- 172.21.2.102:0/4076831786 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74011400 con 0x7f2d7c062740 2021-02-12T17:22:31.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.544+0000 7f2d814b2700 1 -- 172.21.2.102:0/4076831786 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2d7c062740 msgr2=0x7f2d7c062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:31.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.544+0000 7f2d814b2700 1 --2- 172.21.2.102:0/4076831786 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2d7c062740 0x7f2d7c062bf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f2d74009c90 tx=0x7f2d740091d0).stop 2021-02-12T17:22:31.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.544+0000 7f2d814b2700 1 -- 172.21.2.102:0/4076831786 shutdown_connections 2021-02-12T17:22:31.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.544+0000 7f2d814b2700 1 --2- 172.21.2.102:0/4076831786 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2d7c062740 0x7f2d7c062bf0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.544+0000 7f2d814b2700 1 --2- 172.21.2.102:0/4076831786 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2d7c0b8d20 0x7f2d7c068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.544+0000 7f2d814b2700 1 -- 172.21.2.102:0/4076831786 >> 172.21.2.102:0/4076831786 conn(0x7f2d7c0bc480 msgr2=0x7f2d7c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:31.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.544+0000 7f2d814b2700 1 -- 172.21.2.102:0/4076831786 shutdown_connections 2021-02-12T17:22:31.547 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.544+0000 7f2d814b2700 1 -- 172.21.2.102:0/4076831786 wait complete. 2021-02-12T17:22:31.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.545+0000 7f2d814b2700 1 Processor -- start 2021-02-12T17:22:31.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.545+0000 7f2d814b2700 1 -- start start 2021-02-12T17:22:31.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.545+0000 7f2d814b2700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2d7c062740 0x7f2d7c0b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:31.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.545+0000 7f2d814b2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2d7c0b8d20 0x7f2d7c0b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:31.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.545+0000 7f2d814b2700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2d7c14e530 0x7f2d7c0b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:31.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.545+0000 7f2d814b2700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c0b4f60 con 0x7f2d7c0b8d20 2021-02-12T17:22:31.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.545+0000 7f2d814b2700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c160bd0 con 0x7f2d7c14e530 2021-02-12T17:22:31.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.545+0000 7f2d814b2700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c160e70 con 0x7f2d7c062740 2021-02-12T17:22:31.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d7a7fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2d7c0b8d20 0x7f2d7c0b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:31.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d7a7fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2d7c0b8d20 0x7f2d7c0b0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47684/0 (socket says 172.21.2.102:47684) 2021-02-12T17:22:31.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d7a7fc700 1 -- 172.21.2.102:0/2519130316 learned_addr learned my addr 172.21.2.102:0/2519130316 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:31.549 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d7affd700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2d7c062740 0x7f2d7c0b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:31.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d7b7fe700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2d7c14e530 0x7f2d7c0b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:31.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d7a7fc700 1 -- 172.21.2.102:0/2519130316 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2d7c062740 msgr2=0x7f2d7c0b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:31.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d7a7fc700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2d7c062740 0x7f2d7c0b7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d7a7fc700 1 -- 172.21.2.102:0/2519130316 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2d7c14e530 msgr2=0x7f2d7c0b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:31.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d7a7fc700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2d7c14e530 0x7f2d7c0b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d7a7fc700 1 -- 172.21.2.102:0/2519130316 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c161110 con 0x7f2d7c0b8d20 2021-02-12T17:22:31.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d7affd700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2d7c062740 0x7f2d7c0b7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:22:31.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d7b7fe700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2d7c14e530 0x7f2d7c0b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:22:31.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d7a7fc700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2d7c0b8d20 0x7f2d7c0b0ed0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f2d6c00c710 tx=0x7f2d6c007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:31.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d72ffd700 1 -- 172.21.2.102:0/2519130316 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c0072e0 con 0x7f2d7c0b8d20 2021-02-12T17:22:31.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d72ffd700 1 -- 172.21.2.102:0/2519130316 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c007440 con 0x7f2d7c0b8d20 2021-02-12T17:22:31.550 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d72ffd700 1 -- 172.21.2.102:0/2519130316 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c0057f0 con 0x7f2d7c0b8d20 2021-02-12T17:22:31.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d814b2700 1 -- 172.21.2.102:0/2519130316 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7c1613b0 con 0x7f2d7c0b8d20 2021-02-12T17:22:31.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.546+0000 7f2d814b2700 1 -- 172.21.2.102:0/2519130316 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7c161850 con 0x7f2d7c0b8d20 2021-02-12T17:22:31.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.547+0000 7f2d814b2700 1 -- 172.21.2.102:0/2519130316 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7c161540 con 0x7f2d7c0b8d20 2021-02-12T17:22:31.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.547+0000 7f2d72ffd700 1 -- 172.21.2.102:0/2519130316 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f2d6c010070 con 0x7f2d7c0b8d20 2021-02-12T17:22:31.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.548+0000 7f2d72ffd700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2d60059d30 0x7f2d6005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:31.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.548+0000 7f2d72ffd700 1 -- 172.21.2.102:0/2519130316 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f2d6c073530 con 0x7f2d7c0b8d20 2021-02-12T17:22:31.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.548+0000 7f2d7affd700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2d60059d30 0x7f2d6005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:31.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.548+0000 7f2d7affd700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2d60059d30 0x7f2d6005c1f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f2d6400a8c0 tx=0x7f2d64008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:31.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.551+0000 7f2d72ffd700 1 -- 172.21.2.102:0/2519130316 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f2d6c046ab0 con 0x7f2d7c0b8d20 2021-02-12T17:22:31.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.712+0000 7f2d814b2700 1 -- 172.21.2.102:0/2519130316 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d7c045460 con 0x7f2d7c0b8d20 2021-02-12T17:22:31.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.712+0000 7f2d72ffd700 1 -- 172.21.2.102:0/2519130316 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+3406 (secure 0 0 0) 0x7f2d6c018070 con 0x7f2d7c0b8d20 2021-02-12T17:22:31.713 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:31.713 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:31.332466+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:replay","state_seq":1,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:31.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.713+0000 7f2d814b2700 1 -- 172.21.2.102:0/2519130316 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2d60059d30 msgr2=0x7f2d6005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:31.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.713+0000 7f2d814b2700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2d60059d30 0x7f2d6005c1f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f2d6400a8c0 tx=0x7f2d64008040).stop 2021-02-12T17:22:31.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.713+0000 7f2d814b2700 1 -- 172.21.2.102:0/2519130316 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2d7c0b8d20 msgr2=0x7f2d7c0b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:31.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.713+0000 7f2d814b2700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2d7c0b8d20 0x7f2d7c0b0ed0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f2d6c00c710 tx=0x7f2d6c007bd0).stop 2021-02-12T17:22:31.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.713+0000 7f2d814b2700 1 -- 172.21.2.102:0/2519130316 shutdown_connections 2021-02-12T17:22:31.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.713+0000 7f2d814b2700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2d7c14e530 0x7f2d7c0b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.713+0000 7f2d814b2700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2d7c062740 0x7f2d7c0b7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.713+0000 7f2d814b2700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2d60059d30 0x7f2d6005c1f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.713+0000 7f2d814b2700 1 --2- 172.21.2.102:0/2519130316 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2d7c0b8d20 0x7f2d7c0b0ed0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:31.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.713+0000 7f2d814b2700 1 -- 172.21.2.102:0/2519130316 >> 172.21.2.102:0/2519130316 conn(0x7f2d7c0bc480 msgr2=0x7f2d7c14cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:31.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.713+0000 7f2d814b2700 1 -- 172.21.2.102:0/2519130316 shutdown_connections 2021-02-12T17:22:31.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:31.714+0000 7f2d814b2700 1 -- 172.21.2.102:0/2519130316 wait complete. 2021-02-12T17:22:31.715 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 46 2021-02-12T17:22:31.724 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 46, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:01.991560+0000", "damaged": [], "data_pools": [ 4 ], "enabled": true, "epoch": 39, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "a", "in": [ 0 ], "info": { "gid_5451": { "addr": "172.21.2.102:6837/2121955587", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6836", "nonce": 2121955587, "type": "v2" }, { "addr": "172.21.2.102:6837", "nonce": 2121955587, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5451, "incarnation": 36, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 13 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2021-02-12T17:21:24.488481+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5451 } } }, { "id": 2, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:08.529588+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 46, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "b", "in": [ 0 ], "info": { "gid_5625": { "addr": "172.21.2.102:6835/2467742327", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6834", "nonce": 2467742327, "type": "v2" }, { "addr": "172.21.2.102:6835", "nonce": 2467742327, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5625, "incarnation": 46, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 35, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 5, "modified": "2021-02-12T17:22:31.332466+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5625 } } } ], "standbys": [ { "addr": "172.21.2.104:6834/3149030842", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6832", "nonce": 3149030842, "type": "v2" }, { "addr": "172.21.2.104:6834", "nonce": 3149030842, "type": "v1" } ] }, "epoch": 5, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4243, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 2 } ] } 2021-02-12T17:22:33.725 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:33.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.813+0000 7fc44c153700 1 Processor -- start 2021-02-12T17:22:33.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.813+0000 7fc44c153700 1 -- start start 2021-02-12T17:22:33.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.813+0000 7fc44c153700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc44414e530 0x7fc444068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:33.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.813+0000 7fc44c153700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fc444062740 0x7fc444062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:33.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.813+0000 7fc44c153700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4440b7960 con 0x7fc4440b8d20 2021-02-12T17:22:33.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.813+0000 7fc44c153700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc444068d20 con 0x7fc444062740 2021-02-12T17:22:33.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.813+0000 7fc44c153700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440622a0 con 0x7fc44414e530 2021-02-12T17:22:33.816 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.814+0000 7fc44a6f0700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fc444062740 0x7fc444062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:33.816 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.814+0000 7fc449eef700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7fc4440b8d20 0x7fc4440b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:38704/0 (socket says 172.21.2.102:38704) 2021-02-12T17:22:33.816 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.814+0000 7fc449eef700 1 -- 172.21.2.102:0/1404123252 learned_addr learned my addr 172.21.2.102:0/1404123252 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:22:33.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.814+0000 7fc4496ee700 1 --2- 172.21.2.102:0/1404123252 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc44414e530 0x7fc444068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:33.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.814+0000 7fc44a6f0700 1 -- 172.21.2.102:0/1404123252 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc44414e530 msgr2=0x7fc444068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:33.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.814+0000 7fc44a6f0700 1 --2- 172.21.2.102:0/1404123252 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc44414e530 0x7fc444068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:33.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.814+0000 7fc44a6f0700 1 -- 172.21.2.102:0/1404123252 >> v1:172.21.2.104:6789/0 conn(0x7fc4440b8d20 legacy=0x7fc4440b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:33.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.814+0000 7fc44a6f0700 1 -- 172.21.2.102:0/1404123252 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44414ea10 con 0x7fc444062740 2021-02-12T17:22:33.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.815+0000 7fc44a6f0700 1 --2- 172.21.2.102:0/1404123252 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc444062740 0x7fc444062bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fc43c009c90 tx=0x7fc43c0091d0).ready entity=mon.1 client_cookie=1fb966468aee47b8 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:33.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.815+0000 7fc448eed700 1 -- 172.21.2.102:0/1404123252 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c00b9e0 con 0x7fc444062740 2021-02-12T17:22:33.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.815+0000 7fc448eed700 1 -- 172.21.2.102:0/1404123252 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c00bb40 con 0x7fc444062740 2021-02-12T17:22:33.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.815+0000 7fc448eed700 1 -- 172.21.2.102:0/1404123252 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c011400 con 0x7fc444062740 2021-02-12T17:22:33.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.815+0000 7fc44c153700 1 -- 172.21.2.102:0/1404123252 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc444062740 msgr2=0x7fc444062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:33.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.815+0000 7fc44c153700 1 --2- 172.21.2.102:0/1404123252 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc444062740 0x7fc444062bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fc43c009c90 tx=0x7fc43c0091d0).stop 2021-02-12T17:22:33.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.815+0000 7fc44c153700 1 -- 172.21.2.102:0/1404123252 shutdown_connections 2021-02-12T17:22:33.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.815+0000 7fc44c153700 1 --2- 172.21.2.102:0/1404123252 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc444062740 0x7fc444062bf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:33.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.815+0000 7fc44c153700 1 --2- 172.21.2.102:0/1404123252 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc44414e530 0x7fc444068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:33.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.815+0000 7fc44c153700 1 -- 172.21.2.102:0/1404123252 >> 172.21.2.102:0/1404123252 conn(0x7fc4440bc480 msgr2=0x7fc4440b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:33.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.815+0000 7fc44c153700 1 -- 172.21.2.102:0/1404123252 shutdown_connections 2021-02-12T17:22:33.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.815+0000 7fc44c153700 1 -- 172.21.2.102:0/1404123252 wait complete. 2021-02-12T17:22:33.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.816+0000 7fc44c153700 1 Processor -- start 2021-02-12T17:22:33.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.816+0000 7fc44c153700 1 -- start start 2021-02-12T17:22:33.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44c153700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc444062740 0x7fc4440af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:33.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44c153700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc4440b8d20 0x7fc4441536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:33.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44c153700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc44414e530 0x7fc4440acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:33.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44c153700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440b5820 con 0x7fc44414e530 2021-02-12T17:22:33.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44c153700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44414a430 con 0x7fc444062740 2021-02-12T17:22:33.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44c153700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440b5a50 con 0x7fc4440b8d20 2021-02-12T17:22:33.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44a6f0700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc44414e530 0x7fc4440acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:33.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44a6f0700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc44414e530 0x7fc4440acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47700/0 (socket says 172.21.2.102:47700) 2021-02-12T17:22:33.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44a6f0700 1 -- 172.21.2.102:0/2067430937 learned_addr learned my addr 172.21.2.102:0/2067430937 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:33.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc4496ee700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc4440b8d20 0x7fc4441536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:33.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc449eef700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc444062740 0x7fc4440af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:33.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44a6f0700 1 -- 172.21.2.102:0/2067430937 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc4440b8d20 msgr2=0x7fc4441536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:33.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44a6f0700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc4440b8d20 0x7fc4441536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:33.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44a6f0700 1 -- 172.21.2.102:0/2067430937 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc444062740 msgr2=0x7fc4440af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:33.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44a6f0700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc444062740 0x7fc4440af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:33.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44a6f0700 1 -- 172.21.2.102:0/2067430937 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4440b5cf0 con 0x7fc44414e530 2021-02-12T17:22:33.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc4496ee700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc4440b8d20 0x7fc4441536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:22:33.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc449eef700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc444062740 0x7fc4440af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:22:33.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.817+0000 7fc44a6f0700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc44414e530 0x7fc4440acf10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fc43c00b470 tx=0x7fc43c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:33.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.818+0000 7fc431ffb700 1 -- 172.21.2.102:0/2067430937 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c01c630 con 0x7fc44414e530 2021-02-12T17:22:33.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.818+0000 7fc431ffb700 1 -- 172.21.2.102:0/2067430937 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c01c790 con 0x7fc44414e530 2021-02-12T17:22:33.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.818+0000 7fc431ffb700 1 -- 172.21.2.102:0/2067430937 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c01cb10 con 0x7fc44414e530 2021-02-12T17:22:33.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.818+0000 7fc44c153700 1 -- 172.21.2.102:0/2067430937 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4440af050 con 0x7fc44414e530 2021-02-12T17:22:33.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.818+0000 7fc44c153700 1 -- 172.21.2.102:0/2067430937 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc444153ba0 con 0x7fc44414e530 2021-02-12T17:22:33.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.819+0000 7fc44c153700 1 -- 172.21.2.102:0/2067430937 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc444045460 con 0x7fc44414e530 2021-02-12T17:22:33.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.819+0000 7fc431ffb700 1 -- 172.21.2.102:0/2067430937 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fc43c02c070 con 0x7fc44414e530 2021-02-12T17:22:33.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.819+0000 7fc431ffb700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc424059d30 0x7fc42405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:33.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.819+0000 7fc431ffb700 1 -- 172.21.2.102:0/2067430937 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7fc43c076480 con 0x7fc44414e530 2021-02-12T17:22:33.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.819+0000 7fc449eef700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc424059d30 0x7fc42405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:33.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.819+0000 7fc449eef700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc424059d30 0x7fc42405c1f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fc440005590 tx=0x7fc440009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:33.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.822+0000 7fc431ffb700 1 -- 172.21.2.102:0/2067430937 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fc43c049a20 con 0x7fc44414e530 2021-02-12T17:22:33.985 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.984+0000 7fc44c153700 1 -- 172.21.2.102:0/2067430937 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc444063670 con 0x7fc44414e530 2021-02-12T17:22:33.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.985+0000 7fc431ffb700 1 -- 172.21.2.102:0/2067430937 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+3407 (secure 0 0 0) 0x7fc43c04cfc0 con 0x7fc44414e530 2021-02-12T17:22:33.986 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:33.986 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":48,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:33.339411+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:rejoin","state_seq":10,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:33.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.986+0000 7fc44c153700 1 -- 172.21.2.102:0/2067430937 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc424059d30 msgr2=0x7fc42405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:33.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.986+0000 7fc44c153700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc424059d30 0x7fc42405c1f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fc440005590 tx=0x7fc440009040).stop 2021-02-12T17:22:33.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.986+0000 7fc44c153700 1 -- 172.21.2.102:0/2067430937 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc44414e530 msgr2=0x7fc4440acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:33.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.986+0000 7fc44c153700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc44414e530 0x7fc4440acf10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fc43c00b470 tx=0x7fc43c017000).stop 2021-02-12T17:22:33.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.986+0000 7fc44c153700 1 -- 172.21.2.102:0/2067430937 shutdown_connections 2021-02-12T17:22:33.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.986+0000 7fc44c153700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc424059d30 0x7fc42405c1f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:33.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.986+0000 7fc44c153700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc44414e530 0x7fc4440acf10 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:33.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.986+0000 7fc44c153700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc444062740 0x7fc4440af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:33.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.986+0000 7fc44c153700 1 --2- 172.21.2.102:0/2067430937 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc4440b8d20 0x7fc4441536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:33.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.986+0000 7fc44c153700 1 -- 172.21.2.102:0/2067430937 >> 172.21.2.102:0/2067430937 conn(0x7fc4440bc480 msgr2=0x7fc44414cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:33.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.986+0000 7fc44c153700 1 -- 172.21.2.102:0/2067430937 shutdown_connections 2021-02-12T17:22:33.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:33.986+0000 7fc44c153700 1 -- 172.21.2.102:0/2067430937 wait complete. 2021-02-12T17:22:33.988 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 48 2021-02-12T17:22:33.996 INFO:tasks.mds_thrash.fs.[b]:no change 2021-02-12T17:22:35.997 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:36.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.085+0000 7f68c389a700 1 Processor -- start 2021-02-12T17:22:36.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.086+0000 7f68c389a700 1 -- start start 2021-02-12T17:22:36.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.086+0000 7f68c389a700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f68bc0b8d20 0x7f68bc068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:36.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.086+0000 7f68c389a700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f68bc062740 0x7f68bc062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:36.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.086+0000 7f68c389a700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68bc0b7960 con 0x7f68bc14e530 2021-02-12T17:22:36.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.086+0000 7f68c389a700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68bc068d20 con 0x7f68bc0b8d20 2021-02-12T17:22:36.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.086+0000 7f68c389a700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68bc0622a0 con 0x7f68bc062740 2021-02-12T17:22:36.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.087+0000 7f68c1636700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f68bc0b8d20 0x7f68bc068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:36.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.087+0000 7f68c1636700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f68bc0b8d20 0x7f68bc068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47706/0 (socket says 172.21.2.102:47706) 2021-02-12T17:22:36.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.087+0000 7f68c1636700 1 -- 172.21.2.102:0/355295660 learned_addr learned my addr 172.21.2.102:0/355295660 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:36.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.087+0000 7f68c1636700 1 -- 172.21.2.102:0/355295660 >> v2:172.21.2.104:3300/0 conn(0x7f68bc062740 msgr2=0x7f68bc062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:22:36.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.087+0000 7f68c1636700 1 --2- 172.21.2.102:0/355295660 >> v2:172.21.2.104:3300/0 conn(0x7f68bc062740 0x7f68bc062bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:36.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.087+0000 7f68c1636700 1 -- 172.21.2.102:0/355295660 >> v1:172.21.2.104:6789/0 conn(0x7f68bc14e530 legacy=0x7f68bc0b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:22:36.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.087+0000 7f68c1636700 1 -- 172.21.2.102:0/355295660 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc14ea10 con 0x7f68bc0b8d20 2021-02-12T17:22:36.089 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.087+0000 7f68c1636700 1 --2- 172.21.2.102:0/355295660 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68bc0b8d20 0x7f68bc068830 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f68bc068710 tx=0x7f68b8006ea0).ready entity=mon.0 client_cookie=3db7a0654e291072 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:36.089 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.087+0000 7f68abfff700 1 -- 172.21.2.102:0/355295660 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8009800 con 0x7f68bc0b8d20 2021-02-12T17:22:36.089 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.087+0000 7f68abfff700 1 -- 172.21.2.102:0/355295660 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b8009960 con 0x7f68bc0b8d20 2021-02-12T17:22:36.089 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.087+0000 7f68abfff700 1 -- 172.21.2.102:0/355295660 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8009ce0 con 0x7f68bc0b8d20 2021-02-12T17:22:36.090 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.088+0000 7f68c389a700 1 -- 172.21.2.102:0/355295660 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68bc0b8d20 msgr2=0x7f68bc068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:36.090 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.088+0000 7f68c389a700 1 --2- 172.21.2.102:0/355295660 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68bc0b8d20 0x7f68bc068830 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f68bc068710 tx=0x7f68b8006ea0).stop 2021-02-12T17:22:36.090 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.088+0000 7f68c389a700 1 -- 172.21.2.102:0/355295660 shutdown_connections 2021-02-12T17:22:36.090 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.088+0000 7f68c389a700 1 --2- 172.21.2.102:0/355295660 >> v2:172.21.2.104:3300/0 conn(0x7f68bc062740 0x7f68bc062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:36.090 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.088+0000 7f68c389a700 1 --2- 172.21.2.102:0/355295660 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68bc0b8d20 0x7f68bc068830 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:36.090 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.088+0000 7f68c389a700 1 -- 172.21.2.102:0/355295660 >> 172.21.2.102:0/355295660 conn(0x7f68bc0bc480 msgr2=0x7f68bc0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:36.090 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.088+0000 7f68c389a700 1 -- 172.21.2.102:0/355295660 shutdown_connections 2021-02-12T17:22:36.090 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.088+0000 7f68c389a700 1 -- 172.21.2.102:0/355295660 wait complete. 2021-02-12T17:22:36.090 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.089+0000 7f68c389a700 1 Processor -- start 2021-02-12T17:22:36.090 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.089+0000 7f68c389a700 1 -- start start 2021-02-12T17:22:36.091 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.089+0000 7f68c389a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f68bc062740 0x7f68bc0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:36.091 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.089+0000 7f68c389a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68bc0b8d20 0x7f68bc0aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:36.091 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.089+0000 7f68c389a700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f68bc14e530 0x7f68bc0af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:36.091 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.089+0000 7f68c389a700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc15de30 con 0x7f68bc0b8d20 2021-02-12T17:22:36.092 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.089+0000 7f68c389a700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc15e0d0 con 0x7f68bc14e530 2021-02-12T17:22:36.092 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.089+0000 7f68c389a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc15e370 con 0x7f68bc062740 2021-02-12T17:22:36.092 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.089+0000 7f68c0e35700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68bc0b8d20 0x7f68bc0aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:36.092 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.089+0000 7f68c0e35700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68bc0b8d20 0x7f68bc0aeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47712/0 (socket says 172.21.2.102:47712) 2021-02-12T17:22:36.092 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.089+0000 7f68c0e35700 1 -- 172.21.2.102:0/247315058 learned_addr learned my addr 172.21.2.102:0/247315058 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:36.092 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.090+0000 7f68c0e35700 1 -- 172.21.2.102:0/247315058 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f68bc062740 msgr2=0x7f68bc0b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:36.092 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.090+0000 7f68c0e35700 1 --2- 172.21.2.102:0/247315058 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f68bc062740 0x7f68bc0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:36.092 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.090+0000 7f68c1e37700 1 --2- 172.21.2.102:0/247315058 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f68bc14e530 0x7f68bc0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:36.092 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.090+0000 7f68c0e35700 1 -- 172.21.2.102:0/247315058 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f68bc14e530 msgr2=0x7f68bc0af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:36.092 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.090+0000 7f68c0e35700 1 --2- 172.21.2.102:0/247315058 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f68bc14e530 0x7f68bc0af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:36.092 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.090+0000 7f68c0e35700 1 -- 172.21.2.102:0/247315058 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc15e610 con 0x7f68bc0b8d20 2021-02-12T17:22:36.092 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.090+0000 7f68c1e37700 1 --2- 172.21.2.102:0/247315058 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f68bc14e530 0x7f68bc0af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:22:36.093 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.090+0000 7f68c0e35700 1 --2- 172.21.2.102:0/247315058 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68bc0b8d20 0x7f68bc0aeea0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f68ac0096e0 tx=0x7f68ac006d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:36.093 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.090+0000 7f68a97fa700 1 -- 172.21.2.102:0/247315058 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac00d500 con 0x7f68bc0b8d20 2021-02-12T17:22:36.093 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.090+0000 7f68a97fa700 1 -- 172.21.2.102:0/247315058 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac000e90 con 0x7f68bc0b8d20 2021-02-12T17:22:36.093 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.090+0000 7f68a97fa700 1 -- 172.21.2.102:0/247315058 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac00d8d0 con 0x7f68bc0b8d20 2021-02-12T17:22:36.093 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.090+0000 7f68c389a700 1 -- 172.21.2.102:0/247315058 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68bc15e8b0 con 0x7f68bc0b8d20 2021-02-12T17:22:36.093 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.090+0000 7f68c389a700 1 -- 172.21.2.102:0/247315058 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68bc0b5890 con 0x7f68bc0b8d20 2021-02-12T17:22:36.094 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.091+0000 7f68c389a700 1 -- 172.21.2.102:0/247315058 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68bc045460 con 0x7f68bc0b8d20 2021-02-12T17:22:36.094 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.091+0000 7f68a97fa700 1 -- 172.21.2.102:0/247315058 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f68ac00dc40 con 0x7f68bc0b8d20 2021-02-12T17:22:36.094 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.091+0000 7f68a97fa700 1 --2- 172.21.2.102:0/247315058 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f689c059db0 0x7f689c05c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:36.094 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.091+0000 7f68a97fa700 1 -- 172.21.2.102:0/247315058 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f68ac0736e0 con 0x7f68bc0b8d20 2021-02-12T17:22:36.094 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.092+0000 7f68c1636700 1 --2- 172.21.2.102:0/247315058 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f689c059db0 0x7f689c05c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:36.094 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.092+0000 7f68c1636700 1 --2- 172.21.2.102:0/247315058 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f689c059db0 0x7f689c05c270 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f68b8006ee0 tx=0x7f68b8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:36.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.094+0000 7f68a97fa700 1 -- 172.21.2.102:0/247315058 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f68ac046b70 con 0x7f68bc0b8d20 2021-02-12T17:22:36.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.250+0000 7f68c389a700 1 -- 172.21.2.102:0/247315058 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68bc15ea40 con 0x7f68bc0b8d20 2021-02-12T17:22:36.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.250+0000 7f68a97fa700 1 -- 172.21.2.102:0/247315058 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+3407 (secure 0 0 0) 0x7f68ac04a190 con 0x7f68bc0b8d20 2021-02-12T17:22:36.252 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:36.252 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:36.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.252+0000 7f68c389a700 1 -- 172.21.2.102:0/247315058 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f689c059db0 msgr2=0x7f689c05c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:36.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.252+0000 7f68c389a700 1 --2- 172.21.2.102:0/247315058 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f689c059db0 0x7f689c05c270 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f68b8006ee0 tx=0x7f68b8016000).stop 2021-02-12T17:22:36.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.252+0000 7f68c389a700 1 -- 172.21.2.102:0/247315058 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68bc0b8d20 msgr2=0x7f68bc0aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:36.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.252+0000 7f68c389a700 1 --2- 172.21.2.102:0/247315058 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68bc0b8d20 0x7f68bc0aeea0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f68ac0096e0 tx=0x7f68ac006d40).stop 2021-02-12T17:22:36.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.252+0000 7f68c389a700 1 -- 172.21.2.102:0/247315058 shutdown_connections 2021-02-12T17:22:36.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.252+0000 7f68c389a700 1 --2- 172.21.2.102:0/247315058 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f68bc14e530 0x7f68bc0af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:36.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.252+0000 7f68c389a700 1 --2- 172.21.2.102:0/247315058 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f68bc062740 0x7f68bc0b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:36.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.252+0000 7f68c389a700 1 --2- 172.21.2.102:0/247315058 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f689c059db0 0x7f689c05c270 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:36.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.252+0000 7f68c389a700 1 --2- 172.21.2.102:0/247315058 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f68bc0b8d20 0x7f68bc0aeea0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:36.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.252+0000 7f68c389a700 1 -- 172.21.2.102:0/247315058 >> 172.21.2.102:0/247315058 conn(0x7f68bc0bc480 msgr2=0x7f68bc0b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:36.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.252+0000 7f68c389a700 1 -- 172.21.2.102:0/247315058 shutdown_connections 2021-02-12T17:22:36.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:36.252+0000 7f68c389a700 1 -- 172.21.2.102:0/247315058 wait complete. 2021-02-12T17:22:36.254 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 49 2021-02-12T17:22:36.261 INFO:tasks.mds_thrash.fs.[b]:mds.a has gained rank=0, replacing gid=34514 2021-02-12T17:22:36.262 INFO:tasks.mds_thrash.fs.[b]:waiting for 1 secs before reviving mds.d 2021-02-12T17:22:37.262 INFO:tasks.mds_thrash.fs.[b]:reviving mds.d 2021-02-12T17:22:37.262 INFO:tasks.ceph.mds.d:Restarting daemon 2021-02-12T17:22:37.263 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2021-02-12T17:22:37.266 INFO:tasks.ceph.mds.d:Started 2021-02-12T17:22:37.266 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:37.322 INFO:tasks.ceph.mds.d.gibba004.stdout:starting mds.d at 2021-02-12T17:22:37.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.354+0000 7f1116117700 1 Processor -- start 2021-02-12T17:22:37.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.354+0000 7f1116117700 1 -- start start 2021-02-12T17:22:37.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.355+0000 7f1116117700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f111014e530 0x7f1110068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:37.356 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.355+0000 7f1116117700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f1110062740 0x7f1110062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:37.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.355+0000 7f1116117700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11100b7960 con 0x7f11100b8d20 2021-02-12T17:22:37.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.355+0000 7f1116117700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1110068d20 con 0x7f111014e530 2021-02-12T17:22:37.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.355+0000 7f1116117700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11100622a0 con 0x7f1110062740 2021-02-12T17:22:37.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.355+0000 7f110effd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f111014e530 0x7f1110068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:37.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.355+0000 7f110effd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f111014e530 0x7f1110068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47724/0 (socket says 172.21.2.102:47724) 2021-02-12T17:22:37.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.355+0000 7f110effd700 1 -- 172.21.2.102:0/490306783 learned_addr learned my addr 172.21.2.102:0/490306783 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:37.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.355+0000 7f110effd700 1 -- 172.21.2.102:0/490306783 >> v2:172.21.2.104:3300/0 conn(0x7f1110062740 msgr2=0x7f1110062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:22:37.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.355+0000 7f110effd700 1 --2- 172.21.2.102:0/490306783 >> v2:172.21.2.104:3300/0 conn(0x7f1110062740 0x7f1110062bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:37.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.355+0000 7f110effd700 1 -- 172.21.2.102:0/490306783 >> v1:172.21.2.104:6789/0 conn(0x7f11100b8d20 legacy=0x7f11100b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:22:37.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.355+0000 7f110effd700 1 -- 172.21.2.102:0/490306783 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111014ea10 con 0x7f111014e530 2021-02-12T17:22:37.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.356+0000 7f110effd700 1 --2- 172.21.2.102:0/490306783 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f111014e530 0x7f1110068830 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f1110068710 tx=0x7f10f8006ea0).ready entity=mon.0 client_cookie=ab766d8e2a4e121d server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:37.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.356+0000 7f110e7fc700 1 -- 172.21.2.102:0/490306783 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8009800 con 0x7f111014e530 2021-02-12T17:22:37.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.356+0000 7f110e7fc700 1 -- 172.21.2.102:0/490306783 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f8009960 con 0x7f111014e530 2021-02-12T17:22:37.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.356+0000 7f110e7fc700 1 -- 172.21.2.102:0/490306783 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8009ce0 con 0x7f111014e530 2021-02-12T17:22:37.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.356+0000 7f1116117700 1 -- 172.21.2.102:0/490306783 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f111014e530 msgr2=0x7f1110068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:37.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.356+0000 7f1116117700 1 --2- 172.21.2.102:0/490306783 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f111014e530 0x7f1110068830 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f1110068710 tx=0x7f10f8006ea0).stop 2021-02-12T17:22:37.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.356+0000 7f1116117700 1 -- 172.21.2.102:0/490306783 shutdown_connections 2021-02-12T17:22:37.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.356+0000 7f1116117700 1 --2- 172.21.2.102:0/490306783 >> v2:172.21.2.104:3300/0 conn(0x7f1110062740 0x7f1110062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:37.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.356+0000 7f1116117700 1 --2- 172.21.2.102:0/490306783 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f111014e530 0x7f1110068830 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:37.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.356+0000 7f1116117700 1 -- 172.21.2.102:0/490306783 >> 172.21.2.102:0/490306783 conn(0x7f11100bc480 msgr2=0x7f11100b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:37.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.356+0000 7f1116117700 1 -- 172.21.2.102:0/490306783 shutdown_connections 2021-02-12T17:22:37.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.356+0000 7f1116117700 1 -- 172.21.2.102:0/490306783 wait complete. 2021-02-12T17:22:37.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.357+0000 7f1116117700 1 Processor -- start 2021-02-12T17:22:37.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.357+0000 7f1116117700 1 -- start start 2021-02-12T17:22:37.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f1116117700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1110062740 0x7f11100b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:37.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f1116117700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f11100b8d20 0x7f11100ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:37.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f1116117700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f111014e530 0x7f111013f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:37.360 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f1116117700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111015d940 con 0x7f111014e530 2021-02-12T17:22:37.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f1116117700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111015dbe0 con 0x7f11100b8d20 2021-02-12T17:22:37.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f1116117700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111015de80 con 0x7f1110062740 2021-02-12T17:22:37.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f110ffff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f111014e530 0x7f111013f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:37.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f110ffff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f111014e530 0x7f111013f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47730/0 (socket says 172.21.2.102:47730) 2021-02-12T17:22:37.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f110ffff700 1 -- 172.21.2.102:0/424822657 learned_addr learned my addr 172.21.2.102:0/424822657 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:37.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f110effd700 1 --2- 172.21.2.102:0/424822657 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f11100b8d20 0x7f11100ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:37.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f110f7fe700 1 --2- 172.21.2.102:0/424822657 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1110062740 0x7f11100b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:37.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f110ffff700 1 -- 172.21.2.102:0/424822657 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1110062740 msgr2=0x7f11100b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:37.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f110ffff700 1 --2- 172.21.2.102:0/424822657 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1110062740 0x7f11100b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:37.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f110ffff700 1 -- 172.21.2.102:0/424822657 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f11100b8d20 msgr2=0x7f11100ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:37.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f110ffff700 1 --2- 172.21.2.102:0/424822657 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f11100b8d20 0x7f11100ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:37.361 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.358+0000 7f110ffff700 1 -- 172.21.2.102:0/424822657 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111015e120 con 0x7f111014e530 2021-02-12T17:22:37.362 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.359+0000 7f110ffff700 1 --2- 172.21.2.102:0/424822657 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f111014e530 0x7f111013f6a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f110800bae0 tx=0x7f11080091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:37.362 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.359+0000 7f11077fe700 1 -- 172.21.2.102:0/424822657 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110800c740 con 0x7f111014e530 2021-02-12T17:22:37.362 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.359+0000 7f11077fe700 1 -- 172.21.2.102:0/424822657 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110800c8e0 con 0x7f111014e530 2021-02-12T17:22:37.362 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.359+0000 7f1116117700 1 -- 172.21.2.102:0/424822657 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111015e3c0 con 0x7f111014e530 2021-02-12T17:22:37.362 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.359+0000 7f11077fe700 1 -- 172.21.2.102:0/424822657 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110800ca90 con 0x7f111014e530 2021-02-12T17:22:37.362 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.359+0000 7f1116117700 1 -- 172.21.2.102:0/424822657 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11100ae530 con 0x7f111014e530 2021-02-12T17:22:37.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.359+0000 7f1116117700 1 -- 172.21.2.102:0/424822657 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1110045460 con 0x7f111014e530 2021-02-12T17:22:37.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.360+0000 7f11077fe700 1 -- 172.21.2.102:0/424822657 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f110801c070 con 0x7f111014e530 2021-02-12T17:22:37.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.360+0000 7f11077fe700 1 --2- 172.21.2.102:0/424822657 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f10f4059d30 0x7f10f405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:37.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.360+0000 7f11077fe700 1 -- 172.21.2.102:0/424822657 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f1108073510 con 0x7f111014e530 2021-02-12T17:22:37.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.360+0000 7f110f7fe700 1 --2- 172.21.2.102:0/424822657 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f10f4059d30 0x7f10f405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:37.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.360+0000 7f110f7fe700 1 --2- 172.21.2.102:0/424822657 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f10f4059d30 0x7f10f405c1f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f110000c900 tx=0x7f1100008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:37.364 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.363+0000 7f11077fe700 1 -- 172.21.2.102:0/424822657 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f1108046a90 con 0x7f111014e530 2021-02-12T17:22:37.429 INFO:tasks.ceph.mds.a.gibba002.stderr:2021-02-12T17:22:37.428+0000 7f0581c13700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-02-12T17:22:37.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.519+0000 7f1116117700 1 -- 172.21.2.102:0/424822657 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1110063670 con 0x7f111014e530 2021-02-12T17:22:37.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.519+0000 7f11077fe700 1 -- 172.21.2.102:0/424822657 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+3407 (secure 0 0 0) 0x7f110804a0b0 con 0x7f111014e530 2021-02-12T17:22:37.520 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:37.521 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:37.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.521+0000 7f1116117700 1 -- 172.21.2.102:0/424822657 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f10f4059d30 msgr2=0x7f10f405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:37.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.521+0000 7f1116117700 1 --2- 172.21.2.102:0/424822657 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f10f4059d30 0x7f10f405c1f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f110000c900 tx=0x7f1100008040).stop 2021-02-12T17:22:37.521 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.521+0000 7f1116117700 1 -- 172.21.2.102:0/424822657 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f111014e530 msgr2=0x7f111013f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:37.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.521+0000 7f1116117700 1 --2- 172.21.2.102:0/424822657 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f111014e530 0x7f111013f6a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f110800bae0 tx=0x7f11080091a0).stop 2021-02-12T17:22:37.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.521+0000 7f1116117700 1 -- 172.21.2.102:0/424822657 shutdown_connections 2021-02-12T17:22:37.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.521+0000 7f1116117700 1 --2- 172.21.2.102:0/424822657 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f10f4059d30 0x7f10f405c1f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:37.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.521+0000 7f1116117700 1 --2- 172.21.2.102:0/424822657 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f111014e530 0x7f111013f6a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:37.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.521+0000 7f1116117700 1 --2- 172.21.2.102:0/424822657 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1110062740 0x7f11100b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:37.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.521+0000 7f1116117700 1 --2- 172.21.2.102:0/424822657 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f11100b8d20 0x7f11100ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:37.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.521+0000 7f1116117700 1 -- 172.21.2.102:0/424822657 >> 172.21.2.102:0/424822657 conn(0x7f11100bc480 msgr2=0x7f111014cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:37.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.521+0000 7f1116117700 1 -- 172.21.2.102:0/424822657 shutdown_connections 2021-02-12T17:22:37.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:37.521+0000 7f1116117700 1 -- 172.21.2.102:0/424822657 wait complete. 2021-02-12T17:22:37.523 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 49 2021-02-12T17:22:37.531 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2021-02-12T17:22:39.532 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:39.621 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.620+0000 7f63b8ea7700 1 Processor -- start 2021-02-12T17:22:39.621 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.620+0000 7f63b8ea7700 1 -- start start 2021-02-12T17:22:39.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.620+0000 7f63b8ea7700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f63b40b8d20 0x7f63b4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:39.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.620+0000 7f63b8ea7700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f63b4062740 0x7f63b4062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:39.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.620+0000 7f63b8ea7700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b40b7960 con 0x7f63b414e530 2021-02-12T17:22:39.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.620+0000 7f63b8ea7700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b4068d20 con 0x7f63b40b8d20 2021-02-12T17:22:39.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.620+0000 7f63b8ea7700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b40622a0 con 0x7f63b4062740 2021-02-12T17:22:39.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.620+0000 7f63b259c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f63b40b8d20 0x7f63b4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:39.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.621+0000 7f63b259c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f63b40b8d20 0x7f63b4068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47738/0 (socket says 172.21.2.102:47738) 2021-02-12T17:22:39.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.621+0000 7f63b259c700 1 -- 172.21.2.102:0/1959235859 learned_addr learned my addr 172.21.2.102:0/1959235859 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:39.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.621+0000 7f63b2d9d700 1 --2- 172.21.2.102:0/1959235859 >> v2:172.21.2.104:3300/0 conn(0x7f63b4062740 0x7f63b4062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:39.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.621+0000 7f63b259c700 1 -- 172.21.2.102:0/1959235859 >> v2:172.21.2.104:3300/0 conn(0x7f63b4062740 msgr2=0x7f63b4062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:39.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.621+0000 7f63b259c700 1 --2- 172.21.2.102:0/1959235859 >> v2:172.21.2.104:3300/0 conn(0x7f63b4062740 0x7f63b4062bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:39.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.621+0000 7f63b259c700 1 -- 172.21.2.102:0/1959235859 >> v1:172.21.2.104:6789/0 conn(0x7f63b414e530 legacy=0x7f63b40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:39.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.621+0000 7f63b259c700 1 -- 172.21.2.102:0/1959235859 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b414ea10 con 0x7f63b40b8d20 2021-02-12T17:22:39.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.621+0000 7f63b2d9d700 1 --2- 172.21.2.102:0/1959235859 >> v2:172.21.2.104:3300/0 conn(0x7f63b4062740 0x7f63b4062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:22:39.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.621+0000 7f63b259c700 1 --2- 172.21.2.102:0/1959235859 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63b40b8d20 0x7f63b4068830 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f63b4068710 tx=0x7f63a4009290).ready entity=mon.0 client_cookie=8364ac7bff5fa22a server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:39.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.621+0000 7f63b159a700 1 -- 172.21.2.102:0/1959235859 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a400bbf0 con 0x7f63b40b8d20 2021-02-12T17:22:39.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.621+0000 7f63b159a700 1 -- 172.21.2.102:0/1959235859 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a400bd50 con 0x7f63b40b8d20 2021-02-12T17:22:39.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.621+0000 7f63b159a700 1 -- 172.21.2.102:0/1959235859 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4011610 con 0x7f63b40b8d20 2021-02-12T17:22:39.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.622+0000 7f63b8ea7700 1 -- 172.21.2.102:0/1959235859 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63b40b8d20 msgr2=0x7f63b4068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:39.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.622+0000 7f63b8ea7700 1 --2- 172.21.2.102:0/1959235859 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63b40b8d20 0x7f63b4068830 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f63b4068710 tx=0x7f63a4009290).stop 2021-02-12T17:22:39.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.622+0000 7f63b8ea7700 1 -- 172.21.2.102:0/1959235859 shutdown_connections 2021-02-12T17:22:39.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.622+0000 7f63b8ea7700 1 --2- 172.21.2.102:0/1959235859 >> v2:172.21.2.104:3300/0 conn(0x7f63b4062740 0x7f63b4062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:39.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.622+0000 7f63b8ea7700 1 --2- 172.21.2.102:0/1959235859 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63b40b8d20 0x7f63b4068830 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:39.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.622+0000 7f63b8ea7700 1 -- 172.21.2.102:0/1959235859 >> 172.21.2.102:0/1959235859 conn(0x7f63b40bc480 msgr2=0x7f63b40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:39.625 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.622+0000 7f63b8ea7700 1 -- 172.21.2.102:0/1959235859 shutdown_connections 2021-02-12T17:22:39.625 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.622+0000 7f63b8ea7700 1 -- 172.21.2.102:0/1959235859 wait complete. 2021-02-12T17:22:39.627 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.623+0000 7f63b8ea7700 1 Processor -- start 2021-02-12T17:22:39.627 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.623+0000 7f63b8ea7700 1 -- start start 2021-02-12T17:22:39.627 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.623+0000 7f63b8ea7700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f63b4062740 0x7f63b4152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:39.627 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.623+0000 7f63b8ea7700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63b40b8d20 0x7f63b40b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:39.627 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.623+0000 7f63b8ea7700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f63b414e530 0x7f63b40b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:39.627 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.623+0000 7f63b8ea7700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b4160e60 con 0x7f63b40b8d20 2021-02-12T17:22:39.627 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.623+0000 7f63b8ea7700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b4161100 con 0x7f63b414e530 2021-02-12T17:22:39.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.623+0000 7f63b8ea7700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b41613a0 con 0x7f63b4062740 2021-02-12T17:22:39.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.623+0000 7f63b1d9b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63b40b8d20 0x7f63b40b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:39.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.623+0000 7f63b1d9b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63b40b8d20 0x7f63b40b0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47742/0 (socket says 172.21.2.102:47742) 2021-02-12T17:22:39.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.623+0000 7f63b1d9b700 1 -- 172.21.2.102:0/2017999986 learned_addr learned my addr 172.21.2.102:0/2017999986 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:39.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.624+0000 7f63b259c700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f63b4062740 0x7f63b4152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:39.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.624+0000 7f63b2d9d700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f63b414e530 0x7f63b40b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:39.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.624+0000 7f63b1d9b700 1 -- 172.21.2.102:0/2017999986 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f63b4062740 msgr2=0x7f63b4152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:39.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.624+0000 7f63b1d9b700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f63b4062740 0x7f63b4152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:39.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.624+0000 7f63b1d9b700 1 -- 172.21.2.102:0/2017999986 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f63b414e530 msgr2=0x7f63b40b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:39.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.624+0000 7f63b1d9b700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f63b414e530 0x7f63b40b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:39.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.624+0000 7f63b1d9b700 1 -- 172.21.2.102:0/2017999986 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b4161640 con 0x7f63b40b8d20 2021-02-12T17:22:39.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.624+0000 7f63b2d9d700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f63b414e530 0x7f63b40b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:22:39.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.624+0000 7f63b1d9b700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63b40b8d20 0x7f63b40b0fa0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f63ac00c710 tx=0x7f63ac007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:39.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.624+0000 7f63aa7fc700 1 -- 172.21.2.102:0/2017999986 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac007020 con 0x7f63b40b8d20 2021-02-12T17:22:39.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.624+0000 7f63aa7fc700 1 -- 172.21.2.102:0/2017999986 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac007180 con 0x7f63b40b8d20 2021-02-12T17:22:39.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.624+0000 7f63aa7fc700 1 -- 172.21.2.102:0/2017999986 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0064e0 con 0x7f63b40b8d20 2021-02-12T17:22:39.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.624+0000 7f63b8ea7700 1 -- 172.21.2.102:0/2017999986 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b4161ae0 con 0x7f63b40b8d20 2021-02-12T17:22:39.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.624+0000 7f63b8ea7700 1 -- 172.21.2.102:0/2017999986 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b4152fc0 con 0x7f63b40b8d20 2021-02-12T17:22:39.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.625+0000 7f63b8ea7700 1 -- 172.21.2.102:0/2017999986 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b4066d00 con 0x7f63b40b8d20 2021-02-12T17:22:39.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.625+0000 7f63aa7fc700 1 -- 172.21.2.102:0/2017999986 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f63ac010070 con 0x7f63b40b8d20 2021-02-12T17:22:39.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.625+0000 7f63aa7fc700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6398059d80 0x7f639805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:39.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.625+0000 7f63aa7fc700 1 -- 172.21.2.102:0/2017999986 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f63ac073360 con 0x7f63b40b8d20 2021-02-12T17:22:39.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.625+0000 7f63b259c700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6398059d80 0x7f639805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:39.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.626+0000 7f63b259c700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6398059d80 0x7f639805c240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f63b4068710 tx=0x7f63a4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:39.630 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.628+0000 7f63aa7fc700 1 -- 172.21.2.102:0/2017999986 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f63ac046850 con 0x7f63b40b8d20 2021-02-12T17:22:39.792 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.791+0000 7f63b8ea7700 1 -- 172.21.2.102:0/2017999986 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63b41617d0 con 0x7f63b40b8d20 2021-02-12T17:22:39.793 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.792+0000 7f63aa7fc700 1 -- 172.21.2.102:0/2017999986 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+3407 (secure 0 0 0) 0x7f63ac049e70 con 0x7f63b40b8d20 2021-02-12T17:22:39.793 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:39.793 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:39.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.793+0000 7f63b8ea7700 1 -- 172.21.2.102:0/2017999986 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6398059d80 msgr2=0x7f639805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:39.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.793+0000 7f63b8ea7700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6398059d80 0x7f639805c240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f63b4068710 tx=0x7f63a4017000).stop 2021-02-12T17:22:39.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.793+0000 7f63b8ea7700 1 -- 172.21.2.102:0/2017999986 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63b40b8d20 msgr2=0x7f63b40b0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:39.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.793+0000 7f63b8ea7700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63b40b8d20 0x7f63b40b0fa0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f63ac00c710 tx=0x7f63ac007c40).stop 2021-02-12T17:22:39.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.793+0000 7f63b8ea7700 1 -- 172.21.2.102:0/2017999986 shutdown_connections 2021-02-12T17:22:39.794 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.793+0000 7f63b8ea7700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f63b414e530 0x7f63b40b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:39.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.793+0000 7f63b8ea7700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f63b4062740 0x7f63b4152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:39.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.793+0000 7f63b8ea7700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f6398059d80 0x7f639805c240 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:39.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.793+0000 7f63b8ea7700 1 --2- 172.21.2.102:0/2017999986 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f63b40b8d20 0x7f63b40b0fa0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:39.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.793+0000 7f63b8ea7700 1 -- 172.21.2.102:0/2017999986 >> 172.21.2.102:0/2017999986 conn(0x7f63b40bc480 msgr2=0x7f63b414cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:39.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.793+0000 7f63b8ea7700 1 -- 172.21.2.102:0/2017999986 shutdown_connections 2021-02-12T17:22:39.795 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:39.793+0000 7f63b8ea7700 1 -- 172.21.2.102:0/2017999986 wait complete. 2021-02-12T17:22:39.795 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 49 2021-02-12T17:22:39.803 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2021-02-12T17:22:41.168 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:22:41.172 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:22:41.804 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:41.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.890+0000 7f59393c5700 1 Processor -- start 2021-02-12T17:22:41.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.891+0000 7f59393c5700 1 -- start start 2021-02-12T17:22:41.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.891+0000 7f59393c5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f593414e530 0x7f5934068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:41.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.891+0000 7f59393c5700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f5934062740 0x7f5934062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:41.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.891+0000 7f59393c5700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59340b7960 con 0x7f59340b8d20 2021-02-12T17:22:41.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.891+0000 7f59393c5700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5934068d20 con 0x7f5934062740 2021-02-12T17:22:41.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.891+0000 7f59393c5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59340622a0 con 0x7f593414e530 2021-02-12T17:22:41.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.891+0000 7f5932ffd700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f59340b8d20 0x7f59340b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56396/0 (socket says 172.21.2.102:56396) 2021-02-12T17:22:41.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.891+0000 7f5932ffd700 1 -- 172.21.2.102:0/1866275056 learned_addr learned my addr 172.21.2.102:0/1866275056 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:22:41.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.891+0000 7f59337fe700 1 --2- 172.21.2.102:0/1866275056 >> v2:172.21.2.102:3300/0 conn(0x7f5934062740 0x7f5934062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:41.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.891+0000 7f5931ffb700 1 -- 172.21.2.102:0/1866275056 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978946102 0 0) 0x7f59340b7960 con 0x7f59340b8d20 2021-02-12T17:22:41.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f5931ffb700 1 -- 172.21.2.102:0/1866275056 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5914003230 con 0x7f59340b8d20 2021-02-12T17:22:41.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f59337fe700 1 -- 172.21.2.102:0/1866275056 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f593414e530 msgr2=0x7f5934068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:22:41.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f59337fe700 1 --2- 172.21.2.102:0/1866275056 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f593414e530 0x7f5934068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:41.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f59337fe700 1 -- 172.21.2.102:0/1866275056 >> v1:172.21.2.102:6789/0 conn(0x7f59340b8d20 legacy=0x7f59340b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:41.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f59337fe700 1 -- 172.21.2.102:0/1866275056 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593414ea10 con 0x7f5934062740 2021-02-12T17:22:41.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f59337fe700 1 --2- 172.21.2.102:0/1866275056 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5934062740 0x7f5934062bf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f592c009c90 tx=0x7f592c0091d0).ready entity=mon.0 client_cookie=11d1c21f7cf88f89 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:41.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f5931ffb700 1 -- 172.21.2.102:0/1866275056 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c00b9e0 con 0x7f5934062740 2021-02-12T17:22:41.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f5931ffb700 1 -- 172.21.2.102:0/1866275056 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c00bb40 con 0x7f5934062740 2021-02-12T17:22:41.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f5931ffb700 1 -- 172.21.2.102:0/1866275056 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c011400 con 0x7f5934062740 2021-02-12T17:22:41.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f59393c5700 1 -- 172.21.2.102:0/1866275056 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5934062740 msgr2=0x7f5934062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:41.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f59393c5700 1 --2- 172.21.2.102:0/1866275056 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5934062740 0x7f5934062bf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f592c009c90 tx=0x7f592c0091d0).stop 2021-02-12T17:22:41.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f59393c5700 1 -- 172.21.2.102:0/1866275056 shutdown_connections 2021-02-12T17:22:41.894 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f59393c5700 1 --2- 172.21.2.102:0/1866275056 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5934062740 0x7f5934062bf0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:41.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f59393c5700 1 --2- 172.21.2.102:0/1866275056 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f593414e530 0x7f5934068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:41.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f59393c5700 1 -- 172.21.2.102:0/1866275056 >> 172.21.2.102:0/1866275056 conn(0x7f59340bc480 msgr2=0x7f59340b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:41.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f59393c5700 1 -- 172.21.2.102:0/1866275056 shutdown_connections 2021-02-12T17:22:41.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.892+0000 7f59393c5700 1 -- 172.21.2.102:0/1866275056 wait complete. 2021-02-12T17:22:41.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.893+0000 7f59393c5700 1 Processor -- start 2021-02-12T17:22:41.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.893+0000 7f59393c5700 1 -- start start 2021-02-12T17:22:41.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f59393c5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5934062740 0x7f593415dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:41.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f59393c5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59340b8d20 0x7f59340b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:41.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f59393c5700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f593414e530 0x7f59341531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:41.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f59393c5700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593415d3e0 con 0x7f5934062740 2021-02-12T17:22:41.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f59393c5700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59340ad250 con 0x7f593414e530 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f59393c5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59340acfb0 con 0x7f59340b8d20 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f5932ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5934062740 0x7f593415dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f5932ffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5934062740 0x7f593415dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47758/0 (socket says 172.21.2.102:47758) 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f5932ffd700 1 -- 172.21.2.102:0/891118042 learned_addr learned my addr 172.21.2.102:0/891118042 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f5932ffd700 1 -- 172.21.2.102:0/891118042 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59340b8d20 msgr2=0x7f59340b3c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f5932ffd700 1 --2- 172.21.2.102:0/891118042 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59340b8d20 0x7f59340b3c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f5932ffd700 1 -- 172.21.2.102:0/891118042 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f593414e530 msgr2=0x7f59341531b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f5932ffd700 1 --2- 172.21.2.102:0/891118042 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f593414e530 0x7f59341531b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f5932ffd700 1 -- 172.21.2.102:0/891118042 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593415d640 con 0x7f5934062740 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f5932ffd700 1 --2- 172.21.2.102:0/891118042 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5934062740 0x7f593415dd80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f591c00c6d0 tx=0x7f591c007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.894+0000 7f592affd700 1 -- 172.21.2.102:0/891118042 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c007320 con 0x7f5934062740 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.895+0000 7f592affd700 1 -- 172.21.2.102:0/891118042 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c007480 con 0x7f5934062740 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.895+0000 7f59393c5700 1 -- 172.21.2.102:0/891118042 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593415d8e0 con 0x7f5934062740 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.895+0000 7f59393c5700 1 -- 172.21.2.102:0/891118042 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59340b0b10 con 0x7f5934062740 2021-02-12T17:22:41.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.895+0000 7f592affd700 1 -- 172.21.2.102:0/891118042 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c0057f0 con 0x7f5934062740 2021-02-12T17:22:41.898 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.895+0000 7f59393c5700 1 -- 172.21.2.102:0/891118042 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c004f60 con 0x7f5934062740 2021-02-12T17:22:41.898 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.896+0000 7f592affd700 1 -- 172.21.2.102:0/891118042 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f591c010030 con 0x7f5934062740 2021-02-12T17:22:41.898 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.896+0000 7f592affd700 1 --2- 172.21.2.102:0/891118042 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5918059d30 0x7f591805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:41.898 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.896+0000 7f592affd700 1 -- 172.21.2.102:0/891118042 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f591c073d10 con 0x7f5934062740 2021-02-12T17:22:41.898 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.896+0000 7f59327fc700 1 --2- 172.21.2.102:0/891118042 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5918059d30 0x7f591805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:41.899 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.896+0000 7f59327fc700 1 --2- 172.21.2.102:0/891118042 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5918059d30 0x7f591805c1f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f59340b4f10 tx=0x7f5924006880).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:41.899 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:41.899+0000 7f592affd700 1 -- 172.21.2.102:0/891118042 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f591c047180 con 0x7f5934062740 2021-02-12T17:22:42.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:42.056+0000 7f59393c5700 1 -- 172.21.2.102:0/891118042 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f590c005790 con 0x7f5934062740 2021-02-12T17:22:42.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:42.057+0000 7f592affd700 1 -- 172.21.2.102:0/891118042 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+3407 (secure 0 0 0) 0x7f591c04a7a0 con 0x7f5934062740 2021-02-12T17:22:42.058 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:42.058 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:42.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:42.058+0000 7f59393c5700 1 -- 172.21.2.102:0/891118042 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5918059d30 msgr2=0x7f591805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:42.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:42.058+0000 7f59393c5700 1 --2- 172.21.2.102:0/891118042 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5918059d30 0x7f591805c1f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f59340b4f10 tx=0x7f5924006880).stop 2021-02-12T17:22:42.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:42.058+0000 7f59393c5700 1 -- 172.21.2.102:0/891118042 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5934062740 msgr2=0x7f593415dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:42.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:42.058+0000 7f59393c5700 1 --2- 172.21.2.102:0/891118042 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5934062740 0x7f593415dd80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f591c00c6d0 tx=0x7f591c007ac0).stop 2021-02-12T17:22:42.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:42.058+0000 7f59393c5700 1 -- 172.21.2.102:0/891118042 shutdown_connections 2021-02-12T17:22:42.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:42.058+0000 7f59393c5700 1 --2- 172.21.2.102:0/891118042 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f593414e530 0x7f59341531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:42.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:42.058+0000 7f59393c5700 1 --2- 172.21.2.102:0/891118042 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5918059d30 0x7f591805c1f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:42.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:42.058+0000 7f59393c5700 1 --2- 172.21.2.102:0/891118042 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5934062740 0x7f593415dd80 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:42.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:42.058+0000 7f59393c5700 1 --2- 172.21.2.102:0/891118042 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59340b8d20 0x7f59340b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:42.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:42.058+0000 7f59393c5700 1 -- 172.21.2.102:0/891118042 >> 172.21.2.102:0/891118042 conn(0x7f59340bc480 msgr2=0x7f5934152370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:42.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:42.058+0000 7f59393c5700 1 -- 172.21.2.102:0/891118042 shutdown_connections 2021-02-12T17:22:42.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:42.058+0000 7f59393c5700 1 -- 172.21.2.102:0/891118042 wait complete. 2021-02-12T17:22:42.060 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 49 2021-02-12T17:22:42.067 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2021-02-12T17:22:44.069 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:44.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.155+0000 7f96772c2700 1 Processor -- start 2021-02-12T17:22:44.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.155+0000 7f96772c2700 1 -- start start 2021-02-12T17:22:44.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.156+0000 7f96772c2700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f96700b8d20 0x7f9670068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:44.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.156+0000 7f96772c2700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f9670062740 0x7f9670062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:44.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.156+0000 7f96772c2700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96700b7960 con 0x7f967014e530 2021-02-12T17:22:44.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.156+0000 7f96772c2700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9670068d20 con 0x7f9670062740 2021-02-12T17:22:44.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.156+0000 7f96772c2700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96700622a0 con 0x7f96700b8d20 2021-02-12T17:22:44.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.156+0000 7f967585f700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f9670062740 0x7f9670062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:44.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.156+0000 7f967585f700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f9670062740 0x7f9670062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47768/0 (socket says 172.21.2.102:47768) 2021-02-12T17:22:44.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.156+0000 7f967585f700 1 -- 172.21.2.102:0/59461867 learned_addr learned my addr 172.21.2.102:0/59461867 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:44.158 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.157+0000 7f967585f700 1 -- 172.21.2.102:0/59461867 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f96700b8d20 msgr2=0x7f9670068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:44.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.157+0000 7f967585f700 1 --2- 172.21.2.102:0/59461867 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f96700b8d20 0x7f9670068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:44.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.157+0000 7f967585f700 1 -- 172.21.2.102:0/59461867 >> v1:172.21.2.104:6789/0 conn(0x7f967014e530 legacy=0x7f96700b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:44.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.157+0000 7f967585f700 1 -- 172.21.2.102:0/59461867 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967014ea10 con 0x7f9670062740 2021-02-12T17:22:44.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.157+0000 7f967585f700 1 --2- 172.21.2.102:0/59461867 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9670062740 0x7f9670062bf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f9668009d50 tx=0x7f9668009290).ready entity=mon.0 client_cookie=b4c38d25d1c40598 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:44.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.157+0000 7f965ffff700 1 -- 172.21.2.102:0/59461867 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800bbb0 con 0x7f9670062740 2021-02-12T17:22:44.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.157+0000 7f965ffff700 1 -- 172.21.2.102:0/59461867 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966800bd10 con 0x7f9670062740 2021-02-12T17:22:44.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.157+0000 7f965ffff700 1 -- 172.21.2.102:0/59461867 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668011610 con 0x7f9670062740 2021-02-12T17:22:44.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.157+0000 7f96772c2700 1 -- 172.21.2.102:0/59461867 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9670062740 msgr2=0x7f9670062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:44.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.157+0000 7f96772c2700 1 --2- 172.21.2.102:0/59461867 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9670062740 0x7f9670062bf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f9668009d50 tx=0x7f9668009290).stop 2021-02-12T17:22:44.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.157+0000 7f96772c2700 1 -- 172.21.2.102:0/59461867 shutdown_connections 2021-02-12T17:22:44.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.157+0000 7f96772c2700 1 --2- 172.21.2.102:0/59461867 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9670062740 0x7f9670062bf0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:44.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.157+0000 7f96772c2700 1 --2- 172.21.2.102:0/59461867 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f96700b8d20 0x7f9670068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:44.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.157+0000 7f96772c2700 1 -- 172.21.2.102:0/59461867 >> 172.21.2.102:0/59461867 conn(0x7f96700bc480 msgr2=0x7f96700b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:44.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.158+0000 7f96772c2700 1 -- 172.21.2.102:0/59461867 shutdown_connections 2021-02-12T17:22:44.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.158+0000 7f96772c2700 1 -- 172.21.2.102:0/59461867 wait complete. 2021-02-12T17:22:44.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.159+0000 7f96772c2700 1 Processor -- start 2021-02-12T17:22:44.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.159+0000 7f96772c2700 1 -- start start 2021-02-12T17:22:44.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.159+0000 7f96772c2700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9670062740 0x7f96700b9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:44.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.159+0000 7f96772c2700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f96700b8d20 0x7f967015dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:44.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.159+0000 7f96772c2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f967014e530 0x7f967015e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:44.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.159+0000 7f96772c2700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967015e6b0 con 0x7f967014e530 2021-02-12T17:22:44.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.159+0000 7f96772c2700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96700b0430 con 0x7f96700b8d20 2021-02-12T17:22:44.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.159+0000 7f96772c2700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96700b06d0 con 0x7f9670062740 2021-02-12T17:22:44.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.159+0000 7f967585f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f967014e530 0x7f967015e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:44.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.159+0000 7f967585f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f967014e530 0x7f967015e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47774/0 (socket says 172.21.2.102:47774) 2021-02-12T17:22:44.163 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.159+0000 7f967585f700 1 -- 172.21.2.102:0/1276418558 learned_addr learned my addr 172.21.2.102:0/1276418558 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:44.163 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f967585f700 1 -- 172.21.2.102:0/1276418558 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9670062740 msgr2=0x7f96700b9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:44.163 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f967505e700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9670062740 0x7f96700b9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:44.163 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f967585f700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9670062740 0x7f96700b9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:44.163 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f967485d700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f96700b8d20 0x7f967015dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:44.163 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f967585f700 1 -- 172.21.2.102:0/1276418558 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f96700b8d20 msgr2=0x7f967015dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:44.163 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f967585f700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f96700b8d20 0x7f967015dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:44.163 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f967585f700 1 -- 172.21.2.102:0/1276418558 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96700b0970 con 0x7f967014e530 2021-02-12T17:22:44.163 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f967505e700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9670062740 0x7f96700b9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:22:44.163 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f967485d700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f96700b8d20 0x7f967015dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:22:44.163 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f967585f700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f967014e530 0x7f967015e1c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f96700653c0 tx=0x7f9668017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:44.164 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f965d7fa700 1 -- 172.21.2.102:0/1276418558 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800be80 con 0x7f967014e530 2021-02-12T17:22:44.164 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f965d7fa700 1 -- 172.21.2.102:0/1276418558 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9668011e20 con 0x7f967014e530 2021-02-12T17:22:44.164 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f96772c2700 1 -- 172.21.2.102:0/1276418558 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96700b0c10 con 0x7f967014e530 2021-02-12T17:22:44.164 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f965d7fa700 1 -- 172.21.2.102:0/1276418558 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668010e10 con 0x7f967014e530 2021-02-12T17:22:44.164 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.160+0000 7f96772c2700 1 -- 172.21.2.102:0/1276418558 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96700ba470 con 0x7f967014e530 2021-02-12T17:22:44.164 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.161+0000 7f96772c2700 1 -- 172.21.2.102:0/1276418558 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9670045460 con 0x7f967014e530 2021-02-12T17:22:44.165 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.161+0000 7f965d7fa700 1 -- 172.21.2.102:0/1276418558 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f966802a070 con 0x7f967014e530 2021-02-12T17:22:44.165 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.162+0000 7f965d7fa700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9650059d80 0x7f965005c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:44.165 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.162+0000 7f965d7fa700 1 -- 172.21.2.102:0/1276418558 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f96680761b0 con 0x7f967014e530 2021-02-12T17:22:44.165 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.162+0000 7f967505e700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9650059d80 0x7f965005c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:44.165 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.162+0000 7f967505e700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9650059d80 0x7f965005c240 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f96700ba750 tx=0x7f966c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:44.165 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.165+0000 7f965d7fa700 1 -- 172.21.2.102:0/1276418558 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f96680496a0 con 0x7f967014e530 2021-02-12T17:22:44.328 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.327+0000 7f96772c2700 1 -- 172.21.2.102:0/1276418558 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96700b2650 con 0x7f967014e530 2021-02-12T17:22:44.329 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.328+0000 7f965d7fa700 1 -- 172.21.2.102:0/1276418558 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3758 (secure 0 0 0) 0x7f966804ccc0 con 0x7f967014e530 2021-02-12T17:22:44.329 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:44.329 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:44.330 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.329+0000 7f96772c2700 1 -- 172.21.2.102:0/1276418558 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9650059d80 msgr2=0x7f965005c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:44.330 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.329+0000 7f96772c2700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9650059d80 0x7f965005c240 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f96700ba750 tx=0x7f966c008040).stop 2021-02-12T17:22:44.330 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.329+0000 7f96772c2700 1 -- 172.21.2.102:0/1276418558 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f967014e530 msgr2=0x7f967015e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:44.330 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.329+0000 7f96772c2700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f967014e530 0x7f967015e1c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f96700653c0 tx=0x7f9668017000).stop 2021-02-12T17:22:44.331 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.329+0000 7f96772c2700 1 -- 172.21.2.102:0/1276418558 shutdown_connections 2021-02-12T17:22:44.331 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.329+0000 7f96772c2700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9650059d80 0x7f965005c240 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:44.331 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.329+0000 7f96772c2700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f967014e530 0x7f967015e1c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:44.331 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.329+0000 7f96772c2700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9670062740 0x7f96700b9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:44.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.329+0000 7f96772c2700 1 --2- 172.21.2.102:0/1276418558 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f96700b8d20 0x7f967015dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:44.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.329+0000 7f96772c2700 1 -- 172.21.2.102:0/1276418558 >> 172.21.2.102:0/1276418558 conn(0x7f96700bc480 msgr2=0x7f9670151850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:44.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.329+0000 7f96772c2700 1 -- 172.21.2.102:0/1276418558 shutdown_connections 2021-02-12T17:22:44.332 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:44.329+0000 7f96772c2700 1 -- 172.21.2.102:0/1276418558 wait complete. 2021-02-12T17:22:44.332 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 50 2021-02-12T17:22:44.339 INFO:tasks.mds_thrash.fs.[b]:mds.d reported in up:standby state 2021-02-12T17:22:44.339 INFO:tasks.mds_thrash.fs.[b]:waiting for 115 secs before thrashing 2021-02-12T17:22:56.187 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:56.277 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.276+0000 7fcd8bdd5700 1 Processor -- start 2021-02-12T17:22:56.277 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.276+0000 7fcd8bdd5700 1 -- start start 2021-02-12T17:22:56.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.277+0000 7fcd8bdd5700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fcd840b8d20 0x7fcd84068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:56.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.277+0000 7fcd8bdd5700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd840b7960 con 0x7fcd84062740 2021-02-12T17:22:56.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.277+0000 7fcd8bdd5700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd840622a0 con 0x7fcd8414e530 2021-02-12T17:22:56.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.277+0000 7fcd8bdd5700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd84068d20 con 0x7fcd840b8d20 2021-02-12T17:22:56.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.277+0000 7fcd8a372700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fcd84062740 0x7fcd84062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56438/0 (socket says 172.21.2.102:56438) 2021-02-12T17:22:56.278 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.277+0000 7fcd8a372700 1 -- 172.21.2.102:0/838636427 learned_addr learned my addr 172.21.2.102:0/838636427 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:22:56.280 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.277+0000 7fcd88b6f700 1 -- 172.21.2.102:0/838636427 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62595438 0 0) 0x7fcd840b7960 con 0x7fcd84062740 2021-02-12T17:22:56.280 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.277+0000 7fcd88b6f700 1 -- 172.21.2.102:0/838636427 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd6c003230 con 0x7fcd84062740 2021-02-12T17:22:56.280 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd89b71700 1 --2- 172.21.2.102:0/838636427 >> v2:172.21.2.104:3300/0 conn(0x7fcd840b8d20 0x7fcd84068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:56.281 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd88b6f700 1 -- 172.21.2.102:0/838636427 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1704646062 0 0) 0x7fcd6c003230 con 0x7fcd84062740 2021-02-12T17:22:56.281 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd88b6f700 1 -- 172.21.2.102:0/838636427 >> v2:172.21.2.104:3300/0 conn(0x7fcd840b8d20 msgr2=0x7fcd84068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:56.281 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd88b6f700 1 --2- 172.21.2.102:0/838636427 >> v2:172.21.2.104:3300/0 conn(0x7fcd840b8d20 0x7fcd84068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:56.281 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd88b6f700 1 -- 172.21.2.102:0/838636427 >> v1:172.21.2.104:6789/0 conn(0x7fcd8414e530 legacy=0x7fcd840b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:56.281 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd88b6f700 1 -- 172.21.2.102:0/838636427 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8414ea10 con 0x7fcd84062740 2021-02-12T17:22:56.281 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd88b6f700 1 -- 172.21.2.102:0/838636427 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fcd7c001860 con 0x7fcd84062740 2021-02-12T17:22:56.281 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd88b6f700 1 -- 172.21.2.102:0/838636427 >> v1:172.21.2.102:6789/0 conn(0x7fcd84062740 legacy=0x7fcd84062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:56.281 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd88b6f700 1 --2- 172.21.2.102:0/838636427 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcd6c0037f0 0x7fcd6c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:56.281 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd88b6f700 1 --2- 172.21.2.102:0/838636427 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcd6c0044d0 0x7fcd6c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:56.281 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd88b6f700 1 --2- 172.21.2.102:0/838636427 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcd6c004e40 0x7fcd6c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:56.281 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd88b6f700 1 -- 172.21.2.102:0/838636427 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd84068d20 con 0x7fcd6c004e40 2021-02-12T17:22:56.281 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd88b6f700 1 -- 172.21.2.102:0/838636427 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c0053a0 con 0x7fcd6c0037f0 2021-02-12T17:22:56.281 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd88b6f700 1 -- 172.21.2.102:0/838636427 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c00bc60 con 0x7fcd6c0044d0 2021-02-12T17:22:56.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd8a372700 1 --2- 172.21.2.102:0/838636427 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcd6c004e40 0x7fcd6c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:56.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd89b71700 1 --2- 172.21.2.102:0/838636427 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcd6c0037f0 0x7fcd6c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:56.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd89370700 1 --2- 172.21.2.102:0/838636427 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcd6c0044d0 0x7fcd6c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:56.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd8a372700 1 -- 172.21.2.102:0/838636427 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcd6c0044d0 msgr2=0x7fcd6c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:56.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd8a372700 1 --2- 172.21.2.102:0/838636427 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcd6c0044d0 0x7fcd6c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:56.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd8a372700 1 -- 172.21.2.102:0/838636427 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcd6c0037f0 msgr2=0x7fcd6c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:56.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd8a372700 1 --2- 172.21.2.102:0/838636427 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcd6c0037f0 0x7fcd6c003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:56.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd8a372700 1 -- 172.21.2.102:0/838636427 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c003230 con 0x7fcd6c004e40 2021-02-12T17:22:56.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd8a372700 1 -- 172.21.2.102:0/838636427 reap_dead start 2021-02-12T17:22:56.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.278+0000 7fcd8a372700 1 --2- 172.21.2.102:0/838636427 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcd6c004e40 0x7fcd6c00b720 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fcd7c00c630 tx=0x7fcd8414eba0).ready entity=mon.0 client_cookie=9fb80c0c5960507d server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:56.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.279+0000 7fcd88b6f700 1 -- 172.21.2.102:0/838636427 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c005b70 con 0x7fcd6c004e40 2021-02-12T17:22:56.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.279+0000 7fcd88b6f700 1 -- 172.21.2.102:0/838636427 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c005cd0 con 0x7fcd6c004e40 2021-02-12T17:22:56.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.279+0000 7fcd88b6f700 1 -- 172.21.2.102:0/838636427 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c007320 con 0x7fcd6c004e40 2021-02-12T17:22:56.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.279+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/838636427 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcd6c004e40 msgr2=0x7fcd6c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:56.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.279+0000 7fcd8bdd5700 1 --2- 172.21.2.102:0/838636427 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcd6c004e40 0x7fcd6c00b720 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fcd7c00c630 tx=0x7fcd8414eba0).stop 2021-02-12T17:22:56.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.279+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/838636427 shutdown_connections 2021-02-12T17:22:56.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.279+0000 7fcd8bdd5700 1 --2- 172.21.2.102:0/838636427 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcd6c004e40 0x7fcd6c00b720 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:56.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.279+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/838636427 >> 172.21.2.102:0/838636427 conn(0x7fcd840bc480 msgr2=0x7fcd840b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:56.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.279+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/838636427 shutdown_connections 2021-02-12T17:22:56.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.279+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/838636427 wait complete. 2021-02-12T17:22:56.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.280+0000 7fcd8bdd5700 1 Processor -- start 2021-02-12T17:22:56.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.280+0000 7fcd8bdd5700 1 -- start start 2021-02-12T17:22:56.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd8bdd5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcd6c004e40 0x7fcd840b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:56.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd8bdd5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcd84151880 0x7fcd840bab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:56.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd8bdd5700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcd840bb040 0x7fcd8415d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:56.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd8bdd5700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840b2000 con 0x7fcd6c004e40 2021-02-12T17:22:56.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd8bdd5700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840b01a0 con 0x7fcd840bb040 2021-02-12T17:22:56.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd8bdd5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd841605a0 con 0x7fcd84151880 2021-02-12T17:22:56.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd89b71700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcd6c004e40 0x7fcd840b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:56.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd89b71700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcd6c004e40 0x7fcd840b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47804/0 (socket says 172.21.2.102:47804) 2021-02-12T17:22:56.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd89b71700 1 -- 172.21.2.102:0/1873080647 learned_addr learned my addr 172.21.2.102:0/1873080647 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:56.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd8a372700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcd840bb040 0x7fcd8415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:56.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd89370700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcd84151880 0x7fcd840bab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:56.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd89b71700 1 -- 172.21.2.102:0/1873080647 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcd84151880 msgr2=0x7fcd840bab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:56.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd89b71700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcd84151880 0x7fcd840bab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:56.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd89b71700 1 -- 172.21.2.102:0/1873080647 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcd840bb040 msgr2=0x7fcd8415d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:56.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd89b71700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcd840bb040 0x7fcd8415d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:56.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd89b71700 1 -- 172.21.2.102:0/1873080647 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd841607d0 con 0x7fcd6c004e40 2021-02-12T17:22:56.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd8a372700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcd840bb040 0x7fcd8415d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:22:56.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd89370700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcd84151880 0x7fcd840bab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:22:56.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd89b71700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcd6c004e40 0x7fcd840b1b10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fcd8000f890 tx=0x7fcd80008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:56.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd71ffb700 1 -- 172.21.2.102:0/1873080647 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd800115a0 con 0x7fcd6c004e40 2021-02-12T17:22:56.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.281+0000 7fcd71ffb700 1 -- 172.21.2.102:0/1873080647 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd80011700 con 0x7fcd6c004e40 2021-02-12T17:22:56.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.282+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/1873080647 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd84160a70 con 0x7fcd6c004e40 2021-02-12T17:22:56.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.282+0000 7fcd71ffb700 1 -- 172.21.2.102:0/1873080647 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd80011a80 con 0x7fcd6c004e40 2021-02-12T17:22:56.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.282+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/1873080647 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd84160fb0 con 0x7fcd6c004e40 2021-02-12T17:22:56.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.282+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/1873080647 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd84045460 con 0x7fcd6c004e40 2021-02-12T17:22:56.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.283+0000 7fcd71ffb700 1 -- 172.21.2.102:0/1873080647 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fcd8001d460 con 0x7fcd6c004e40 2021-02-12T17:22:56.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.283+0000 7fcd71ffb700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcd64059d60 0x7fcd6405c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:56.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.283+0000 7fcd71ffb700 1 -- 172.21.2.102:0/1873080647 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7fcd80073fe0 con 0x7fcd6c004e40 2021-02-12T17:22:56.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.283+0000 7fcd89370700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcd64059d60 0x7fcd6405c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:56.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.283+0000 7fcd89370700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcd64059d60 0x7fcd6405c220 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fcd840b8190 tx=0x7fcd74009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:56.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.286+0000 7fcd71ffb700 1 -- 172.21.2.102:0/1873080647 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fcd800473f0 con 0x7fcd6c004e40 2021-02-12T17:22:56.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.448+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/1873080647 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd84151660 con 0x7fcd6c004e40 2021-02-12T17:22:56.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.448+0000 7fcd71ffb700 1 -- 172.21.2.102:0/1873080647 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3758 (secure 0 0 0) 0x7fcd8004aa10 con 0x7fcd6c004e40 2021-02-12T17:22:56.449 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:56.449 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:56.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.449+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/1873080647 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcd64059d60 msgr2=0x7fcd6405c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:56.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.449+0000 7fcd8bdd5700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcd64059d60 0x7fcd6405c220 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fcd840b8190 tx=0x7fcd74009040).stop 2021-02-12T17:22:56.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.449+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/1873080647 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcd6c004e40 msgr2=0x7fcd840b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:56.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.449+0000 7fcd8bdd5700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcd6c004e40 0x7fcd840b1b10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fcd8000f890 tx=0x7fcd80008040).stop 2021-02-12T17:22:56.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.449+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/1873080647 shutdown_connections 2021-02-12T17:22:56.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.449+0000 7fcd8bdd5700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fcd840bb040 0x7fcd8415d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:56.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.449+0000 7fcd8bdd5700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fcd64059d60 0x7fcd6405c220 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:56.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.450+0000 7fcd8bdd5700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fcd6c004e40 0x7fcd840b1b10 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:56.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.450+0000 7fcd8bdd5700 1 --2- 172.21.2.102:0/1873080647 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fcd84151880 0x7fcd840bab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:56.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.450+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/1873080647 >> 172.21.2.102:0/1873080647 conn(0x7fcd840bc480 msgr2=0x7fcd840b9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:56.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.450+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/1873080647 shutdown_connections 2021-02-12T17:22:56.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.450+0000 7fcd8bdd5700 1 -- 172.21.2.102:0/1873080647 wait complete. 2021-02-12T17:22:56.451 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 50 2021-02-12T17:22:56.459 INFO:tasks.mds_thrash.fs.[a]:kill mds.c (rank=0) 2021-02-12T17:22:56.459 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-02-12T17:22:56.459 INFO:teuthology.orchestra.run:waiting for 300 2021-02-12T17:22:56.465 INFO:tasks.ceph.mds.c:Stopped 2021-02-12T17:22:56.466 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:56.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.593+0000 7fe8b482e700 1 Processor -- start 2021-02-12T17:22:56.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.593+0000 7fe8b482e700 1 -- start start 2021-02-12T17:22:56.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.593+0000 7fe8b482e700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fe8b0150b40 0x7fe8b00b7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:56.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.593+0000 7fe8b482e700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b009c410 con 0x7fe8b00b12b0 2021-02-12T17:22:56.594 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.593+0000 7fe8b482e700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b00b22a0 con 0x7fe8b00b71a0 2021-02-12T17:22:56.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.593+0000 7fe8b482e700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b00b2540 con 0x7fe8b0150b40 2021-02-12T17:22:56.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.594+0000 7fe8affff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fe8b00b12b0 0x7fe8b009cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56458/0 (socket says 172.21.2.102:56458) 2021-02-12T17:22:56.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.594+0000 7fe8affff700 1 -- 172.21.2.102:0/3861177110 learned_addr learned my addr 172.21.2.102:0/3861177110 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:22:56.595 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.594+0000 7fe8aeffd700 1 --2- 172.21.2.102:0/3861177110 >> v2:172.21.2.102:3300/0 conn(0x7fe8b0150b40 0x7fe8b00b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:56.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.594+0000 7fe8ae7fc700 1 -- 172.21.2.102:0/3861177110 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174757476 0 0) 0x7fe8b009c410 con 0x7fe8b00b12b0 2021-02-12T17:22:56.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.594+0000 7fe8aeffd700 1 -- 172.21.2.102:0/3861177110 >> v1:172.21.2.104:6789/0 conn(0x7fe8b00b71a0 legacy=0x7fe8b0150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:56.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.594+0000 7fe8aeffd700 1 -- 172.21.2.102:0/3861177110 >> v1:172.21.2.102:6789/0 conn(0x7fe8b00b12b0 legacy=0x7fe8b009cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:56.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.594+0000 7fe8aeffd700 1 -- 172.21.2.102:0/3861177110 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b009c640 con 0x7fe8b0150b40 2021-02-12T17:22:56.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.594+0000 7fe8aeffd700 1 --2- 172.21.2.102:0/3861177110 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b0150b40 0x7fe8b00b7580 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fe8a000b980 tx=0x7fe8a0006de0).ready entity=mon.0 client_cookie=aa11b5b3b91c1c06 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:56.596 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.594+0000 7fe8ae7fc700 1 -- 172.21.2.102:0/3861177110 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0009870 con 0x7fe8b0150b40 2021-02-12T17:22:56.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.594+0000 7fe8ae7fc700 1 -- 172.21.2.102:0/3861177110 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a00099d0 con 0x7fe8b0150b40 2021-02-12T17:22:56.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.594+0000 7fe8ae7fc700 1 -- 172.21.2.102:0/3861177110 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0009d50 con 0x7fe8b0150b40 2021-02-12T17:22:56.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.595+0000 7fe8b482e700 1 -- 172.21.2.102:0/3861177110 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b0150b40 msgr2=0x7fe8b00b7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:56.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.595+0000 7fe8b482e700 1 --2- 172.21.2.102:0/3861177110 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b0150b40 0x7fe8b00b7580 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fe8a000b980 tx=0x7fe8a0006de0).stop 2021-02-12T17:22:56.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.595+0000 7fe8b482e700 1 -- 172.21.2.102:0/3861177110 shutdown_connections 2021-02-12T17:22:56.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.595+0000 7fe8b482e700 1 --2- 172.21.2.102:0/3861177110 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b0150b40 0x7fe8b00b7580 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:56.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.595+0000 7fe8b482e700 1 -- 172.21.2.102:0/3861177110 >> 172.21.2.102:0/3861177110 conn(0x7fe8b00b8290 msgr2=0x7fe8b00b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:56.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.595+0000 7fe8b482e700 1 -- 172.21.2.102:0/3861177110 shutdown_connections 2021-02-12T17:22:56.597 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.595+0000 7fe8b482e700 1 -- 172.21.2.102:0/3861177110 wait complete. 2021-02-12T17:22:56.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.596+0000 7fe8b482e700 1 Processor -- start 2021-02-12T17:22:56.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.596+0000 7fe8b482e700 1 -- start start 2021-02-12T17:22:56.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.596+0000 7fe8b482e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b00b12b0 0x7fe8b014c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:56.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.596+0000 7fe8b482e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b00b71a0 0x7fe8b00b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:56.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.596+0000 7fe8b482e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b0150b40 0x7fe8b00b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:56.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.596+0000 7fe8b482e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b015d550 con 0x7fe8b00b12b0 2021-02-12T17:22:56.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.596+0000 7fe8b482e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b015d780 con 0x7fe8b0150b40 2021-02-12T17:22:56.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.596+0000 7fe8b482e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b015da20 con 0x7fe8b00b71a0 2021-02-12T17:22:56.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.596+0000 7fe8af7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b00b12b0 0x7fe8b014c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:56.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.597+0000 7fe8af7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b00b12b0 0x7fe8b014c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47820/0 (socket says 172.21.2.102:47820) 2021-02-12T17:22:56.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.597+0000 7fe8af7fe700 1 -- 172.21.2.102:0/1225009376 learned_addr learned my addr 172.21.2.102:0/1225009376 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:56.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.597+0000 7fe8af7fe700 1 -- 172.21.2.102:0/1225009376 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b00b71a0 msgr2=0x7fe8b00b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:56.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.597+0000 7fe8af7fe700 1 --2- 172.21.2.102:0/1225009376 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b00b71a0 0x7fe8b00b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:56.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.597+0000 7fe8af7fe700 1 -- 172.21.2.102:0/1225009376 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b0150b40 msgr2=0x7fe8b00b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:56.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.597+0000 7fe8af7fe700 1 --2- 172.21.2.102:0/1225009376 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b0150b40 0x7fe8b00b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:56.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.597+0000 7fe8af7fe700 1 -- 172.21.2.102:0/1225009376 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b015dcc0 con 0x7fe8b00b12b0 2021-02-12T17:22:56.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.597+0000 7fe8af7fe700 1 --2- 172.21.2.102:0/1225009376 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b00b12b0 0x7fe8b014c6f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fe89800c710 tx=0x7fe898007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:56.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.597+0000 7fe8a77fe700 1 -- 172.21.2.102:0/1225009376 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe898007020 con 0x7fe8b00b12b0 2021-02-12T17:22:56.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.597+0000 7fe8a77fe700 1 -- 172.21.2.102:0/1225009376 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe898007180 con 0x7fe8b00b12b0 2021-02-12T17:22:56.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.597+0000 7fe8b482e700 1 -- 172.21.2.102:0/1225009376 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b0065d90 con 0x7fe8b00b12b0 2021-02-12T17:22:56.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.597+0000 7fe8a77fe700 1 -- 172.21.2.102:0/1225009376 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe898010510 con 0x7fe8b00b12b0 2021-02-12T17:22:56.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.597+0000 7fe8b482e700 1 -- 172.21.2.102:0/1225009376 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b015e160 con 0x7fe8b00b12b0 2021-02-12T17:22:56.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.598+0000 7fe8b482e700 1 -- 172.21.2.102:0/1225009376 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b005c080 con 0x7fe8b00b12b0 2021-02-12T17:22:56.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.598+0000 7fe8a77fe700 1 -- 172.21.2.102:0/1225009376 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fe898018020 con 0x7fe8b00b12b0 2021-02-12T17:22:56.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.598+0000 7fe8a77fe700 1 --2- 172.21.2.102:0/1225009376 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe894059d80 0x7fe89405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:56.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.598+0000 7fe8a77fe700 1 -- 172.21.2.102:0/1225009376 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7fe8980738b0 con 0x7fe8b00b12b0 2021-02-12T17:22:56.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.599+0000 7fe8aeffd700 1 --2- 172.21.2.102:0/1225009376 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe894059d80 0x7fe89405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:56.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.599+0000 7fe8aeffd700 1 --2- 172.21.2.102:0/1225009376 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe894059d80 0x7fe89405c240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fe8b00b5960 tx=0x7fe8a0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:56.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.601+0000 7fe8a77fe700 1 -- 172.21.2.102:0/1225009376 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fe898046da0 con 0x7fe8b00b12b0 2021-02-12T17:22:56.762 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.760+0000 7fe8b482e700 1 -- 172.21.2.102:0/1225009376 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8b00b78f0 con 0x7fe8b00b12b0 2021-02-12T17:22:56.762 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.761+0000 7fe8a77fe700 1 -- 172.21.2.102:0/1225009376 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3758 (secure 0 0 0) 0x7fe89804a3c0 con 0x7fe8b00b12b0 2021-02-12T17:22:56.762 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:56.762 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:56.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.762+0000 7fe8b482e700 1 -- 172.21.2.102:0/1225009376 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe894059d80 msgr2=0x7fe89405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:56.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.762+0000 7fe8b482e700 1 --2- 172.21.2.102:0/1225009376 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe894059d80 0x7fe89405c240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fe8b00b5960 tx=0x7fe8a0016000).stop 2021-02-12T17:22:56.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.762+0000 7fe8b482e700 1 -- 172.21.2.102:0/1225009376 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b00b12b0 msgr2=0x7fe8b014c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:56.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.762+0000 7fe8b482e700 1 --2- 172.21.2.102:0/1225009376 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b00b12b0 0x7fe8b014c6f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fe89800c710 tx=0x7fe898007c40).stop 2021-02-12T17:22:56.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.762+0000 7fe8b482e700 1 -- 172.21.2.102:0/1225009376 shutdown_connections 2021-02-12T17:22:56.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.762+0000 7fe8b482e700 1 --2- 172.21.2.102:0/1225009376 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b0150b40 0x7fe8b00b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:56.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.762+0000 7fe8b482e700 1 --2- 172.21.2.102:0/1225009376 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe894059d80 0x7fe89405c240 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:56.763 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.762+0000 7fe8b482e700 1 --2- 172.21.2.102:0/1225009376 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b00b12b0 0x7fe8b014c6f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:56.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.762+0000 7fe8b482e700 1 --2- 172.21.2.102:0/1225009376 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b00b71a0 0x7fe8b00b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:56.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.762+0000 7fe8b482e700 1 -- 172.21.2.102:0/1225009376 >> 172.21.2.102:0/1225009376 conn(0x7fe8b00b8290 msgr2=0x7fe8b009cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:56.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.762+0000 7fe8b482e700 1 -- 172.21.2.102:0/1225009376 shutdown_connections 2021-02-12T17:22:56.764 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:56.762+0000 7fe8b482e700 1 -- 172.21.2.102:0/1225009376 wait complete. 2021-02-12T17:22:56.764 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 50 2021-02-12T17:22:56.771 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:22:58.772 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:22:58.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.860+0000 7fd5703f2700 1 Processor -- start 2021-02-12T17:22:58.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.860+0000 7fd5703f2700 1 -- start start 2021-02-12T17:22:58.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.861+0000 7fd5703f2700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd5680b8d20 0x7fd568068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:58.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.861+0000 7fd5703f2700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fd56814e530 0x7fd5680b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:58.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.861+0000 7fd5703f2700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5680622a0 con 0x7fd568062740 2021-02-12T17:22:58.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.861+0000 7fd5703f2700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd568068d20 con 0x7fd56814e530 2021-02-12T17:22:58.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.861+0000 7fd5703f2700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56814ea10 con 0x7fd5680b8d20 2021-02-12T17:22:58.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.861+0000 7fd56e98f700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fd568062740 0x7fd568062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56480/0 (socket says 172.21.2.102:56480) 2021-02-12T17:22:58.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.861+0000 7fd56e98f700 1 -- 172.21.2.102:0/1470592896 learned_addr learned my addr 172.21.2.102:0/1470592896 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:22:58.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.861+0000 7fd56d18c700 1 -- 172.21.2.102:0/1470592896 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001296830 0 0) 0x7fd5680622a0 con 0x7fd568062740 2021-02-12T17:22:58.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 -- 172.21.2.102:0/1470592896 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd550003230 con 0x7fd568062740 2021-02-12T17:22:58.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d98d700 1 --2- 172.21.2.102:0/1470592896 >> v2:172.21.2.104:3300/0 conn(0x7fd56814e530 0x7fd5680b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:58.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 -- 172.21.2.102:0/1470592896 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 52305296 0 0) 0x7fd550003230 con 0x7fd568062740 2021-02-12T17:22:58.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56e18e700 1 --2- 172.21.2.102:0/1470592896 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd5680b8d20 0x7fd568068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:58.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 -- 172.21.2.102:0/1470592896 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd5680b8d20 msgr2=0x7fd568068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:58.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 --2- 172.21.2.102:0/1470592896 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd5680b8d20 0x7fd568068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:58.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 -- 172.21.2.102:0/1470592896 >> v2:172.21.2.104:3300/0 conn(0x7fd56814e530 msgr2=0x7fd5680b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:58.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 --2- 172.21.2.102:0/1470592896 >> v2:172.21.2.104:3300/0 conn(0x7fd56814e530 0x7fd5680b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:58.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 -- 172.21.2.102:0/1470592896 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680b63f0 con 0x7fd568062740 2021-02-12T17:22:58.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 -- 172.21.2.102:0/1470592896 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fd560001860 con 0x7fd568062740 2021-02-12T17:22:58.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 -- 172.21.2.102:0/1470592896 >> v1:172.21.2.102:6789/0 conn(0x7fd568062740 legacy=0x7fd568062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:58.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 --2- 172.21.2.102:0/1470592896 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd5500037a0 0x7fd550003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:58.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 --2- 172.21.2.102:0/1470592896 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd5500044d0 0x7fd550004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:58.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 --2- 172.21.2.102:0/1470592896 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd550004e40 0x7fd55000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:58.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 -- 172.21.2.102:0/1470592896 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd568068d20 con 0x7fd550004e40 2021-02-12T17:22:58.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 -- 172.21.2.102:0/1470592896 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56814ea10 con 0x7fd5500037a0 2021-02-12T17:22:58.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56d18c700 1 -- 172.21.2.102:0/1470592896 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd550005340 con 0x7fd5500044d0 2021-02-12T17:22:58.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56e18e700 1 --2- 172.21.2.102:0/1470592896 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd5680b8d20 0x7fd568068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:22:58.866 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56e98f700 1 --2- 172.21.2.102:0/1470592896 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd550004e40 0x7fd55000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:58.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56e98f700 1 -- 172.21.2.102:0/1470592896 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd5500044d0 msgr2=0x7fd550004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:58.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56e98f700 1 --2- 172.21.2.102:0/1470592896 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd5500044d0 0x7fd550004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:58.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56e98f700 1 -- 172.21.2.102:0/1470592896 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd5500037a0 msgr2=0x7fd550003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:22:58.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56e98f700 1 --2- 172.21.2.102:0/1470592896 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd5500037a0 0x7fd550003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:22:58.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.862+0000 7fd56e98f700 1 -- 172.21.2.102:0/1470592896 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd550003230 con 0x7fd550004e40 2021-02-12T17:22:58.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.863+0000 7fd56e98f700 1 --2- 172.21.2.102:0/1470592896 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd550004e40 0x7fd55000b720 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fd56000c5d0 tx=0x7fd5680b6580).ready entity=mon.0 client_cookie=5c43a20147774d1 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:58.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.863+0000 7fd56d18c700 1 -- 172.21.2.102:0/1470592896 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560005b70 con 0x7fd550004e40 2021-02-12T17:22:58.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.863+0000 7fd56d18c700 1 -- 172.21.2.102:0/1470592896 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560005cd0 con 0x7fd550004e40 2021-02-12T17:22:58.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.863+0000 7fd56d18c700 1 -- 172.21.2.102:0/1470592896 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560007320 con 0x7fd550004e40 2021-02-12T17:22:58.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.863+0000 7fd5703f2700 1 -- 172.21.2.102:0/1470592896 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd550004e40 msgr2=0x7fd55000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:58.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.863+0000 7fd5703f2700 1 --2- 172.21.2.102:0/1470592896 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd550004e40 0x7fd55000b720 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fd56000c5d0 tx=0x7fd5680b6580).stop 2021-02-12T17:22:58.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.863+0000 7fd56e98f700 1 -- 172.21.2.102:0/1470592896 reap_dead start 2021-02-12T17:22:58.867 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.863+0000 7fd5703f2700 1 -- 172.21.2.102:0/1470592896 shutdown_connections 2021-02-12T17:22:58.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.863+0000 7fd5703f2700 1 -- 172.21.2.102:0/1470592896 >> 172.21.2.102:0/1470592896 conn(0x7fd5680bc480 msgr2=0x7fd5680b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:58.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.863+0000 7fd5703f2700 1 -- 172.21.2.102:0/1470592896 shutdown_connections 2021-02-12T17:22:58.868 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.864+0000 7fd5703f2700 1 -- 172.21.2.102:0/1470592896 wait complete. 2021-02-12T17:22:58.869 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.864+0000 7fd5703f2700 1 Processor -- start 2021-02-12T17:22:58.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.864+0000 7fd5703f2700 1 -- start start 2021-02-12T17:22:58.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd5703f2700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd550004e40 0x7fd568150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:58.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd5703f2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd568153610 0x7fd5681409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:58.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd5703f2700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd568140ec0 0x7fd568141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:58.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd5703f2700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680b0d60 con 0x7fd568153610 2021-02-12T17:22:58.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd5703f2700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56815d8b0 con 0x7fd550004e40 2021-02-12T17:22:58.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd5703f2700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56815db50 con 0x7fd568140ec0 2021-02-12T17:22:58.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd56d98d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd568153610 0x7fd5681409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:58.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd56d98d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd568153610 0x7fd5681409d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47848/0 (socket says 172.21.2.102:47848) 2021-02-12T17:22:58.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd56d98d700 1 -- 172.21.2.102:0/3196736321 learned_addr learned my addr 172.21.2.102:0/3196736321 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:22:58.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd56e98f700 1 --2- 172.21.2.102:0/3196736321 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd568140ec0 0x7fd568141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:58.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd56e18e700 1 --2- 172.21.2.102:0/3196736321 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd550004e40 0x7fd568150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:58.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd56d98d700 1 -- 172.21.2.102:0/3196736321 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd568140ec0 msgr2=0x7fd568141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:58.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd56d98d700 1 --2- 172.21.2.102:0/3196736321 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd568140ec0 0x7fd568141340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:58.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd56d98d700 1 -- 172.21.2.102:0/3196736321 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd550004e40 msgr2=0x7fd568150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:58.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd56d98d700 1 --2- 172.21.2.102:0/3196736321 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd550004e40 0x7fd568150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:58.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd56d98d700 1 -- 172.21.2.102:0/3196736321 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56815ddf0 con 0x7fd568153610 2021-02-12T17:22:58.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.865+0000 7fd56d98d700 1 --2- 172.21.2.102:0/3196736321 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd568153610 0x7fd5681409d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fd564009710 tx=0x7fd564008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:58.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.866+0000 7fd55a7fc700 1 -- 172.21.2.102:0/3196736321 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400f490 con 0x7fd568153610 2021-02-12T17:22:58.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.866+0000 7fd55a7fc700 1 -- 172.21.2.102:0/3196736321 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56400f040 con 0x7fd568153610 2021-02-12T17:22:58.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.866+0000 7fd55a7fc700 1 -- 172.21.2.102:0/3196736321 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400f840 con 0x7fd568153610 2021-02-12T17:22:58.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.866+0000 7fd5703f2700 1 -- 172.21.2.102:0/3196736321 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56815e090 con 0x7fd568153610 2021-02-12T17:22:58.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.866+0000 7fd5703f2700 1 -- 172.21.2.102:0/3196736321 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd568150550 con 0x7fd568153610 2021-02-12T17:22:58.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.867+0000 7fd5703f2700 1 -- 172.21.2.102:0/3196736321 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd568045460 con 0x7fd568153610 2021-02-12T17:22:58.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.867+0000 7fd55a7fc700 1 -- 172.21.2.102:0/3196736321 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fd56400fbb0 con 0x7fd568153610 2021-02-12T17:22:58.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.867+0000 7fd55a7fc700 1 --2- 172.21.2.102:0/3196736321 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd548059d80 0x7fd54805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:22:58.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.867+0000 7fd55a7fc700 1 -- 172.21.2.102:0/3196736321 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7fd5640739c0 con 0x7fd568153610 2021-02-12T17:22:58.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.867+0000 7fd56e18e700 1 --2- 172.21.2.102:0/3196736321 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd548059d80 0x7fd54805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:22:58.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.868+0000 7fd56e18e700 1 --2- 172.21.2.102:0/3196736321 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd548059d80 0x7fd54805c240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fd56806abc0 tx=0x7fd55c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:22:58.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:58.870+0000 7fd55a7fc700 1 -- 172.21.2.102:0/3196736321 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fd564046eb0 con 0x7fd568153610 2021-02-12T17:22:59.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:59.030+0000 7fd5703f2700 1 -- 172.21.2.102:0/3196736321 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd568063670 con 0x7fd568153610 2021-02-12T17:22:59.031 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:59.030+0000 7fd55a7fc700 1 -- 172.21.2.102:0/3196736321 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3758 (secure 0 0 0) 0x7fd56404a4d0 con 0x7fd568153610 2021-02-12T17:22:59.031 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:22:59.031 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:22:59.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:59.031+0000 7fd5703f2700 1 -- 172.21.2.102:0/3196736321 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd548059d80 msgr2=0x7fd54805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:59.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:59.031+0000 7fd5703f2700 1 --2- 172.21.2.102:0/3196736321 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd548059d80 0x7fd54805c240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fd56806abc0 tx=0x7fd55c008040).stop 2021-02-12T17:22:59.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:59.031+0000 7fd5703f2700 1 -- 172.21.2.102:0/3196736321 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd568153610 msgr2=0x7fd5681409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:22:59.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:59.031+0000 7fd5703f2700 1 --2- 172.21.2.102:0/3196736321 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd568153610 0x7fd5681409d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fd564009710 tx=0x7fd564008040).stop 2021-02-12T17:22:59.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:59.032+0000 7fd5703f2700 1 -- 172.21.2.102:0/3196736321 shutdown_connections 2021-02-12T17:22:59.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:59.032+0000 7fd5703f2700 1 --2- 172.21.2.102:0/3196736321 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd568140ec0 0x7fd568141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:59.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:59.032+0000 7fd5703f2700 1 --2- 172.21.2.102:0/3196736321 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd550004e40 0x7fd568150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:59.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:59.032+0000 7fd5703f2700 1 --2- 172.21.2.102:0/3196736321 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd548059d80 0x7fd54805c240 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:59.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:59.032+0000 7fd5703f2700 1 --2- 172.21.2.102:0/3196736321 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd568153610 0x7fd5681409d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:22:59.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:59.032+0000 7fd5703f2700 1 -- 172.21.2.102:0/3196736321 >> 172.21.2.102:0/3196736321 conn(0x7fd5680bc480 msgr2=0x7fd5680b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:22:59.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:59.032+0000 7fd5703f2700 1 -- 172.21.2.102:0/3196736321 shutdown_connections 2021-02-12T17:22:59.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:22:59.032+0000 7fd5703f2700 1 -- 172.21.2.102:0/3196736321 wait complete. 2021-02-12T17:22:59.034 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 50 2021-02-12T17:22:59.041 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:23:01.043 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:23:01.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.131+0000 7fa156bf6700 1 Processor -- start 2021-02-12T17:23:01.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.131+0000 7fa156bf6700 1 -- start start 2021-02-12T17:23:01.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.132+0000 7fa156bf6700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fa1500b8d20 0x7fa150068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:01.132 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.132+0000 7fa156bf6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa15014e530 0x7fa1500b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:01.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.132+0000 7fa156bf6700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1500622a0 con 0x7fa150062740 2021-02-12T17:23:01.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.132+0000 7fa156bf6700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa150068d20 con 0x7fa1500b8d20 2021-02-12T17:23:01.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.132+0000 7fa156bf6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15014ea10 con 0x7fa15014e530 2021-02-12T17:23:01.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.132+0000 7fa155193700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fa150062740 0x7fa150062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56502/0 (socket says 172.21.2.102:56502) 2021-02-12T17:23:01.133 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.132+0000 7fa155193700 1 -- 172.21.2.102:0/2729350588 learned_addr learned my addr 172.21.2.102:0/2729350588 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:23:01.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.132+0000 7fa14f7fe700 1 -- 172.21.2.102:0/2729350588 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953568476 0 0) 0x7fa1500622a0 con 0x7fa150062740 2021-02-12T17:23:01.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.132+0000 7fa14ffff700 1 --2- 172.21.2.102:0/2729350588 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa15014e530 0x7fa1500b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:01.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.132+0000 7fa14f7fe700 1 -- 172.21.2.102:0/2729350588 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa130003230 con 0x7fa150062740 2021-02-12T17:23:01.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.132+0000 7fa154992700 1 --2- 172.21.2.102:0/2729350588 >> v2:172.21.2.104:3300/0 conn(0x7fa1500b8d20 0x7fa150068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:01.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.132+0000 7fa14f7fe700 1 -- 172.21.2.102:0/2729350588 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1772986525 0 0) 0x7fa130003230 con 0x7fa150062740 2021-02-12T17:23:01.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.132+0000 7fa14f7fe700 1 -- 172.21.2.102:0/2729350588 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa15014e530 msgr2=0x7fa1500b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:01.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.132+0000 7fa14f7fe700 1 --2- 172.21.2.102:0/2729350588 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa15014e530 0x7fa1500b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:01.135 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14f7fe700 1 -- 172.21.2.102:0/2729350588 >> v2:172.21.2.104:3300/0 conn(0x7fa1500b8d20 msgr2=0x7fa150068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:01.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14f7fe700 1 --2- 172.21.2.102:0/2729350588 >> v2:172.21.2.104:3300/0 conn(0x7fa1500b8d20 0x7fa150068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:01.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14f7fe700 1 -- 172.21.2.102:0/2729350588 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500b63f0 con 0x7fa150062740 2021-02-12T17:23:01.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14f7fe700 1 -- 172.21.2.102:0/2729350588 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fa148001860 con 0x7fa150062740 2021-02-12T17:23:01.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14f7fe700 1 -- 172.21.2.102:0/2729350588 >> v1:172.21.2.102:6789/0 conn(0x7fa150062740 legacy=0x7fa150062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:01.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14f7fe700 1 --2- 172.21.2.102:0/2729350588 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa130003720 0x7fa130003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:01.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14f7fe700 1 --2- 172.21.2.102:0/2729350588 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa1300044d0 0x7fa130004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:01.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14f7fe700 1 --2- 172.21.2.102:0/2729350588 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa15014e530 0x7fa130004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:01.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14f7fe700 1 -- 172.21.2.102:0/2729350588 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa150068d20 con 0x7fa130003720 2021-02-12T17:23:01.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14f7fe700 1 -- 172.21.2.102:0/2729350588 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15014ea10 con 0x7fa1300044d0 2021-02-12T17:23:01.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14f7fe700 1 -- 172.21.2.102:0/2729350588 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa130004260 con 0x7fa15014e530 2021-02-12T17:23:01.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa154992700 1 --2- 172.21.2.102:0/2729350588 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa130003720 0x7fa130003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:01.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa155193700 1 --2- 172.21.2.102:0/2729350588 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa15014e530 0x7fa130004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:01.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14ffff700 1 --2- 172.21.2.102:0/2729350588 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa1300044d0 0x7fa130004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:01.136 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa154992700 1 -- 172.21.2.102:0/2729350588 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa15014e530 msgr2=0x7fa130004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:01.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa154992700 1 --2- 172.21.2.102:0/2729350588 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa15014e530 0x7fa130004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:01.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa154992700 1 -- 172.21.2.102:0/2729350588 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa1300044d0 msgr2=0x7fa130004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:01.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa154992700 1 --2- 172.21.2.102:0/2729350588 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa1300044d0 0x7fa130004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:01.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa154992700 1 -- 172.21.2.102:0/2729350588 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa130003230 con 0x7fa130003720 2021-02-12T17:23:01.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa154992700 1 --2- 172.21.2.102:0/2729350588 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa130003720 0x7fa130003b40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fa13800bb90 tx=0x7fa138008040).ready entity=mon.0 client_cookie=29f88b81d13c4648 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:01.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14f7fe700 1 -- 172.21.2.102:0/2729350588 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13800b2b0 con 0x7fa130003720 2021-02-12T17:23:01.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14f7fe700 1 -- 172.21.2.102:0/2729350588 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13800e9a0 con 0x7fa130003720 2021-02-12T17:23:01.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.133+0000 7fa14f7fe700 1 -- 172.21.2.102:0/2729350588 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13800ed40 con 0x7fa130003720 2021-02-12T17:23:01.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.134+0000 7fa156bf6700 1 -- 172.21.2.102:0/2729350588 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa130003720 msgr2=0x7fa130003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:01.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.134+0000 7fa156bf6700 1 --2- 172.21.2.102:0/2729350588 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa130003720 0x7fa130003b40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fa13800bb90 tx=0x7fa138008040).stop 2021-02-12T17:23:01.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.134+0000 7fa155193700 1 -- 172.21.2.102:0/2729350588 reap_dead start 2021-02-12T17:23:01.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.134+0000 7fa156bf6700 1 -- 172.21.2.102:0/2729350588 shutdown_connections 2021-02-12T17:23:01.137 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.134+0000 7fa156bf6700 1 -- 172.21.2.102:0/2729350588 >> 172.21.2.102:0/2729350588 conn(0x7fa1500bc480 msgr2=0x7fa1500b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:01.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.134+0000 7fa156bf6700 1 -- 172.21.2.102:0/2729350588 shutdown_connections 2021-02-12T17:23:01.138 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.134+0000 7fa156bf6700 1 -- 172.21.2.102:0/2729350588 wait complete. 2021-02-12T17:23:01.139 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.135+0000 7fa156bf6700 1 Processor -- start 2021-02-12T17:23:01.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.135+0000 7fa156bf6700 1 -- start start 2021-02-12T17:23:01.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa156bf6700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa130003720 0x7fa1500acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:01.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa156bf6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1500aebf0 0x7fa1500af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:01.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa156bf6700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa150140840 0x7fa150140cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:01.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa156bf6700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa150151e40 con 0x7fa150140840 2021-02-12T17:23:01.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa156bf6700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500ae210 con 0x7fa130003720 2021-02-12T17:23:01.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa156bf6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500ad400 con 0x7fa1500aebf0 2021-02-12T17:23:01.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa155193700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa150140840 0x7fa150140cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:01.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa155193700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa150140840 0x7fa150140cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47870/0 (socket says 172.21.2.102:47870) 2021-02-12T17:23:01.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa155193700 1 -- 172.21.2.102:0/251867301 learned_addr learned my addr 172.21.2.102:0/251867301 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:01.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa154992700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa130003720 0x7fa1500acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:01.140 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa14ffff700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1500aebf0 0x7fa1500af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:01.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa14ffff700 1 -- 172.21.2.102:0/251867301 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa130003720 msgr2=0x7fa1500acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:01.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa14ffff700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa130003720 0x7fa1500acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:01.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa14ffff700 1 -- 172.21.2.102:0/251867301 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa150140840 msgr2=0x7fa150140cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:01.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa14ffff700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa150140840 0x7fa150140cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:01.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa14ffff700 1 -- 172.21.2.102:0/251867301 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500ad620 con 0x7fa1500aebf0 2021-02-12T17:23:01.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa155193700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa150140840 0x7fa150140cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:23:01.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.136+0000 7fa14ffff700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1500aebf0 0x7fa1500af070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa140011cf0 tx=0x7fa140008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:01.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.137+0000 7fa14cff9700 1 -- 172.21.2.102:0/251867301 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000f940 con 0x7fa1500aebf0 2021-02-12T17:23:01.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.137+0000 7fa14cff9700 1 -- 172.21.2.102:0/251867301 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14000faa0 con 0x7fa1500aebf0 2021-02-12T17:23:01.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.137+0000 7fa14cff9700 1 -- 172.21.2.102:0/251867301 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000fe20 con 0x7fa1500aebf0 2021-02-12T17:23:01.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.137+0000 7fa156bf6700 1 -- 172.21.2.102:0/251867301 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1500af560 con 0x7fa1500aebf0 2021-02-12T17:23:01.141 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.137+0000 7fa156bf6700 1 -- 172.21.2.102:0/251867301 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1501511c0 con 0x7fa1500aebf0 2021-02-12T17:23:01.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.137+0000 7fa156bf6700 1 -- 172.21.2.102:0/251867301 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa150045460 con 0x7fa1500aebf0 2021-02-12T17:23:01.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.138+0000 7fa14cff9700 1 -- 172.21.2.102:0/251867301 <== mon.2 v2:172.21.2.104:3301/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fa140014650 con 0x7fa1500aebf0 2021-02-12T17:23:01.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.138+0000 7fa14cff9700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa134059d60 0x7fa13405c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:01.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.138+0000 7fa14cff9700 1 -- 172.21.2.102:0/251867301 <== mon.2 v2:172.21.2.104:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7fa1400744a0 con 0x7fa1500aebf0 2021-02-12T17:23:01.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.138+0000 7fa154992700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa134059d60 0x7fa13405c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:01.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.138+0000 7fa154992700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa134059d60 0x7fa13405c220 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fa13800c010 tx=0x7fa13801a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:01.142 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.141+0000 7fa14cff9700 1 -- 172.21.2.102:0/251867301 <== mon.2 v2:172.21.2.104:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fa1400479a0 con 0x7fa1500aebf0 2021-02-12T17:23:01.301 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.301+0000 7fa156bf6700 1 -- 172.21.2.102:0/251867301 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa150063670 con 0x7fa1500aebf0 2021-02-12T17:23:01.302 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.302+0000 7fa14cff9700 1 -- 172.21.2.102:0/251867301 <== mon.2 v2:172.21.2.104:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3758 (secure 0 0 0) 0x7fa14004afc0 con 0x7fa1500aebf0 2021-02-12T17:23:01.303 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:23:01.303 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:23:01.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.303+0000 7fa156bf6700 1 -- 172.21.2.102:0/251867301 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa134059d60 msgr2=0x7fa13405c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:01.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.303+0000 7fa156bf6700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa134059d60 0x7fa13405c220 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fa13800c010 tx=0x7fa13801a000).stop 2021-02-12T17:23:01.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.303+0000 7fa156bf6700 1 -- 172.21.2.102:0/251867301 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1500aebf0 msgr2=0x7fa1500af070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:01.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.303+0000 7fa156bf6700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1500aebf0 0x7fa1500af070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa140011cf0 tx=0x7fa140008040).stop 2021-02-12T17:23:01.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.303+0000 7fa156bf6700 1 -- 172.21.2.102:0/251867301 shutdown_connections 2021-02-12T17:23:01.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.303+0000 7fa156bf6700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa134059d60 0x7fa13405c220 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:01.304 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.303+0000 7fa156bf6700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa150140840 0x7fa150140cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:01.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.303+0000 7fa156bf6700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa130003720 0x7fa1500acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:01.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.303+0000 7fa156bf6700 1 --2- 172.21.2.102:0/251867301 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1500aebf0 0x7fa1500af070 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:01.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.303+0000 7fa156bf6700 1 -- 172.21.2.102:0/251867301 >> 172.21.2.102:0/251867301 conn(0x7fa1500bc480 msgr2=0x7fa1500b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:01.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.303+0000 7fa156bf6700 1 -- 172.21.2.102:0/251867301 shutdown_connections 2021-02-12T17:23:01.305 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:01.303+0000 7fa156bf6700 1 -- 172.21.2.102:0/251867301 wait complete. 2021-02-12T17:23:01.305 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 50 2021-02-12T17:23:01.312 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:23:03.314 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:23:03.403 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.403+0000 7fef981e6700 1 Processor -- start 2021-02-12T17:23:03.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.403+0000 7fef981e6700 1 -- start start 2021-02-12T17:23:03.404 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.403+0000 7fef981e6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef9014e530 0x7fef90068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:03.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.403+0000 7fef981e6700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fef90062740 0x7fef90062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:03.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.403+0000 7fef981e6700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef900b7960 con 0x7fef900b8d20 2021-02-12T17:23:03.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.403+0000 7fef981e6700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef90068d20 con 0x7fef90062740 2021-02-12T17:23:03.405 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.403+0000 7fef981e6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef900622a0 con 0x7fef9014e530 2021-02-12T17:23:03.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.404+0000 7fef96783700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fef90062740 0x7fef90062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:03.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.404+0000 7fef95f82700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7fef900b8d20 0x7fef900b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:38892/0 (socket says 172.21.2.102:38892) 2021-02-12T17:23:03.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.404+0000 7fef95f82700 1 -- 172.21.2.102:0/2035109787 learned_addr learned my addr 172.21.2.102:0/2035109787 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:23:03.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.404+0000 7fef95781700 1 --2- 172.21.2.102:0/2035109787 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef9014e530 0x7fef90068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:03.407 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.405+0000 7fef94f80700 1 -- 172.21.2.102:0/2035109787 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297172781 0 0) 0x7fef900b7960 con 0x7fef900b8d20 2021-02-12T17:23:03.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.405+0000 7fef94f80700 1 -- 172.21.2.102:0/2035109787 --> v1:172.21.2.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef78003230 con 0x7fef900b8d20 2021-02-12T17:23:03.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.405+0000 7fef96783700 1 -- 172.21.2.102:0/2035109787 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef9014e530 msgr2=0x7fef90068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:03.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.405+0000 7fef96783700 1 --2- 172.21.2.102:0/2035109787 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef9014e530 0x7fef90068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:03.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.405+0000 7fef96783700 1 -- 172.21.2.102:0/2035109787 >> v1:172.21.2.104:6789/0 conn(0x7fef900b8d20 legacy=0x7fef900b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:03.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.405+0000 7fef96783700 1 -- 172.21.2.102:0/2035109787 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9014ea10 con 0x7fef90062740 2021-02-12T17:23:03.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.405+0000 7fef96783700 1 --2- 172.21.2.102:0/2035109787 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef90062740 0x7fef90062bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fef88009c90 tx=0x7fef880091d0).ready entity=mon.1 client_cookie=4aa5082406e01992 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:03.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.405+0000 7fef94f80700 1 -- 172.21.2.102:0/2035109787 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8800b930 con 0x7fef90062740 2021-02-12T17:23:03.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.406+0000 7fef94f80700 1 -- 172.21.2.102:0/2035109787 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8800ba90 con 0x7fef90062740 2021-02-12T17:23:03.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.406+0000 7fef94f80700 1 -- 172.21.2.102:0/2035109787 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8800be10 con 0x7fef90062740 2021-02-12T17:23:03.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.406+0000 7fef981e6700 1 -- 172.21.2.102:0/2035109787 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef90062740 msgr2=0x7fef90062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:03.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.406+0000 7fef981e6700 1 --2- 172.21.2.102:0/2035109787 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef90062740 0x7fef90062bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fef88009c90 tx=0x7fef880091d0).stop 2021-02-12T17:23:03.408 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.406+0000 7fef981e6700 1 -- 172.21.2.102:0/2035109787 shutdown_connections 2021-02-12T17:23:03.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.406+0000 7fef981e6700 1 --2- 172.21.2.102:0/2035109787 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef90062740 0x7fef90062bf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:03.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.406+0000 7fef981e6700 1 --2- 172.21.2.102:0/2035109787 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef9014e530 0x7fef90068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:03.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.406+0000 7fef981e6700 1 -- 172.21.2.102:0/2035109787 >> 172.21.2.102:0/2035109787 conn(0x7fef900bc480 msgr2=0x7fef900b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:03.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.406+0000 7fef981e6700 1 -- 172.21.2.102:0/2035109787 shutdown_connections 2021-02-12T17:23:03.409 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.406+0000 7fef981e6700 1 -- 172.21.2.102:0/2035109787 wait complete. 2021-02-12T17:23:03.413 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.407+0000 7fef981e6700 1 Processor -- start 2021-02-12T17:23:03.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.407+0000 7fef981e6700 1 -- start start 2021-02-12T17:23:03.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.407+0000 7fef981e6700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef90062740 0x7fef90151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:03.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.407+0000 7fef981e6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef900b8d20 0x7fef9014b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:03.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.407+0000 7fef981e6700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef9014e530 0x7fef9014bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:03.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.407+0000 7fef981e6700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef900b4cc0 con 0x7fef90062740 2021-02-12T17:23:03.415 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.407+0000 7fef981e6700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef900b4f60 con 0x7fef9014e530 2021-02-12T17:23:03.415 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.407+0000 7fef981e6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef900b3b90 con 0x7fef900b8d20 2021-02-12T17:23:03.415 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.408+0000 7fef95f82700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef90062740 0x7fef90151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:03.415 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.408+0000 7fef95f82700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef90062740 0x7fef90151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47884/0 (socket says 172.21.2.102:47884) 2021-02-12T17:23:03.415 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.408+0000 7fef95f82700 1 -- 172.21.2.102:0/3763137014 learned_addr learned my addr 172.21.2.102:0/3763137014 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:03.415 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.408+0000 7fef95f82700 1 -- 172.21.2.102:0/3763137014 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef900b8d20 msgr2=0x7fef9014b8c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:23:03.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.408+0000 7fef95f82700 1 --2- 172.21.2.102:0/3763137014 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef900b8d20 0x7fef9014b8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:03.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.408+0000 7fef95f82700 1 -- 172.21.2.102:0/3763137014 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef9014e530 msgr2=0x7fef9014bdb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:23:03.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.408+0000 7fef95f82700 1 --2- 172.21.2.102:0/3763137014 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef9014e530 0x7fef9014bdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:03.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.408+0000 7fef95f82700 1 -- 172.21.2.102:0/3763137014 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef900b3e30 con 0x7fef90062740 2021-02-12T17:23:03.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.408+0000 7fef95f82700 1 --2- 172.21.2.102:0/3763137014 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef90062740 0x7fef90151420 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fef8c00c6d0 tx=0x7fef8c007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:03.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.408+0000 7fef7dffb700 1 -- 172.21.2.102:0/3763137014 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c007320 con 0x7fef90062740 2021-02-12T17:23:03.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.408+0000 7fef7dffb700 1 -- 172.21.2.102:0/3763137014 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c007480 con 0x7fef90062740 2021-02-12T17:23:03.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.408+0000 7fef981e6700 1 -- 172.21.2.102:0/3763137014 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef900b40d0 con 0x7fef90062740 2021-02-12T17:23:03.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.408+0000 7fef7dffb700 1 -- 172.21.2.102:0/3763137014 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c0057f0 con 0x7fef90062740 2021-02-12T17:23:03.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.408+0000 7fef981e6700 1 -- 172.21.2.102:0/3763137014 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef90151910 con 0x7fef90062740 2021-02-12T17:23:03.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.409+0000 7fef981e6700 1 -- 172.21.2.102:0/3763137014 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef900b4260 con 0x7fef90062740 2021-02-12T17:23:03.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.409+0000 7fef7dffb700 1 -- 172.21.2.102:0/3763137014 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fef8c010030 con 0x7fef90062740 2021-02-12T17:23:03.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.409+0000 7fef7dffb700 1 --2- 172.21.2.102:0/3763137014 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fef70059d30 0x7fef7005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:03.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.409+0000 7fef7dffb700 1 -- 172.21.2.102:0/3763137014 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7fef8c073e10 con 0x7fef90062740 2021-02-12T17:23:03.418 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.410+0000 7fef95781700 1 --2- 172.21.2.102:0/3763137014 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fef70059d30 0x7fef7005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:03.419 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.410+0000 7fef95781700 1 --2- 172.21.2.102:0/3763137014 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fef70059d30 0x7fef7005c1f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fef900b70f0 tx=0x7fef80006de0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:03.419 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.412+0000 7fef7dffb700 1 -- 172.21.2.102:0/3763137014 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fef8c070580 con 0x7fef90062740 2021-02-12T17:23:03.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.571+0000 7fef981e6700 1 -- 172.21.2.102:0/3763137014 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef90045460 con 0x7fef90062740 2021-02-12T17:23:03.572 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.571+0000 7fef7dffb700 1 -- 172.21.2.102:0/3763137014 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3758 (secure 0 0 0) 0x7fef8c04c090 con 0x7fef90062740 2021-02-12T17:23:03.573 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:23:03.573 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:23:03.574 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.572+0000 7fef981e6700 1 -- 172.21.2.102:0/3763137014 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fef70059d30 msgr2=0x7fef7005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:03.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.572+0000 7fef981e6700 1 --2- 172.21.2.102:0/3763137014 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fef70059d30 0x7fef7005c1f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fef900b70f0 tx=0x7fef80006de0).stop 2021-02-12T17:23:03.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.572+0000 7fef981e6700 1 -- 172.21.2.102:0/3763137014 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef90062740 msgr2=0x7fef90151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:03.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.572+0000 7fef981e6700 1 --2- 172.21.2.102:0/3763137014 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef90062740 0x7fef90151420 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fef8c00c6d0 tx=0x7fef8c007ac0).stop 2021-02-12T17:23:03.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.572+0000 7fef981e6700 1 -- 172.21.2.102:0/3763137014 shutdown_connections 2021-02-12T17:23:03.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.572+0000 7fef981e6700 1 --2- 172.21.2.102:0/3763137014 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fef9014e530 0x7fef9014bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:03.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.572+0000 7fef981e6700 1 --2- 172.21.2.102:0/3763137014 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fef70059d30 0x7fef7005c1f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:03.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.572+0000 7fef981e6700 1 --2- 172.21.2.102:0/3763137014 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fef90062740 0x7fef90151420 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:03.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.572+0000 7fef981e6700 1 --2- 172.21.2.102:0/3763137014 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fef900b8d20 0x7fef9014b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:03.575 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.572+0000 7fef981e6700 1 -- 172.21.2.102:0/3763137014 >> 172.21.2.102:0/3763137014 conn(0x7fef900bc480 msgr2=0x7fef90062b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:03.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.573+0000 7fef981e6700 1 -- 172.21.2.102:0/3763137014 shutdown_connections 2021-02-12T17:23:03.576 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:03.573+0000 7fef981e6700 1 -- 172.21.2.102:0/3763137014 wait complete. 2021-02-12T17:23:03.576 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 50 2021-02-12T17:23:03.582 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:23:05.583 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:23:05.675 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.674+0000 7f2a98696700 1 Processor -- start 2021-02-12T17:23:05.675 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.674+0000 7f2a98696700 1 -- start start 2021-02-12T17:23:05.676 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.675+0000 7f2a98696700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f2a9014e530 0x7f2a90068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:05.676 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.675+0000 7f2a98696700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a900b7960 con 0x7f2a900b8d20 2021-02-12T17:23:05.676 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.675+0000 7f2a98696700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a900622a0 con 0x7f2a90062740 2021-02-12T17:23:05.676 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.675+0000 7f2a98696700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a90068d20 con 0x7f2a9014e530 2021-02-12T17:23:05.677 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.675+0000 7f2a96432700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f2a900b8d20 0x7f2a900b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56538/0 (socket says 172.21.2.102:56538) 2021-02-12T17:23:05.677 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.675+0000 7f2a96432700 1 -- 172.21.2.102:0/616637190 learned_addr learned my addr 172.21.2.102:0/616637190 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:23:05.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 -- 172.21.2.102:0/616637190 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082075236 0 0) 0x7f2a900b7960 con 0x7f2a900b8d20 2021-02-12T17:23:05.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 -- 172.21.2.102:0/616637190 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a78003230 con 0x7f2a900b8d20 2021-02-12T17:23:05.679 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95c31700 1 --2- 172.21.2.102:0/616637190 >> v2:172.21.2.104:3300/0 conn(0x7f2a9014e530 0x7f2a90068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:05.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 -- 172.21.2.102:0/616637190 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2406641934 0 0) 0x7f2a78003230 con 0x7f2a900b8d20 2021-02-12T17:23:05.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 -- 172.21.2.102:0/616637190 >> v2:172.21.2.104:3300/0 conn(0x7f2a9014e530 msgr2=0x7f2a90068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:05.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 --2- 172.21.2.102:0/616637190 >> v2:172.21.2.104:3300/0 conn(0x7f2a9014e530 0x7f2a90068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:05.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 -- 172.21.2.102:0/616637190 >> v1:172.21.2.104:6789/0 conn(0x7f2a90062740 legacy=0x7f2a90062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:05.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 -- 172.21.2.102:0/616637190 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9014ea10 con 0x7f2a900b8d20 2021-02-12T17:23:05.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 -- 172.21.2.102:0/616637190 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f2a8c0014e0 con 0x7f2a900b8d20 2021-02-12T17:23:05.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 -- 172.21.2.102:0/616637190 >> v1:172.21.2.102:6789/0 conn(0x7f2a900b8d20 legacy=0x7f2a900b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:05.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 --2- 172.21.2.102:0/616637190 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2a78003770 0x7f2a78003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:05.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 --2- 172.21.2.102:0/616637190 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2a780044d0 0x7f2a78004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:05.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 --2- 172.21.2.102:0/616637190 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2a78004e40 0x7f2a7800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:05.680 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 -- 172.21.2.102:0/616637190 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a90068d20 con 0x7f2a78004e40 2021-02-12T17:23:05.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 -- 172.21.2.102:0/616637190 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a78005320 con 0x7f2a780044d0 2021-02-12T17:23:05.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.676+0000 7f2a95430700 1 -- 172.21.2.102:0/616637190 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7800bc10 con 0x7f2a78003770 2021-02-12T17:23:05.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a96c33700 1 --2- 172.21.2.102:0/616637190 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2a78004e40 0x7f2a7800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:05.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a95c31700 1 --2- 172.21.2.102:0/616637190 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2a780044d0 0x7f2a78004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:05.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a96432700 1 --2- 172.21.2.102:0/616637190 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2a78003770 0x7f2a78003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:05.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a96c33700 1 -- 172.21.2.102:0/616637190 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2a78003770 msgr2=0x7f2a78003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:05.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a96c33700 1 --2- 172.21.2.102:0/616637190 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2a78003770 0x7f2a78003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:05.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a96c33700 1 -- 172.21.2.102:0/616637190 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2a780044d0 msgr2=0x7f2a78004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:05.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a96c33700 1 --2- 172.21.2.102:0/616637190 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2a780044d0 0x7f2a78004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:05.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a96c33700 1 -- 172.21.2.102:0/616637190 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a78003230 con 0x7f2a78004e40 2021-02-12T17:23:05.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a96c33700 1 -- 172.21.2.102:0/616637190 reap_dead start 2021-02-12T17:23:05.681 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a96c33700 1 --2- 172.21.2.102:0/616637190 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2a78004e40 0x7f2a7800b720 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f2a88001e70 tx=0x7f2a88007f00).ready entity=mon.0 client_cookie=f526bd1faffdd8da server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:05.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a95430700 1 -- 172.21.2.102:0/616637190 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a88001540 con 0x7f2a78004e40 2021-02-12T17:23:05.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a95430700 1 -- 172.21.2.102:0/616637190 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8800c930 con 0x7f2a78004e40 2021-02-12T17:23:05.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a95430700 1 -- 172.21.2.102:0/616637190 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8800ccd0 con 0x7f2a78004e40 2021-02-12T17:23:05.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a98696700 1 -- 172.21.2.102:0/616637190 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2a78004e40 msgr2=0x7f2a7800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:05.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.677+0000 7f2a98696700 1 --2- 172.21.2.102:0/616637190 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2a78004e40 0x7f2a7800b720 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f2a88001e70 tx=0x7f2a88007f00).stop 2021-02-12T17:23:05.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.678+0000 7f2a98696700 1 -- 172.21.2.102:0/616637190 shutdown_connections 2021-02-12T17:23:05.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.678+0000 7f2a98696700 1 --2- 172.21.2.102:0/616637190 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2a78004e40 0x7f2a7800b720 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:05.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.678+0000 7f2a98696700 1 -- 172.21.2.102:0/616637190 >> 172.21.2.102:0/616637190 conn(0x7f2a900bc480 msgr2=0x7f2a900b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:05.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.678+0000 7f2a98696700 1 -- 172.21.2.102:0/616637190 shutdown_connections 2021-02-12T17:23:05.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.678+0000 7f2a98696700 1 -- 172.21.2.102:0/616637190 wait complete. 2021-02-12T17:23:05.682 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.679+0000 7f2a98696700 1 Processor -- start 2021-02-12T17:23:05.683 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.679+0000 7f2a98696700 1 -- start start 2021-02-12T17:23:05.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.679+0000 7f2a98696700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2a78004e40 0x7f2a9014b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:05.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.679+0000 7f2a98696700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2a900b4620 0x7f2a90160980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:05.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.679+0000 7f2a98696700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2a900b5730 0x7f2a90149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:05.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.679+0000 7f2a98696700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900b4bb0 con 0x7f2a900b4620 2021-02-12T17:23:05.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.679+0000 7f2a98696700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900baef0 con 0x7f2a900b5730 2021-02-12T17:23:05.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.679+0000 7f2a98696700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900ada50 con 0x7f2a78004e40 2021-02-12T17:23:05.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.679+0000 7f2a95c31700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2a900b4620 0x7f2a90160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:05.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.679+0000 7f2a95c31700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2a900b4620 0x7f2a90160980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47908/0 (socket says 172.21.2.102:47908) 2021-02-12T17:23:05.685 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.679+0000 7f2a95c31700 1 -- 172.21.2.102:0/1427779125 learned_addr learned my addr 172.21.2.102:0/1427779125 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:05.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.679+0000 7f2a96432700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2a78004e40 0x7f2a9014b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:05.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.679+0000 7f2a96c33700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2a900b5730 0x7f2a90149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:05.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.680+0000 7f2a95c31700 1 -- 172.21.2.102:0/1427779125 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2a78004e40 msgr2=0x7f2a9014b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:05.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.680+0000 7f2a95c31700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2a78004e40 0x7f2a9014b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:05.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.680+0000 7f2a95c31700 1 -- 172.21.2.102:0/1427779125 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2a900b5730 msgr2=0x7f2a90149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:05.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.680+0000 7f2a95c31700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2a900b5730 0x7f2a90149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:05.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.680+0000 7f2a95c31700 1 -- 172.21.2.102:0/1427779125 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a900adcf0 con 0x7f2a900b4620 2021-02-12T17:23:05.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.680+0000 7f2a96c33700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2a900b5730 0x7f2a90149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:23:05.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.680+0000 7f2a95c31700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2a900b4620 0x7f2a90160980 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f2a80006db0 tx=0x7f2a80008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:05.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.680+0000 7f2a7e7fc700 1 -- 172.21.2.102:0/1427779125 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8000f9e0 con 0x7f2a900b4620 2021-02-12T17:23:05.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.680+0000 7f2a7e7fc700 1 -- 172.21.2.102:0/1427779125 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8000fb40 con 0x7f2a900b4620 2021-02-12T17:23:05.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.680+0000 7f2a98696700 1 -- 172.21.2.102:0/1427779125 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a900b3d10 con 0x7f2a900b4620 2021-02-12T17:23:05.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.680+0000 7f2a7e7fc700 1 -- 172.21.2.102:0/1427779125 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8000fec0 con 0x7f2a900b4620 2021-02-12T17:23:05.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.680+0000 7f2a98696700 1 -- 172.21.2.102:0/1427779125 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a900b4250 con 0x7f2a900b4620 2021-02-12T17:23:05.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.680+0000 7f2a98696700 1 -- 172.21.2.102:0/1427779125 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a900b4d00 con 0x7f2a900b4620 2021-02-12T17:23:05.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.681+0000 7f2a7e7fc700 1 -- 172.21.2.102:0/1427779125 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f2a80014650 con 0x7f2a900b4620 2021-02-12T17:23:05.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.681+0000 7f2a7e7fc700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2a70059d30 0x7f2a7005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:05.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.681+0000 7f2a7e7fc700 1 -- 172.21.2.102:0/1427779125 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f2a80074550 con 0x7f2a900b4620 2021-02-12T17:23:05.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.681+0000 7f2a96432700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2a70059d30 0x7f2a7005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:05.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.682+0000 7f2a96432700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2a70059d30 0x7f2a7005c1f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f2a8c007790 tx=0x7f2a9014eba0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:05.687 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.684+0000 7f2a7e7fc700 1 -- 172.21.2.102:0/1427779125 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f2a900b4d00 con 0x7f2a900b4620 2021-02-12T17:23:05.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.845+0000 7f2a98696700 1 -- 172.21.2.102:0/1427779125 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a900b4d00 con 0x7f2a900b4620 2021-02-12T17:23:05.846 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.845+0000 7f2a7e7fc700 1 -- 172.21.2.102:0/1427779125 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3758 (secure 0 0 0) 0x7f2a900b4d00 con 0x7f2a900b4620 2021-02-12T17:23:05.847 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:23:05.847 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:23:05.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.847+0000 7f2a98696700 1 -- 172.21.2.102:0/1427779125 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2a70059d30 msgr2=0x7f2a7005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:05.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.847+0000 7f2a98696700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2a70059d30 0x7f2a7005c1f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f2a8c007790 tx=0x7f2a9014eba0).stop 2021-02-12T17:23:05.847 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.847+0000 7f2a98696700 1 -- 172.21.2.102:0/1427779125 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2a900b4620 msgr2=0x7f2a90160980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:05.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.847+0000 7f2a98696700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2a900b4620 0x7f2a90160980 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f2a80006db0 tx=0x7f2a80008040).stop 2021-02-12T17:23:05.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.847+0000 7f2a98696700 1 -- 172.21.2.102:0/1427779125 shutdown_connections 2021-02-12T17:23:05.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.847+0000 7f2a98696700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2a900b5730 0x7f2a90149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:05.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.847+0000 7f2a98696700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2a78004e40 0x7f2a9014b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:05.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.847+0000 7f2a98696700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2a70059d30 0x7f2a7005c1f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:05.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.847+0000 7f2a98696700 1 --2- 172.21.2.102:0/1427779125 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2a900b4620 0x7f2a90160980 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:05.848 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.847+0000 7f2a98696700 1 -- 172.21.2.102:0/1427779125 >> 172.21.2.102:0/1427779125 conn(0x7f2a900bc480 msgr2=0x7f2a90153130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:05.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.847+0000 7f2a98696700 1 -- 172.21.2.102:0/1427779125 shutdown_connections 2021-02-12T17:23:05.849 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:05.847+0000 7f2a98696700 1 -- 172.21.2.102:0/1427779125 wait complete. 2021-02-12T17:23:05.849 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 50 2021-02-12T17:23:05.856 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:23:07.857 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:23:07.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.947+0000 7fbda9829700 1 Processor -- start 2021-02-12T17:23:07.948 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.947+0000 7fbda9829700 1 -- start start 2021-02-12T17:23:07.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.947+0000 7fbda9829700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbda40b8ca0 0x7fbda40b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:07.949 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.947+0000 7fbda9829700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fbda40b77d0 0x7fbda40671f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:07.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.947+0000 7fbda9829700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fbda40676e0 0x7fbda414c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:07.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.947+0000 7fbda9829700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda40b7d40 con 0x7fbda40b77d0 2021-02-12T17:23:07.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.947+0000 7fbda9829700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda40b7fe0 con 0x7fbda40676e0 2021-02-12T17:23:07.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.947+0000 7fbda9829700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda4066ab0 con 0x7fbda40b8ca0 2021-02-12T17:23:07.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda27fc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fbda40b77d0 0x7fbda40671f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:07.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda27fc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fbda40b77d0 0x7fbda40671f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47920/0 (socket says 172.21.2.102:47920) 2021-02-12T17:23:07.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda27fc700 1 -- 172.21.2.102:0/2914876364 learned_addr learned my addr 172.21.2.102:0/2914876364 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:07.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda27fc700 1 -- 172.21.2.102:0/2914876364 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbda40b8ca0 msgr2=0x7fbda40b72e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:23:07.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda27fc700 1 --2- 172.21.2.102:0/2914876364 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbda40b8ca0 0x7fbda40b72e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:07.950 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda27fc700 1 -- 172.21.2.102:0/2914876364 >> v2:172.21.2.104:3300/0 conn(0x7fbda40676e0 msgr2=0x7fbda414c8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:23:07.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda27fc700 1 --2- 172.21.2.102:0/2914876364 >> v2:172.21.2.104:3300/0 conn(0x7fbda40676e0 0x7fbda414c8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:07.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda27fc700 1 -- 172.21.2.102:0/2914876364 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda4066d50 con 0x7fbda40b77d0 2021-02-12T17:23:07.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda27fc700 1 --2- 172.21.2.102:0/2914876364 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbda40b77d0 0x7fbda40671f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fbd9400b9e0 tx=0x7fbd94006ea0).ready entity=mon.0 client_cookie=1a357b6d719f12b0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:07.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda1ffb700 1 -- 172.21.2.102:0/2914876364 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd94009890 con 0x7fbda40b77d0 2021-02-12T17:23:07.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda1ffb700 1 -- 172.21.2.102:0/2914876364 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd940099f0 con 0x7fbda40b77d0 2021-02-12T17:23:07.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda1ffb700 1 -- 172.21.2.102:0/2914876364 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd94009d70 con 0x7fbda40b77d0 2021-02-12T17:23:07.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda9829700 1 -- 172.21.2.102:0/2914876364 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbda40b77d0 msgr2=0x7fbda40671f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:07.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda9829700 1 --2- 172.21.2.102:0/2914876364 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbda40b77d0 0x7fbda40671f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fbd9400b9e0 tx=0x7fbd94006ea0).stop 2021-02-12T17:23:07.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda9829700 1 -- 172.21.2.102:0/2914876364 shutdown_connections 2021-02-12T17:23:07.951 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda9829700 1 --2- 172.21.2.102:0/2914876364 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbda40b8ca0 0x7fbda40b72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:07.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.948+0000 7fbda9829700 1 --2- 172.21.2.102:0/2914876364 >> v2:172.21.2.104:3300/0 conn(0x7fbda40676e0 0x7fbda414c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:07.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.949+0000 7fbda9829700 1 --2- 172.21.2.102:0/2914876364 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbda40b77d0 0x7fbda40671f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:07.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.949+0000 7fbda9829700 1 -- 172.21.2.102:0/2914876364 >> 172.21.2.102:0/2914876364 conn(0x7fbda40bc400 msgr2=0x7fbda40b83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:07.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.949+0000 7fbda9829700 1 -- 172.21.2.102:0/2914876364 shutdown_connections 2021-02-12T17:23:07.952 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.949+0000 7fbda9829700 1 -- 172.21.2.102:0/2914876364 wait complete. 2021-02-12T17:23:07.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.949+0000 7fbda9829700 1 Processor -- start 2021-02-12T17:23:07.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.949+0000 7fbda9829700 1 -- start start 2021-02-12T17:23:07.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda9829700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbda40676e0 0x7fbda4151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:07.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda9829700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbda40b77d0 0x7fbda409c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:07.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda9829700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbda40b8ca0 0x7fbda4160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:07.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda9829700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda409bdd0 con 0x7fbda40b8ca0 2021-02-12T17:23:07.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda9829700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda409de10 con 0x7fbda40676e0 2021-02-12T17:23:07.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda9829700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda409c950 con 0x7fbda40b77d0 2021-02-12T17:23:07.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda37fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbda40b8ca0 0x7fbda4160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:07.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda37fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbda40b8ca0 0x7fbda4160860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47926/0 (socket says 172.21.2.102:47926) 2021-02-12T17:23:07.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda37fe700 1 -- 172.21.2.102:0/3785943950 learned_addr learned my addr 172.21.2.102:0/3785943950 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:07.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda37fe700 1 -- 172.21.2.102:0/3785943950 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbda40b77d0 msgr2=0x7fbda409c460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:23:07.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda37fe700 1 --2- 172.21.2.102:0/3785943950 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbda40b77d0 0x7fbda409c460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:07.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda37fe700 1 -- 172.21.2.102:0/3785943950 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbda40676e0 msgr2=0x7fbda4151a50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:23:07.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda37fe700 1 --2- 172.21.2.102:0/3785943950 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbda40676e0 0x7fbda4151a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:07.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda37fe700 1 -- 172.21.2.102:0/3785943950 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda409e040 con 0x7fbda40b8ca0 2021-02-12T17:23:07.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda37fe700 1 --2- 172.21.2.102:0/3785943950 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbda40b8ca0 0x7fbda4160860 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fbd9c00bab0 tx=0x7fbd9c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:07.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbd9affd700 1 -- 172.21.2.102:0/3785943950 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00c740 con 0x7fbda40b8ca0 2021-02-12T17:23:07.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbd9affd700 1 -- 172.21.2.102:0/3785943950 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c00c8a0 con 0x7fbda40b8ca0 2021-02-12T17:23:07.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.950+0000 7fbda9829700 1 -- 172.21.2.102:0/3785943950 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda409e2e0 con 0x7fbda40b8ca0 2021-02-12T17:23:07.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.951+0000 7fbda9829700 1 -- 172.21.2.102:0/3785943950 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda4160d50 con 0x7fbda40b8ca0 2021-02-12T17:23:07.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.951+0000 7fbd9affd700 1 -- 172.21.2.102:0/3785943950 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00ca50 con 0x7fbda40b8ca0 2021-02-12T17:23:07.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.951+0000 7fbda9829700 1 -- 172.21.2.102:0/3785943950 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda409c180 con 0x7fbda40b8ca0 2021-02-12T17:23:07.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.952+0000 7fbd9affd700 1 -- 172.21.2.102:0/3785943950 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fbd9c01c070 con 0x7fbda40b8ca0 2021-02-12T17:23:07.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.952+0000 7fbd9affd700 1 --2- 172.21.2.102:0/3785943950 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbd88059d30 0x7fbd8805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:07.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.952+0000 7fbd9affd700 1 -- 172.21.2.102:0/3785943950 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7fbd9c0736c0 con 0x7fbda40b8ca0 2021-02-12T17:23:07.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.952+0000 7fbda2ffd700 1 --2- 172.21.2.102:0/3785943950 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbd88059d30 0x7fbd8805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:07.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.952+0000 7fbda2ffd700 1 --2- 172.21.2.102:0/3785943950 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbd88059d30 0x7fbd8805c1f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fbd8c006fd0 tx=0x7fbd8c006910).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:07.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:07.956+0000 7fbd9affd700 1 -- 172.21.2.102:0/3785943950 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fbd9c046b30 con 0x7fbda40b8ca0 2021-02-12T17:23:08.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:08.112+0000 7fbda9829700 1 -- 172.21.2.102:0/3785943950 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbda40b2530 con 0x7fbda40b8ca0 2021-02-12T17:23:08.113 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:08.112+0000 7fbd9affd700 1 -- 172.21.2.102:0/3785943950 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3758 (secure 0 0 0) 0x7fbd9c01a070 con 0x7fbda40b8ca0 2021-02-12T17:23:08.114 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:23:08.114 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:23:08.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:08.114+0000 7fbda9829700 1 -- 172.21.2.102:0/3785943950 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbd88059d30 msgr2=0x7fbd8805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:08.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:08.114+0000 7fbda9829700 1 --2- 172.21.2.102:0/3785943950 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbd88059d30 0x7fbd8805c1f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fbd8c006fd0 tx=0x7fbd8c006910).stop 2021-02-12T17:23:08.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:08.114+0000 7fbda9829700 1 -- 172.21.2.102:0/3785943950 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbda40b8ca0 msgr2=0x7fbda4160860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:08.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:08.114+0000 7fbda9829700 1 --2- 172.21.2.102:0/3785943950 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbda40b8ca0 0x7fbda4160860 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fbd9c00bab0 tx=0x7fbd9c0090f0).stop 2021-02-12T17:23:08.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:08.114+0000 7fbda9829700 1 -- 172.21.2.102:0/3785943950 shutdown_connections 2021-02-12T17:23:08.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:08.114+0000 7fbda9829700 1 --2- 172.21.2.102:0/3785943950 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbd88059d30 0x7fbd8805c1f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:08.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:08.114+0000 7fbda9829700 1 --2- 172.21.2.102:0/3785943950 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbda40b8ca0 0x7fbda4160860 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:08.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:08.114+0000 7fbda9829700 1 --2- 172.21.2.102:0/3785943950 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbda40676e0 0x7fbda4151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:08.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:08.114+0000 7fbda9829700 1 --2- 172.21.2.102:0/3785943950 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbda40b77d0 0x7fbda409c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:08.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:08.114+0000 7fbda9829700 1 -- 172.21.2.102:0/3785943950 >> 172.21.2.102:0/3785943950 conn(0x7fbda40bc400 msgr2=0x7fbda4147610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:08.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:08.114+0000 7fbda9829700 1 -- 172.21.2.102:0/3785943950 shutdown_connections 2021-02-12T17:23:08.115 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:08.114+0000 7fbda9829700 1 -- 172.21.2.102:0/3785943950 wait complete. 2021-02-12T17:23:08.116 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 50 2021-02-12T17:23:08.123 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:23:10.125 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:23:10.214 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.213+0000 7f0e9c33b700 1 Processor -- start 2021-02-12T17:23:10.214 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.213+0000 7f0e9c33b700 1 -- start start 2021-02-12T17:23:10.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.214+0000 7f0e9c33b700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f0e940b8d20 0x7f0e940681b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:10.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.214+0000 7f0e9c33b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0e94146400 0x7f0e94066aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:10.215 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.214+0000 7f0e9c33b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0e941477f0 0x7f0e941498f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:10.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.214+0000 7f0e9c33b700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e940686a0 con 0x7f0e941477f0 2021-02-12T17:23:10.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.214+0000 7f0e9c33b700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e94067290 con 0x7f0e940b8d20 2021-02-12T17:23:10.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.214+0000 7f0e9c33b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e94067530 con 0x7f0e94146400 2021-02-12T17:23:10.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.214+0000 7f0e9a8d8700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0e941477f0 0x7f0e941498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:10.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.214+0000 7f0e9a8d8700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0e941477f0 0x7f0e941498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47934/0 (socket says 172.21.2.102:47934) 2021-02-12T17:23:10.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.214+0000 7f0e9a8d8700 1 -- 172.21.2.102:0/516329947 learned_addr learned my addr 172.21.2.102:0/516329947 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:10.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9a8d8700 1 -- 172.21.2.102:0/516329947 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0e94146400 msgr2=0x7f0e94066aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:10.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9a8d8700 1 --2- 172.21.2.102:0/516329947 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0e94146400 0x7f0e94066aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:10.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9a8d8700 1 -- 172.21.2.102:0/516329947 >> v2:172.21.2.104:3300/0 conn(0x7f0e940b8d20 msgr2=0x7f0e940681b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:10.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9a8d8700 1 --2- 172.21.2.102:0/516329947 >> v2:172.21.2.104:3300/0 conn(0x7f0e940b8d20 0x7f0e940681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:10.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9a8d8700 1 -- 172.21.2.102:0/516329947 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e940677d0 con 0x7f0e941477f0 2021-02-12T17:23:10.216 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9a8d8700 1 --2- 172.21.2.102:0/516329947 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0e941477f0 0x7f0e941498f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f0e9406abc0 tx=0x7f0e8c009290).ready entity=mon.0 client_cookie=8f42ca7896ee9c1 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:10.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e990d5700 1 -- 172.21.2.102:0/516329947 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00bc80 con 0x7f0e941477f0 2021-02-12T17:23:10.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e990d5700 1 -- 172.21.2.102:0/516329947 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c00bde0 con 0x7f0e941477f0 2021-02-12T17:23:10.217 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e990d5700 1 -- 172.21.2.102:0/516329947 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c011610 con 0x7f0e941477f0 2021-02-12T17:23:10.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9c33b700 1 -- 172.21.2.102:0/516329947 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0e941477f0 msgr2=0x7f0e941498f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:10.218 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9c33b700 1 --2- 172.21.2.102:0/516329947 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0e941477f0 0x7f0e941498f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f0e9406abc0 tx=0x7f0e8c009290).stop 2021-02-12T17:23:10.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9c33b700 1 -- 172.21.2.102:0/516329947 shutdown_connections 2021-02-12T17:23:10.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9c33b700 1 --2- 172.21.2.102:0/516329947 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0e941477f0 0x7f0e941498f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:10.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9c33b700 1 --2- 172.21.2.102:0/516329947 >> v2:172.21.2.104:3300/0 conn(0x7f0e940b8d20 0x7f0e940681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:10.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9c33b700 1 --2- 172.21.2.102:0/516329947 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0e94146400 0x7f0e94066aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:10.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9c33b700 1 -- 172.21.2.102:0/516329947 >> 172.21.2.102:0/516329947 conn(0x7f0e940bc480 msgr2=0x7f0e940b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:10.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9c33b700 1 -- 172.21.2.102:0/516329947 shutdown_connections 2021-02-12T17:23:10.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.215+0000 7f0e9c33b700 1 -- 172.21.2.102:0/516329947 wait complete. 2021-02-12T17:23:10.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.216+0000 7f0e9c33b700 1 Processor -- start 2021-02-12T17:23:10.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.216+0000 7f0e9c33b700 1 -- start start 2021-02-12T17:23:10.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9c33b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0e940b8d20 0x7f0e94139b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:10.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9c33b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0e94146400 0x7f0e940b8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:10.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9c33b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0e941477f0 0x7f0e94145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:10.219 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9c33b700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e94137070 con 0x7f0e941477f0 2021-02-12T17:23:10.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9c33b700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e94137310 con 0x7f0e94146400 2021-02-12T17:23:10.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9c33b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e941375b0 con 0x7f0e940b8d20 2021-02-12T17:23:10.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9a8d8700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0e941477f0 0x7f0e94145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:10.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9a8d8700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0e941477f0 0x7f0e94145320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47944/0 (socket says 172.21.2.102:47944) 2021-02-12T17:23:10.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9a8d8700 1 -- 172.21.2.102:0/3067138146 learned_addr learned my addr 172.21.2.102:0/3067138146 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:10.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e998d6700 1 --2- 172.21.2.102:0/3067138146 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0e94146400 0x7f0e940b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:10.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9a8d8700 1 -- 172.21.2.102:0/3067138146 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0e940b8d20 msgr2=0x7f0e94139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:10.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9a8d8700 1 --2- 172.21.2.102:0/3067138146 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0e940b8d20 0x7f0e94139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:10.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9a8d8700 1 -- 172.21.2.102:0/3067138146 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0e94146400 msgr2=0x7f0e940b8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:10.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9a8d8700 1 --2- 172.21.2.102:0/3067138146 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0e94146400 0x7f0e940b8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:10.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9a8d8700 1 -- 172.21.2.102:0/3067138146 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e94137850 con 0x7f0e941477f0 2021-02-12T17:23:10.220 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9a8d8700 1 --2- 172.21.2.102:0/3067138146 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0e941477f0 0x7f0e94145320 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f0e8c0092d0 tx=0x7f0e8c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:10.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e867fc700 1 -- 172.21.2.102:0/3067138146 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c01f070 con 0x7f0e941477f0 2021-02-12T17:23:10.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e867fc700 1 -- 172.21.2.102:0/3067138146 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c009e60 con 0x7f0e941477f0 2021-02-12T17:23:10.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e9c33b700 1 -- 172.21.2.102:0/3067138146 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e940b8880 con 0x7f0e941477f0 2021-02-12T17:23:10.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.217+0000 7f0e867fc700 1 -- 172.21.2.102:0/3067138146 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c010e30 con 0x7f0e941477f0 2021-02-12T17:23:10.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.218+0000 7f0e9c33b700 1 -- 172.21.2.102:0/3067138146 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e94136210 con 0x7f0e941477f0 2021-02-12T17:23:10.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.218+0000 7f0e9c33b700 1 -- 172.21.2.102:0/3067138146 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e940bb7f0 con 0x7f0e941477f0 2021-02-12T17:23:10.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.218+0000 7f0e867fc700 1 -- 172.21.2.102:0/3067138146 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f0e8c00f070 con 0x7f0e941477f0 2021-02-12T17:23:10.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.219+0000 7f0e867fc700 1 --2- 172.21.2.102:0/3067138146 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0e74059d30 0x7f0e7405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:10.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.219+0000 7f0e867fc700 1 -- 172.21.2.102:0/3067138146 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7537+0+0 (secure 0 0 0) 0x7f0e8c075d00 con 0x7f0e941477f0 2021-02-12T17:23:10.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.219+0000 7f0e9a0d7700 1 --2- 172.21.2.102:0/3067138146 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0e74059d30 0x7f0e7405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:10.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.219+0000 7f0e9a0d7700 1 --2- 172.21.2.102:0/3067138146 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0e74059d30 0x7f0e7405c1f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f0e94138da0 tx=0x7f0e88006a70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:10.222 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.222+0000 7f0e867fc700 1 -- 172.21.2.102:0/3067138146 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f0e8c049150 con 0x7f0e941477f0 2021-02-12T17:23:10.382 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.381+0000 7f0e9c33b700 1 -- 172.21.2.102:0/3067138146 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e94045460 con 0x7f0e941477f0 2021-02-12T17:23:10.383 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.382+0000 7f0e867fc700 1 -- 172.21.2.102:0/3067138146 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3758 (secure 0 0 0) 0x7f0e8c04c770 con 0x7f0e941477f0 2021-02-12T17:23:10.383 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:23:10.383 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":34571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":50}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:21:24.488481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":13,"addr":"172.21.2.102:6837/2121955587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":2121955587},{"type":"v1","addr":"172.21.2.102:6837","nonce":2121955587}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:23:10.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.383+0000 7f0e9c33b700 1 -- 172.21.2.102:0/3067138146 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0e74059d30 msgr2=0x7f0e7405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:10.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.383+0000 7f0e9c33b700 1 --2- 172.21.2.102:0/3067138146 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0e74059d30 0x7f0e7405c1f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f0e94138da0 tx=0x7f0e88006a70).stop 2021-02-12T17:23:10.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.383+0000 7f0e9c33b700 1 -- 172.21.2.102:0/3067138146 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0e941477f0 msgr2=0x7f0e94145320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:10.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.383+0000 7f0e9c33b700 1 --2- 172.21.2.102:0/3067138146 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0e941477f0 0x7f0e94145320 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f0e8c0092d0 tx=0x7f0e8c017000).stop 2021-02-12T17:23:10.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.383+0000 7f0e9c33b700 1 -- 172.21.2.102:0/3067138146 shutdown_connections 2021-02-12T17:23:10.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.383+0000 7f0e9c33b700 1 --2- 172.21.2.102:0/3067138146 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0e74059d30 0x7f0e7405c1f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:10.384 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.383+0000 7f0e9c33b700 1 --2- 172.21.2.102:0/3067138146 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0e941477f0 0x7f0e94145320 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:10.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.383+0000 7f0e9c33b700 1 --2- 172.21.2.102:0/3067138146 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0e940b8d20 0x7f0e94139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:10.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.383+0000 7f0e9c33b700 1 --2- 172.21.2.102:0/3067138146 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0e94146400 0x7f0e940b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:10.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.383+0000 7f0e9c33b700 1 -- 172.21.2.102:0/3067138146 >> 172.21.2.102:0/3067138146 conn(0x7f0e940bc480 msgr2=0x7f0e94148650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:10.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.383+0000 7f0e9c33b700 1 -- 172.21.2.102:0/3067138146 shutdown_connections 2021-02-12T17:23:10.385 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:10.383+0000 7f0e9c33b700 1 -- 172.21.2.102:0/3067138146 wait complete. 2021-02-12T17:23:10.385 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 50 2021-02-12T17:23:10.392 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:23:11.220 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:23:11.223 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:23:12.394 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:23:12.482 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.481+0000 7f8bbfb34700 1 Processor -- start 2021-02-12T17:23:12.482 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.482+0000 7f8bbfb34700 1 -- start start 2021-02-12T17:23:12.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.482+0000 7f8bbfb34700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f8bb80b8d20 0x7f8bb8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:12.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.482+0000 7f8bbfb34700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8bb8062740 0x7f8bb8062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:12.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.482+0000 7f8bbfb34700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb80b7960 con 0x7f8bb814e530 2021-02-12T17:23:12.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.482+0000 7f8bbfb34700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb8068d20 con 0x7f8bb80b8d20 2021-02-12T17:23:12.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.482+0000 7f8bbfb34700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80622a0 con 0x7f8bb8062740 2021-02-12T17:23:12.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.482+0000 7f8bbd8d0700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f8bb80b8d20 0x7f8bb8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:12.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.482+0000 7f8bbd8d0700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f8bb80b8d20 0x7f8bb8068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47950/0 (socket says 172.21.2.102:47950) 2021-02-12T17:23:12.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.482+0000 7f8bbd8d0700 1 -- 172.21.2.102:0/1200707931 learned_addr learned my addr 172.21.2.102:0/1200707931 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:12.484 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbd8d0700 1 -- 172.21.2.102:0/1200707931 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8bb8062740 msgr2=0x7f8bb8062bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:23:12.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbd8d0700 1 --2- 172.21.2.102:0/1200707931 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8bb8062740 0x7f8bb8062bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:12.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbd8d0700 1 -- 172.21.2.102:0/1200707931 >> v1:172.21.2.104:6789/0 conn(0x7f8bb814e530 legacy=0x7f8bb80b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:23:12.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbd8d0700 1 -- 172.21.2.102:0/1200707931 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb814ea10 con 0x7f8bb80b8d20 2021-02-12T17:23:12.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbd8d0700 1 --2- 172.21.2.102:0/1200707931 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8bb80b8d20 0x7f8bb8068830 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f8bac00b9e0 tx=0x7f8bac006ea0).ready entity=mon.0 client_cookie=cb08c6282df32050 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:12.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbc8ce700 1 -- 172.21.2.102:0/1200707931 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac009800 con 0x7f8bb80b8d20 2021-02-12T17:23:12.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbc8ce700 1 -- 172.21.2.102:0/1200707931 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac009960 con 0x7f8bb80b8d20 2021-02-12T17:23:12.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbc8ce700 1 -- 172.21.2.102:0/1200707931 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac009ce0 con 0x7f8bb80b8d20 2021-02-12T17:23:12.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1200707931 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8bb80b8d20 msgr2=0x7f8bb8068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:12.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbfb34700 1 --2- 172.21.2.102:0/1200707931 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8bb80b8d20 0x7f8bb8068830 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f8bac00b9e0 tx=0x7f8bac006ea0).stop 2021-02-12T17:23:12.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1200707931 shutdown_connections 2021-02-12T17:23:12.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbfb34700 1 --2- 172.21.2.102:0/1200707931 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8bb8062740 0x7f8bb8062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:12.485 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbfb34700 1 --2- 172.21.2.102:0/1200707931 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8bb80b8d20 0x7f8bb8068830 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:12.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1200707931 >> 172.21.2.102:0/1200707931 conn(0x7f8bb80bc480 msgr2=0x7f8bb80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:12.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1200707931 shutdown_connections 2021-02-12T17:23:12.486 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.483+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1200707931 wait complete. 2021-02-12T17:23:12.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.484+0000 7f8bbfb34700 1 Processor -- start 2021-02-12T17:23:12.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.484+0000 7f8bbfb34700 1 -- start start 2021-02-12T17:23:12.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.484+0000 7f8bbfb34700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8bb8062740 0x7f8bb80acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:12.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbfb34700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8bb80b8d20 0x7f8bb80ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:12.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbfb34700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8bb814e530 0x7f8bb80b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:12.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbfb34700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80af760 con 0x7f8bb814e530 2021-02-12T17:23:12.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbfb34700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb815d980 con 0x7f8bb8062740 2021-02-12T17:23:12.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbfb34700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb815dc20 con 0x7f8bb80b8d20 2021-02-12T17:23:12.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbe0d1700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8bb814e530 0x7f8bb80b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:12.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbe0d1700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8bb814e530 0x7f8bb80b4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47960/0 (socket says 172.21.2.102:47960) 2021-02-12T17:23:12.488 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbe0d1700 1 -- 172.21.2.102:0/1570469594 learned_addr learned my addr 172.21.2.102:0/1570469594 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:12.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbe0d1700 1 -- 172.21.2.102:0/1570469594 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8bb80b8d20 msgr2=0x7f8bb80ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:12.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbe0d1700 1 --2- 172.21.2.102:0/1570469594 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8bb80b8d20 0x7f8bb80ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:12.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbe0d1700 1 -- 172.21.2.102:0/1570469594 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8bb8062740 msgr2=0x7f8bb80acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:12.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbe0d1700 1 --2- 172.21.2.102:0/1570469594 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8bb8062740 0x7f8bb80acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:12.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbe0d1700 1 -- 172.21.2.102:0/1570469594 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb815dec0 con 0x7f8bb814e530 2021-02-12T17:23:12.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbe0d1700 1 --2- 172.21.2.102:0/1570469594 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8bb814e530 0x7f8bb80b4a70 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f8bb000bae0 tx=0x7f8bb00091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:12.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8ba9ffb700 1 -- 172.21.2.102:0/1570469594 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000c880 con 0x7f8bb814e530 2021-02-12T17:23:12.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8ba9ffb700 1 -- 172.21.2.102:0/1570469594 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb000ca20 con 0x7f8bb814e530 2021-02-12T17:23:12.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1570469594 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb815e160 con 0x7f8bb814e530 2021-02-12T17:23:12.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.485+0000 7f8ba9ffb700 1 -- 172.21.2.102:0/1570469594 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000cbd0 con 0x7f8bb814e530 2021-02-12T17:23:12.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.486+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1570469594 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb80b4f60 con 0x7f8bb814e530 2021-02-12T17:23:12.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.486+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1570469594 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb80b77a0 con 0x7f8bb814e530 2021-02-12T17:23:12.489 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.486+0000 7f8ba9ffb700 1 -- 172.21.2.102:0/1570469594 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f8bb001c070 con 0x7f8bb814e530 2021-02-12T17:23:12.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.487+0000 7f8ba9ffb700 1 --2- 172.21.2.102:0/1570469594 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8b98059d30 0x7f8b9805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:12.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.487+0000 7f8ba9ffb700 1 -- 172.21.2.102:0/1570469594 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7f8bb00737e0 con 0x7f8bb814e530 2021-02-12T17:23:12.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.487+0000 7f8bbd8d0700 1 --2- 172.21.2.102:0/1570469594 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8b98059d30 0x7f8b9805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:12.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.487+0000 7f8bbd8d0700 1 --2- 172.21.2.102:0/1570469594 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8b98059d30 0x7f8b9805c1f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f8bac00b190 tx=0x7f8bac016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:12.490 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.490+0000 7f8ba9ffb700 1 -- 172.21.2.102:0/1570469594 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f8bb0046d10 con 0x7f8bb814e530 2021-02-12T17:23:12.647 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.647+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1570469594 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bb815e5c0 con 0x7f8bb814e530 2021-02-12T17:23:12.648 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.647+0000 7f8ba9ffb700 1 -- 172.21.2.102:0/1570469594 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+3410 (secure 0 0 0) 0x7f8bb004a330 con 0x7f8bb814e530 2021-02-12T17:23:12.648 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:23:12.648 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:12.344137+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:reconnect","state_seq":10,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:23:12.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.648+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1570469594 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8b98059d30 msgr2=0x7f8b9805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:12.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.648+0000 7f8bbfb34700 1 --2- 172.21.2.102:0/1570469594 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8b98059d30 0x7f8b9805c1f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f8bac00b190 tx=0x7f8bac016000).stop 2021-02-12T17:23:12.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.648+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1570469594 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8bb814e530 msgr2=0x7f8bb80b4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:12.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.648+0000 7f8bbfb34700 1 --2- 172.21.2.102:0/1570469594 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8bb814e530 0x7f8bb80b4a70 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f8bb000bae0 tx=0x7f8bb00091a0).stop 2021-02-12T17:23:12.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.648+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1570469594 shutdown_connections 2021-02-12T17:23:12.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.648+0000 7f8bbfb34700 1 --2- 172.21.2.102:0/1570469594 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8b98059d30 0x7f8b9805c1f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:12.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.648+0000 7f8bbfb34700 1 --2- 172.21.2.102:0/1570469594 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8bb814e530 0x7f8bb80b4a70 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:12.649 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.648+0000 7f8bbfb34700 1 --2- 172.21.2.102:0/1570469594 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8bb8062740 0x7f8bb80acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:12.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.648+0000 7f8bbfb34700 1 --2- 172.21.2.102:0/1570469594 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8bb80b8d20 0x7f8bb80ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:12.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.648+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1570469594 >> 172.21.2.102:0/1570469594 conn(0x7f8bb80bc480 msgr2=0x7f8bb80b6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:12.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.648+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1570469594 shutdown_connections 2021-02-12T17:23:12.650 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.648+0000 7f8bbfb34700 1 -- 172.21.2.102:0/1570469594 wait complete. 2021-02-12T17:23:12.650 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 52 2021-02-12T17:23:12.658 INFO:tasks.mds_thrash.fs.[a]:mds.c down, removed from mdsmap 2021-02-12T17:23:12.658 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2021-02-12T17:23:12.658 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:23:12.747 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.746+0000 7febce67e700 1 Processor -- start 2021-02-12T17:23:12.747 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.746+0000 7febce67e700 1 -- start start 2021-02-12T17:23:12.747 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.746+0000 7febce67e700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7febc80b8d20 0x7febc8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:12.747 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.746+0000 7febce67e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febc8062740 0x7febc8062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:12.747 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.746+0000 7febce67e700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc80b7960 con 0x7febc814e530 2021-02-12T17:23:12.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.746+0000 7febce67e700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc8068d20 con 0x7febc80b8d20 2021-02-12T17:23:12.748 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.746+0000 7febce67e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc80622a0 con 0x7febc8062740 2021-02-12T17:23:12.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.748+0000 7febc7fff700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7febc80b8d20 0x7febc8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:12.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.748+0000 7febc77fe700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7febc814e530 0x7febc80b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:38982/0 (socket says 172.21.2.102:38982) 2021-02-12T17:23:12.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.748+0000 7febc77fe700 1 -- 172.21.2.102:0/3891246052 learned_addr learned my addr 172.21.2.102:0/3891246052 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:23:12.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.748+0000 7febccc1b700 1 --2- 172.21.2.102:0/3891246052 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febc8062740 0x7febc8062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:12.750 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.748+0000 7febc7fff700 1 -- 172.21.2.102:0/3891246052 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febc8062740 msgr2=0x7febc8062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:12.750 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.748+0000 7febc7fff700 1 --2- 172.21.2.102:0/3891246052 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febc8062740 0x7febc8062bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:12.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.748+0000 7febc7fff700 1 -- 172.21.2.102:0/3891246052 >> v1:172.21.2.104:6789/0 conn(0x7febc814e530 legacy=0x7febc80b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:12.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.748+0000 7febc7fff700 1 -- 172.21.2.102:0/3891246052 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc814ea10 con 0x7febc80b8d20 2021-02-12T17:23:12.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.749+0000 7febc7fff700 1 --2- 172.21.2.102:0/3891246052 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febc80b8d20 0x7febc8068830 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7febb800b980 tx=0x7febb8006de0).ready entity=mon.1 client_cookie=bef007b10554dedb server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:12.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.749+0000 7febc6ffd700 1 -- 172.21.2.102:0/3891246052 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800be70 con 0x7febc80b8d20 2021-02-12T17:23:12.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.749+0000 7febc6ffd700 1 -- 172.21.2.102:0/3891246052 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb80097e0 con 0x7febc80b8d20 2021-02-12T17:23:12.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.749+0000 7febc6ffd700 1 -- 172.21.2.102:0/3891246052 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb8009b60 con 0x7febc80b8d20 2021-02-12T17:23:12.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.749+0000 7febce67e700 1 -- 172.21.2.102:0/3891246052 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febc80b8d20 msgr2=0x7febc8068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:12.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.749+0000 7febce67e700 1 --2- 172.21.2.102:0/3891246052 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febc80b8d20 0x7febc8068830 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7febb800b980 tx=0x7febb8006de0).stop 2021-02-12T17:23:12.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.749+0000 7febce67e700 1 -- 172.21.2.102:0/3891246052 shutdown_connections 2021-02-12T17:23:12.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.749+0000 7febce67e700 1 --2- 172.21.2.102:0/3891246052 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febc8062740 0x7febc8062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:12.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.749+0000 7febce67e700 1 --2- 172.21.2.102:0/3891246052 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febc80b8d20 0x7febc8068830 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:12.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.749+0000 7febce67e700 1 -- 172.21.2.102:0/3891246052 >> 172.21.2.102:0/3891246052 conn(0x7febc80bc480 msgr2=0x7febc80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:12.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.749+0000 7febce67e700 1 -- 172.21.2.102:0/3891246052 shutdown_connections 2021-02-12T17:23:12.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.749+0000 7febce67e700 1 -- 172.21.2.102:0/3891246052 wait complete. 2021-02-12T17:23:12.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.750+0000 7febce67e700 1 Processor -- start 2021-02-12T17:23:12.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.750+0000 7febce67e700 1 -- start start 2021-02-12T17:23:12.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febce67e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febc8062740 0x7febc811d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:12.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febce67e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febc80b8d20 0x7febc811dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:12.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febce67e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febc814e530 0x7febc814ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:12.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febce67e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc80af490 con 0x7febc80b8d20 2021-02-12T17:23:12.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febce67e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc814a8d0 con 0x7febc814e530 2021-02-12T17:23:12.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febce67e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc80afef0 con 0x7febc8062740 2021-02-12T17:23:12.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febc77fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febc80b8d20 0x7febc811dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:12.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febc77fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febc80b8d20 0x7febc811dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47974/0 (socket says 172.21.2.102:47974) 2021-02-12T17:23:12.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febc77fe700 1 -- 172.21.2.102:0/3853331184 learned_addr learned my addr 172.21.2.102:0/3853331184 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:12.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febccc1b700 1 --2- 172.21.2.102:0/3853331184 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febc814e530 0x7febc814ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:12.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febc7fff700 1 --2- 172.21.2.102:0/3853331184 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febc8062740 0x7febc811d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:12.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febc77fe700 1 -- 172.21.2.102:0/3853331184 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febc8062740 msgr2=0x7febc811d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:12.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febc77fe700 1 --2- 172.21.2.102:0/3853331184 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febc8062740 0x7febc811d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:12.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febc77fe700 1 -- 172.21.2.102:0/3853331184 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febc814e530 msgr2=0x7febc814ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:12.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febc77fe700 1 --2- 172.21.2.102:0/3853331184 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febc814e530 0x7febc814ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:12.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febc77fe700 1 -- 172.21.2.102:0/3853331184 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc814c440 con 0x7febc80b8d20 2021-02-12T17:23:12.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febc77fe700 1 --2- 172.21.2.102:0/3853331184 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febc80b8d20 0x7febc811dad0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7febb000c710 tx=0x7febb0007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:12.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febbffff700 1 -- 172.21.2.102:0/3853331184 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb00072e0 con 0x7febc80b8d20 2021-02-12T17:23:12.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febbffff700 1 -- 172.21.2.102:0/3853331184 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb0007440 con 0x7febc80b8d20 2021-02-12T17:23:12.755 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febce67e700 1 -- 172.21.2.102:0/3853331184 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc815e430 con 0x7febc80b8d20 2021-02-12T17:23:12.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.751+0000 7febbffff700 1 -- 172.21.2.102:0/3853331184 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb00057f0 con 0x7febc80b8d20 2021-02-12T17:23:12.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.752+0000 7febce67e700 1 -- 172.21.2.102:0/3853331184 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc80af960 con 0x7febc80b8d20 2021-02-12T17:23:12.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.752+0000 7febce67e700 1 -- 172.21.2.102:0/3853331184 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc814aa40 con 0x7febc80b8d20 2021-02-12T17:23:12.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.752+0000 7febbffff700 1 -- 172.21.2.102:0/3853331184 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7febb001a060 con 0x7febc80b8d20 2021-02-12T17:23:12.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.753+0000 7febbffff700 1 --2- 172.21.2.102:0/3853331184 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7febac059d30 0x7febac05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:12.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.753+0000 7febbffff700 1 -- 172.21.2.102:0/3853331184 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7febb0073740 con 0x7febc80b8d20 2021-02-12T17:23:12.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.753+0000 7febc7fff700 1 --2- 172.21.2.102:0/3853331184 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7febac059d30 0x7febac05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:12.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.753+0000 7febc7fff700 1 --2- 172.21.2.102:0/3853331184 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7febac059d30 0x7febac05c1f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7febb8006e20 tx=0x7febb8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:12.757 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.755+0000 7febbffff700 1 -- 172.21.2.102:0/3853331184 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7febc814aa40 con 0x7febc80b8d20 2021-02-12T17:23:12.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.911+0000 7febce67e700 1 -- 172.21.2.102:0/3853331184 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febc814aa40 con 0x7febc80b8d20 2021-02-12T17:23:12.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.912+0000 7febbffff700 1 -- 172.21.2.102:0/3853331184 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+3410 (secure 0 0 0) 0x7febc814aa40 con 0x7febc80b8d20 2021-02-12T17:23:12.913 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:23:12.913 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:12.344137+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:reconnect","state_seq":10,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:23:12.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.913+0000 7febce67e700 1 -- 172.21.2.102:0/3853331184 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7febac059d30 msgr2=0x7febac05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:12.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.913+0000 7febce67e700 1 --2- 172.21.2.102:0/3853331184 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7febac059d30 0x7febac05c1f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7febb8006e20 tx=0x7febb8016000).stop 2021-02-12T17:23:12.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.913+0000 7febce67e700 1 -- 172.21.2.102:0/3853331184 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febc80b8d20 msgr2=0x7febc811dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:12.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.913+0000 7febce67e700 1 --2- 172.21.2.102:0/3853331184 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febc80b8d20 0x7febc811dad0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7febb000c710 tx=0x7febb0007c90).stop 2021-02-12T17:23:12.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.913+0000 7febce67e700 1 -- 172.21.2.102:0/3853331184 shutdown_connections 2021-02-12T17:23:12.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.913+0000 7febce67e700 1 --2- 172.21.2.102:0/3853331184 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7febc814e530 0x7febc814ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:12.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.913+0000 7febce67e700 1 --2- 172.21.2.102:0/3853331184 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7febc8062740 0x7febc811d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:12.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.913+0000 7febce67e700 1 --2- 172.21.2.102:0/3853331184 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7febac059d30 0x7febac05c1f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:12.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.913+0000 7febce67e700 1 --2- 172.21.2.102:0/3853331184 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7febc80b8d20 0x7febc811dad0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:12.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.913+0000 7febce67e700 1 -- 172.21.2.102:0/3853331184 >> 172.21.2.102:0/3853331184 conn(0x7febc80bc480 msgr2=0x7febc8062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:12.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.913+0000 7febce67e700 1 -- 172.21.2.102:0/3853331184 shutdown_connections 2021-02-12T17:23:12.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:12.913+0000 7febce67e700 1 -- 172.21.2.102:0/3853331184 wait complete. 2021-02-12T17:23:12.915 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 52 2021-02-12T17:23:12.923 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 52, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:01.991560+0000", "damaged": [], "data_pools": [ 4 ], "enabled": true, "epoch": 52, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "a", "in": [ 0 ], "info": { "gid_34571": { "addr": "172.21.2.104:6835/973150871", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6833", "nonce": 973150871, "type": "v2" }, { "addr": "172.21.2.104:6835", "nonce": 973150871, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 34571, "incarnation": 51, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:reconnect", "state_seq": 10 } }, "last_failure": 0, "last_failure_osd_epoch": 36, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2021-02-12T17:23:12.344137+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 34571 } } }, { "id": 2, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:08.529588+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 49, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "b", "in": [ 0 ], "info": { "gid_5625": { "addr": "172.21.2.102:6835/2467742327", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6834", "nonce": 2467742327, "type": "v2" }, { "addr": "172.21.2.102:6835", "nonce": 2467742327, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5625, "incarnation": 46, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 35, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 5, "modified": "2021-02-12T17:22:34.342390+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5625 } } } ], "standbys": [ { "addr": "172.21.2.104:6834/3149030842", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6832", "nonce": 3149030842, "type": "v2" }, { "addr": "172.21.2.104:6834", "nonce": 3149030842, "type": "v1" } ] }, "epoch": 5, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4243, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 2 } ] } 2021-02-12T17:23:14.924 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:23:15.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.012+0000 7f80781ee700 1 Processor -- start 2021-02-12T17:23:15.013 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.012+0000 7f80781ee700 1 -- start start 2021-02-12T17:23:15.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.013+0000 7f80781ee700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f807014e530 0x7f8070068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:15.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.013+0000 7f80781ee700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80700b7960 con 0x7f80700b8d20 2021-02-12T17:23:15.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.013+0000 7f80781ee700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80700622a0 con 0x7f8070062740 2021-02-12T17:23:15.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.013+0000 7f80781ee700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8070068d20 con 0x7f807014e530 2021-02-12T17:23:15.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.013+0000 7f8075789700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f807014e530 0x7f8070068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:15.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.013+0000 7f8075789700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f807014e530 0x7f8070068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47980/0 (socket says 172.21.2.102:47980) 2021-02-12T17:23:15.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.013+0000 7f8075789700 1 -- 172.21.2.102:0/125069563 learned_addr learned my addr 172.21.2.102:0/125069563 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:15.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.013+0000 7f8075789700 1 -- 172.21.2.102:0/125069563 >> v1:172.21.2.104:6789/0 conn(0x7f8070062740 legacy=0x7f8070062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:23:15.014 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.013+0000 7f8075789700 1 -- 172.21.2.102:0/125069563 >> v1:172.21.2.102:6789/0 conn(0x7f80700b8d20 legacy=0x7f80700b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:15.015 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.013+0000 7f8075789700 1 -- 172.21.2.102:0/125069563 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807014ea10 con 0x7f807014e530 2021-02-12T17:23:15.015 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.013+0000 7f8075789700 1 --2- 172.21.2.102:0/125069563 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f807014e530 0x7f8070068830 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f806c00b9e0 tx=0x7f806c006ea0).ready entity=mon.0 client_cookie=166b953208720f1a server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:15.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.014+0000 7f8074f88700 1 -- 172.21.2.102:0/125069563 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c009800 con 0x7f807014e530 2021-02-12T17:23:15.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.014+0000 7f8074f88700 1 -- 172.21.2.102:0/125069563 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c009960 con 0x7f807014e530 2021-02-12T17:23:15.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.014+0000 7f8074f88700 1 -- 172.21.2.102:0/125069563 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c009ce0 con 0x7f807014e530 2021-02-12T17:23:15.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.014+0000 7f80781ee700 1 -- 172.21.2.102:0/125069563 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f807014e530 msgr2=0x7f8070068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:15.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.014+0000 7f80781ee700 1 --2- 172.21.2.102:0/125069563 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f807014e530 0x7f8070068830 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f806c00b9e0 tx=0x7f806c006ea0).stop 2021-02-12T17:23:15.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.014+0000 7f80781ee700 1 -- 172.21.2.102:0/125069563 shutdown_connections 2021-02-12T17:23:15.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.014+0000 7f80781ee700 1 --2- 172.21.2.102:0/125069563 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f807014e530 0x7f8070068830 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:15.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.014+0000 7f80781ee700 1 -- 172.21.2.102:0/125069563 >> 172.21.2.102:0/125069563 conn(0x7f80700bc480 msgr2=0x7f80700b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:15.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.014+0000 7f80781ee700 1 -- 172.21.2.102:0/125069563 shutdown_connections 2021-02-12T17:23:15.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.014+0000 7f80781ee700 1 -- 172.21.2.102:0/125069563 wait complete. 2021-02-12T17:23:15.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.015+0000 7f80781ee700 1 Processor -- start 2021-02-12T17:23:15.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.015+0000 7f80781ee700 1 -- start start 2021-02-12T17:23:15.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.015+0000 7f80781ee700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8070062740 0x7f80700ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:15.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.015+0000 7f80781ee700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f80700b8d20 0x7f807015e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:15.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.015+0000 7f80781ee700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f807014e530 0x7f80700b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:15.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.015+0000 7f80781ee700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80700b1b00 con 0x7f8070062740 2021-02-12T17:23:15.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.015+0000 7f80781ee700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807015d9e0 con 0x7f807014e530 2021-02-12T17:23:15.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.015+0000 7f80781ee700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80700af8c0 con 0x7f80700b8d20 2021-02-12T17:23:15.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.016+0000 7f8075f8a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8070062740 0x7f80700ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:15.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.016+0000 7f8075f8a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8070062740 0x7f80700ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:47986/0 (socket says 172.21.2.102:47986) 2021-02-12T17:23:15.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.016+0000 7f8075f8a700 1 -- 172.21.2.102:0/1914167683 learned_addr learned my addr 172.21.2.102:0/1914167683 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:15.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.016+0000 7f8075f8a700 1 -- 172.21.2.102:0/1914167683 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f80700b8d20 msgr2=0x7f807015e5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:23:15.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.016+0000 7f8075f8a700 1 --2- 172.21.2.102:0/1914167683 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f80700b8d20 0x7f807015e5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:15.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.016+0000 7f8075f8a700 1 -- 172.21.2.102:0/1914167683 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f807014e530 msgr2=0x7f80700b51e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:23:15.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.016+0000 7f8075f8a700 1 --2- 172.21.2.102:0/1914167683 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f807014e530 0x7f80700b51e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:15.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.016+0000 7f8075f8a700 1 -- 172.21.2.102:0/1914167683 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807015dc00 con 0x7f8070062740 2021-02-12T17:23:15.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.016+0000 7f8075f8a700 1 --2- 172.21.2.102:0/1914167683 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8070062740 0x7f80700ae750 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f806400c710 tx=0x7f8064007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:15.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.016+0000 7f8061ffb700 1 -- 172.21.2.102:0/1914167683 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806400e4a0 con 0x7f8070062740 2021-02-12T17:23:15.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.016+0000 7f8061ffb700 1 -- 172.21.2.102:0/1914167683 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806400e600 con 0x7f8070062740 2021-02-12T17:23:15.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.016+0000 7f80781ee700 1 -- 172.21.2.102:0/1914167683 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807015dea0 con 0x7f8070062740 2021-02-12T17:23:15.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.016+0000 7f8061ffb700 1 -- 172.21.2.102:0/1914167683 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806400e9a0 con 0x7f8070062740 2021-02-12T17:23:15.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.016+0000 7f80781ee700 1 -- 172.21.2.102:0/1914167683 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80700ae400 con 0x7f8070062740 2021-02-12T17:23:15.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.017+0000 7f80781ee700 1 -- 172.21.2.102:0/1914167683 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807015e030 con 0x7f8070062740 2021-02-12T17:23:15.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.017+0000 7f8061ffb700 1 -- 172.21.2.102:0/1914167683 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f8064019030 con 0x7f8070062740 2021-02-12T17:23:15.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.017+0000 7f8061ffb700 1 --2- 172.21.2.102:0/1914167683 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8050059d30 0x7f805005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:15.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.018+0000 7f8061ffb700 1 -- 172.21.2.102:0/1914167683 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7f8064073570 con 0x7f8070062740 2021-02-12T17:23:15.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.018+0000 7f8075789700 1 --2- 172.21.2.102:0/1914167683 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8050059d30 0x7f805005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:15.021 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.018+0000 7f8075789700 1 --2- 172.21.2.102:0/1914167683 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8050059d30 0x7f805005c1f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f806c00b9e0 tx=0x7f806c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:15.021 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.020+0000 7f8061ffb700 1 -- 172.21.2.102:0/1914167683 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f8064046aa0 con 0x7f8070062740 2021-02-12T17:23:15.181 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.181+0000 7f80781ee700 1 -- 172.21.2.102:0/1914167683 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8070045460 con 0x7f8070062740 2021-02-12T17:23:15.182 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.181+0000 7f8061ffb700 1 -- 172.21.2.102:0/1914167683 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+3407 (secure 0 0 0) 0x7f8064017090 con 0x7f8070062740 2021-02-12T17:23:15.182 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:23:15.182 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":54,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:23:15.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.182+0000 7f80781ee700 1 -- 172.21.2.102:0/1914167683 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8050059d30 msgr2=0x7f805005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:15.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.182+0000 7f80781ee700 1 --2- 172.21.2.102:0/1914167683 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8050059d30 0x7f805005c1f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f806c00b9e0 tx=0x7f806c016000).stop 2021-02-12T17:23:15.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.182+0000 7f80781ee700 1 -- 172.21.2.102:0/1914167683 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8070062740 msgr2=0x7f80700ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:15.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.182+0000 7f80781ee700 1 --2- 172.21.2.102:0/1914167683 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8070062740 0x7f80700ae750 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f806400c710 tx=0x7f8064007c00).stop 2021-02-12T17:23:15.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.182+0000 7f80781ee700 1 -- 172.21.2.102:0/1914167683 shutdown_connections 2021-02-12T17:23:15.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.182+0000 7f80781ee700 1 --2- 172.21.2.102:0/1914167683 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f807014e530 0x7f80700b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:15.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.182+0000 7f80781ee700 1 --2- 172.21.2.102:0/1914167683 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8050059d30 0x7f805005c1f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:15.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.182+0000 7f80781ee700 1 --2- 172.21.2.102:0/1914167683 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f8070062740 0x7f80700ae750 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:15.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.182+0000 7f80781ee700 1 --2- 172.21.2.102:0/1914167683 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f80700b8d20 0x7f807015e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:15.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.182+0000 7f80781ee700 1 -- 172.21.2.102:0/1914167683 >> 172.21.2.102:0/1914167683 conn(0x7f80700bc480 msgr2=0x7f80700b7250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:15.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.182+0000 7f80781ee700 1 -- 172.21.2.102:0/1914167683 shutdown_connections 2021-02-12T17:23:15.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:15.182+0000 7f80781ee700 1 -- 172.21.2.102:0/1914167683 wait complete. 2021-02-12T17:23:15.184 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 54 2021-02-12T17:23:15.191 INFO:tasks.mds_thrash.fs.[a]:mds.d has gained rank=0, replacing gid=5451 2021-02-12T17:23:15.192 INFO:tasks.mds_thrash.fs.[a]:waiting for 5 secs before reviving mds.c 2021-02-12T17:23:17.344 INFO:tasks.ceph.mds.d.gibba004.stderr:2021-02-12T17:23:17.343+0000 7f11f43ff700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-02-12T17:23:20.193 INFO:tasks.mds_thrash.fs.[a]:reviving mds.c 2021-02-12T17:23:20.193 INFO:tasks.ceph.mds.c:Restarting daemon 2021-02-12T17:23:20.193 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-02-12T17:23:20.196 INFO:tasks.ceph.mds.c:Started 2021-02-12T17:23:20.197 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:23:20.251 INFO:tasks.ceph.mds.c.gibba002.stdout:starting mds.c at 2021-02-12T17:23:20.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.286+0000 7f234e7ae700 1 Processor -- start 2021-02-12T17:23:20.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.286+0000 7f234e7ae700 1 -- start start 2021-02-12T17:23:20.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.286+0000 7f234e7ae700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f23480b3e90 0x7f23480b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:20.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.286+0000 7f234e7ae700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f2348145a50 0x7f234809d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:20.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.286+0000 7f234e7ae700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23480b4f50 con 0x7f234809dca0 2021-02-12T17:23:20.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.286+0000 7f234e7ae700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23480b3760 con 0x7f23480b3e90 2021-02-12T17:23:20.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.286+0000 7f234e7ae700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23480b51f0 con 0x7f2348145a50 2021-02-12T17:23:20.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.287+0000 7f234d7ac700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f23480b3e90 0x7f23480b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:20.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.287+0000 7f234d7ac700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f23480b3e90 0x7f23480b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48002/0 (socket says 172.21.2.102:48002) 2021-02-12T17:23:20.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.287+0000 7f234d7ac700 1 -- 172.21.2.102:0/2950600254 learned_addr learned my addr 172.21.2.102:0/2950600254 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:20.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.287+0000 7f234d7ac700 1 -- 172.21.2.102:0/2950600254 >> v2:172.21.2.104:3300/0 conn(0x7f2348145a50 msgr2=0x7f234809d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:20.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.287+0000 7f234d7ac700 1 --2- 172.21.2.102:0/2950600254 >> v2:172.21.2.104:3300/0 conn(0x7f2348145a50 0x7f234809d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:20.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.287+0000 7f234d7ac700 1 -- 172.21.2.102:0/2950600254 >> v1:172.21.2.104:6789/0 conn(0x7f234809dca0 legacy=0x7f23480b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:20.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.287+0000 7f234d7ac700 1 -- 172.21.2.102:0/2950600254 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23480b5490 con 0x7f23480b3e90 2021-02-12T17:23:20.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.287+0000 7f234d7ac700 1 --2- 172.21.2.102:0/2950600254 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f23480b3e90 0x7f23480b49b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f23480b5fc0 tx=0x7f2344006ea0).ready entity=mon.0 client_cookie=f5f290f5b84f9787 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:20.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.287+0000 7f2337fff700 1 -- 172.21.2.102:0/2950600254 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2344009800 con 0x7f23480b3e90 2021-02-12T17:23:20.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.287+0000 7f2337fff700 1 -- 172.21.2.102:0/2950600254 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2344009960 con 0x7f23480b3e90 2021-02-12T17:23:20.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.287+0000 7f2337fff700 1 -- 172.21.2.102:0/2950600254 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2344009ce0 con 0x7f23480b3e90 2021-02-12T17:23:20.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.288+0000 7f234e7ae700 1 -- 172.21.2.102:0/2950600254 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f23480b3e90 msgr2=0x7f23480b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:20.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.288+0000 7f234e7ae700 1 --2- 172.21.2.102:0/2950600254 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f23480b3e90 0x7f23480b49b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f23480b5fc0 tx=0x7f2344006ea0).stop 2021-02-12T17:23:20.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.288+0000 7f234e7ae700 1 -- 172.21.2.102:0/2950600254 shutdown_connections 2021-02-12T17:23:20.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.288+0000 7f234e7ae700 1 --2- 172.21.2.102:0/2950600254 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f23480b3e90 0x7f23480b49b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:20.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.288+0000 7f234e7ae700 1 --2- 172.21.2.102:0/2950600254 >> v2:172.21.2.104:3300/0 conn(0x7f2348145a50 0x7f234809d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:20.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.288+0000 7f234e7ae700 1 -- 172.21.2.102:0/2950600254 >> 172.21.2.102:0/2950600254 conn(0x7f23480b8290 msgr2=0x7f23480b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:20.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.288+0000 7f234e7ae700 1 -- 172.21.2.102:0/2950600254 shutdown_connections 2021-02-12T17:23:20.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.288+0000 7f234e7ae700 1 -- 172.21.2.102:0/2950600254 wait complete. 2021-02-12T17:23:20.291 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.288+0000 7f234e7ae700 1 Processor -- start 2021-02-12T17:23:20.291 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234e7ae700 1 -- start start 2021-02-12T17:23:20.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234e7ae700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f234809dca0 0x7f2348061940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:20.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234e7ae700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f23480b3e90 0x7f23480a0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:20.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234e7ae700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2348145a50 0x7f23480a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:20.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234e7ae700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234815c790 con 0x7f234809dca0 2021-02-12T17:23:20.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234e7ae700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234815ca30 con 0x7f23480b3e90 2021-02-12T17:23:20.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234e7ae700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234815ccd0 con 0x7f2348145a50 2021-02-12T17:23:20.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234d7ac700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f234809dca0 0x7f2348061940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:20.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234d7ac700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f234809dca0 0x7f2348061940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48006/0 (socket says 172.21.2.102:48006) 2021-02-12T17:23:20.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234d7ac700 1 -- 172.21.2.102:0/929695277 learned_addr learned my addr 172.21.2.102:0/929695277 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:20.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234d7ac700 1 -- 172.21.2.102:0/929695277 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2348145a50 msgr2=0x7f23480a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:20.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234d7ac700 1 --2- 172.21.2.102:0/929695277 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2348145a50 0x7f23480a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:20.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234d7ac700 1 -- 172.21.2.102:0/929695277 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f23480b3e90 msgr2=0x7f23480a0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:20.292 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234d7ac700 1 --2- 172.21.2.102:0/929695277 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f23480b3e90 0x7f23480a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:20.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.289+0000 7f234d7ac700 1 -- 172.21.2.102:0/929695277 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234815cf70 con 0x7f234809dca0 2021-02-12T17:23:20.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.290+0000 7f234d7ac700 1 --2- 172.21.2.102:0/929695277 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f234809dca0 0x7f2348061940 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f2344006ee0 tx=0x7f2344016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:20.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.290+0000 7f23357fa700 1 -- 172.21.2.102:0/929695277 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234401b410 con 0x7f234809dca0 2021-02-12T17:23:20.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.290+0000 7f23357fa700 1 -- 172.21.2.102:0/929695277 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234401b590 con 0x7f234809dca0 2021-02-12T17:23:20.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.290+0000 7f234e7ae700 1 -- 172.21.2.102:0/929695277 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234815d210 con 0x7f234809dca0 2021-02-12T17:23:20.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.290+0000 7f23357fa700 1 -- 172.21.2.102:0/929695277 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234401b950 con 0x7f234809dca0 2021-02-12T17:23:20.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.290+0000 7f234e7ae700 1 -- 172.21.2.102:0/929695277 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2348061e30 con 0x7f234809dca0 2021-02-12T17:23:20.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.290+0000 7f234e7ae700 1 -- 172.21.2.102:0/929695277 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2348063f60 con 0x7f234809dca0 2021-02-12T17:23:20.293 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.291+0000 7f23357fa700 1 -- 172.21.2.102:0/929695277 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f234402a070 con 0x7f234809dca0 2021-02-12T17:23:20.294 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.291+0000 7f23357fa700 1 --2- 172.21.2.102:0/929695277 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2328059d30 0x7f232805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:20.294 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.291+0000 7f23357fa700 1 -- 172.21.2.102:0/929695277 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7f23440753b0 con 0x7f234809dca0 2021-02-12T17:23:20.294 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.291+0000 7f234cfab700 1 --2- 172.21.2.102:0/929695277 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2328059d30 0x7f232805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:20.294 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.292+0000 7f234cfab700 1 --2- 172.21.2.102:0/929695277 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2328059d30 0x7f232805c1f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f23480614b0 tx=0x7f23380069d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:20.295 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.294+0000 7f23357fa700 1 -- 172.21.2.102:0/929695277 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f23440488e0 con 0x7f234809dca0 2021-02-12T17:23:20.455 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.455+0000 7f234e7ae700 1 -- 172.21.2.102:0/929695277 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2348044c00 con 0x7f234809dca0 2021-02-12T17:23:20.456 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.455+0000 7f23357fa700 1 -- 172.21.2.102:0/929695277 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+3407 (secure 0 0 0) 0x7f234404bf00 con 0x7f234809dca0 2021-02-12T17:23:20.456 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:23:20.456 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":54,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:23:20.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.456+0000 7f234e7ae700 1 -- 172.21.2.102:0/929695277 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2328059d30 msgr2=0x7f232805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:20.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.456+0000 7f234e7ae700 1 --2- 172.21.2.102:0/929695277 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2328059d30 0x7f232805c1f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f23480614b0 tx=0x7f23380069d0).stop 2021-02-12T17:23:20.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.456+0000 7f234e7ae700 1 -- 172.21.2.102:0/929695277 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f234809dca0 msgr2=0x7f2348061940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:20.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.456+0000 7f234e7ae700 1 --2- 172.21.2.102:0/929695277 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f234809dca0 0x7f2348061940 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f2344006ee0 tx=0x7f2344016000).stop 2021-02-12T17:23:20.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.456+0000 7f234e7ae700 1 -- 172.21.2.102:0/929695277 shutdown_connections 2021-02-12T17:23:20.457 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.456+0000 7f234e7ae700 1 --2- 172.21.2.102:0/929695277 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2348145a50 0x7f23480a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:20.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.456+0000 7f234e7ae700 1 --2- 172.21.2.102:0/929695277 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2328059d30 0x7f232805c1f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:20.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.456+0000 7f234e7ae700 1 --2- 172.21.2.102:0/929695277 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f234809dca0 0x7f2348061940 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:20.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.456+0000 7f234e7ae700 1 --2- 172.21.2.102:0/929695277 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f23480b3e90 0x7f23480a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:20.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.456+0000 7f234e7ae700 1 -- 172.21.2.102:0/929695277 >> 172.21.2.102:0/929695277 conn(0x7f23480b8290 msgr2=0x7f23480b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:20.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.457+0000 7f234e7ae700 1 -- 172.21.2.102:0/929695277 shutdown_connections 2021-02-12T17:23:20.458 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:20.457+0000 7f234e7ae700 1 -- 172.21.2.102:0/929695277 wait complete. 2021-02-12T17:23:20.458 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 54 2021-02-12T17:23:20.466 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2021-02-12T17:23:22.467 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:23:22.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.554+0000 7f3e6ad7e700 1 Processor -- start 2021-02-12T17:23:22.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.554+0000 7f3e6ad7e700 1 -- start start 2021-02-12T17:23:22.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.554+0000 7f3e6ad7e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3e640b8d20 0x7f3e64068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:22.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.554+0000 7f3e6ad7e700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3e64062740 0x7f3e64062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:22.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.554+0000 7f3e6ad7e700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e640b7960 con 0x7f3e6414e530 2021-02-12T17:23:22.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.554+0000 7f3e6ad7e700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e64068d20 con 0x7f3e64062740 2021-02-12T17:23:22.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.554+0000 7f3e6ad7e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e640622a0 con 0x7f3e640b8d20 2021-02-12T17:23:22.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.555+0000 7f3e6931b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3e64062740 0x7f3e64062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:22.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.555+0000 7f3e6931b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f3e64062740 0x7f3e64062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48018/0 (socket says 172.21.2.102:48018) 2021-02-12T17:23:22.556 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.555+0000 7f3e6931b700 1 -- 172.21.2.102:0/576336604 learned_addr learned my addr 172.21.2.102:0/576336604 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:22.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.555+0000 7f3e68b1a700 1 --2- 172.21.2.102:0/576336604 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3e640b8d20 0x7f3e64068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:22.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.555+0000 7f3e6931b700 1 -- 172.21.2.102:0/576336604 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3e640b8d20 msgr2=0x7f3e64068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:22.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.555+0000 7f3e6931b700 1 --2- 172.21.2.102:0/576336604 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3e640b8d20 0x7f3e64068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:22.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.555+0000 7f3e6931b700 1 -- 172.21.2.102:0/576336604 >> v1:172.21.2.104:6789/0 conn(0x7f3e6414e530 legacy=0x7f3e640b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:22.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.555+0000 7f3e6931b700 1 -- 172.21.2.102:0/576336604 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6414ea10 con 0x7f3e64062740 2021-02-12T17:23:22.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.555+0000 7f3e6931b700 1 --2- 172.21.2.102:0/576336604 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3e64062740 0x7f3e64062bf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f3e5c009d50 tx=0x7f3e5c009290).ready entity=mon.0 client_cookie=4eb6218ff3d3baf6 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:22.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.555+0000 7f3e637fe700 1 -- 172.21.2.102:0/576336604 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c00bbf0 con 0x7f3e64062740 2021-02-12T17:23:22.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.555+0000 7f3e637fe700 1 -- 172.21.2.102:0/576336604 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c00bd50 con 0x7f3e64062740 2021-02-12T17:23:22.557 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.556+0000 7f3e637fe700 1 -- 172.21.2.102:0/576336604 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c011610 con 0x7f3e64062740 2021-02-12T17:23:22.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.556+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/576336604 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3e64062740 msgr2=0x7f3e64062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:22.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.556+0000 7f3e6ad7e700 1 --2- 172.21.2.102:0/576336604 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3e64062740 0x7f3e64062bf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f3e5c009d50 tx=0x7f3e5c009290).stop 2021-02-12T17:23:22.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.556+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/576336604 shutdown_connections 2021-02-12T17:23:22.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.556+0000 7f3e6ad7e700 1 --2- 172.21.2.102:0/576336604 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3e64062740 0x7f3e64062bf0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:22.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.556+0000 7f3e6ad7e700 1 --2- 172.21.2.102:0/576336604 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3e640b8d20 0x7f3e64068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:22.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.556+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/576336604 >> 172.21.2.102:0/576336604 conn(0x7f3e640bc480 msgr2=0x7f3e640b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:22.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.556+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/576336604 shutdown_connections 2021-02-12T17:23:22.558 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.556+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/576336604 wait complete. 2021-02-12T17:23:22.559 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.557+0000 7f3e6ad7e700 1 Processor -- start 2021-02-12T17:23:22.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.557+0000 7f3e6ad7e700 1 -- start start 2021-02-12T17:23:22.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e6ad7e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3e64062740 0x7f3e640b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:22.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e6ad7e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3e640b8d20 0x7f3e6414a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:22.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e6ad7e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3e6414e530 0x7f3e6414ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:22.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e6ad7e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e640b1860 con 0x7f3e640b8d20 2021-02-12T17:23:22.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e6ad7e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e640b1ad0 con 0x7f3e6414e530 2021-02-12T17:23:22.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e6ad7e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e640b1d70 con 0x7f3e64062740 2021-02-12T17:23:22.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e63fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3e640b8d20 0x7f3e6414a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:22.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e6931b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3e6414e530 0x7f3e6414ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:22.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e63fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3e640b8d20 0x7f3e6414a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48020/0 (socket says 172.21.2.102:48020) 2021-02-12T17:23:22.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e63fff700 1 -- 172.21.2.102:0/99971244 learned_addr learned my addr 172.21.2.102:0/99971244 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:22.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e68b1a700 1 --2- 172.21.2.102:0/99971244 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3e64062740 0x7f3e640b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:22.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e63fff700 1 -- 172.21.2.102:0/99971244 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3e64062740 msgr2=0x7f3e640b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:22.560 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e63fff700 1 --2- 172.21.2.102:0/99971244 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3e64062740 0x7f3e640b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:22.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e63fff700 1 -- 172.21.2.102:0/99971244 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3e6414e530 msgr2=0x7f3e6414ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:22.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e63fff700 1 --2- 172.21.2.102:0/99971244 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3e6414e530 0x7f3e6414ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:22.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e63fff700 1 -- 172.21.2.102:0/99971244 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e640b2b40 con 0x7f3e640b8d20 2021-02-12T17:23:22.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e68b1a700 1 --2- 172.21.2.102:0/99971244 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3e64062740 0x7f3e640b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:23:22.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e63fff700 1 --2- 172.21.2.102:0/99971244 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3e640b8d20 0x7f3e6414a960 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f3e4c00c6e0 tx=0x7f3e4c007b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:22.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.558+0000 7f3e60ff9700 1 -- 172.21.2.102:0/99971244 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c013410 con 0x7f3e640b8d20 2021-02-12T17:23:22.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.559+0000 7f3e60ff9700 1 -- 172.21.2.102:0/99971244 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c013570 con 0x7f3e640b8d20 2021-02-12T17:23:22.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.559+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/99971244 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e640b0840 con 0x7f3e640b8d20 2021-02-12T17:23:22.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.559+0000 7f3e60ff9700 1 -- 172.21.2.102:0/99971244 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0138f0 con 0x7f3e640b8d20 2021-02-12T17:23:22.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.559+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/99971244 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6414b340 con 0x7f3e640b8d20 2021-02-12T17:23:22.561 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.559+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/99971244 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e64063340 con 0x7f3e640b8d20 2021-02-12T17:23:22.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.559+0000 7f3e60ff9700 1 -- 172.21.2.102:0/99971244 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f3e4c010030 con 0x7f3e640b8d20 2021-02-12T17:23:22.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.560+0000 7f3e60ff9700 1 --2- 172.21.2.102:0/99971244 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3e48059d60 0x7f3e4805c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:22.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.560+0000 7f3e60ff9700 1 -- 172.21.2.102:0/99971244 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7f3e4c073bd0 con 0x7f3e640b8d20 2021-02-12T17:23:22.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.560+0000 7f3e68b1a700 1 --2- 172.21.2.102:0/99971244 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3e48059d60 0x7f3e4805c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:22.562 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.560+0000 7f3e68b1a700 1 --2- 172.21.2.102:0/99971244 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3e48059d60 0x7f3e4805c220 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f3e540112c0 tx=0x7f3e54006de0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:22.563 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.563+0000 7f3e60ff9700 1 -- 172.21.2.102:0/99971244 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f3e4c0470a0 con 0x7f3e640b8d20 2021-02-12T17:23:22.722 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.722+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/99971244 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e640b2cd0 con 0x7f3e640b8d20 2021-02-12T17:23:22.723 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.722+0000 7f3e60ff9700 1 -- 172.21.2.102:0/99971244 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+3407 (secure 0 0 0) 0x7f3e4c04a6c0 con 0x7f3e640b8d20 2021-02-12T17:23:22.723 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:23:22.723 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":54,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:23:22.724 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.723+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/99971244 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3e48059d60 msgr2=0x7f3e4805c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:22.724 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.723+0000 7f3e6ad7e700 1 --2- 172.21.2.102:0/99971244 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3e48059d60 0x7f3e4805c220 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f3e540112c0 tx=0x7f3e54006de0).stop 2021-02-12T17:23:22.724 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.723+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/99971244 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3e640b8d20 msgr2=0x7f3e6414a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:22.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.723+0000 7f3e6ad7e700 1 --2- 172.21.2.102:0/99971244 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3e640b8d20 0x7f3e6414a960 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f3e4c00c6e0 tx=0x7f3e4c007b60).stop 2021-02-12T17:23:22.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.723+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/99971244 shutdown_connections 2021-02-12T17:23:22.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.723+0000 7f3e6ad7e700 1 --2- 172.21.2.102:0/99971244 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f3e6414e530 0x7f3e6414ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:22.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.723+0000 7f3e6ad7e700 1 --2- 172.21.2.102:0/99971244 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3e64062740 0x7f3e640b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:22.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.723+0000 7f3e6ad7e700 1 --2- 172.21.2.102:0/99971244 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3e48059d60 0x7f3e4805c220 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:22.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.723+0000 7f3e6ad7e700 1 --2- 172.21.2.102:0/99971244 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f3e640b8d20 0x7f3e6414a960 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:22.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.723+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/99971244 >> 172.21.2.102:0/99971244 conn(0x7f3e640bc480 msgr2=0x7f3e640baa10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:22.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.724+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/99971244 shutdown_connections 2021-02-12T17:23:22.725 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:22.724+0000 7f3e6ad7e700 1 -- 172.21.2.102:0/99971244 wait complete. 2021-02-12T17:23:22.726 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 54 2021-02-12T17:23:22.733 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2021-02-12T17:23:24.733 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:23:24.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.821+0000 7f5946460700 1 Processor -- start 2021-02-12T17:23:24.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.821+0000 7f5946460700 1 -- start start 2021-02-12T17:23:24.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.822+0000 7f5946460700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f59400b8d20 0x7f5940068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:24.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.822+0000 7f5946460700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5940062740 0x7f5940062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:24.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.822+0000 7f5946460700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59400b7960 con 0x7f594014e530 2021-02-12T17:23:24.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.822+0000 7f5946460700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5940068d20 con 0x7f59400b8d20 2021-02-12T17:23:24.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.822+0000 7f5946460700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59400622a0 con 0x7f5940062740 2021-02-12T17:23:24.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.822+0000 7f593ffff700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f59400b8d20 0x7f5940068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:24.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.822+0000 7f593f7fe700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f594014e530 0x7f59400b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:39046/0 (socket says 172.21.2.102:39046) 2021-02-12T17:23:24.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.822+0000 7f593f7fe700 1 -- 172.21.2.102:0/4265482867 learned_addr learned my addr 172.21.2.102:0/4265482867 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:23:24.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.822+0000 7f59449fd700 1 --2- 172.21.2.102:0/4265482867 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5940062740 0x7f5940062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:24.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.823+0000 7f593ffff700 1 -- 172.21.2.102:0/4265482867 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5940062740 msgr2=0x7f5940062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:23:24.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.823+0000 7f593ffff700 1 --2- 172.21.2.102:0/4265482867 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5940062740 0x7f5940062bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:24.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.823+0000 7f593ffff700 1 -- 172.21.2.102:0/4265482867 >> v1:172.21.2.104:6789/0 conn(0x7f594014e530 legacy=0x7f59400b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:24.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.823+0000 7f593ffff700 1 -- 172.21.2.102:0/4265482867 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594014ea10 con 0x7f59400b8d20 2021-02-12T17:23:24.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.823+0000 7f59449fd700 1 --2- 172.21.2.102:0/4265482867 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5940062740 0x7f5940062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:23:24.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.823+0000 7f593ffff700 1 --2- 172.21.2.102:0/4265482867 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59400b8d20 0x7f5940068830 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f593000b980 tx=0x7f5930006de0).ready entity=mon.1 client_cookie=b9d87dbf00efe208 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:24.825 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.823+0000 7f593effd700 1 -- 172.21.2.102:0/4265482867 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593000be70 con 0x7f59400b8d20 2021-02-12T17:23:24.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.823+0000 7f593effd700 1 -- 172.21.2.102:0/4265482867 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59300097e0 con 0x7f59400b8d20 2021-02-12T17:23:24.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.823+0000 7f593effd700 1 -- 172.21.2.102:0/4265482867 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930009b60 con 0x7f59400b8d20 2021-02-12T17:23:24.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.824+0000 7f5946460700 1 -- 172.21.2.102:0/4265482867 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59400b8d20 msgr2=0x7f5940068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:24.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.824+0000 7f5946460700 1 --2- 172.21.2.102:0/4265482867 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59400b8d20 0x7f5940068830 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f593000b980 tx=0x7f5930006de0).stop 2021-02-12T17:23:24.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.824+0000 7f5946460700 1 -- 172.21.2.102:0/4265482867 shutdown_connections 2021-02-12T17:23:24.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.824+0000 7f5946460700 1 --2- 172.21.2.102:0/4265482867 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5940062740 0x7f5940062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:24.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.824+0000 7f5946460700 1 --2- 172.21.2.102:0/4265482867 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59400b8d20 0x7f5940068830 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0x7f593000b980 tx=0x7f5930006de0).stop 2021-02-12T17:23:24.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.824+0000 7f5946460700 1 -- 172.21.2.102:0/4265482867 >> 172.21.2.102:0/4265482867 conn(0x7f59400bc480 msgr2=0x7f59400b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:24.826 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.824+0000 7f5946460700 1 -- 172.21.2.102:0/4265482867 shutdown_connections 2021-02-12T17:23:24.827 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.824+0000 7f5946460700 1 -- 172.21.2.102:0/4265482867 wait complete. 2021-02-12T17:23:24.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.825+0000 7f5946460700 1 Processor -- start 2021-02-12T17:23:24.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.825+0000 7f5946460700 1 -- start start 2021-02-12T17:23:24.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.825+0000 7f5946460700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5940062740 0x7f59400b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:24.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.825+0000 7f5946460700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f594014e530 0x7f59400b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:24.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.825+0000 7f5946460700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59400acf10 0x7f594015de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:24.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.825+0000 7f5946460700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594015d7f0 con 0x7f59400acf10 2021-02-12T17:23:24.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.825+0000 7f5946460700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594011d810 con 0x7f5940062740 2021-02-12T17:23:24.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.825+0000 7f5946460700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594011dab0 con 0x7f594014e530 2021-02-12T17:23:24.829 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.825+0000 7f59449fd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59400acf10 0x7f594015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:24.830 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.825+0000 7f59449fd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59400acf10 0x7f594015de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48036/0 (socket says 172.21.2.102:48036) 2021-02-12T17:23:24.830 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.826+0000 7f59449fd700 1 -- 172.21.2.102:0/4181674453 learned_addr learned my addr 172.21.2.102:0/4181674453 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:23:24.830 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.826+0000 7f59449fd700 1 -- 172.21.2.102:0/4181674453 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f594014e530 msgr2=0x7f59400b0ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:23:24.830 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.826+0000 7f59449fd700 1 --2- 172.21.2.102:0/4181674453 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f594014e530 0x7f59400b0ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:24.830 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.826+0000 7f59449fd700 1 -- 172.21.2.102:0/4181674453 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5940062740 msgr2=0x7f59400b55b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:23:24.830 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.826+0000 7f59449fd700 1 --2- 172.21.2.102:0/4181674453 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5940062740 0x7f59400b55b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:24.830 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.826+0000 7f59449fd700 1 -- 172.21.2.102:0/4181674453 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594011dd50 con 0x7f59400acf10 2021-02-12T17:23:24.830 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.826+0000 7f59449fd700 1 --2- 172.21.2.102:0/4181674453 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59400acf10 0x7f594015de80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f593800ef20 tx=0x7f59380091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:24.830 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.826+0000 7f5937fff700 1 -- 172.21.2.102:0/4181674453 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938009820 con 0x7f59400acf10 2021-02-12T17:23:24.830 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.826+0000 7f5937fff700 1 -- 172.21.2.102:0/4181674453 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593800cd10 con 0x7f59400acf10 2021-02-12T17:23:24.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.826+0000 7f5946460700 1 -- 172.21.2.102:0/4181674453 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594015d9e0 con 0x7f59400acf10 2021-02-12T17:23:24.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.826+0000 7f5946460700 1 -- 172.21.2.102:0/4181674453 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594011d420 con 0x7f59400acf10 2021-02-12T17:23:24.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.826+0000 7f5937fff700 1 -- 172.21.2.102:0/4181674453 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938012640 con 0x7f59400acf10 2021-02-12T17:23:24.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.827+0000 7f5946460700 1 -- 172.21.2.102:0/4181674453 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5918004f60 con 0x7f59400acf10 2021-02-12T17:23:24.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.827+0000 7f5937fff700 1 -- 172.21.2.102:0/4181674453 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f5938022070 con 0x7f59400acf10 2021-02-12T17:23:24.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.827+0000 7f5937fff700 1 --2- 172.21.2.102:0/4181674453 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5924059d30 0x7f592405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:23:24.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.827+0000 7f5937fff700 1 -- 172.21.2.102:0/4181674453 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7f59380749a0 con 0x7f59400acf10 2021-02-12T17:23:24.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.827+0000 7f593ffff700 1 --2- 172.21.2.102:0/4181674453 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5924059d30 0x7f592405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:23:24.831 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.828+0000 7f593ffff700 1 --2- 172.21.2.102:0/4181674453 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5924059d30 0x7f592405c1f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f5940065ad0 tx=0x7f5930016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:23:24.832 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.830+0000 7f5937fff700 1 -- 172.21.2.102:0/4181674453 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f5938047dc0 con 0x7f59400acf10 2021-02-12T17:23:24.989 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.989+0000 7f5946460700 1 -- 172.21.2.102:0/4181674453 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5918005790 con 0x7f59400acf10 2021-02-12T17:23:24.990 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.989+0000 7f5937fff700 1 -- 172.21.2.102:0/4181674453 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f5938016030 con 0x7f59400acf10 2021-02-12T17:23:24.990 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:23:24.990 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:23:24.991 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.990+0000 7f5946460700 1 -- 172.21.2.102:0/4181674453 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5924059d30 msgr2=0x7f592405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:24.991 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.990+0000 7f5946460700 1 --2- 172.21.2.102:0/4181674453 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5924059d30 0x7f592405c1f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f5940065ad0 tx=0x7f5930016000).stop 2021-02-12T17:23:24.991 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.990+0000 7f5946460700 1 -- 172.21.2.102:0/4181674453 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59400acf10 msgr2=0x7f594015de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:23:24.991 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.990+0000 7f5946460700 1 --2- 172.21.2.102:0/4181674453 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59400acf10 0x7f594015de80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f593800ef20 tx=0x7f59380091d0).stop 2021-02-12T17:23:24.992 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.990+0000 7f5946460700 1 -- 172.21.2.102:0/4181674453 shutdown_connections 2021-02-12T17:23:24.992 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.990+0000 7f5946460700 1 --2- 172.21.2.102:0/4181674453 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5924059d30 0x7f592405c1f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:24.992 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.990+0000 7f5946460700 1 --2- 172.21.2.102:0/4181674453 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59400acf10 0x7f594015de80 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:23:24.992 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.990+0000 7f5946460700 1 --2- 172.21.2.102:0/4181674453 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5940062740 0x7f59400b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:24.992 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.990+0000 7f5946460700 1 --2- 172.21.2.102:0/4181674453 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f594014e530 0x7f59400b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:23:24.992 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.990+0000 7f5946460700 1 -- 172.21.2.102:0/4181674453 >> 172.21.2.102:0/4181674453 conn(0x7f59400bc480 msgr2=0x7f594014cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:23:24.992 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.991+0000 7f5946460700 1 -- 172.21.2.102:0/4181674453 shutdown_connections 2021-02-12T17:23:24.992 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:23:24.991+0000 7f5946460700 1 -- 172.21.2.102:0/4181674453 wait complete. 2021-02-12T17:23:24.993 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 55 2021-02-12T17:23:25.000 INFO:tasks.mds_thrash.fs.[a]:mds.c reported in up:standby state 2021-02-12T17:23:25.000 INFO:tasks.mds_thrash.fs.[a]:waiting for 117 secs before thrashing 2021-02-12T17:23:41.279 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:23:41.282 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:24:11.331 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:24:11.334 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:24:39.341 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:24:39.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.430+0000 7f0cf9b75700 1 Processor -- start 2021-02-12T17:24:39.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.430+0000 7f0cf9b75700 1 -- start start 2021-02-12T17:24:39.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.431+0000 7f0cf9b75700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f0cf414e530 0x7f0cf4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:39.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.431+0000 7f0cf9b75700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0cf4062740 0x7f0cf4062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:39.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.431+0000 7f0cf9b75700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf40b7960 con 0x7f0cf40b8d20 2021-02-12T17:24:39.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.431+0000 7f0cf9b75700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf4068d20 con 0x7f0cf414e530 2021-02-12T17:24:39.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.431+0000 7f0cf9b75700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40622a0 con 0x7f0cf4062740 2021-02-12T17:24:39.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.431+0000 7f0cf37fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f0cf40b8d20 0x7f0cf40b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56716/0 (socket says 172.21.2.102:56716) 2021-02-12T17:24:39.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.431+0000 7f0cf37fe700 1 -- 172.21.2.102:0/2644901300 learned_addr learned my addr 172.21.2.102:0/2644901300 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:24:39.433 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.431+0000 7f0cf2ffd700 1 --2- 172.21.2.102:0/2644901300 >> v2:172.21.2.102:3300/0 conn(0x7f0cf414e530 0x7f0cf4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:39.433 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.431+0000 7f0cf27fc700 1 -- 172.21.2.102:0/2644901300 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326260093 0 0) 0x7f0cf40b7960 con 0x7f0cf40b8d20 2021-02-12T17:24:39.433 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.431+0000 7f0cf27fc700 1 -- 172.21.2.102:0/2644901300 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ce0003230 con 0x7f0cf40b8d20 2021-02-12T17:24:39.433 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.431+0000 7f0cf2ffd700 1 -- 172.21.2.102:0/2644901300 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0cf4062740 msgr2=0x7f0cf4062bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:24:39.433 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.431+0000 7f0cf2ffd700 1 --2- 172.21.2.102:0/2644901300 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0cf4062740 0x7f0cf4062bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:39.433 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.431+0000 7f0cf2ffd700 1 -- 172.21.2.102:0/2644901300 >> v1:172.21.2.102:6789/0 conn(0x7f0cf40b8d20 legacy=0x7f0cf40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:39.433 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.431+0000 7f0cf2ffd700 1 -- 172.21.2.102:0/2644901300 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf414ea10 con 0x7f0cf414e530 2021-02-12T17:24:39.433 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.432+0000 7f0cf2ffd700 1 --2- 172.21.2.102:0/2644901300 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0cf414e530 0x7f0cf4068830 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f0ce800b980 tx=0x7f0ce8006de0).ready entity=mon.0 client_cookie=1d8e50ffde96c9f8 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:39.433 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.432+0000 7f0cf27fc700 1 -- 172.21.2.102:0/2644901300 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce800be70 con 0x7f0cf414e530 2021-02-12T17:24:39.433 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.432+0000 7f0cf27fc700 1 -- 172.21.2.102:0/2644901300 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce80097e0 con 0x7f0cf414e530 2021-02-12T17:24:39.433 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.432+0000 7f0cf27fc700 1 -- 172.21.2.102:0/2644901300 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8009b60 con 0x7f0cf414e530 2021-02-12T17:24:39.435 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.432+0000 7f0cf9b75700 1 -- 172.21.2.102:0/2644901300 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0cf414e530 msgr2=0x7f0cf4068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:39.435 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.432+0000 7f0cf9b75700 1 --2- 172.21.2.102:0/2644901300 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0cf414e530 0x7f0cf4068830 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f0ce800b980 tx=0x7f0ce8006de0).stop 2021-02-12T17:24:39.435 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.432+0000 7f0cf9b75700 1 -- 172.21.2.102:0/2644901300 shutdown_connections 2021-02-12T17:24:39.435 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.432+0000 7f0cf9b75700 1 --2- 172.21.2.102:0/2644901300 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0cf4062740 0x7f0cf4062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:39.435 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.432+0000 7f0cf9b75700 1 --2- 172.21.2.102:0/2644901300 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0cf414e530 0x7f0cf4068830 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:39.435 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.432+0000 7f0cf9b75700 1 -- 172.21.2.102:0/2644901300 >> 172.21.2.102:0/2644901300 conn(0x7f0cf40bc480 msgr2=0x7f0cf40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:39.436 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.432+0000 7f0cf9b75700 1 -- 172.21.2.102:0/2644901300 shutdown_connections 2021-02-12T17:24:39.436 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.432+0000 7f0cf9b75700 1 -- 172.21.2.102:0/2644901300 wait complete. 2021-02-12T17:24:39.436 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.433+0000 7f0cf9b75700 1 Processor -- start 2021-02-12T17:24:39.436 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.433+0000 7f0cf9b75700 1 -- start start 2021-02-12T17:24:39.436 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf9b75700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0cf4062740 0x7f0cf40b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:39.436 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf9b75700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0cf40b8d20 0x7f0cf414a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:39.436 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf9b75700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0cf414e530 0x7f0cf414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:39.436 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf9b75700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40b5870 con 0x7f0cf414e530 2021-02-12T17:24:39.436 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf9b75700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf415d560 con 0x7f0cf4062740 2021-02-12T17:24:39.436 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf9b75700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf415d800 con 0x7f0cf40b8d20 2021-02-12T17:24:39.436 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf3fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0cf414e530 0x7f0cf414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:39.436 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf3fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0cf414e530 0x7f0cf414ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48078/0 (socket says 172.21.2.102:48078) 2021-02-12T17:24:39.436 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf3fff700 1 -- 172.21.2.102:0/1918343648 learned_addr learned my addr 172.21.2.102:0/1918343648 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:39.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf3fff700 1 -- 172.21.2.102:0/1918343648 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0cf40b8d20 msgr2=0x7f0cf414a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:39.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf3fff700 1 --2- 172.21.2.102:0/1918343648 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0cf40b8d20 0x7f0cf414a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:39.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf3fff700 1 -- 172.21.2.102:0/1918343648 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0cf4062740 msgr2=0x7f0cf40b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:39.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf3fff700 1 --2- 172.21.2.102:0/1918343648 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0cf4062740 0x7f0cf40b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:39.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf3fff700 1 -- 172.21.2.102:0/1918343648 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf415daa0 con 0x7f0cf414e530 2021-02-12T17:24:39.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf3fff700 1 --2- 172.21.2.102:0/1918343648 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0cf414e530 0x7f0cf414ae40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f0cec00bae0 tx=0x7f0cec0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:39.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cdb7fe700 1 -- 172.21.2.102:0/1918343648 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00c880 con 0x7f0cf414e530 2021-02-12T17:24:39.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cdb7fe700 1 -- 172.21.2.102:0/1918343648 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00ca20 con 0x7f0cf414e530 2021-02-12T17:24:39.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf9b75700 1 -- 172.21.2.102:0/1918343648 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf415dd40 con 0x7f0cf414e530 2021-02-12T17:24:39.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cdb7fe700 1 -- 172.21.2.102:0/1918343648 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00cbd0 con 0x7f0cf414e530 2021-02-12T17:24:39.437 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.434+0000 7f0cf9b75700 1 -- 172.21.2.102:0/1918343648 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf414b330 con 0x7f0cf414e530 2021-02-12T17:24:39.438 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.435+0000 7f0cf9b75700 1 -- 172.21.2.102:0/1918343648 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf4045460 con 0x7f0cf414e530 2021-02-12T17:24:39.438 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.435+0000 7f0cdb7fe700 1 -- 172.21.2.102:0/1918343648 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f0cec01c070 con 0x7f0cf414e530 2021-02-12T17:24:39.438 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.436+0000 7f0cdb7fe700 1 --2- 172.21.2.102:0/1918343648 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0cd4059d30 0x7f0cd405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:39.438 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.436+0000 7f0cdb7fe700 1 -- 172.21.2.102:0/1918343648 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7f0cec0737e0 con 0x7f0cf414e530 2021-02-12T17:24:39.438 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.436+0000 7f0cf37fe700 1 --2- 172.21.2.102:0/1918343648 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0cd4059d30 0x7f0cd405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:39.439 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.436+0000 7f0cf37fe700 1 --2- 172.21.2.102:0/1918343648 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0cd4059d30 0x7f0cd405c1f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f0ce4005590 tx=0x7f0ce4007690).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:39.439 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.439+0000 7f0cdb7fe700 1 -- 172.21.2.102:0/1918343648 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f0cec046d10 con 0x7f0cf414e530 2021-02-12T17:24:39.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.599+0000 7f0cf9b75700 1 -- 172.21.2.102:0/1918343648 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cf415ded0 con 0x7f0cf414e530 2021-02-12T17:24:39.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.600+0000 7f0cdb7fe700 1 -- 172.21.2.102:0/1918343648 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f0cec04a330 con 0x7f0cf414e530 2021-02-12T17:24:39.601 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:24:39.601 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:24:39.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.601+0000 7f0cf9b75700 1 -- 172.21.2.102:0/1918343648 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0cd4059d30 msgr2=0x7f0cd405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:39.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.601+0000 7f0cf9b75700 1 --2- 172.21.2.102:0/1918343648 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0cd4059d30 0x7f0cd405c1f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f0ce4005590 tx=0x7f0ce4007690).stop 2021-02-12T17:24:39.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.601+0000 7f0cf9b75700 1 -- 172.21.2.102:0/1918343648 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0cf414e530 msgr2=0x7f0cf414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:39.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.601+0000 7f0cf9b75700 1 --2- 172.21.2.102:0/1918343648 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0cf414e530 0x7f0cf414ae40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f0cec00bae0 tx=0x7f0cec0091a0).stop 2021-02-12T17:24:39.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.601+0000 7f0cf9b75700 1 -- 172.21.2.102:0/1918343648 shutdown_connections 2021-02-12T17:24:39.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.601+0000 7f0cf9b75700 1 --2- 172.21.2.102:0/1918343648 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f0cd4059d30 0x7f0cd405c1f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:39.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.601+0000 7f0cf9b75700 1 --2- 172.21.2.102:0/1918343648 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f0cf414e530 0x7f0cf414ae40 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:39.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.601+0000 7f0cf9b75700 1 --2- 172.21.2.102:0/1918343648 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f0cf4062740 0x7f0cf40b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:39.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.601+0000 7f0cf9b75700 1 --2- 172.21.2.102:0/1918343648 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f0cf40b8d20 0x7f0cf414a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:39.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.601+0000 7f0cf9b75700 1 -- 172.21.2.102:0/1918343648 >> 172.21.2.102:0/1918343648 conn(0x7f0cf40bc480 msgr2=0x7f0cf4151a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:39.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.601+0000 7f0cf9b75700 1 -- 172.21.2.102:0/1918343648 shutdown_connections 2021-02-12T17:24:39.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.601+0000 7f0cf9b75700 1 -- 172.21.2.102:0/1918343648 wait complete. 2021-02-12T17:24:39.604 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 55 2021-02-12T17:24:39.611 INFO:tasks.mds_thrash.fs.[b]:kill mds.a (rank=0) 2021-02-12T17:24:39.611 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-12T17:24:39.611 INFO:teuthology.orchestra.run:waiting for 300 2021-02-12T17:24:39.618 INFO:tasks.ceph.mds.a:Stopped 2021-02-12T17:24:39.618 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:24:39.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.748+0000 7f2ebe43c700 1 Processor -- start 2021-02-12T17:24:39.749 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.748+0000 7f2ebe43c700 1 -- start start 2021-02-12T17:24:39.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.749+0000 7f2ebe43c700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f2eb80b6350 0x7f2eb81463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:39.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.749+0000 7f2ebe43c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f2eb8144ea0 0x7f2eb8145330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:39.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.749+0000 7f2ebe43c700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb80b2930 con 0x7f2eb8067720 2021-02-12T17:24:39.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.749+0000 7f2ebe43c700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb8068980 con 0x7f2eb8144ea0 2021-02-12T17:24:39.751 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.749+0000 7f2ebe43c700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb80b67b0 con 0x7f2eb80b6350 2021-02-12T17:24:39.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.749+0000 7f2ebc9d9700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f2eb8144ea0 0x7f2eb8145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:39.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.749+0000 7f2ebc9d9700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f2eb8144ea0 0x7f2eb8145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48086/0 (socket says 172.21.2.102:48086) 2021-02-12T17:24:39.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.749+0000 7f2ebc9d9700 1 -- 172.21.2.102:0/1818358758 learned_addr learned my addr 172.21.2.102:0/1818358758 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:39.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2ebc9d9700 1 -- 172.21.2.102:0/1818358758 >> v2:172.21.2.104:3300/0 conn(0x7f2eb80b6350 msgr2=0x7f2eb81463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:24:39.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2ebc9d9700 1 --2- 172.21.2.102:0/1818358758 >> v2:172.21.2.104:3300/0 conn(0x7f2eb80b6350 0x7f2eb81463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:39.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2ebc9d9700 1 -- 172.21.2.102:0/1818358758 >> v1:172.21.2.104:6789/0 conn(0x7f2eb8067720 legacy=0x7f2eb8062580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:24:39.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2ebc9d9700 1 -- 172.21.2.102:0/1818358758 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8066db0 con 0x7f2eb8144ea0 2021-02-12T17:24:39.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2ebc9d9700 1 --2- 172.21.2.102:0/1818358758 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2eb8144ea0 0x7f2eb8145330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f2eb8065c50 tx=0x7f2eb000a430).ready entity=mon.0 client_cookie=1814517edb93e610 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:39.752 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2eb6ffd700 1 -- 172.21.2.102:0/1818358758 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb000cdc0 con 0x7f2eb8144ea0 2021-02-12T17:24:39.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2eb6ffd700 1 -- 172.21.2.102:0/1818358758 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb000f470 con 0x7f2eb8144ea0 2021-02-12T17:24:39.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2eb6ffd700 1 -- 172.21.2.102:0/1818358758 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb000f7f0 con 0x7f2eb8144ea0 2021-02-12T17:24:39.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1818358758 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2eb8144ea0 msgr2=0x7f2eb8145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:39.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2ebe43c700 1 --2- 172.21.2.102:0/1818358758 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2eb8144ea0 0x7f2eb8145330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f2eb8065c50 tx=0x7f2eb000a430).stop 2021-02-12T17:24:39.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1818358758 shutdown_connections 2021-02-12T17:24:39.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2ebe43c700 1 --2- 172.21.2.102:0/1818358758 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2eb8144ea0 0x7f2eb8145330 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:39.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2ebe43c700 1 --2- 172.21.2.102:0/1818358758 >> v2:172.21.2.104:3300/0 conn(0x7f2eb80b6350 0x7f2eb81463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:39.753 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1818358758 >> 172.21.2.102:0/1818358758 conn(0x7f2eb80bc480 msgr2=0x7f2eb80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:39.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1818358758 shutdown_connections 2021-02-12T17:24:39.754 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.750+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1818358758 wait complete. 2021-02-12T17:24:39.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.751+0000 7f2ebe43c700 1 Processor -- start 2021-02-12T17:24:39.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.751+0000 7f2ebe43c700 1 -- start start 2021-02-12T17:24:39.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2ebe43c700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2eb8067720 0x7f2eb8153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:39.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2ebe43c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2eb80b6350 0x7f2eb8143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:39.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2ebe43c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2eb8144ea0 0x7f2eb8147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:39.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2ebe43c700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb8154b80 con 0x7f2eb80b6350 2021-02-12T17:24:39.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2ebe43c700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb8154e20 con 0x7f2eb8067720 2021-02-12T17:24:39.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2ebe43c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb81550c0 con 0x7f2eb8144ea0 2021-02-12T17:24:39.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2eb77fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2eb80b6350 0x7f2eb8143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:39.756 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2eb77fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2eb80b6350 0x7f2eb8143c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48090/0 (socket says 172.21.2.102:48090) 2021-02-12T17:24:39.757 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2eb77fe700 1 -- 172.21.2.102:0/1917900283 learned_addr learned my addr 172.21.2.102:0/1917900283 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:39.757 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2eb77fe700 1 -- 172.21.2.102:0/1917900283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2eb8144ea0 msgr2=0x7f2eb8147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:39.757 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2eb77fe700 1 --2- 172.21.2.102:0/1917900283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2eb8144ea0 0x7f2eb8147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:39.757 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2eb77fe700 1 -- 172.21.2.102:0/1917900283 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2eb8067720 msgr2=0x7f2eb8153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:39.757 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2eb77fe700 1 --2- 172.21.2.102:0/1917900283 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2eb8067720 0x7f2eb8153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:39.757 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2eb77fe700 1 -- 172.21.2.102:0/1917900283 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8146e80 con 0x7f2eb80b6350 2021-02-12T17:24:39.757 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2eb77fe700 1 --2- 172.21.2.102:0/1917900283 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2eb80b6350 0x7f2eb8143c70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f2eac009790 tx=0x7f2eac006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:39.757 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2e9ffff700 1 -- 172.21.2.102:0/1917900283 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac013070 con 0x7f2eb80b6350 2021-02-12T17:24:39.758 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2e9ffff700 1 -- 172.21.2.102:0/1917900283 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac000e90 con 0x7f2eb80b6350 2021-02-12T17:24:39.758 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1917900283 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb80bb240 con 0x7f2eb80b6350 2021-02-12T17:24:39.758 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2e9ffff700 1 -- 172.21.2.102:0/1917900283 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac00d880 con 0x7f2eb80b6350 2021-02-12T17:24:39.758 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.752+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1917900283 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb8149e60 con 0x7f2eb80b6350 2021-02-12T17:24:39.758 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.753+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1917900283 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb8147010 con 0x7f2eb80b6350 2021-02-12T17:24:39.758 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.753+0000 7f2e9ffff700 1 -- 172.21.2.102:0/1917900283 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f2eac00dbf0 con 0x7f2eb80b6350 2021-02-12T17:24:39.758 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.753+0000 7f2e9ffff700 1 --2- 172.21.2.102:0/1917900283 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2e98059d30 0x7f2e9805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:39.758 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.754+0000 7f2e9ffff700 1 -- 172.21.2.102:0/1917900283 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7f2eac073810 con 0x7f2eb80b6350 2021-02-12T17:24:39.758 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.754+0000 7f2eb7fff700 1 --2- 172.21.2.102:0/1917900283 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2e98059d30 0x7f2e9805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:39.759 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.754+0000 7f2eb7fff700 1 --2- 172.21.2.102:0/1917900283 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2e98059d30 0x7f2e9805c1f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f2ea8009480 tx=0x7f2ea80069a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:39.759 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.756+0000 7f2e9ffff700 1 -- 172.21.2.102:0/1917900283 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f2eac046d40 con 0x7f2eb80b6350 2021-02-12T17:24:39.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.916+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1917900283 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2eb8045460 con 0x7f2eb80b6350 2021-02-12T17:24:39.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.916+0000 7f2e9ffff700 1 -- 172.21.2.102:0/1917900283 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f2eac04a360 con 0x7f2eb80b6350 2021-02-12T17:24:39.917 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:24:39.917 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:24:39.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.917+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1917900283 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2e98059d30 msgr2=0x7f2e9805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:39.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.917+0000 7f2ebe43c700 1 --2- 172.21.2.102:0/1917900283 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2e98059d30 0x7f2e9805c1f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f2ea8009480 tx=0x7f2ea80069a0).stop 2021-02-12T17:24:39.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.917+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1917900283 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2eb80b6350 msgr2=0x7f2eb8143c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:39.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.917+0000 7f2ebe43c700 1 --2- 172.21.2.102:0/1917900283 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2eb80b6350 0x7f2eb8143c70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f2eac009790 tx=0x7f2eac006eb0).stop 2021-02-12T17:24:39.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.917+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1917900283 shutdown_connections 2021-02-12T17:24:39.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.917+0000 7f2ebe43c700 1 --2- 172.21.2.102:0/1917900283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f2eb8144ea0 0x7f2eb8147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:39.919 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.917+0000 7f2ebe43c700 1 --2- 172.21.2.102:0/1917900283 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f2eb8067720 0x7f2eb8153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:39.919 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.917+0000 7f2ebe43c700 1 --2- 172.21.2.102:0/1917900283 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f2e98059d30 0x7f2e9805c1f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:39.919 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.917+0000 7f2ebe43c700 1 --2- 172.21.2.102:0/1917900283 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f2eb80b6350 0x7f2eb8143c70 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:39.919 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.917+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1917900283 >> 172.21.2.102:0/1917900283 conn(0x7f2eb80bc480 msgr2=0x7f2eb80b5430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:39.919 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.918+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1917900283 shutdown_connections 2021-02-12T17:24:39.919 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:39.918+0000 7f2ebe43c700 1 -- 172.21.2.102:0/1917900283 wait complete. 2021-02-12T17:24:39.919 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 55 2021-02-12T17:24:39.927 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:24:41.395 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:24:41.397 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:24:41.928 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:24:42.015 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.014+0000 7f74f53d0700 1 Processor -- start 2021-02-12T17:24:42.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.014+0000 7f74f53d0700 1 -- start start 2021-02-12T17:24:42.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.015+0000 7f74f53d0700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f74f00b8d20 0x7f74f0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:42.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.015+0000 7f74f53d0700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f74f0062740 0x7f74f0062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:42.016 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.015+0000 7f74f53d0700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f00b7960 con 0x7f74f014e530 2021-02-12T17:24:42.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.015+0000 7f74f53d0700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f0068d20 con 0x7f74f0062740 2021-02-12T17:24:42.017 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.015+0000 7f74f53d0700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f00622a0 con 0x7f74f00b8d20 2021-02-12T17:24:42.018 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.017+0000 7f74ee7fc700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f74f014e530 0x7f74f00b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:39110/0 (socket says 172.21.2.102:39110) 2021-02-12T17:24:42.019 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.017+0000 7f74ef7fe700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f74f0062740 0x7f74f0062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:42.019 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.017+0000 7f74ee7fc700 1 -- 172.21.2.102:0/2426274614 learned_addr learned my addr 172.21.2.102:0/2426274614 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:24:42.019 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.017+0000 7f74eeffd700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f74f00b8d20 0x7f74f0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:42.019 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.017+0000 7f74edffb700 1 -- 172.21.2.102:0/2426274614 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999400948 0 0) 0x7f74f00b7960 con 0x7f74f014e530 2021-02-12T17:24:42.019 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.017+0000 7f74edffb700 1 -- 172.21.2.102:0/2426274614 --> v1:172.21.2.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74d0003230 con 0x7f74f014e530 2021-02-12T17:24:42.019 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.017+0000 7f74ef7fe700 1 -- 172.21.2.102:0/2426274614 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f74f00b8d20 msgr2=0x7f74f0068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:24:42.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.017+0000 7f74ef7fe700 1 --2- 172.21.2.102:0/2426274614 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f74f00b8d20 0x7f74f0068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:42.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.017+0000 7f74ef7fe700 1 -- 172.21.2.102:0/2426274614 >> v1:172.21.2.104:6789/0 conn(0x7f74f014e530 legacy=0x7f74f00b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:42.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.017+0000 7f74ef7fe700 1 -- 172.21.2.102:0/2426274614 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f014ea10 con 0x7f74f0062740 2021-02-12T17:24:42.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.017+0000 7f74eeffd700 1 --2- 172.21.2.102:0/2426274614 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f74f00b8d20 0x7f74f0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:24:42.020 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.018+0000 7f74ef7fe700 1 --2- 172.21.2.102:0/2426274614 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f74f0062740 0x7f74f0062bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f74e8009c90 tx=0x7f74e80091d0).ready entity=mon.1 client_cookie=67d841f22e4398b7 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:42.021 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.018+0000 7f74edffb700 1 -- 172.21.2.102:0/2426274614 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e800b930 con 0x7f74f0062740 2021-02-12T17:24:42.021 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.018+0000 7f74edffb700 1 -- 172.21.2.102:0/2426274614 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e800ba90 con 0x7f74f0062740 2021-02-12T17:24:42.021 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.018+0000 7f74edffb700 1 -- 172.21.2.102:0/2426274614 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e800be10 con 0x7f74f0062740 2021-02-12T17:24:42.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.018+0000 7f74f53d0700 1 -- 172.21.2.102:0/2426274614 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f74f0062740 msgr2=0x7f74f0062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:42.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.018+0000 7f74f53d0700 1 --2- 172.21.2.102:0/2426274614 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f74f0062740 0x7f74f0062bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f74e8009c90 tx=0x7f74e80091d0).stop 2021-02-12T17:24:42.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.018+0000 7f74f53d0700 1 -- 172.21.2.102:0/2426274614 shutdown_connections 2021-02-12T17:24:42.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.018+0000 7f74f53d0700 1 --2- 172.21.2.102:0/2426274614 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f74f0062740 0x7f74f0062bf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:42.026 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.018+0000 7f74f53d0700 1 --2- 172.21.2.102:0/2426274614 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f74f00b8d20 0x7f74f0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:42.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.018+0000 7f74f53d0700 1 -- 172.21.2.102:0/2426274614 >> 172.21.2.102:0/2426274614 conn(0x7f74f00bc480 msgr2=0x7f74f00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:42.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.018+0000 7f74f53d0700 1 -- 172.21.2.102:0/2426274614 shutdown_connections 2021-02-12T17:24:42.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.018+0000 7f74f53d0700 1 -- 172.21.2.102:0/2426274614 wait complete. 2021-02-12T17:24:42.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.019+0000 7f74f53d0700 1 Processor -- start 2021-02-12T17:24:42.027 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.019+0000 7f74f53d0700 1 -- start start 2021-02-12T17:24:42.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74f53d0700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f74f0062740 0x7f74f015d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:42.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74f53d0700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f74f00b8d20 0x7f74f00acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:42.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74f53d0700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f74f014e530 0x7f74f00b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:42.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74f53d0700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f015d5d0 con 0x7f74f00b8d20 2021-02-12T17:24:42.028 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74f53d0700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f015d870 con 0x7f74f0062740 2021-02-12T17:24:42.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74f53d0700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f015db10 con 0x7f74f014e530 2021-02-12T17:24:42.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74ee7fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f74f00b8d20 0x7f74f00acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:42.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74ee7fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f74f00b8d20 0x7f74f00acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48104/0 (socket says 172.21.2.102:48104) 2021-02-12T17:24:42.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74ee7fc700 1 -- 172.21.2.102:0/1909213162 learned_addr learned my addr 172.21.2.102:0/1909213162 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:42.029 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74eeffd700 1 --2- 172.21.2.102:0/1909213162 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f74f0062740 0x7f74f015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:42.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74ef7fe700 1 --2- 172.21.2.102:0/1909213162 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f74f014e530 0x7f74f00b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:42.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74ee7fc700 1 -- 172.21.2.102:0/1909213162 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f74f014e530 msgr2=0x7f74f00b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:42.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74ee7fc700 1 --2- 172.21.2.102:0/1909213162 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f74f014e530 0x7f74f00b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:42.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74ee7fc700 1 -- 172.21.2.102:0/1909213162 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f74f0062740 msgr2=0x7f74f015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:42.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74ee7fc700 1 --2- 172.21.2.102:0/1909213162 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f74f0062740 0x7f74f015d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:42.030 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74ee7fc700 1 -- 172.21.2.102:0/1909213162 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f015ddb0 con 0x7f74f00b8d20 2021-02-12T17:24:42.031 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.020+0000 7f74ee7fc700 1 --2- 172.21.2.102:0/1909213162 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f74f00b8d20 0x7f74f00acf10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f74d800c6e0 tx=0x7f74d8007a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:42.031 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.021+0000 7f74e6ffd700 1 -- 172.21.2.102:0/1909213162 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d80072e0 con 0x7f74f00b8d20 2021-02-12T17:24:42.031 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.021+0000 7f74e6ffd700 1 -- 172.21.2.102:0/1909213162 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d8007440 con 0x7f74f00b8d20 2021-02-12T17:24:42.031 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.021+0000 7f74f53d0700 1 -- 172.21.2.102:0/1909213162 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f0063360 con 0x7f74f00b8d20 2021-02-12T17:24:42.031 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.021+0000 7f74e6ffd700 1 -- 172.21.2.102:0/1909213162 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d80057f0 con 0x7f74f00b8d20 2021-02-12T17:24:42.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.021+0000 7f74f53d0700 1 -- 172.21.2.102:0/1909213162 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f014aa70 con 0x7f74f00b8d20 2021-02-12T17:24:42.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.021+0000 7f74f53d0700 1 -- 172.21.2.102:0/1909213162 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f015df40 con 0x7f74f00b8d20 2021-02-12T17:24:42.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.021+0000 7f74e6ffd700 1 -- 172.21.2.102:0/1909213162 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f74d801a060 con 0x7f74f00b8d20 2021-02-12T17:24:42.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.022+0000 7f74e6ffd700 1 --2- 172.21.2.102:0/1909213162 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f74d4059d30 0x7f74d405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:42.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.022+0000 7f74e6ffd700 1 -- 172.21.2.102:0/1909213162 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7f74d8073780 con 0x7f74f00b8d20 2021-02-12T17:24:42.032 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.022+0000 7f74eeffd700 1 --2- 172.21.2.102:0/1909213162 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f74d4059d30 0x7f74d405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:42.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.022+0000 7f74eeffd700 1 --2- 172.21.2.102:0/1909213162 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f74d4059d30 0x7f74d405c1f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f74e000bdc0 tx=0x7f74e0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:42.033 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.025+0000 7f74e6ffd700 1 -- 172.21.2.102:0/1909213162 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f74d8046c50 con 0x7f74f00b8d20 2021-02-12T17:24:42.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.182+0000 7f74f53d0700 1 -- 172.21.2.102:0/1909213162 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74f0045460 con 0x7f74f00b8d20 2021-02-12T17:24:42.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.182+0000 7f74e6ffd700 1 -- 172.21.2.102:0/1909213162 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f74d8018070 con 0x7f74f00b8d20 2021-02-12T17:24:42.183 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:24:42.184 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:24:42.185 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.183+0000 7f74f53d0700 1 -- 172.21.2.102:0/1909213162 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f74d4059d30 msgr2=0x7f74d405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:42.185 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.183+0000 7f74f53d0700 1 --2- 172.21.2.102:0/1909213162 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f74d4059d30 0x7f74d405c1f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f74e000bdc0 tx=0x7f74e0008040).stop 2021-02-12T17:24:42.185 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.183+0000 7f74f53d0700 1 -- 172.21.2.102:0/1909213162 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f74f00b8d20 msgr2=0x7f74f00acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:42.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.183+0000 7f74f53d0700 1 --2- 172.21.2.102:0/1909213162 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f74f00b8d20 0x7f74f00acf10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f74d800c6e0 tx=0x7f74d8007a10).stop 2021-02-12T17:24:42.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.183+0000 7f74f53d0700 1 -- 172.21.2.102:0/1909213162 shutdown_connections 2021-02-12T17:24:42.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.183+0000 7f74f53d0700 1 --2- 172.21.2.102:0/1909213162 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f74f014e530 0x7f74f00b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:42.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.183+0000 7f74f53d0700 1 --2- 172.21.2.102:0/1909213162 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f74f0062740 0x7f74f015d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:42.186 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.183+0000 7f74f53d0700 1 --2- 172.21.2.102:0/1909213162 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f74d4059d30 0x7f74d405c1f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:42.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.183+0000 7f74f53d0700 1 --2- 172.21.2.102:0/1909213162 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f74f00b8d20 0x7f74f00acf10 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:42.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.183+0000 7f74f53d0700 1 -- 172.21.2.102:0/1909213162 >> 172.21.2.102:0/1909213162 conn(0x7f74f00bc480 msgr2=0x7f74f00bb120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:42.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.183+0000 7f74f53d0700 1 -- 172.21.2.102:0/1909213162 shutdown_connections 2021-02-12T17:24:42.187 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:42.183+0000 7f74f53d0700 1 -- 172.21.2.102:0/1909213162 wait complete. 2021-02-12T17:24:42.187 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 55 2021-02-12T17:24:42.193 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:24:44.194 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:24:44.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.281+0000 7f8843007700 1 Processor -- start 2021-02-12T17:24:44.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.281+0000 7f8843007700 1 -- start start 2021-02-12T17:24:44.282 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.282+0000 7f8843007700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f883c0b8d20 0x7f883c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:44.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.282+0000 7f8843007700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f883c14e530 0x7f883c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:44.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.282+0000 7f8843007700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c0622a0 con 0x7f883c062740 2021-02-12T17:24:44.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.282+0000 7f8843007700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883c068d20 con 0x7f883c14e530 2021-02-12T17:24:44.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.282+0000 7f8843007700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c14ea10 con 0x7f883c0b8d20 2021-02-12T17:24:44.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.282+0000 7f883bfff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f883c14e530 0x7f883c0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:44.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.282+0000 7f883bfff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f883c14e530 0x7f883c0b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48112/0 (socket says 172.21.2.102:48112) 2021-02-12T17:24:44.283 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.282+0000 7f883bfff700 1 -- 172.21.2.102:0/339369461 learned_addr learned my addr 172.21.2.102:0/339369461 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:44.284 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f883bfff700 1 -- 172.21.2.102:0/339369461 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f883c0b8d20 msgr2=0x7f883c068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:24:44.284 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f883bfff700 1 --2- 172.21.2.102:0/339369461 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f883c0b8d20 0x7f883c068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:44.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f883bfff700 1 -- 172.21.2.102:0/339369461 >> v1:172.21.2.104:6789/0 conn(0x7f883c062740 legacy=0x7f883c062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:24:44.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f883bfff700 1 -- 172.21.2.102:0/339369461 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c0b63f0 con 0x7f883c14e530 2021-02-12T17:24:44.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f883bfff700 1 --2- 172.21.2.102:0/339369461 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f883c14e530 0x7f883c0b7250 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f882c00b9e0 tx=0x7f882c006ea0).ready entity=mon.0 client_cookie=873d5d3c7e753f41 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:44.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f883b7fe700 1 -- 172.21.2.102:0/339369461 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c009800 con 0x7f883c14e530 2021-02-12T17:24:44.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f883b7fe700 1 -- 172.21.2.102:0/339369461 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c009960 con 0x7f883c14e530 2021-02-12T17:24:44.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f883b7fe700 1 -- 172.21.2.102:0/339369461 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c009ce0 con 0x7f883c14e530 2021-02-12T17:24:44.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f8843007700 1 -- 172.21.2.102:0/339369461 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f883c14e530 msgr2=0x7f883c0b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:44.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f8843007700 1 --2- 172.21.2.102:0/339369461 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f883c14e530 0x7f883c0b7250 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f882c00b9e0 tx=0x7f882c006ea0).stop 2021-02-12T17:24:44.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f8843007700 1 -- 172.21.2.102:0/339369461 shutdown_connections 2021-02-12T17:24:44.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f8843007700 1 --2- 172.21.2.102:0/339369461 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f883c0b8d20 0x7f883c068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:44.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f8843007700 1 --2- 172.21.2.102:0/339369461 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f883c14e530 0x7f883c0b7250 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:44.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f8843007700 1 -- 172.21.2.102:0/339369461 >> 172.21.2.102:0/339369461 conn(0x7f883c0bc480 msgr2=0x7f883c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:44.285 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f8843007700 1 -- 172.21.2.102:0/339369461 shutdown_connections 2021-02-12T17:24:44.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.283+0000 7f8843007700 1 -- 172.21.2.102:0/339369461 wait complete. 2021-02-12T17:24:44.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.284+0000 7f8843007700 1 Processor -- start 2021-02-12T17:24:44.286 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.284+0000 7f8843007700 1 -- start start 2021-02-12T17:24:44.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8843007700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f883c062740 0x7f883c15dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:44.287 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8843007700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f883c0b8d20 0x7f883c1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:44.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8843007700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f883c14e530 0x7f883c0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:44.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8843007700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c15e250 con 0x7f883c062740 2021-02-12T17:24:44.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8843007700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0aef40 con 0x7f883c0b8d20 2021-02-12T17:24:44.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8843007700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0af1e0 con 0x7f883c14e530 2021-02-12T17:24:44.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8840da3700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f883c062740 0x7f883c15dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:44.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8840da3700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f883c062740 0x7f883c15dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48114/0 (socket says 172.21.2.102:48114) 2021-02-12T17:24:44.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8840da3700 1 -- 172.21.2.102:0/2504941852 learned_addr learned my addr 172.21.2.102:0/2504941852 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:44.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8840da3700 1 -- 172.21.2.102:0/2504941852 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f883c14e530 msgr2=0x7f883c0ad8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:24:44.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8840da3700 1 --2- 172.21.2.102:0/2504941852 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f883c14e530 0x7f883c0ad8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:44.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8840da3700 1 -- 172.21.2.102:0/2504941852 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f883c0b8d20 msgr2=0x7f883c1517d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:24:44.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8840da3700 1 --2- 172.21.2.102:0/2504941852 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f883c0b8d20 0x7f883c1517d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:44.288 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8840da3700 1 -- 172.21.2.102:0/2504941852 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c0acf10 con 0x7f883c062740 2021-02-12T17:24:44.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8840da3700 1 --2- 172.21.2.102:0/2504941852 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f883c062740 0x7f883c15dd60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f88240096b0 tx=0x7f8824006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:44.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8838ff9700 1 -- 172.21.2.102:0/2504941852 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882400d500 con 0x7f883c062740 2021-02-12T17:24:44.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8838ff9700 1 -- 172.21.2.102:0/2504941852 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882400d680 con 0x7f883c062740 2021-02-12T17:24:44.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8843007700 1 -- 172.21.2.102:0/2504941852 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883c0ad1b0 con 0x7f883c062740 2021-02-12T17:24:44.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8838ff9700 1 -- 172.21.2.102:0/2504941852 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882400da40 con 0x7f883c062740 2021-02-12T17:24:44.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.285+0000 7f8843007700 1 -- 172.21.2.102:0/2504941852 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c0aec70 con 0x7f883c062740 2021-02-12T17:24:44.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.286+0000 7f8843007700 1 -- 172.21.2.102:0/2504941852 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883c045460 con 0x7f883c062740 2021-02-12T17:24:44.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.286+0000 7f8838ff9700 1 -- 172.21.2.102:0/2504941852 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f8824012420 con 0x7f883c062740 2021-02-12T17:24:44.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.286+0000 7f8838ff9700 1 --2- 172.21.2.102:0/2504941852 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8820059d30 0x7f882005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:44.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.287+0000 7f8838ff9700 1 -- 172.21.2.102:0/2504941852 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7f8824074000 con 0x7f883c062740 2021-02-12T17:24:44.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.287+0000 7f883bfff700 1 --2- 172.21.2.102:0/2504941852 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8820059d30 0x7f882005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:44.289 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.287+0000 7f883bfff700 1 --2- 172.21.2.102:0/2504941852 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8820059d30 0x7f882005c1f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f882c00b9e0 tx=0x7f882c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:44.290 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.289+0000 7f8838ff9700 1 -- 172.21.2.102:0/2504941852 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f88240473c0 con 0x7f883c062740 2021-02-12T17:24:44.447 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.447+0000 7f8843007700 1 -- 172.21.2.102:0/2504941852 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f883c063670 con 0x7f883c062740 2021-02-12T17:24:44.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.447+0000 7f8838ff9700 1 -- 172.21.2.102:0/2504941852 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f882400ddb0 con 0x7f883c062740 2021-02-12T17:24:44.448 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:24:44.448 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:24:44.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.448+0000 7f8843007700 1 -- 172.21.2.102:0/2504941852 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8820059d30 msgr2=0x7f882005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:44.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.448+0000 7f8843007700 1 --2- 172.21.2.102:0/2504941852 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8820059d30 0x7f882005c1f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f882c00b9e0 tx=0x7f882c016000).stop 2021-02-12T17:24:44.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.448+0000 7f8843007700 1 -- 172.21.2.102:0/2504941852 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f883c062740 msgr2=0x7f883c15dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:44.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.448+0000 7f8843007700 1 --2- 172.21.2.102:0/2504941852 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f883c062740 0x7f883c15dd60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f88240096b0 tx=0x7f8824006de0).stop 2021-02-12T17:24:44.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.448+0000 7f8843007700 1 -- 172.21.2.102:0/2504941852 shutdown_connections 2021-02-12T17:24:44.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.448+0000 7f8843007700 1 --2- 172.21.2.102:0/2504941852 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f883c14e530 0x7f883c0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:44.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.448+0000 7f8843007700 1 --2- 172.21.2.102:0/2504941852 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8820059d30 0x7f882005c1f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:44.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.448+0000 7f8843007700 1 --2- 172.21.2.102:0/2504941852 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f883c062740 0x7f883c15dd60 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:44.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.448+0000 7f8843007700 1 --2- 172.21.2.102:0/2504941852 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f883c0b8d20 0x7f883c1517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:44.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.448+0000 7f8843007700 1 -- 172.21.2.102:0/2504941852 >> 172.21.2.102:0/2504941852 conn(0x7f883c0bc480 msgr2=0x7f883c0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:44.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.448+0000 7f8843007700 1 -- 172.21.2.102:0/2504941852 shutdown_connections 2021-02-12T17:24:44.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:44.448+0000 7f8843007700 1 -- 172.21.2.102:0/2504941852 wait complete. 2021-02-12T17:24:44.450 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 55 2021-02-12T17:24:44.458 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:24:46.459 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:24:46.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.545+0000 7f8971939700 1 Processor -- start 2021-02-12T17:24:46.546 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.545+0000 7f8971939700 1 -- start start 2021-02-12T17:24:46.547 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.546+0000 7f8971939700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f896c062e50 0x7f896c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:46.547 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.546+0000 7f8971939700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c0b7960 con 0x7f896c0b8d20 2021-02-12T17:24:46.547 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.546+0000 7f8971939700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c0622a0 con 0x7f896c14e530 2021-02-12T17:24:46.547 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.546+0000 7f8971939700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896c068d20 con 0x7f896c062e50 2021-02-12T17:24:46.547 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.546+0000 7f896b7fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f896c062e50 0x7f896c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:46.548 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.546+0000 7f896affd700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f896c0b8d20 0x7f896c0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56770/0 (socket says 172.21.2.102:56770) 2021-02-12T17:24:46.548 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.546+0000 7f896b7fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f896c062e50 0x7f896c068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48126/0 (socket says 172.21.2.102:48126) 2021-02-12T17:24:46.548 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.546+0000 7f896b7fe700 1 -- 172.21.2.102:0/3237379763 learned_addr learned my addr 172.21.2.102:0/3237379763 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:46.548 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.546+0000 7f896b7fe700 1 -- 172.21.2.102:0/3237379763 >> v1:172.21.2.104:6789/0 conn(0x7f896c14e530 legacy=0x7f896c062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:24:46.548 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.546+0000 7f896b7fe700 1 -- 172.21.2.102:0/3237379763 >> v1:172.21.2.102:6789/0 conn(0x7f896c0b8d20 legacy=0x7f896c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:46.548 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.546+0000 7f8969ffb700 1 -- 172.21.2.102:0/3237379763 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509960301 0 0) 0x7f896c0b7960 con 0x7f896c0b8d20 2021-02-12T17:24:46.548 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.547+0000 7f896b7fe700 1 -- 172.21.2.102:0/3237379763 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c14ea10 con 0x7f896c062e50 2021-02-12T17:24:46.548 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.547+0000 7f896b7fe700 1 --2- 172.21.2.102:0/3237379763 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f896c062e50 0x7f896c068830 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f8964009d50 tx=0x7f8964009290).ready entity=mon.0 client_cookie=89e9b5e875a6e7b7 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:46.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.547+0000 7f8969ffb700 1 -- 172.21.2.102:0/3237379763 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896400bbb0 con 0x7f896c062e50 2021-02-12T17:24:46.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.547+0000 7f8969ffb700 1 -- 172.21.2.102:0/3237379763 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896400bd10 con 0x7f896c062e50 2021-02-12T17:24:46.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.547+0000 7f8969ffb700 1 -- 172.21.2.102:0/3237379763 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964011610 con 0x7f896c062e50 2021-02-12T17:24:46.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.547+0000 7f8971939700 1 -- 172.21.2.102:0/3237379763 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f896c062e50 msgr2=0x7f896c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:46.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.547+0000 7f8971939700 1 --2- 172.21.2.102:0/3237379763 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f896c062e50 0x7f896c068830 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f8964009d50 tx=0x7f8964009290).stop 2021-02-12T17:24:46.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.547+0000 7f8971939700 1 -- 172.21.2.102:0/3237379763 shutdown_connections 2021-02-12T17:24:46.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.547+0000 7f8971939700 1 --2- 172.21.2.102:0/3237379763 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f896c062e50 0x7f896c068830 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:46.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.547+0000 7f8971939700 1 -- 172.21.2.102:0/3237379763 >> 172.21.2.102:0/3237379763 conn(0x7f896c0bc480 msgr2=0x7f896c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:46.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.547+0000 7f8971939700 1 -- 172.21.2.102:0/3237379763 shutdown_connections 2021-02-12T17:24:46.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.547+0000 7f8971939700 1 -- 172.21.2.102:0/3237379763 wait complete. 2021-02-12T17:24:46.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.548+0000 7f8971939700 1 Processor -- start 2021-02-12T17:24:46.551 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.548+0000 7f8971939700 1 -- start start 2021-02-12T17:24:46.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f8971939700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f896c062e50 0x7f896c161380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:46.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f8971939700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f896c0b8d20 0x7f896c0b98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:46.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f8971939700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f896c14e530 0x7f896c0b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:46.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f8971939700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0acf10 con 0x7f896c062e50 2021-02-12T17:24:46.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f8971939700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0ad140 con 0x7f896c0b8d20 2021-02-12T17:24:46.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f8971939700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c1609a0 con 0x7f896c14e530 2021-02-12T17:24:46.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f896affd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f896c062e50 0x7f896c161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:46.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f896a7fc700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f896c0b8d20 0x7f896c0b98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:46.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f896affd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f896c062e50 0x7f896c161380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48132/0 (socket says 172.21.2.102:48132) 2021-02-12T17:24:46.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f896affd700 1 -- 172.21.2.102:0/1765299081 learned_addr learned my addr 172.21.2.102:0/1765299081 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:46.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f896b7fe700 1 --2- 172.21.2.102:0/1765299081 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f896c14e530 0x7f896c0b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:46.552 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f896affd700 1 -- 172.21.2.102:0/1765299081 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f896c14e530 msgr2=0x7f896c0b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:46.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f896affd700 1 --2- 172.21.2.102:0/1765299081 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f896c14e530 0x7f896c0b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:46.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f896affd700 1 -- 172.21.2.102:0/1765299081 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f896c0b8d20 msgr2=0x7f896c0b98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:46.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f896affd700 1 --2- 172.21.2.102:0/1765299081 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f896c0b8d20 0x7f896c0b98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:46.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.549+0000 7f896affd700 1 -- 172.21.2.102:0/1765299081 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c160c40 con 0x7f896c062e50 2021-02-12T17:24:46.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.550+0000 7f896affd700 1 --2- 172.21.2.102:0/1765299081 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f896c062e50 0x7f896c161380 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f895c00c710 tx=0x7f895c007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:46.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.550+0000 7f8962ffd700 1 -- 172.21.2.102:0/1765299081 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c0072e0 con 0x7f896c062e50 2021-02-12T17:24:46.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.550+0000 7f8962ffd700 1 -- 172.21.2.102:0/1765299081 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c005520 con 0x7f896c062e50 2021-02-12T17:24:46.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.550+0000 7f8971939700 1 -- 172.21.2.102:0/1765299081 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896c160ee0 con 0x7f896c062e50 2021-02-12T17:24:46.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.550+0000 7f8971939700 1 -- 172.21.2.102:0/1765299081 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896c0bb5a0 con 0x7f896c062e50 2021-02-12T17:24:46.553 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.550+0000 7f8962ffd700 1 -- 172.21.2.102:0/1765299081 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c0058a0 con 0x7f896c062e50 2021-02-12T17:24:46.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.551+0000 7f8971939700 1 -- 172.21.2.102:0/1765299081 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896c045460 con 0x7f896c062e50 2021-02-12T17:24:46.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.551+0000 7f8962ffd700 1 -- 172.21.2.102:0/1765299081 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f895c010070 con 0x7f896c062e50 2021-02-12T17:24:46.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.551+0000 7f8962ffd700 1 --2- 172.21.2.102:0/1765299081 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8950059d60 0x7f895005c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:46.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.551+0000 7f8962ffd700 1 -- 172.21.2.102:0/1765299081 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7f895c073560 con 0x7f896c062e50 2021-02-12T17:24:46.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.551+0000 7f896a7fc700 1 --2- 172.21.2.102:0/1765299081 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8950059d60 0x7f895005c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:46.554 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.552+0000 7f896a7fc700 1 --2- 172.21.2.102:0/1765299081 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8950059d60 0x7f895005c220 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f896c153170 tx=0x7f8954008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:46.555 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.554+0000 7f8962ffd700 1 -- 172.21.2.102:0/1765299081 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f895c046a90 con 0x7f896c062e50 2021-02-12T17:24:46.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.713+0000 7f8971939700 1 -- 172.21.2.102:0/1765299081 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f896c067e40 con 0x7f896c062e50 2021-02-12T17:24:46.714 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.713+0000 7f8962ffd700 1 -- 172.21.2.102:0/1765299081 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f895c04a0b0 con 0x7f896c062e50 2021-02-12T17:24:46.714 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:24:46.714 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:24:46.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.715+0000 7f8971939700 1 -- 172.21.2.102:0/1765299081 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8950059d60 msgr2=0x7f895005c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:46.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.715+0000 7f8971939700 1 --2- 172.21.2.102:0/1765299081 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8950059d60 0x7f895005c220 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f896c153170 tx=0x7f8954008040).stop 2021-02-12T17:24:46.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.715+0000 7f8971939700 1 -- 172.21.2.102:0/1765299081 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f896c062e50 msgr2=0x7f896c161380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:46.715 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.715+0000 7f8971939700 1 --2- 172.21.2.102:0/1765299081 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f896c062e50 0x7f896c161380 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f895c00c710 tx=0x7f895c007ad0).stop 2021-02-12T17:24:46.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.715+0000 7f8971939700 1 -- 172.21.2.102:0/1765299081 shutdown_connections 2021-02-12T17:24:46.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.715+0000 7f8971939700 1 --2- 172.21.2.102:0/1765299081 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f896c14e530 0x7f896c0b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:46.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.715+0000 7f8971939700 1 --2- 172.21.2.102:0/1765299081 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8950059d60 0x7f895005c220 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:46.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.715+0000 7f8971939700 1 --2- 172.21.2.102:0/1765299081 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f896c062e50 0x7f896c161380 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:46.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.715+0000 7f8971939700 1 --2- 172.21.2.102:0/1765299081 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f896c0b8d20 0x7f896c0b98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:46.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.715+0000 7f8971939700 1 -- 172.21.2.102:0/1765299081 >> 172.21.2.102:0/1765299081 conn(0x7f896c0bc480 msgr2=0x7f896c151810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:46.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.715+0000 7f8971939700 1 -- 172.21.2.102:0/1765299081 shutdown_connections 2021-02-12T17:24:46.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:46.715+0000 7f8971939700 1 -- 172.21.2.102:0/1765299081 wait complete. 2021-02-12T17:24:46.717 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 55 2021-02-12T17:24:46.724 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:24:48.725 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:24:48.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.814+0000 7f1a60e9e700 1 Processor -- start 2021-02-12T17:24:48.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.814+0000 7f1a60e9e700 1 -- start start 2021-02-12T17:24:48.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.814+0000 7f1a60e9e700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f1a5c0b8d20 0x7f1a5c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:48.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.814+0000 7f1a60e9e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1a5c14e530 0x7f1a5c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:48.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.814+0000 7f1a60e9e700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5c0622a0 con 0x7f1a5c062740 2021-02-12T17:24:48.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.814+0000 7f1a60e9e700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c068d20 con 0x7f1a5c0b8d20 2021-02-12T17:24:48.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.814+0000 7f1a60e9e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c14ea10 con 0x7f1a5c14e530 2021-02-12T17:24:48.816 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.815+0000 7f1a5a59c700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f1a5c0b8d20 0x7f1a5c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:48.816 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.815+0000 7f1a5ad9d700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f1a5c062740 0x7f1a5c062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56784/0 (socket says 172.21.2.102:56784) 2021-02-12T17:24:48.816 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.815+0000 7f1a5ad9d700 1 -- 172.21.2.102:0/3835485753 learned_addr learned my addr 172.21.2.102:0/3835485753 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:24:48.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.815+0000 7f1a5a59c700 1 -- 172.21.2.102:0/3835485753 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1a5c14e530 msgr2=0x7f1a5c0b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:24:48.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.815+0000 7f1a5a59c700 1 --2- 172.21.2.102:0/3835485753 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1a5c14e530 0x7f1a5c0b7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:48.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.815+0000 7f1a5a59c700 1 -- 172.21.2.102:0/3835485753 >> v1:172.21.2.102:6789/0 conn(0x7f1a5c062740 legacy=0x7f1a5c062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:48.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.815+0000 7f1a5a59c700 1 -- 172.21.2.102:0/3835485753 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c0b63f0 con 0x7f1a5c0b8d20 2021-02-12T17:24:48.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.815+0000 7f1a5a59c700 1 --2- 172.21.2.102:0/3835485753 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1a5c0b8d20 0x7f1a5c068830 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f1a4c00b980 tx=0x7f1a4c006de0).ready entity=mon.0 client_cookie=36436fdd31bd697d server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:48.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.815+0000 7f1a5959a700 1 -- 172.21.2.102:0/3835485753 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0096e0 con 0x7f1a5c0b8d20 2021-02-12T17:24:48.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.815+0000 7f1a5959a700 1 -- 172.21.2.102:0/3835485753 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c009840 con 0x7f1a5c0b8d20 2021-02-12T17:24:48.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.815+0000 7f1a5959a700 1 -- 172.21.2.102:0/3835485753 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c009bc0 con 0x7f1a5c0b8d20 2021-02-12T17:24:48.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.816+0000 7f1a60e9e700 1 -- 172.21.2.102:0/3835485753 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1a5c0b8d20 msgr2=0x7f1a5c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:48.817 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.816+0000 7f1a60e9e700 1 --2- 172.21.2.102:0/3835485753 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1a5c0b8d20 0x7f1a5c068830 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f1a4c00b980 tx=0x7f1a4c006de0).stop 2021-02-12T17:24:48.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.816+0000 7f1a60e9e700 1 -- 172.21.2.102:0/3835485753 shutdown_connections 2021-02-12T17:24:48.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.816+0000 7f1a60e9e700 1 --2- 172.21.2.102:0/3835485753 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1a5c0b8d20 0x7f1a5c068830 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:48.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.816+0000 7f1a60e9e700 1 --2- 172.21.2.102:0/3835485753 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1a5c14e530 0x7f1a5c0b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:48.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.816+0000 7f1a60e9e700 1 -- 172.21.2.102:0/3835485753 >> 172.21.2.102:0/3835485753 conn(0x7f1a5c0bc480 msgr2=0x7f1a5c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:48.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.816+0000 7f1a60e9e700 1 -- 172.21.2.102:0/3835485753 shutdown_connections 2021-02-12T17:24:48.818 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.816+0000 7f1a60e9e700 1 -- 172.21.2.102:0/3835485753 wait complete. 2021-02-12T17:24:48.820 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.817+0000 7f1a60e9e700 1 Processor -- start 2021-02-12T17:24:48.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.817+0000 7f1a60e9e700 1 -- start start 2021-02-12T17:24:48.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.817+0000 7f1a60e9e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1a5c062740 0x7f1a5c14b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:48.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.817+0000 7f1a60e9e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1a5c0b8d20 0x7f1a5c11d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:48.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.817+0000 7f1a60e9e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1a5c14e530 0x7f1a5c0acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:48.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a60e9e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0b1740 con 0x7f1a5c14e530 2021-02-12T17:24:48.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a60e9e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c15e2e0 con 0x7f1a5c062740 2021-02-12T17:24:48.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a60e9e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0b7020 con 0x7f1a5c0b8d20 2021-02-12T17:24:48.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a5ad9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1a5c14e530 0x7f1a5c0acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:48.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a5ad9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1a5c14e530 0x7f1a5c0acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48146/0 (socket says 172.21.2.102:48146) 2021-02-12T17:24:48.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a5ad9d700 1 -- 172.21.2.102:0/268826413 learned_addr learned my addr 172.21.2.102:0/268826413 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:48.821 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a5ad9d700 1 -- 172.21.2.102:0/268826413 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1a5c0b8d20 msgr2=0x7f1a5c11d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:48.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a59d9b700 1 --2- 172.21.2.102:0/268826413 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1a5c0b8d20 0x7f1a5c11d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:48.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a5ad9d700 1 --2- 172.21.2.102:0/268826413 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1a5c0b8d20 0x7f1a5c11d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:48.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a5ad9d700 1 -- 172.21.2.102:0/268826413 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1a5c062740 msgr2=0x7f1a5c14b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:48.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a5ad9d700 1 --2- 172.21.2.102:0/268826413 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1a5c062740 0x7f1a5c14b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:48.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a5ad9d700 1 -- 172.21.2.102:0/268826413 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c15e040 con 0x7f1a5c14e530 2021-02-12T17:24:48.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a59d9b700 1 --2- 172.21.2.102:0/268826413 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1a5c0b8d20 0x7f1a5c11d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:24:48.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a5ad9d700 1 --2- 172.21.2.102:0/268826413 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1a5c14e530 0x7f1a5c0acf10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f1a540012a0 tx=0x7f1a54007ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:48.822 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a527fc700 1 -- 172.21.2.102:0/268826413 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54005b70 con 0x7f1a5c14e530 2021-02-12T17:24:48.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a527fc700 1 -- 172.21.2.102:0/268826413 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54005cd0 con 0x7f1a5c14e530 2021-02-12T17:24:48.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a60e9e700 1 -- 172.21.2.102:0/268826413 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5c0b4d30 con 0x7f1a5c14e530 2021-02-12T17:24:48.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a527fc700 1 -- 172.21.2.102:0/268826413 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54007360 con 0x7f1a5c14e530 2021-02-12T17:24:48.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.818+0000 7f1a60e9e700 1 -- 172.21.2.102:0/268826413 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5c15dc90 con 0x7f1a5c14e530 2021-02-12T17:24:48.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.819+0000 7f1a60e9e700 1 -- 172.21.2.102:0/268826413 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5c045460 con 0x7f1a5c14e530 2021-02-12T17:24:48.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.819+0000 7f1a527fc700 1 -- 172.21.2.102:0/268826413 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f1a54019020 con 0x7f1a5c14e530 2021-02-12T17:24:48.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.820+0000 7f1a527fc700 1 --2- 172.21.2.102:0/268826413 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1a40059d60 0x7f1a4005c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:48.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.820+0000 7f1a527fc700 1 -- 172.21.2.102:0/268826413 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7f1a54073c70 con 0x7f1a5c14e530 2021-02-12T17:24:48.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.820+0000 7f1a5a59c700 1 --2- 172.21.2.102:0/268826413 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1a40059d60 0x7f1a4005c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:48.823 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.820+0000 7f1a5a59c700 1 --2- 172.21.2.102:0/268826413 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1a40059d60 0x7f1a4005c220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f1a4c00b980 tx=0x7f1a4c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:48.824 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.822+0000 7f1a527fc700 1 -- 172.21.2.102:0/268826413 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f1a54047090 con 0x7f1a5c14e530 2021-02-12T17:24:48.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.979+0000 7f1a60e9e700 1 -- 172.21.2.102:0/268826413 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a5c063670 con 0x7f1a5c14e530 2021-02-12T17:24:48.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.979+0000 7f1a527fc700 1 -- 172.21.2.102:0/268826413 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f1a5404a6b0 con 0x7f1a5c14e530 2021-02-12T17:24:48.980 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:24:48.980 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:24:48.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.980+0000 7f1a60e9e700 1 -- 172.21.2.102:0/268826413 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1a40059d60 msgr2=0x7f1a4005c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:48.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.980+0000 7f1a60e9e700 1 --2- 172.21.2.102:0/268826413 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1a40059d60 0x7f1a4005c220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f1a4c00b980 tx=0x7f1a4c016000).stop 2021-02-12T17:24:48.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.980+0000 7f1a60e9e700 1 -- 172.21.2.102:0/268826413 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1a5c14e530 msgr2=0x7f1a5c0acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:48.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.980+0000 7f1a60e9e700 1 --2- 172.21.2.102:0/268826413 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1a5c14e530 0x7f1a5c0acf10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f1a540012a0 tx=0x7f1a54007ee0).stop 2021-02-12T17:24:48.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.981+0000 7f1a60e9e700 1 -- 172.21.2.102:0/268826413 shutdown_connections 2021-02-12T17:24:48.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.981+0000 7f1a60e9e700 1 --2- 172.21.2.102:0/268826413 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1a40059d60 0x7f1a4005c220 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:48.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.981+0000 7f1a60e9e700 1 --2- 172.21.2.102:0/268826413 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1a5c14e530 0x7f1a5c0acf10 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:48.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.981+0000 7f1a60e9e700 1 --2- 172.21.2.102:0/268826413 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1a5c062740 0x7f1a5c14b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:48.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.981+0000 7f1a60e9e700 1 --2- 172.21.2.102:0/268826413 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1a5c0b8d20 0x7f1a5c11d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:48.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.981+0000 7f1a60e9e700 1 -- 172.21.2.102:0/268826413 >> 172.21.2.102:0/268826413 conn(0x7f1a5c0bc480 msgr2=0x7f1a5c14cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:48.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.981+0000 7f1a60e9e700 1 -- 172.21.2.102:0/268826413 shutdown_connections 2021-02-12T17:24:48.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:48.981+0000 7f1a60e9e700 1 -- 172.21.2.102:0/268826413 wait complete. 2021-02-12T17:24:48.982 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 55 2021-02-12T17:24:48.990 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:24:50.991 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:24:51.080 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.080+0000 7f894bc53700 1 Processor -- start 2021-02-12T17:24:51.080 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.080+0000 7f894bc53700 1 -- start start 2021-02-12T17:24:51.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.080+0000 7f894bc53700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f894414e530 0x7f8944068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:51.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.080+0000 7f894bc53700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8944062740 0x7f8944062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:51.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.080+0000 7f894bc53700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89440b7960 con 0x7f89440b8d20 2021-02-12T17:24:51.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.080+0000 7f894bc53700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8944068d20 con 0x7f894414e530 2021-02-12T17:24:51.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.080+0000 7f894bc53700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89440622a0 con 0x7f8944062740 2021-02-12T17:24:51.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.081+0000 7f89491ee700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f894414e530 0x7f8944068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:51.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.081+0000 7f89491ee700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f894414e530 0x7f8944068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48156/0 (socket says 172.21.2.102:48156) 2021-02-12T17:24:51.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.081+0000 7f89491ee700 1 -- 172.21.2.102:0/320807736 learned_addr learned my addr 172.21.2.102:0/320807736 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:51.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.081+0000 7f89491ee700 1 -- 172.21.2.102:0/320807736 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8944062740 msgr2=0x7f8944062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:24:51.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.081+0000 7f89491ee700 1 --2- 172.21.2.102:0/320807736 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8944062740 0x7f8944062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:51.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.081+0000 7f89491ee700 1 -- 172.21.2.102:0/320807736 >> v1:172.21.2.104:6789/0 conn(0x7f89440b8d20 legacy=0x7f89440b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:24:51.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.081+0000 7f89491ee700 1 -- 172.21.2.102:0/320807736 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894414ea10 con 0x7f894414e530 2021-02-12T17:24:51.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.081+0000 7f89491ee700 1 --2- 172.21.2.102:0/320807736 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f894414e530 0x7f8944068830 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f893800b9e0 tx=0x7f8938006ea0).ready entity=mon.0 client_cookie=3facaba7c3edfb server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:51.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.081+0000 7f89489ed700 1 -- 172.21.2.102:0/320807736 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938009800 con 0x7f894414e530 2021-02-12T17:24:51.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.082+0000 7f89489ed700 1 -- 172.21.2.102:0/320807736 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8938009960 con 0x7f894414e530 2021-02-12T17:24:51.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.082+0000 7f89489ed700 1 -- 172.21.2.102:0/320807736 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938009ce0 con 0x7f894414e530 2021-02-12T17:24:51.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.082+0000 7f894bc53700 1 -- 172.21.2.102:0/320807736 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f894414e530 msgr2=0x7f8944068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:51.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.082+0000 7f894bc53700 1 --2- 172.21.2.102:0/320807736 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f894414e530 0x7f8944068830 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f893800b9e0 tx=0x7f8938006ea0).stop 2021-02-12T17:24:51.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.082+0000 7f894bc53700 1 -- 172.21.2.102:0/320807736 shutdown_connections 2021-02-12T17:24:51.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.082+0000 7f894bc53700 1 --2- 172.21.2.102:0/320807736 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f8944062740 0x7f8944062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:51.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.082+0000 7f894bc53700 1 --2- 172.21.2.102:0/320807736 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f894414e530 0x7f8944068830 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:51.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.082+0000 7f894bc53700 1 -- 172.21.2.102:0/320807736 >> 172.21.2.102:0/320807736 conn(0x7f89440bc480 msgr2=0x7f89440b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:51.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.082+0000 7f894bc53700 1 -- 172.21.2.102:0/320807736 shutdown_connections 2021-02-12T17:24:51.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.082+0000 7f894bc53700 1 -- 172.21.2.102:0/320807736 wait complete. 2021-02-12T17:24:51.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.083+0000 7f894bc53700 1 Processor -- start 2021-02-12T17:24:51.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.083+0000 7f894bc53700 1 -- start start 2021-02-12T17:24:51.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f894bc53700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8944062740 0x7f8944151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:51.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f894bc53700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f89440b8d20 0x7f89440ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:51.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f894bc53700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f894414e530 0x7f89440ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:51.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f894bc53700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89440b1c70 con 0x7f89440b8d20 2021-02-12T17:24:51.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f894bc53700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89440aee90 con 0x7f8944062740 2021-02-12T17:24:51.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f894bc53700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8944160cd0 con 0x7f894414e530 2021-02-12T17:24:51.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f89491ee700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f89440b8d20 0x7f89440ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:51.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f89491ee700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f89440b8d20 0x7f89440ae4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48158/0 (socket says 172.21.2.102:48158) 2021-02-12T17:24:51.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f89491ee700 1 -- 172.21.2.102:0/4080369208 learned_addr learned my addr 172.21.2.102:0/4080369208 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:51.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f894a1f0700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f894414e530 0x7f89440ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:51.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f89499ef700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8944062740 0x7f8944151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:51.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f89491ee700 1 -- 172.21.2.102:0/4080369208 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f894414e530 msgr2=0x7f89440ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:51.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f89491ee700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f894414e530 0x7f89440ae9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:51.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f89491ee700 1 -- 172.21.2.102:0/4080369208 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8944062740 msgr2=0x7f8944151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:51.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f89491ee700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8944062740 0x7f8944151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:51.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f89491ee700 1 -- 172.21.2.102:0/4080369208 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8944160f30 con 0x7f89440b8d20 2021-02-12T17:24:51.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f89499ef700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8944062740 0x7f8944151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:24:51.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f89491ee700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f89440b8d20 0x7f89440ae4b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f8938007fd0 tx=0x7f8938016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:51.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.084+0000 7f8935ffb700 1 -- 172.21.2.102:0/4080369208 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938011e30 con 0x7f89440b8d20 2021-02-12T17:24:51.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.085+0000 7f8935ffb700 1 -- 172.21.2.102:0/4080369208 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893801c420 con 0x7f89440b8d20 2021-02-12T17:24:51.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.085+0000 7f894bc53700 1 -- 172.21.2.102:0/4080369208 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89441611d0 con 0x7f89440b8d20 2021-02-12T17:24:51.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.085+0000 7f8935ffb700 1 -- 172.21.2.102:0/4080369208 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893801c7a0 con 0x7f89440b8d20 2021-02-12T17:24:51.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.085+0000 7f894bc53700 1 -- 172.21.2.102:0/4080369208 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8944151b00 con 0x7f89440b8d20 2021-02-12T17:24:51.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.085+0000 7f894bc53700 1 -- 172.21.2.102:0/4080369208 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8944161ad0 con 0x7f89440b8d20 2021-02-12T17:24:51.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.085+0000 7f8935ffb700 1 -- 172.21.2.102:0/4080369208 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f893800f070 con 0x7f89440b8d20 2021-02-12T17:24:51.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.086+0000 7f8935ffb700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8924059d30 0x7f892405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:51.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.086+0000 7f8935ffb700 1 -- 172.21.2.102:0/4080369208 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7f8938075700 con 0x7f89440b8d20 2021-02-12T17:24:51.089 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.086+0000 7f89499ef700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8924059d30 0x7f892405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:51.089 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.086+0000 7f89499ef700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8924059d30 0x7f892405c1f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f894000a6d0 tx=0x7f8940008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:51.089 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.089+0000 7f8935ffb700 1 -- 172.21.2.102:0/4080369208 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f8938048c30 con 0x7f89440b8d20 2021-02-12T17:24:51.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.249+0000 7f894bc53700 1 -- 172.21.2.102:0/4080369208 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89441618d0 con 0x7f89440b8d20 2021-02-12T17:24:51.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.250+0000 7f8935ffb700 1 -- 172.21.2.102:0/4080369208 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f893804c250 con 0x7f89440b8d20 2021-02-12T17:24:51.251 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:24:51.251 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:24:51.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.251+0000 7f894bc53700 1 -- 172.21.2.102:0/4080369208 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8924059d30 msgr2=0x7f892405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:51.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.251+0000 7f894bc53700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8924059d30 0x7f892405c1f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f894000a6d0 tx=0x7f8940008040).stop 2021-02-12T17:24:51.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.251+0000 7f894bc53700 1 -- 172.21.2.102:0/4080369208 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f89440b8d20 msgr2=0x7f89440ae4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:51.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.251+0000 7f894bc53700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f89440b8d20 0x7f89440ae4b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f8938007fd0 tx=0x7f8938016000).stop 2021-02-12T17:24:51.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.251+0000 7f894bc53700 1 -- 172.21.2.102:0/4080369208 shutdown_connections 2021-02-12T17:24:51.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.251+0000 7f894bc53700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f894414e530 0x7f89440ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:51.252 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.251+0000 7f894bc53700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f8944062740 0x7f8944151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:51.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.251+0000 7f894bc53700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f8924059d30 0x7f892405c1f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:51.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.251+0000 7f894bc53700 1 --2- 172.21.2.102:0/4080369208 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f89440b8d20 0x7f89440ae4b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:51.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.251+0000 7f894bc53700 1 -- 172.21.2.102:0/4080369208 >> 172.21.2.102:0/4080369208 conn(0x7f89440bc480 msgr2=0x7f894414faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:51.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.251+0000 7f894bc53700 1 -- 172.21.2.102:0/4080369208 shutdown_connections 2021-02-12T17:24:51.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:51.251+0000 7f894bc53700 1 -- 172.21.2.102:0/4080369208 wait complete. 2021-02-12T17:24:51.253 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 55 2021-02-12T17:24:51.261 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:24:53.262 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:24:53.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.350+0000 7f387e8b4700 1 Processor -- start 2021-02-12T17:24:53.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.350+0000 7f387e8b4700 1 -- start start 2021-02-12T17:24:53.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.350+0000 7f387e8b4700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f38780b8d20 0x7f3878068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:53.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.350+0000 7f387e8b4700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38780b7960 con 0x7f3878062740 2021-02-12T17:24:53.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.350+0000 7f387e8b4700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38780622a0 con 0x7f387814e530 2021-02-12T17:24:53.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.350+0000 7f387e8b4700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3878068d20 con 0x7f38780b8d20 2021-02-12T17:24:53.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.351+0000 7f387ce51700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f3878062740 0x7f3878062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56810/0 (socket says 172.21.2.102:56810) 2021-02-12T17:24:53.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.351+0000 7f387ce51700 1 -- 172.21.2.102:0/158117833 learned_addr learned my addr 172.21.2.102:0/158117833 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:24:53.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.351+0000 7f3877fff700 1 --2- 172.21.2.102:0/158117833 >> v2:172.21.2.104:3300/0 conn(0x7f38780b8d20 0x7f3878068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:53.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.351+0000 7f3876ffd700 1 -- 172.21.2.102:0/158117833 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875153108 0 0) 0x7f38780b7960 con 0x7f3878062740 2021-02-12T17:24:53.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.351+0000 7f3876ffd700 1 -- 172.21.2.102:0/158117833 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3864003230 con 0x7f3878062740 2021-02-12T17:24:53.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.351+0000 7f3877fff700 1 -- 172.21.2.102:0/158117833 >> v1:172.21.2.104:6789/0 conn(0x7f387814e530 legacy=0x7f38780b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:53.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.351+0000 7f3877fff700 1 -- 172.21.2.102:0/158117833 >> v1:172.21.2.102:6789/0 conn(0x7f3878062740 legacy=0x7f3878062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:53.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.351+0000 7f3877fff700 1 -- 172.21.2.102:0/158117833 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387814ea10 con 0x7f38780b8d20 2021-02-12T17:24:53.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.351+0000 7f3877fff700 1 --2- 172.21.2.102:0/158117833 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38780b8d20 0x7f3878068830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f386c00b980 tx=0x7f386c006de0).ready entity=mon.1 client_cookie=b7c282f3a73f8037 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:53.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.352+0000 7f3876ffd700 1 -- 172.21.2.102:0/158117833 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c00be70 con 0x7f38780b8d20 2021-02-12T17:24:53.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.352+0000 7f3876ffd700 1 -- 172.21.2.102:0/158117833 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c0097e0 con 0x7f38780b8d20 2021-02-12T17:24:53.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.352+0000 7f3876ffd700 1 -- 172.21.2.102:0/158117833 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c009b60 con 0x7f38780b8d20 2021-02-12T17:24:53.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.352+0000 7f387e8b4700 1 -- 172.21.2.102:0/158117833 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38780b8d20 msgr2=0x7f3878068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:53.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.352+0000 7f387e8b4700 1 --2- 172.21.2.102:0/158117833 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38780b8d20 0x7f3878068830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f386c00b980 tx=0x7f386c006de0).stop 2021-02-12T17:24:53.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.352+0000 7f387e8b4700 1 -- 172.21.2.102:0/158117833 shutdown_connections 2021-02-12T17:24:53.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.352+0000 7f387e8b4700 1 --2- 172.21.2.102:0/158117833 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38780b8d20 0x7f3878068830 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:53.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.352+0000 7f387e8b4700 1 -- 172.21.2.102:0/158117833 >> 172.21.2.102:0/158117833 conn(0x7f38780bc480 msgr2=0x7f38780b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:53.354 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.352+0000 7f387e8b4700 1 -- 172.21.2.102:0/158117833 shutdown_connections 2021-02-12T17:24:53.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.352+0000 7f387e8b4700 1 -- 172.21.2.102:0/158117833 wait complete. 2021-02-12T17:24:53.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.353+0000 7f387e8b4700 1 Processor -- start 2021-02-12T17:24:53.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.353+0000 7f387e8b4700 1 -- start start 2021-02-12T17:24:53.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.353+0000 7f387e8b4700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3878062740 0x7f38780ba240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:53.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.353+0000 7f387e8b4700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38780b8d20 0x7f38780b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:53.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.353+0000 7f387e8b4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f387814e530 0x7f38780b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:53.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.353+0000 7f387e8b4700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38780aeb40 con 0x7f387814e530 2021-02-12T17:24:53.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.353+0000 7f387e8b4700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38780b5810 con 0x7f38780b8d20 2021-02-12T17:24:53.355 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.353+0000 7f387e8b4700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3878160c00 con 0x7f3878062740 2021-02-12T17:24:53.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f387ce51700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f387814e530 0x7f38780b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:53.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f387ce51700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f387814e530 0x7f38780b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48174/0 (socket says 172.21.2.102:48174) 2021-02-12T17:24:53.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f387ce51700 1 -- 172.21.2.102:0/2096539464 learned_addr learned my addr 172.21.2.102:0/2096539464 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:53.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f38777fe700 1 --2- 172.21.2.102:0/2096539464 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38780b8d20 0x7f38780b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:53.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f3877fff700 1 --2- 172.21.2.102:0/2096539464 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3878062740 0x7f38780ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:53.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f387ce51700 1 -- 172.21.2.102:0/2096539464 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3878062740 msgr2=0x7f38780ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:53.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f387ce51700 1 --2- 172.21.2.102:0/2096539464 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3878062740 0x7f38780ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:53.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f387ce51700 1 -- 172.21.2.102:0/2096539464 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38780b8d20 msgr2=0x7f38780b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:53.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f387ce51700 1 --2- 172.21.2.102:0/2096539464 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38780b8d20 0x7f38780b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:53.357 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f387ce51700 1 -- 172.21.2.102:0/2096539464 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3878160ea0 con 0x7f387814e530 2021-02-12T17:24:53.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f387ce51700 1 --2- 172.21.2.102:0/2096539464 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f387814e530 0x7f38780b10b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f3870005910 tx=0x7f3870007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:53.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f385ffff700 1 -- 172.21.2.102:0/2096539464 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3870005b70 con 0x7f387814e530 2021-02-12T17:24:53.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f385ffff700 1 -- 172.21.2.102:0/2096539464 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3870005cd0 con 0x7f387814e530 2021-02-12T17:24:53.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f387e8b4700 1 -- 172.21.2.102:0/2096539464 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3878161140 con 0x7f387814e530 2021-02-12T17:24:53.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f385ffff700 1 -- 172.21.2.102:0/2096539464 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3870007320 con 0x7f387814e530 2021-02-12T17:24:53.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.354+0000 7f387e8b4700 1 -- 172.21.2.102:0/2096539464 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38781608f0 con 0x7f387814e530 2021-02-12T17:24:53.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.355+0000 7f387e8b4700 1 -- 172.21.2.102:0/2096539464 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3878045460 con 0x7f387814e530 2021-02-12T17:24:53.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.355+0000 7f385ffff700 1 -- 172.21.2.102:0/2096539464 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f3870010030 con 0x7f387814e530 2021-02-12T17:24:53.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.356+0000 7f385ffff700 1 --2- 172.21.2.102:0/2096539464 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3858059d30 0x7f385805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:53.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.356+0000 7f385ffff700 1 -- 172.21.2.102:0/2096539464 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7f3870073fd0 con 0x7f387814e530 2021-02-12T17:24:53.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.356+0000 7f3877fff700 1 --2- 172.21.2.102:0/2096539464 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3858059d30 0x7f385805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:53.358 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.356+0000 7f3877fff700 1 --2- 172.21.2.102:0/2096539464 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3858059d30 0x7f385805c1f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f386c006e20 tx=0x7f386c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:53.359 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.359+0000 7f385ffff700 1 -- 172.21.2.102:0/2096539464 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f38700473f0 con 0x7f387814e530 2021-02-12T17:24:53.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.517+0000 7f387e8b4700 1 -- 172.21.2.102:0/2096539464 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3878063670 con 0x7f387814e530 2021-02-12T17:24:53.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.518+0000 7f385ffff700 1 -- 172.21.2.102:0/2096539464 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f387004aa10 con 0x7f387814e530 2021-02-12T17:24:53.518 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:24:53.519 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:24:53.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.519+0000 7f387e8b4700 1 -- 172.21.2.102:0/2096539464 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3858059d30 msgr2=0x7f385805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:53.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.519+0000 7f387e8b4700 1 --2- 172.21.2.102:0/2096539464 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3858059d30 0x7f385805c1f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f386c006e20 tx=0x7f386c016000).stop 2021-02-12T17:24:53.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.519+0000 7f387e8b4700 1 -- 172.21.2.102:0/2096539464 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f387814e530 msgr2=0x7f38780b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:53.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.519+0000 7f387e8b4700 1 --2- 172.21.2.102:0/2096539464 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f387814e530 0x7f38780b10b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f3870005910 tx=0x7f3870007e10).stop 2021-02-12T17:24:53.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.519+0000 7f387e8b4700 1 -- 172.21.2.102:0/2096539464 shutdown_connections 2021-02-12T17:24:53.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.519+0000 7f387e8b4700 1 --2- 172.21.2.102:0/2096539464 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f3858059d30 0x7f385805c1f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:53.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.519+0000 7f387e8b4700 1 --2- 172.21.2.102:0/2096539464 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f387814e530 0x7f38780b10b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:53.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.519+0000 7f387e8b4700 1 --2- 172.21.2.102:0/2096539464 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f3878062740 0x7f38780ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:53.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.519+0000 7f387e8b4700 1 --2- 172.21.2.102:0/2096539464 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38780b8d20 0x7f38780b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:53.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.519+0000 7f387e8b4700 1 -- 172.21.2.102:0/2096539464 >> 172.21.2.102:0/2096539464 conn(0x7f38780bc480 msgr2=0x7f38780b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:53.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.519+0000 7f387e8b4700 1 -- 172.21.2.102:0/2096539464 shutdown_connections 2021-02-12T17:24:53.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:53.519+0000 7f387e8b4700 1 -- 172.21.2.102:0/2096539464 wait complete. 2021-02-12T17:24:53.521 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 55 2021-02-12T17:24:53.528 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:24:55.529 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:24:55.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.617+0000 7fbc421f0700 1 Processor -- start 2021-02-12T17:24:55.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.617+0000 7fbc421f0700 1 -- start start 2021-02-12T17:24:55.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.618+0000 7fbc421f0700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fbc3c067720 0x7fbc3c0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:55.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.618+0000 7fbc421f0700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbc3c062580 0x7fbc3c1463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:55.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.618+0000 7fbc421f0700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c0b2930 con 0x7fbc3c144ea0 2021-02-12T17:24:55.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.618+0000 7fbc421f0700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c068980 con 0x7fbc3c067720 2021-02-12T17:24:55.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.618+0000 7fbc421f0700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c145a40 con 0x7fbc3c062580 2021-02-12T17:24:55.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.618+0000 7fbc3bfff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fbc3c144ea0 0x7fbc3c145330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56824/0 (socket says 172.21.2.102:56824) 2021-02-12T17:24:55.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.618+0000 7fbc3bfff700 1 -- 172.21.2.102:0/3372758147 learned_addr learned my addr 172.21.2.102:0/3372758147 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:24:55.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 -- 172.21.2.102:0/3372758147 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494831383 0 0) 0x7fbc34001450 con 0x7fbc3c144ea0 2021-02-12T17:24:55.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 -- 172.21.2.102:0/3372758147 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc1c003230 con 0x7fbc3c144ea0 2021-02-12T17:24:55.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3affd700 1 --2- 172.21.2.102:0/3372758147 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbc3c062580 0x7fbc3c1463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:55.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3b7fe700 1 --2- 172.21.2.102:0/3372758147 >> v2:172.21.2.104:3300/0 conn(0x7fbc3c067720 0x7fbc3c0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:55.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 -- 172.21.2.102:0/3372758147 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1413610991 0 0) 0x7fbc1c003230 con 0x7fbc3c144ea0 2021-02-12T17:24:55.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 -- 172.21.2.102:0/3372758147 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbc3c062580 msgr2=0x7fbc3c1463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:24:55.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 --2- 172.21.2.102:0/3372758147 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbc3c062580 0x7fbc3c1463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:55.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 -- 172.21.2.102:0/3372758147 >> v2:172.21.2.104:3300/0 conn(0x7fbc3c067720 msgr2=0x7fbc3c0b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:24:55.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 --2- 172.21.2.102:0/3372758147 >> v2:172.21.2.104:3300/0 conn(0x7fbc3c067720 0x7fbc3c0b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:55.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 -- 172.21.2.102:0/3372758147 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c066db0 con 0x7fbc3c144ea0 2021-02-12T17:24:55.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 -- 172.21.2.102:0/3372758147 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fbc340019f0 con 0x7fbc3c144ea0 2021-02-12T17:24:55.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 -- 172.21.2.102:0/3372758147 >> v1:172.21.2.102:6789/0 conn(0x7fbc3c144ea0 legacy=0x7fbc3c145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:55.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 --2- 172.21.2.102:0/3372758147 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbc1c0037d0 0x7fbc1c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:55.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 --2- 172.21.2.102:0/3372758147 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbc1c0044d0 0x7fbc1c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:55.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 --2- 172.21.2.102:0/3372758147 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbc3c062580 0x7fbc1c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:55.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 -- 172.21.2.102:0/3372758147 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c068980 con 0x7fbc1c0044d0 2021-02-12T17:24:55.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 -- 172.21.2.102:0/3372758147 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c145a40 con 0x7fbc1c0037d0 2021-02-12T17:24:55.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3a7fc700 1 -- 172.21.2.102:0/3372758147 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c005330 con 0x7fbc3c062580 2021-02-12T17:24:55.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3b7fe700 1 --2- 172.21.2.102:0/3372758147 >> v2:172.21.2.104:3300/0 conn(0x7fbc3c067720 0x7fbc3c0b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:24:55.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.619+0000 7fbc3affd700 1 --2- 172.21.2.102:0/3372758147 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbc1c0044d0 0x7fbc1c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:55.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc3affd700 1 -- 172.21.2.102:0/3372758147 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbc3c062580 msgr2=0x7fbc1c004e40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:24:55.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc3affd700 1 --2- 172.21.2.102:0/3372758147 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbc3c062580 0x7fbc1c004e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:55.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc3affd700 1 -- 172.21.2.102:0/3372758147 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbc1c0037d0 msgr2=0x7fbc1c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:24:55.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc3affd700 1 --2- 172.21.2.102:0/3372758147 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbc1c0037d0 0x7fbc1c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:55.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc3affd700 1 -- 172.21.2.102:0/3372758147 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c066db0 con 0x7fbc1c0044d0 2021-02-12T17:24:55.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc3affd700 1 --2- 172.21.2.102:0/3372758147 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbc1c0044d0 0x7fbc1c004950 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fbc2400bb90 tx=0x7fbc24008040).ready entity=mon.0 client_cookie=636f52f2b5a1bfd6 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:55.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc3a7fc700 1 -- 172.21.2.102:0/3372758147 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2400b2b0 con 0x7fbc1c0044d0 2021-02-12T17:24:55.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc3a7fc700 1 -- 172.21.2.102:0/3372758147 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2400ea00 con 0x7fbc1c0044d0 2021-02-12T17:24:55.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc3a7fc700 1 -- 172.21.2.102:0/3372758147 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2400ed80 con 0x7fbc1c0044d0 2021-02-12T17:24:55.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc421f0700 1 -- 172.21.2.102:0/3372758147 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbc1c0044d0 msgr2=0x7fbc1c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:55.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc421f0700 1 --2- 172.21.2.102:0/3372758147 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbc1c0044d0 0x7fbc1c004950 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fbc2400bb90 tx=0x7fbc24008040).stop 2021-02-12T17:24:55.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc3bfff700 1 -- 172.21.2.102:0/3372758147 reap_dead start 2021-02-12T17:24:55.624 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc421f0700 1 -- 172.21.2.102:0/3372758147 shutdown_connections 2021-02-12T17:24:55.625 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc421f0700 1 -- 172.21.2.102:0/3372758147 >> 172.21.2.102:0/3372758147 conn(0x7fbc3c0bc480 msgr2=0x7fbc3c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:55.625 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc421f0700 1 -- 172.21.2.102:0/3372758147 shutdown_connections 2021-02-12T17:24:55.625 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.620+0000 7fbc421f0700 1 -- 172.21.2.102:0/3372758147 wait complete. 2021-02-12T17:24:55.625 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.621+0000 7fbc421f0700 1 Processor -- start 2021-02-12T17:24:55.625 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.621+0000 7fbc421f0700 1 -- start start 2021-02-12T17:24:55.625 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc421f0700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbc3c0b52f0 0x7fbc3c1613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:55.625 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc421f0700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbc3c0b10b0 0x7fbc3c15d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:55.625 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc421f0700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbc3c15d820 0x7fbc3c0af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:55.625 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc421f0700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0b18a0 con 0x7fbc3c0b10b0 2021-02-12T17:24:55.625 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc421f0700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c160a00 con 0x7fbc3c15d820 2021-02-12T17:24:55.625 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc421f0700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0b1600 con 0x7fbc3c0b52f0 2021-02-12T17:24:55.627 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc3affd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbc3c0b10b0 0x7fbc3c15d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:55.627 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc3affd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbc3c0b10b0 0x7fbc3c15d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48190/0 (socket says 172.21.2.102:48190) 2021-02-12T17:24:55.627 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc3affd700 1 -- 172.21.2.102:0/178331933 learned_addr learned my addr 172.21.2.102:0/178331933 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:55.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc3b7fe700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbc3c0b52f0 0x7fbc3c1613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:55.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc3bfff700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbc3c15d820 0x7fbc3c0af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:55.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc3affd700 1 -- 172.21.2.102:0/178331933 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbc3c0b52f0 msgr2=0x7fbc3c1613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:55.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc3affd700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbc3c0b52f0 0x7fbc3c1613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:55.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc3affd700 1 -- 172.21.2.102:0/178331933 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbc3c15d820 msgr2=0x7fbc3c0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:55.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc3affd700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbc3c15d820 0x7fbc3c0af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:55.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc3affd700 1 -- 172.21.2.102:0/178331933 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c160c60 con 0x7fbc3c0b10b0 2021-02-12T17:24:55.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc3bfff700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbc3c15d820 0x7fbc3c0af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:24:55.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.622+0000 7fbc3affd700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbc3c0b10b0 0x7fbc3c15d330 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fbc2400e4b0 tx=0x7fbc2401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:55.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.623+0000 7fbc337fe700 1 -- 172.21.2.102:0/178331933 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24012e60 con 0x7fbc3c0b10b0 2021-02-12T17:24:55.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.623+0000 7fbc337fe700 1 -- 172.21.2.102:0/178331933 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2401b660 con 0x7fbc3c0b10b0 2021-02-12T17:24:55.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.623+0000 7fbc337fe700 1 -- 172.21.2.102:0/178331933 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2401ba00 con 0x7fbc3c0b10b0 2021-02-12T17:24:55.628 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.623+0000 7fbc421f0700 1 -- 172.21.2.102:0/178331933 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c160f00 con 0x7fbc3c0b10b0 2021-02-12T17:24:55.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.623+0000 7fbc421f0700 1 -- 172.21.2.102:0/178331933 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c146ed0 con 0x7fbc3c0b10b0 2021-02-12T17:24:55.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.623+0000 7fbc421f0700 1 -- 172.21.2.102:0/178331933 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3c14ad10 con 0x7fbc3c0b10b0 2021-02-12T17:24:55.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.624+0000 7fbc337fe700 1 -- 172.21.2.102:0/178331933 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fbc24026440 con 0x7fbc3c0b10b0 2021-02-12T17:24:55.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.624+0000 7fbc337fe700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbc20059d60 0x7fbc2005c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:55.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.624+0000 7fbc337fe700 1 -- 172.21.2.102:0/178331933 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 7623+0+0 (secure 0 0 0) 0x7fbc24075fb0 con 0x7fbc3c0b10b0 2021-02-12T17:24:55.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.624+0000 7fbc3b7fe700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbc20059d60 0x7fbc2005c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:55.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.624+0000 7fbc3b7fe700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbc20059d60 0x7fbc2005c220 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fbc2c006a80 tx=0x7fbc2c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:55.629 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.627+0000 7fbc337fe700 1 -- 172.21.2.102:0/178331933 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fbc24049480 con 0x7fbc3c0b10b0 2021-02-12T17:24:55.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.787+0000 7fbc421f0700 1 -- 172.21.2.102:0/178331933 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc3c161090 con 0x7fbc3c0b10b0 2021-02-12T17:24:55.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.787+0000 7fbc337fe700 1 -- 172.21.2.102:0/178331933 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3760 (secure 0 0 0) 0x7fbc2402b020 con 0x7fbc3c0b10b0 2021-02-12T17:24:55.788 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:24:55.788 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:22:34.342390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.2.102:6835/2467742327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":2467742327},{"type":"v1","addr":"172.21.2.102:6835","nonce":2467742327}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:24:55.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.788+0000 7fbc421f0700 1 -- 172.21.2.102:0/178331933 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbc20059d60 msgr2=0x7fbc2005c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:55.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.788+0000 7fbc421f0700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbc20059d60 0x7fbc2005c220 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fbc2c006a80 tx=0x7fbc2c008040).stop 2021-02-12T17:24:55.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.788+0000 7fbc421f0700 1 -- 172.21.2.102:0/178331933 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbc3c0b10b0 msgr2=0x7fbc3c15d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:55.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.788+0000 7fbc421f0700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbc3c0b10b0 0x7fbc3c15d330 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fbc2400e4b0 tx=0x7fbc2401a000).stop 2021-02-12T17:24:55.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.789+0000 7fbc421f0700 1 -- 172.21.2.102:0/178331933 shutdown_connections 2021-02-12T17:24:55.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.789+0000 7fbc421f0700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbc3c15d820 0x7fbc3c0af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:55.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.789+0000 7fbc421f0700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbc3c0b52f0 0x7fbc3c1613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:55.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.789+0000 7fbc421f0700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbc20059d60 0x7fbc2005c220 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:55.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.789+0000 7fbc421f0700 1 --2- 172.21.2.102:0/178331933 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbc3c0b10b0 0x7fbc3c15d330 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:55.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.789+0000 7fbc421f0700 1 -- 172.21.2.102:0/178331933 >> 172.21.2.102:0/178331933 conn(0x7fbc3c0bc480 msgr2=0x7fbc3c0ba3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:55.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.789+0000 7fbc421f0700 1 -- 172.21.2.102:0/178331933 shutdown_connections 2021-02-12T17:24:55.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:55.789+0000 7fbc421f0700 1 -- 172.21.2.102:0/178331933 wait complete. 2021-02-12T17:24:55.790 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 55 2021-02-12T17:24:55.798 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-02-12T17:24:57.799 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:24:57.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.889+0000 7fd7c7bb3700 1 Processor -- start 2021-02-12T17:24:57.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.889+0000 7fd7c7bb3700 1 -- start start 2021-02-12T17:24:57.890 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.889+0000 7fd7c7bb3700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fd7c00b8d20 0x7fd7c0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:57.890 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.889+0000 7fd7c7bb3700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fd7c014e530 0x7fd7c00b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:57.890 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.889+0000 7fd7c7bb3700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c00622a0 con 0x7fd7c0062740 2021-02-12T17:24:57.890 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.889+0000 7fd7c7bb3700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c0068d20 con 0x7fd7c014e530 2021-02-12T17:24:57.890 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.889+0000 7fd7c7bb3700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c014ea10 con 0x7fd7c00b8d20 2021-02-12T17:24:57.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.890+0000 7fd7c514e700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fd7c014e530 0x7fd7c00b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:57.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.890+0000 7fd7c6150700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fd7c0062740 0x7fd7c0062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56858/0 (socket says 172.21.2.102:56858) 2021-02-12T17:24:57.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.890+0000 7fd7c6150700 1 -- 172.21.2.102:0/4159666782 learned_addr learned my addr 172.21.2.102:0/4159666782 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:24:57.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.890+0000 7fd7c594f700 1 --2- 172.21.2.102:0/4159666782 >> v2:172.21.2.104:3300/0 conn(0x7fd7c00b8d20 0x7fd7c0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:57.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.890+0000 7fd7c514e700 1 -- 172.21.2.102:0/4159666782 >> v2:172.21.2.104:3300/0 conn(0x7fd7c00b8d20 msgr2=0x7fd7c0068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:24:57.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.890+0000 7fd7c514e700 1 --2- 172.21.2.102:0/4159666782 >> v2:172.21.2.104:3300/0 conn(0x7fd7c00b8d20 0x7fd7c0068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:57.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.890+0000 7fd7c514e700 1 -- 172.21.2.102:0/4159666782 >> v1:172.21.2.102:6789/0 conn(0x7fd7c0062740 legacy=0x7fd7c0062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:57.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.890+0000 7fd7c494d700 1 -- 172.21.2.102:0/4159666782 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286841025 0 0) 0x7fd7c00622a0 con 0x7fd7c0062740 2021-02-12T17:24:57.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.890+0000 7fd7c514e700 1 -- 172.21.2.102:0/4159666782 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c00b63f0 con 0x7fd7c014e530 2021-02-12T17:24:57.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.890+0000 7fd7c514e700 1 --2- 172.21.2.102:0/4159666782 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd7c014e530 0x7fd7c00b7250 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fd7c006abc0 tx=0x7fd7bc006de0).ready entity=mon.0 client_cookie=a7b38430d68bc0ba server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:57.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.890+0000 7fd7c494d700 1 -- 172.21.2.102:0/4159666782 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc009630 con 0x7fd7c014e530 2021-02-12T17:24:57.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.890+0000 7fd7c494d700 1 -- 172.21.2.102:0/4159666782 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc009790 con 0x7fd7c014e530 2021-02-12T17:24:57.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.890+0000 7fd7c494d700 1 -- 172.21.2.102:0/4159666782 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc009b10 con 0x7fd7c014e530 2021-02-12T17:24:57.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.891+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/4159666782 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd7c014e530 msgr2=0x7fd7c00b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:57.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.891+0000 7fd7c7bb3700 1 --2- 172.21.2.102:0/4159666782 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd7c014e530 0x7fd7c00b7250 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fd7c006abc0 tx=0x7fd7bc006de0).stop 2021-02-12T17:24:57.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.891+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/4159666782 shutdown_connections 2021-02-12T17:24:57.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.891+0000 7fd7c7bb3700 1 --2- 172.21.2.102:0/4159666782 >> v2:172.21.2.104:3300/0 conn(0x7fd7c00b8d20 0x7fd7c0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:57.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.891+0000 7fd7c7bb3700 1 --2- 172.21.2.102:0/4159666782 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd7c014e530 0x7fd7c00b7250 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:57.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.891+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/4159666782 >> 172.21.2.102:0/4159666782 conn(0x7fd7c00bc480 msgr2=0x7fd7c00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:57.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.891+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/4159666782 shutdown_connections 2021-02-12T17:24:57.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.891+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/4159666782 wait complete. 2021-02-12T17:24:57.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.892+0000 7fd7c7bb3700 1 Processor -- start 2021-02-12T17:24:57.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.892+0000 7fd7c7bb3700 1 -- start start 2021-02-12T17:24:57.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.892+0000 7fd7c7bb3700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd7c0062740 0x7fd7c00b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:57.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.892+0000 7fd7c7bb3700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd7c00b8d20 0x7fd7c00b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:57.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.892+0000 7fd7c7bb3700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd7c014e530 0x7fd7c00b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:57.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.892+0000 7fd7c7bb3700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00afa00 con 0x7fd7c00b8d20 2021-02-12T17:24:57.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.892+0000 7fd7c7bb3700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c015d6f0 con 0x7fd7c0062740 2021-02-12T17:24:57.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.892+0000 7fd7c7bb3700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c015d990 con 0x7fd7c014e530 2021-02-12T17:24:57.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.892+0000 7fd7c514e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd7c00b8d20 0x7fd7c00b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:57.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.892+0000 7fd7c514e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd7c00b8d20 0x7fd7c00b0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48218/0 (socket says 172.21.2.102:48218) 2021-02-12T17:24:57.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.892+0000 7fd7c514e700 1 -- 172.21.2.102:0/2034530059 learned_addr learned my addr 172.21.2.102:0/2034530059 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:57.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.893+0000 7fd7c594f700 1 --2- 172.21.2.102:0/2034530059 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd7c0062740 0x7fd7c00b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:57.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.893+0000 7fd7c514e700 1 -- 172.21.2.102:0/2034530059 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd7c014e530 msgr2=0x7fd7c00b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:57.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.893+0000 7fd7c514e700 1 --2- 172.21.2.102:0/2034530059 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd7c014e530 0x7fd7c00b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:57.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.893+0000 7fd7c514e700 1 -- 172.21.2.102:0/2034530059 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd7c0062740 msgr2=0x7fd7c00b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:57.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.893+0000 7fd7c514e700 1 --2- 172.21.2.102:0/2034530059 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd7c0062740 0x7fd7c00b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:57.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.893+0000 7fd7c514e700 1 -- 172.21.2.102:0/2034530059 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c015dc30 con 0x7fd7c00b8d20 2021-02-12T17:24:57.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.893+0000 7fd7c514e700 1 --2- 172.21.2.102:0/2034530059 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd7c00b8d20 0x7fd7c00b0e90 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fd7bc006e20 tx=0x7fd7bc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:57.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.893+0000 7fd7adffb700 1 -- 172.21.2.102:0/2034530059 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc01c420 con 0x7fd7c00b8d20 2021-02-12T17:24:57.896 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.893+0000 7fd7adffb700 1 -- 172.21.2.102:0/2034530059 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc01c580 con 0x7fd7c00b8d20 2021-02-12T17:24:57.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.893+0000 7fd7adffb700 1 -- 172.21.2.102:0/2034530059 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc01c900 con 0x7fd7c00b8d20 2021-02-12T17:24:57.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.893+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/2034530059 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c015ded0 con 0x7fd7c00b8d20 2021-02-12T17:24:57.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.893+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/2034530059 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c015d2b0 con 0x7fd7c00b8d20 2021-02-12T17:24:57.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.894+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/2034530059 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c00bb820 con 0x7fd7c00b8d20 2021-02-12T17:24:57.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.894+0000 7fd7adffb700 1 -- 172.21.2.102:0/2034530059 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fd7bc00f070 con 0x7fd7c00b8d20 2021-02-12T17:24:57.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.894+0000 7fd7adffb700 1 --2- 172.21.2.102:0/2034530059 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd7a0059d30 0x7fd7a005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:57.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.895+0000 7fd7adffb700 1 -- 172.21.2.102:0/2034530059 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7fd7bc075b90 con 0x7fd7c00b8d20 2021-02-12T17:24:57.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.895+0000 7fd7c594f700 1 --2- 172.21.2.102:0/2034530059 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd7a0059d30 0x7fd7a005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:57.897 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.895+0000 7fd7c594f700 1 --2- 172.21.2.102:0/2034530059 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd7a0059d30 0x7fd7a005c1f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fd7b000bb80 tx=0x7fd7b0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:57.898 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:57.897+0000 7fd7adffb700 1 -- 172.21.2.102:0/2034530059 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fd7bc049070 con 0x7fd7c00b8d20 2021-02-12T17:24:58.056 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.056+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/2034530059 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7c0045460 con 0x7fd7c00b8d20 2021-02-12T17:24:58.057 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.056+0000 7fd7adffb700 1 -- 172.21.2.102:0/2034530059 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3410 (secure 0 0 0) 0x7fd7bc04c690 con 0x7fd7c00b8d20 2021-02-12T17:24:58.057 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:24:58.057 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":57,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:57.788734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:reconnect","state_seq":26,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:24:58.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.057+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/2034530059 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd7a0059d30 msgr2=0x7fd7a005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:58.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.057+0000 7fd7c7bb3700 1 --2- 172.21.2.102:0/2034530059 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd7a0059d30 0x7fd7a005c1f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fd7b000bb80 tx=0x7fd7b0008040).stop 2021-02-12T17:24:58.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.057+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/2034530059 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd7c00b8d20 msgr2=0x7fd7c00b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:58.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.057+0000 7fd7c7bb3700 1 --2- 172.21.2.102:0/2034530059 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd7c00b8d20 0x7fd7c00b0e90 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fd7bc006e20 tx=0x7fd7bc016000).stop 2021-02-12T17:24:58.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.058+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/2034530059 shutdown_connections 2021-02-12T17:24:58.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.058+0000 7fd7c7bb3700 1 --2- 172.21.2.102:0/2034530059 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fd7c014e530 0x7fd7c00b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:58.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.058+0000 7fd7c7bb3700 1 --2- 172.21.2.102:0/2034530059 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fd7c0062740 0x7fd7c00b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:58.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.058+0000 7fd7c7bb3700 1 --2- 172.21.2.102:0/2034530059 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fd7a0059d30 0x7fd7a005c1f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:58.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.058+0000 7fd7c7bb3700 1 --2- 172.21.2.102:0/2034530059 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fd7c00b8d20 0x7fd7c00b0e90 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:58.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.058+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/2034530059 >> 172.21.2.102:0/2034530059 conn(0x7fd7c00bc480 msgr2=0x7fd7c00badc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:58.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.058+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/2034530059 shutdown_connections 2021-02-12T17:24:58.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.058+0000 7fd7c7bb3700 1 -- 172.21.2.102:0/2034530059 wait complete. 2021-02-12T17:24:58.059 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 57 2021-02-12T17:24:58.067 INFO:tasks.mds_thrash.fs.[b]:mds.a down, removed from mdsmap 2021-02-12T17:24:58.067 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2021-02-12T17:24:58.067 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:24:58.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.154+0000 7f477d990700 1 Processor -- start 2021-02-12T17:24:58.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.154+0000 7f477d990700 1 -- start start 2021-02-12T17:24:58.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f477d990700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f4778067720 0x7f47780b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:58.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f477d990700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f4778062580 0x7f47781463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:58.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f477d990700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47780b2930 con 0x7f4778144ea0 2021-02-12T17:24:58.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f477d990700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4778068980 con 0x7f4778062580 2021-02-12T17:24:58.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f477d990700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4778145a40 con 0x7f4778067720 2021-02-12T17:24:58.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f47767fc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f4778062580 0x7f47781463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:58.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f47767fc700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f4778062580 0x7f47781463a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48226/0 (socket says 172.21.2.102:48226) 2021-02-12T17:24:58.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f47767fc700 1 -- 172.21.2.102:0/3472974690 learned_addr learned my addr 172.21.2.102:0/3472974690 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:58.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f47767fc700 1 -- 172.21.2.102:0/3472974690 >> v2:172.21.2.104:3300/0 conn(0x7f4778067720 msgr2=0x7f47780b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:24:58.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f47767fc700 1 --2- 172.21.2.102:0/3472974690 >> v2:172.21.2.104:3300/0 conn(0x7f4778067720 0x7f47780b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:58.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f47767fc700 1 -- 172.21.2.102:0/3472974690 >> v1:172.21.2.102:6789/0 conn(0x7f4778144ea0 legacy=0x7f4778145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:58.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f47767fc700 1 -- 172.21.2.102:0/3472974690 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4778066db0 con 0x7f4778062580 2021-02-12T17:24:58.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f47767fc700 1 --2- 172.21.2.102:0/3472974690 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4778062580 0x7f47781463a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f476000ba10 tx=0x7f4760006ea0).ready entity=mon.0 client_cookie=d14ff184e9b646a3 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:58.158 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f4775ffb700 1 -- 172.21.2.102:0/3472974690 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760009850 con 0x7f4778062580 2021-02-12T17:24:58.158 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f4775ffb700 1 -- 172.21.2.102:0/3472974690 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47600099b0 con 0x7f4778062580 2021-02-12T17:24:58.158 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.155+0000 7f4775ffb700 1 -- 172.21.2.102:0/3472974690 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760009d30 con 0x7f4778062580 2021-02-12T17:24:58.158 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.156+0000 7f477d990700 1 -- 172.21.2.102:0/3472974690 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4778062580 msgr2=0x7f47781463a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:58.158 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.156+0000 7f477d990700 1 --2- 172.21.2.102:0/3472974690 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4778062580 0x7f47781463a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f476000ba10 tx=0x7f4760006ea0).stop 2021-02-12T17:24:58.158 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.156+0000 7f477d990700 1 -- 172.21.2.102:0/3472974690 shutdown_connections 2021-02-12T17:24:58.158 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.156+0000 7f477d990700 1 --2- 172.21.2.102:0/3472974690 >> v2:172.21.2.104:3300/0 conn(0x7f4778067720 0x7f47780b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:58.158 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.156+0000 7f477d990700 1 --2- 172.21.2.102:0/3472974690 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4778062580 0x7f47781463a0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:58.158 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.156+0000 7f477d990700 1 -- 172.21.2.102:0/3472974690 >> 172.21.2.102:0/3472974690 conn(0x7f47780bc480 msgr2=0x7f47780b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:58.158 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.156+0000 7f477d990700 1 -- 172.21.2.102:0/3472974690 shutdown_connections 2021-02-12T17:24:58.158 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.156+0000 7f477d990700 1 -- 172.21.2.102:0/3472974690 wait complete. 2021-02-12T17:24:58.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.157+0000 7f477d990700 1 Processor -- start 2021-02-12T17:24:58.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.157+0000 7f477d990700 1 -- start start 2021-02-12T17:24:58.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.157+0000 7f477d990700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4778062580 0x7f4778149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:58.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.157+0000 7f477d990700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4778067720 0x7f47780af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:58.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.157+0000 7f477d990700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4778144ea0 0x7f47780afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:58.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.157+0000 7f477d990700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4778146d80 con 0x7f4778144ea0 2021-02-12T17:24:58.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.157+0000 7f477d990700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4778146b20 con 0x7f4778067720 2021-02-12T17:24:58.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.157+0000 7f477d990700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4778147a40 con 0x7f4778062580 2021-02-12T17:24:58.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.157+0000 7f47777fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4778144ea0 0x7f47780afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:58.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.157+0000 7f47777fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4778144ea0 0x7f47780afa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48234/0 (socket says 172.21.2.102:48234) 2021-02-12T17:24:58.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.157+0000 7f47777fe700 1 -- 172.21.2.102:0/73381946 learned_addr learned my addr 172.21.2.102:0/73381946 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:24:58.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.158+0000 7f47777fe700 1 -- 172.21.2.102:0/73381946 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4778062580 msgr2=0x7f4778149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:58.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.158+0000 7f47777fe700 1 --2- 172.21.2.102:0/73381946 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4778062580 0x7f4778149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:58.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.158+0000 7f47777fe700 1 -- 172.21.2.102:0/73381946 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4778067720 msgr2=0x7f47780af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:58.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.158+0000 7f47777fe700 1 --2- 172.21.2.102:0/73381946 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4778067720 0x7f47780af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:58.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.158+0000 7f47777fe700 1 -- 172.21.2.102:0/73381946 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4778147ce0 con 0x7f4778144ea0 2021-02-12T17:24:58.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.158+0000 7f47777fe700 1 --2- 172.21.2.102:0/73381946 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4778144ea0 0x7f47780afa10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f477000ca60 tx=0x7f4770007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:58.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.158+0000 7f476effd700 1 -- 172.21.2.102:0/73381946 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770003080 con 0x7f4778144ea0 2021-02-12T17:24:58.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.158+0000 7f476effd700 1 -- 172.21.2.102:0/73381946 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477000a830 con 0x7f4778144ea0 2021-02-12T17:24:58.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.158+0000 7f477d990700 1 -- 172.21.2.102:0/73381946 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4778147f80 con 0x7f4778144ea0 2021-02-12T17:24:58.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.158+0000 7f477d990700 1 -- 172.21.2.102:0/73381946 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4778148c40 con 0x7f4778144ea0 2021-02-12T17:24:58.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.158+0000 7f476effd700 1 -- 172.21.2.102:0/73381946 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000abb0 con 0x7f4778144ea0 2021-02-12T17:24:58.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.159+0000 7f477d990700 1 -- 172.21.2.102:0/73381946 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4750004f60 con 0x7f4778144ea0 2021-02-12T17:24:58.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.159+0000 7f476effd700 1 -- 172.21.2.102:0/73381946 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f4770019030 con 0x7f4778144ea0 2021-02-12T17:24:58.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.159+0000 7f476effd700 1 --2- 172.21.2.102:0/73381946 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f475c059d80 0x7f475c05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:24:58.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.159+0000 7f476effd700 1 -- 172.21.2.102:0/73381946 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f47700734f0 con 0x7f4778144ea0 2021-02-12T17:24:58.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.159+0000 7f4776ffd700 1 --2- 172.21.2.102:0/73381946 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f475c059d80 0x7f475c05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:24:58.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.160+0000 7f4776ffd700 1 --2- 172.21.2.102:0/73381946 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f475c059d80 0x7f475c05c240 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f4768009540 tx=0x7f4768006a70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:24:58.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.162+0000 7f476effd700 1 -- 172.21.2.102:0/73381946 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f4770045580 con 0x7f4778144ea0 2021-02-12T17:24:58.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.321+0000 7f477d990700 1 -- 172.21.2.102:0/73381946 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4750005790 con 0x7f4778144ea0 2021-02-12T17:24:58.322 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.321+0000 7f476effd700 1 -- 172.21.2.102:0/73381946 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3410 (secure 0 0 0) 0x7f47700469f0 con 0x7f4778144ea0 2021-02-12T17:24:58.322 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:24:58.322 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":57,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:57.788734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:reconnect","state_seq":26,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:24:58.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.322+0000 7f477d990700 1 -- 172.21.2.102:0/73381946 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f475c059d80 msgr2=0x7f475c05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:58.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.322+0000 7f477d990700 1 --2- 172.21.2.102:0/73381946 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f475c059d80 0x7f475c05c240 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f4768009540 tx=0x7f4768006a70).stop 2021-02-12T17:24:58.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.322+0000 7f477d990700 1 -- 172.21.2.102:0/73381946 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4778144ea0 msgr2=0x7f47780afa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:24:58.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.322+0000 7f477d990700 1 --2- 172.21.2.102:0/73381946 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4778144ea0 0x7f47780afa10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f477000ca60 tx=0x7f4770007f40).stop 2021-02-12T17:24:58.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.323+0000 7f477d990700 1 -- 172.21.2.102:0/73381946 shutdown_connections 2021-02-12T17:24:58.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.323+0000 7f477d990700 1 --2- 172.21.2.102:0/73381946 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f475c059d80 0x7f475c05c240 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:58.323 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.323+0000 7f477d990700 1 --2- 172.21.2.102:0/73381946 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f4778144ea0 0x7f47780afa10 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:24:58.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.323+0000 7f477d990700 1 --2- 172.21.2.102:0/73381946 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f4778062580 0x7f4778149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:58.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.323+0000 7f477d990700 1 --2- 172.21.2.102:0/73381946 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f4778067720 0x7f47780af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:24:58.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.323+0000 7f477d990700 1 -- 172.21.2.102:0/73381946 >> 172.21.2.102:0/73381946 conn(0x7f47780bc480 msgr2=0x7f47780bae20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:24:58.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.323+0000 7f477d990700 1 -- 172.21.2.102:0/73381946 shutdown_connections 2021-02-12T17:24:58.324 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:24:58.323+0000 7f477d990700 1 -- 172.21.2.102:0/73381946 wait complete. 2021-02-12T17:24:58.324 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 57 2021-02-12T17:24:58.333 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 57, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:01.991560+0000", "damaged": [], "data_pools": [ 4 ], "enabled": true, "epoch": 54, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "a", "in": [ 0 ], "info": { "gid_34571": { "addr": "172.21.2.104:6835/973150871", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6833", "nonce": 973150871, "type": "v2" }, { "addr": "172.21.2.104:6835", "nonce": 973150871, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 34571, "incarnation": 51, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:active", "state_seq": 12 } }, "last_failure": 0, "last_failure_osd_epoch": 36, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2021-02-12T17:23:14.352545+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 34571 } } }, { "id": 2, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:08.529588+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 57, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "b", "in": [ 0 ], "info": { "gid_5823": { "addr": "172.21.2.102:6837/3756112970", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6836", "nonce": 3756112970, "type": "v2" }, { "addr": "172.21.2.102:6837", "nonce": 3756112970, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5823, "incarnation": 56, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:reconnect", "state_seq": 26 } }, "last_failure": 0, "last_failure_osd_epoch": 37, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 5, "modified": "2021-02-12T17:24:57.788734+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5823 } } } ], "standbys": [ { "addr": "172.21.2.104:6834/3149030842", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6832", "nonce": 3149030842, "type": "v2" }, { "addr": "172.21.2.104:6834", "nonce": 3149030842, "type": "v1" } ] }, "epoch": 5, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4243, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 2 } ] } 2021-02-12T17:25:00.334 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:00.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.423+0000 7fa7099f2700 1 Processor -- start 2021-02-12T17:25:00.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.423+0000 7fa7099f2700 1 -- start start 2021-02-12T17:25:00.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.423+0000 7fa7099f2700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fa7040b8d20 0x7fa704068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:00.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.423+0000 7fa7099f2700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa70414e530 0x7fa7040b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:00.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.423+0000 7fa7099f2700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7040622a0 con 0x7fa704062740 2021-02-12T17:25:00.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.423+0000 7fa7099f2700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa704068d20 con 0x7fa7040b8d20 2021-02-12T17:25:00.424 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.423+0000 7fa7099f2700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70414ea10 con 0x7fa70414e530 2021-02-12T17:25:00.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.424+0000 7fa7037fe700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7fa704062740 0x7fa704062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:39256/0 (socket says 172.21.2.102:39256) 2021-02-12T17:25:00.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.424+0000 7fa7037fe700 1 -- 172.21.2.102:0/3470705478 learned_addr learned my addr 172.21.2.102:0/3470705478 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:00.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.424+0000 7fa702ffd700 1 --2- 172.21.2.102:0/3470705478 >> v2:172.21.2.104:3300/0 conn(0x7fa7040b8d20 0x7fa704068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:00.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.424+0000 7fa7027fc700 1 --2- 172.21.2.102:0/3470705478 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa70414e530 0x7fa7040b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:00.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.425+0000 7fa702ffd700 1 -- 172.21.2.102:0/3470705478 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa70414e530 msgr2=0x7fa7040b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:00.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.425+0000 7fa702ffd700 1 --2- 172.21.2.102:0/3470705478 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa70414e530 0x7fa7040b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:00.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.425+0000 7fa702ffd700 1 -- 172.21.2.102:0/3470705478 >> v1:172.21.2.104:6789/0 conn(0x7fa704062740 legacy=0x7fa704062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:00.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.425+0000 7fa702ffd700 1 -- 172.21.2.102:0/3470705478 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7040b63f0 con 0x7fa7040b8d20 2021-02-12T17:25:00.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.425+0000 7fa702ffd700 1 --2- 172.21.2.102:0/3470705478 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa7040b8d20 0x7fa704068830 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fa6f400b980 tx=0x7fa6f4006de0).ready entity=mon.1 client_cookie=4e163901f199d746 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:00.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.425+0000 7fa701ffb700 1 -- 172.21.2.102:0/3470705478 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f400be70 con 0x7fa7040b8d20 2021-02-12T17:25:00.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.425+0000 7fa701ffb700 1 -- 172.21.2.102:0/3470705478 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f40097e0 con 0x7fa7040b8d20 2021-02-12T17:25:00.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.425+0000 7fa701ffb700 1 -- 172.21.2.102:0/3470705478 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4009b60 con 0x7fa7040b8d20 2021-02-12T17:25:00.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.426+0000 7fa7099f2700 1 -- 172.21.2.102:0/3470705478 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa7040b8d20 msgr2=0x7fa704068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:00.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.426+0000 7fa7099f2700 1 --2- 172.21.2.102:0/3470705478 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa7040b8d20 0x7fa704068830 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fa6f400b980 tx=0x7fa6f4006de0).stop 2021-02-12T17:25:00.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.426+0000 7fa7099f2700 1 -- 172.21.2.102:0/3470705478 shutdown_connections 2021-02-12T17:25:00.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.426+0000 7fa7099f2700 1 --2- 172.21.2.102:0/3470705478 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa7040b8d20 0x7fa704068830 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:00.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.426+0000 7fa7099f2700 1 --2- 172.21.2.102:0/3470705478 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa70414e530 0x7fa7040b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:00.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.426+0000 7fa7099f2700 1 -- 172.21.2.102:0/3470705478 >> 172.21.2.102:0/3470705478 conn(0x7fa7040bc480 msgr2=0x7fa7040b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:00.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.426+0000 7fa7099f2700 1 -- 172.21.2.102:0/3470705478 shutdown_connections 2021-02-12T17:25:00.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.426+0000 7fa7099f2700 1 -- 172.21.2.102:0/3470705478 wait complete. 2021-02-12T17:25:00.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.427+0000 7fa7099f2700 1 Processor -- start 2021-02-12T17:25:00.428 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.427+0000 7fa7099f2700 1 -- start start 2021-02-12T17:25:00.430 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.427+0000 7fa7099f2700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa704062740 0x7fa70415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:00.430 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.427+0000 7fa7099f2700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa7040b8d20 0x7fa7040ba480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:00.430 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.427+0000 7fa7099f2700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa70414e530 0x7fa7040afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:00.430 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.427+0000 7fa7099f2700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040b06d0 con 0x7fa7040b8d20 2021-02-12T17:25:00.430 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.427+0000 7fa7099f2700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040b0970 con 0x7fa704062740 2021-02-12T17:25:00.430 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.427+0000 7fa7099f2700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70415d3f0 con 0x7fa70414e530 2021-02-12T17:25:00.430 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.427+0000 7fa7027fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa7040b8d20 0x7fa7040ba480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:00.430 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa7027fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa7040b8d20 0x7fa7040ba480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48248/0 (socket says 172.21.2.102:48248) 2021-02-12T17:25:00.430 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa7027fc700 1 -- 172.21.2.102:0/1318935007 learned_addr learned my addr 172.21.2.102:0/1318935007 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:00.430 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa7037fe700 1 --2- 172.21.2.102:0/1318935007 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa70414e530 0x7fa7040afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:00.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa7027fc700 1 -- 172.21.2.102:0/1318935007 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa70414e530 msgr2=0x7fa7040afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:00.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa7027fc700 1 --2- 172.21.2.102:0/1318935007 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa70414e530 0x7fa7040afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:00.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa7027fc700 1 -- 172.21.2.102:0/1318935007 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa704062740 msgr2=0x7fa70415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:00.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa7027fc700 1 --2- 172.21.2.102:0/1318935007 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa704062740 0x7fa70415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:00.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa7027fc700 1 -- 172.21.2.102:0/1318935007 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70415d690 con 0x7fa7040b8d20 2021-02-12T17:25:00.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa7037fe700 1 --2- 172.21.2.102:0/1318935007 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa70414e530 0x7fa7040afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:00.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa7027fc700 1 --2- 172.21.2.102:0/1318935007 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa7040b8d20 0x7fa7040ba480 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fa6ec00ebd0 tx=0x7fa6ec006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:00.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa6faffd700 1 -- 172.21.2.102:0/1318935007 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00b840 con 0x7fa7040b8d20 2021-02-12T17:25:00.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa6faffd700 1 -- 172.21.2.102:0/1318935007 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec00b9a0 con 0x7fa7040b8d20 2021-02-12T17:25:00.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa7099f2700 1 -- 172.21.2.102:0/1318935007 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70415d930 con 0x7fa7040b8d20 2021-02-12T17:25:00.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa7099f2700 1 -- 172.21.2.102:0/1318935007 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7040b0360 con 0x7fa7040b8d20 2021-02-12T17:25:00.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.428+0000 7fa6faffd700 1 -- 172.21.2.102:0/1318935007 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00bd20 con 0x7fa7040b8d20 2021-02-12T17:25:00.431 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.429+0000 7fa7099f2700 1 -- 172.21.2.102:0/1318935007 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70415dac0 con 0x7fa7040b8d20 2021-02-12T17:25:00.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.429+0000 7fa6faffd700 1 -- 172.21.2.102:0/1318935007 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fa6ec012600 con 0x7fa7040b8d20 2021-02-12T17:25:00.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.429+0000 7fa6faffd700 1 --2- 172.21.2.102:0/1318935007 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa6e8059d30 0x7fa6e805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:00.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.429+0000 7fa6faffd700 1 -- 172.21.2.102:0/1318935007 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7fa6ec074440 con 0x7fa7040b8d20 2021-02-12T17:25:00.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.429+0000 7fa702ffd700 1 --2- 172.21.2.102:0/1318935007 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa6e8059d30 0x7fa6e805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:00.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.430+0000 7fa702ffd700 1 --2- 172.21.2.102:0/1318935007 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa6e8059d30 0x7fa6e805c1f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fa6f4007fd0 tx=0x7fa6f4016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:00.432 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.432+0000 7fa6faffd700 1 -- 172.21.2.102:0/1318935007 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fa6ec047810 con 0x7fa7040b8d20 2021-02-12T17:25:00.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.590+0000 7fa7099f2700 1 -- 172.21.2.102:0/1318935007 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa704045460 con 0x7fa7040b8d20 2021-02-12T17:25:00.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.590+0000 7fa6faffd700 1 -- 172.21.2.102:0/1318935007 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+3407 (secure 0 0 0) 0x7fa6ec04ae30 con 0x7fa7040b8d20 2021-02-12T17:25:00.591 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:00.591 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:00.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.591+0000 7fa7099f2700 1 -- 172.21.2.102:0/1318935007 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa6e8059d30 msgr2=0x7fa6e805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:00.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.591+0000 7fa7099f2700 1 --2- 172.21.2.102:0/1318935007 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa6e8059d30 0x7fa6e805c1f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fa6f4007fd0 tx=0x7fa6f4016000).stop 2021-02-12T17:25:00.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.591+0000 7fa7099f2700 1 -- 172.21.2.102:0/1318935007 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa7040b8d20 msgr2=0x7fa7040ba480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:00.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.591+0000 7fa7099f2700 1 --2- 172.21.2.102:0/1318935007 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa7040b8d20 0x7fa7040ba480 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fa6ec00ebd0 tx=0x7fa6ec006de0).stop 2021-02-12T17:25:00.592 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.591+0000 7fa7099f2700 1 -- 172.21.2.102:0/1318935007 shutdown_connections 2021-02-12T17:25:00.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.591+0000 7fa7099f2700 1 --2- 172.21.2.102:0/1318935007 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa70414e530 0x7fa7040afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:00.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.591+0000 7fa7099f2700 1 --2- 172.21.2.102:0/1318935007 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa704062740 0x7fa70415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:00.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.591+0000 7fa7099f2700 1 --2- 172.21.2.102:0/1318935007 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa6e8059d30 0x7fa6e805c1f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:00.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.591+0000 7fa7099f2700 1 --2- 172.21.2.102:0/1318935007 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa7040b8d20 0x7fa7040ba480 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:00.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.591+0000 7fa7099f2700 1 -- 172.21.2.102:0/1318935007 >> 172.21.2.102:0/1318935007 conn(0x7fa7040bc480 msgr2=0x7fa7040b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:00.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.592+0000 7fa7099f2700 1 -- 172.21.2.102:0/1318935007 shutdown_connections 2021-02-12T17:25:00.593 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:00.592+0000 7fa7099f2700 1 -- 172.21.2.102:0/1318935007 wait complete. 2021-02-12T17:25:00.593 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 59 2021-02-12T17:25:00.601 INFO:tasks.mds_thrash.fs.[b]:mds.c has gained rank=0, replacing gid=5625 2021-02-12T17:25:00.601 INFO:tasks.mds_thrash.fs.[b]:waiting for 4 secs before reviving mds.a 2021-02-12T17:25:04.400 INFO:tasks.ceph.mds.c.gibba002.stderr:2021-02-12T17:25:04.399+0000 7f935c426700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-02-12T17:25:04.601 INFO:tasks.mds_thrash.fs.[b]:reviving mds.a 2021-02-12T17:25:04.602 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-12T17:25:04.602 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-12T17:25:04.605 INFO:tasks.ceph.mds.a:Started 2021-02-12T17:25:04.605 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:04.662 INFO:tasks.ceph.mds.a.gibba002.stdout:starting mds.a at 2021-02-12T17:25:04.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.696+0000 7ff51beb7700 1 Processor -- start 2021-02-12T17:25:04.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.696+0000 7ff51beb7700 1 -- start start 2021-02-12T17:25:04.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.697+0000 7ff51beb7700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5140b8d20 0x7ff514068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:04.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.697+0000 7ff51beb7700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7ff514062740 0x7ff514062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:04.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.697+0000 7ff51beb7700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5140b7960 con 0x7ff51414e530 2021-02-12T17:25:04.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.697+0000 7ff51beb7700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff514068d20 con 0x7ff514062740 2021-02-12T17:25:04.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.697+0000 7ff51beb7700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140622a0 con 0x7ff5140b8d20 2021-02-12T17:25:04.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.697+0000 7ff519452700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7ff51414e530 0x7ff5140b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56908/0 (socket says 172.21.2.102:56908) 2021-02-12T17:25:04.700 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.697+0000 7ff519452700 1 -- 172.21.2.102:0/2540520738 learned_addr learned my addr 172.21.2.102:0/2540520738 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:04.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.697+0000 7ff518c51700 1 -- 172.21.2.102:0/2540520738 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485778506 0 0) 0x7ff5140b7960 con 0x7ff51414e530 2021-02-12T17:25:04.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 -- 172.21.2.102:0/2540520738 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f8003230 con 0x7ff51414e530 2021-02-12T17:25:04.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff519c53700 1 --2- 172.21.2.102:0/2540520738 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5140b8d20 0x7ff514068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:04.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff51a454700 1 --2- 172.21.2.102:0/2540520738 >> v2:172.21.2.104:3300/0 conn(0x7ff514062740 0x7ff514062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:04.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 -- 172.21.2.102:0/2540520738 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2316874582 0 0) 0x7ff4f8003230 con 0x7ff51414e530 2021-02-12T17:25:04.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 -- 172.21.2.102:0/2540520738 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5140b8d20 msgr2=0x7ff514068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:04.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 --2- 172.21.2.102:0/2540520738 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5140b8d20 0x7ff514068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:04.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 -- 172.21.2.102:0/2540520738 >> v2:172.21.2.104:3300/0 conn(0x7ff514062740 msgr2=0x7ff514062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:04.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 --2- 172.21.2.102:0/2540520738 >> v2:172.21.2.104:3300/0 conn(0x7ff514062740 0x7ff514062bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:04.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 -- 172.21.2.102:0/2540520738 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51414ea10 con 0x7ff51414e530 2021-02-12T17:25:04.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 -- 172.21.2.102:0/2540520738 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7ff5080014e0 con 0x7ff51414e530 2021-02-12T17:25:04.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 -- 172.21.2.102:0/2540520738 >> v1:172.21.2.102:6789/0 conn(0x7ff51414e530 legacy=0x7ff5140b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:04.701 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 --2- 172.21.2.102:0/2540520738 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5140b8d20 0x7ff4f8003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:04.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 --2- 172.21.2.102:0/2540520738 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4f8003c30 0x7ff4f80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:04.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 --2- 172.21.2.102:0/2540520738 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff4f80049c0 0x7ff4f8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:04.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 -- 172.21.2.102:0/2540520738 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff514068d20 con 0x7ff4f8003c30 2021-02-12T17:25:04.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 -- 172.21.2.102:0/2540520738 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140622a0 con 0x7ff4f80049c0 2021-02-12T17:25:04.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 -- 172.21.2.102:0/2540520738 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80041f0 con 0x7ff5140b8d20 2021-02-12T17:25:04.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff519452700 1 --2- 172.21.2.102:0/2540520738 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4f8003c30 0x7ff4f80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:04.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff519c53700 1 --2- 172.21.2.102:0/2540520738 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5140b8d20 0x7ff4f8003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:04.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff519452700 1 -- 172.21.2.102:0/2540520738 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5140b8d20 msgr2=0x7ff4f8003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:04.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff519452700 1 --2- 172.21.2.102:0/2540520738 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5140b8d20 0x7ff4f8003720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:04.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff519452700 1 -- 172.21.2.102:0/2540520738 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff4f80049c0 msgr2=0x7ff4f8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:04.702 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff519452700 1 --2- 172.21.2.102:0/2540520738 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff4f80049c0 0x7ff4f8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:04.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff519452700 1 -- 172.21.2.102:0/2540520738 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f8003230 con 0x7ff4f8003c30 2021-02-12T17:25:04.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff519452700 1 --2- 172.21.2.102:0/2540520738 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4f8003c30 0x7ff4f80044d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7ff51406ac60 tx=0x7ff51414eba0).ready entity=mon.0 client_cookie=489da095a6be3ccc server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:04.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 -- 172.21.2.102:0/2540520738 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080070d0 con 0x7ff4f8003c30 2021-02-12T17:25:04.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 -- 172.21.2.102:0/2540520738 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff508007230 con 0x7ff4f8003c30 2021-02-12T17:25:04.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.698+0000 7ff518c51700 1 -- 172.21.2.102:0/2540520738 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080055e0 con 0x7ff4f8003c30 2021-02-12T17:25:04.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.699+0000 7ff51beb7700 1 -- 172.21.2.102:0/2540520738 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4f8003c30 msgr2=0x7ff4f80044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:04.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.699+0000 7ff51beb7700 1 --2- 172.21.2.102:0/2540520738 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4f8003c30 0x7ff4f80044d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7ff51406ac60 tx=0x7ff51414eba0).stop 2021-02-12T17:25:04.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.699+0000 7ff51a454700 1 -- 172.21.2.102:0/2540520738 reap_dead start 2021-02-12T17:25:04.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.699+0000 7ff51beb7700 1 -- 172.21.2.102:0/2540520738 shutdown_connections 2021-02-12T17:25:04.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.699+0000 7ff51beb7700 1 -- 172.21.2.102:0/2540520738 >> 172.21.2.102:0/2540520738 conn(0x7ff5140bc480 msgr2=0x7ff5140b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:04.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.699+0000 7ff51beb7700 1 -- 172.21.2.102:0/2540520738 shutdown_connections 2021-02-12T17:25:04.703 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.699+0000 7ff51beb7700 1 -- 172.21.2.102:0/2540520738 wait complete. 2021-02-12T17:25:04.704 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.699+0000 7ff51beb7700 1 Processor -- start 2021-02-12T17:25:04.704 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.699+0000 7ff51beb7700 1 -- start start 2021-02-12T17:25:04.705 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff51beb7700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4f8003c30 0x7ff51415d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:04.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff51beb7700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff5140acf80 0x7ff51414b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:04.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff51beb7700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5140b4af0 0x7ff5140b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:04.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff51beb7700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140ad6a0 con 0x7ff4f8003c30 2021-02-12T17:25:04.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff51beb7700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140afed0 con 0x7ff5140acf80 2021-02-12T17:25:04.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff51beb7700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51415d5d0 con 0x7ff5140b4af0 2021-02-12T17:25:04.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff519c53700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4f8003c30 0x7ff51415d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:04.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff519c53700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4f8003c30 0x7ff51415d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48276/0 (socket says 172.21.2.102:48276) 2021-02-12T17:25:04.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff519c53700 1 -- 172.21.2.102:0/956862379 learned_addr learned my addr 172.21.2.102:0/956862379 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:04.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff51a454700 1 --2- 172.21.2.102:0/956862379 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5140b4af0 0x7ff5140b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:04.706 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff519452700 1 --2- 172.21.2.102:0/956862379 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff5140acf80 0x7ff51414b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:04.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff519c53700 1 -- 172.21.2.102:0/956862379 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5140b4af0 msgr2=0x7ff5140b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:04.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff519c53700 1 --2- 172.21.2.102:0/956862379 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5140b4af0 0x7ff5140b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:04.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff519c53700 1 -- 172.21.2.102:0/956862379 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff5140acf80 msgr2=0x7ff51414b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:04.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff519c53700 1 --2- 172.21.2.102:0/956862379 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff5140acf80 0x7ff51414b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:04.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff519c53700 1 -- 172.21.2.102:0/956862379 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5140ad890 con 0x7ff4f8003c30 2021-02-12T17:25:04.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff519c53700 1 --2- 172.21.2.102:0/956862379 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4f8003c30 0x7ff51415d0e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7ff510006cf0 tx=0x7ff510008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:04.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff505ffb700 1 -- 172.21.2.102:0/956862379 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff510013610 con 0x7ff4f8003c30 2021-02-12T17:25:04.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff505ffb700 1 -- 172.21.2.102:0/956862379 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff510013770 con 0x7ff4f8003c30 2021-02-12T17:25:04.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff51beb7700 1 -- 172.21.2.102:0/956862379 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5140adb30 con 0x7ff4f8003c30 2021-02-12T17:25:04.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.700+0000 7ff505ffb700 1 -- 172.21.2.102:0/956862379 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff510013af0 con 0x7ff4f8003c30 2021-02-12T17:25:04.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.701+0000 7ff51beb7700 1 -- 172.21.2.102:0/956862379 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51414be10 con 0x7ff4f8003c30 2021-02-12T17:25:04.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.701+0000 7ff51beb7700 1 -- 172.21.2.102:0/956862379 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5140adf90 con 0x7ff4f8003c30 2021-02-12T17:25:04.707 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.701+0000 7ff505ffb700 1 -- 172.21.2.102:0/956862379 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7ff510023070 con 0x7ff4f8003c30 2021-02-12T17:25:04.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.701+0000 7ff505ffb700 1 --2- 172.21.2.102:0/956862379 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff4fc059d30 0x7ff4fc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:04.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.701+0000 7ff505ffb700 1 -- 172.21.2.102:0/956862379 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7ff510074350 con 0x7ff4f8003c30 2021-02-12T17:25:04.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.702+0000 7ff519452700 1 --2- 172.21.2.102:0/956862379 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff4fc059d30 0x7ff4fc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:04.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.702+0000 7ff519452700 1 --2- 172.21.2.102:0/956862379 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff4fc059d30 0x7ff4fc05c1f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7ff51406ac60 tx=0x7ff508015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:04.708 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.704+0000 7ff505ffb700 1 -- 172.21.2.102:0/956862379 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7ff510047720 con 0x7ff4f8003c30 2021-02-12T17:25:04.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.862+0000 7ff51beb7700 1 -- 172.21.2.102:0/956862379 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff514045460 con 0x7ff4f8003c30 2021-02-12T17:25:04.863 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.863+0000 7ff505ffb700 1 -- 172.21.2.102:0/956862379 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+3407 (secure 0 0 0) 0x7ff510013e60 con 0x7ff4f8003c30 2021-02-12T17:25:04.863 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:04.864 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:04.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.864+0000 7ff51beb7700 1 -- 172.21.2.102:0/956862379 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff4fc059d30 msgr2=0x7ff4fc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:04.864 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.864+0000 7ff51beb7700 1 --2- 172.21.2.102:0/956862379 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff4fc059d30 0x7ff4fc05c1f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7ff51406ac60 tx=0x7ff508015000).stop 2021-02-12T17:25:04.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.864+0000 7ff51beb7700 1 -- 172.21.2.102:0/956862379 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4f8003c30 msgr2=0x7ff51415d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:04.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.864+0000 7ff51beb7700 1 --2- 172.21.2.102:0/956862379 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4f8003c30 0x7ff51415d0e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7ff510006cf0 tx=0x7ff510008040).stop 2021-02-12T17:25:04.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.864+0000 7ff51beb7700 1 -- 172.21.2.102:0/956862379 shutdown_connections 2021-02-12T17:25:04.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.864+0000 7ff51beb7700 1 --2- 172.21.2.102:0/956862379 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5140b4af0 0x7ff5140b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:04.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.864+0000 7ff51beb7700 1 --2- 172.21.2.102:0/956862379 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff4fc059d30 0x7ff4fc05c1f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:04.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.864+0000 7ff51beb7700 1 --2- 172.21.2.102:0/956862379 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4f8003c30 0x7ff51415d0e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:04.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.864+0000 7ff51beb7700 1 --2- 172.21.2.102:0/956862379 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff5140acf80 0x7ff51414b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:04.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.864+0000 7ff51beb7700 1 -- 172.21.2.102:0/956862379 >> 172.21.2.102:0/956862379 conn(0x7ff5140bc480 msgr2=0x7ff5140bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:04.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.864+0000 7ff51beb7700 1 -- 172.21.2.102:0/956862379 shutdown_connections 2021-02-12T17:25:04.865 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:04.864+0000 7ff51beb7700 1 -- 172.21.2.102:0/956862379 wait complete. 2021-02-12T17:25:04.866 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 59 2021-02-12T17:25:04.873 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-02-12T17:25:06.874 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:06.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.961+0000 7f32ee6f3700 1 Processor -- start 2021-02-12T17:25:06.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.961+0000 7f32ee6f3700 1 -- start start 2021-02-12T17:25:06.963 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.962+0000 7f32ee6f3700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f32e814e530 0x7f32e8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:06.963 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.962+0000 7f32ee6f3700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f32e8062740 0x7f32e8062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:06.963 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.962+0000 7f32ee6f3700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e80b7960 con 0x7f32e80b8d20 2021-02-12T17:25:06.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.962+0000 7f32ee6f3700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e8068d20 con 0x7f32e814e530 2021-02-12T17:25:06.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.962+0000 7f32ee6f3700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80622a0 con 0x7f32e8062740 2021-02-12T17:25:06.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.962+0000 7f32e77fe700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f32e814e530 0x7f32e8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:06.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.962+0000 7f32e7fff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f32e80b8d20 0x7f32e80b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56928/0 (socket says 172.21.2.102:56928) 2021-02-12T17:25:06.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.962+0000 7f32e7fff700 1 -- 172.21.2.102:0/2029193969 learned_addr learned my addr 172.21.2.102:0/2029193969 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:06.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.962+0000 7f32e77fe700 1 -- 172.21.2.102:0/2029193969 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f32e8062740 msgr2=0x7f32e8062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:06.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.962+0000 7f32e77fe700 1 --2- 172.21.2.102:0/2029193969 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f32e8062740 0x7f32e8062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:06.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.962+0000 7f32e77fe700 1 -- 172.21.2.102:0/2029193969 >> v1:172.21.2.102:6789/0 conn(0x7f32e80b8d20 legacy=0x7f32e80b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:06.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.962+0000 7f32e77fe700 1 -- 172.21.2.102:0/2029193969 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e814ea10 con 0x7f32e814e530 2021-02-12T17:25:06.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.962+0000 7f32e77fe700 1 --2- 172.21.2.102:0/2029193969 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32e814e530 0x7f32e8068830 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f32d800b980 tx=0x7f32d8006de0).ready entity=mon.0 client_cookie=eedfb00083bce8ce server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:06.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.963+0000 7f32e6ffd700 1 -- 172.21.2.102:0/2029193969 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d80097e0 con 0x7f32e814e530 2021-02-12T17:25:06.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.963+0000 7f32e6ffd700 1 -- 172.21.2.102:0/2029193969 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d8009940 con 0x7f32e814e530 2021-02-12T17:25:06.965 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.963+0000 7f32e6ffd700 1 -- 172.21.2.102:0/2029193969 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d8009cc0 con 0x7f32e814e530 2021-02-12T17:25:06.965 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.963+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2029193969 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32e814e530 msgr2=0x7f32e8068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:06.965 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.963+0000 7f32ee6f3700 1 --2- 172.21.2.102:0/2029193969 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32e814e530 0x7f32e8068830 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f32d800b980 tx=0x7f32d8006de0).stop 2021-02-12T17:25:06.967 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.963+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2029193969 shutdown_connections 2021-02-12T17:25:06.967 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.963+0000 7f32ee6f3700 1 --2- 172.21.2.102:0/2029193969 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f32e8062740 0x7f32e8062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:06.967 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.963+0000 7f32ee6f3700 1 --2- 172.21.2.102:0/2029193969 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32e814e530 0x7f32e8068830 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:06.967 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.963+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2029193969 >> 172.21.2.102:0/2029193969 conn(0x7f32e80bc480 msgr2=0x7f32e80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:06.967 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.963+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2029193969 shutdown_connections 2021-02-12T17:25:06.967 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.963+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2029193969 wait complete. 2021-02-12T17:25:06.967 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.964+0000 7f32ee6f3700 1 Processor -- start 2021-02-12T17:25:06.967 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.964+0000 7f32ee6f3700 1 -- start start 2021-02-12T17:25:06.967 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ee6f3700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f32e8062740 0x7f32e815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:06.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ee6f3700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f32e80b8d20 0x7f32e80afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:06.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ee6f3700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32e814e530 0x7f32e80b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:06.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ee6f3700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80b4a80 con 0x7f32e814e530 2021-02-12T17:25:06.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ee6f3700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e815e2c0 con 0x7f32e80b8d20 2021-02-12T17:25:06.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ee6f3700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80bacc0 con 0x7f32e8062740 2021-02-12T17:25:06.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ecc90700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32e814e530 0x7f32e80b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:06.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ecc90700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32e814e530 0x7f32e80b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48290/0 (socket says 172.21.2.102:48290) 2021-02-12T17:25:06.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ecc90700 1 -- 172.21.2.102:0/2644094881 learned_addr learned my addr 172.21.2.102:0/2644094881 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:06.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32e77fe700 1 --2- 172.21.2.102:0/2644094881 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f32e80b8d20 0x7f32e80afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:06.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ecc90700 1 -- 172.21.2.102:0/2644094881 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f32e8062740 msgr2=0x7f32e815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:06.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ecc90700 1 --2- 172.21.2.102:0/2644094881 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f32e8062740 0x7f32e815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:06.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ecc90700 1 -- 172.21.2.102:0/2644094881 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f32e80b8d20 msgr2=0x7f32e80afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:06.968 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ecc90700 1 --2- 172.21.2.102:0/2644094881 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f32e80b8d20 0x7f32e80afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:06.969 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ecc90700 1 -- 172.21.2.102:0/2644094881 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e80b4ce0 con 0x7f32e814e530 2021-02-12T17:25:06.969 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32e77fe700 1 --2- 172.21.2.102:0/2644094881 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f32e80b8d20 0x7f32e80afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:06.969 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.965+0000 7f32ecc90700 1 --2- 172.21.2.102:0/2644094881 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32e814e530 0x7f32e80b1af0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f32e000bae0 tx=0x7f32e0009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:06.969 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.966+0000 7f32dffff700 1 -- 172.21.2.102:0/2644094881 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e000c8d0 con 0x7f32e814e530 2021-02-12T17:25:06.969 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.966+0000 7f32dffff700 1 -- 172.21.2.102:0/2644094881 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e000ca30 con 0x7f32e814e530 2021-02-12T17:25:06.969 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.966+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2644094881 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e80b4f80 con 0x7f32e814e530 2021-02-12T17:25:06.969 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.966+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2644094881 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e80ad620 con 0x7f32e814e530 2021-02-12T17:25:06.969 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.966+0000 7f32dffff700 1 -- 172.21.2.102:0/2644094881 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e000cbe0 con 0x7f32e814e530 2021-02-12T17:25:06.969 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.966+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2644094881 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c0004f60 con 0x7f32e814e530 2021-02-12T17:25:06.969 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.967+0000 7f32dffff700 1 -- 172.21.2.102:0/2644094881 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f32e001c070 con 0x7f32e814e530 2021-02-12T17:25:06.970 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.967+0000 7f32dffff700 1 --2- 172.21.2.102:0/2644094881 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f32cc059db0 0x7f32cc05c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:06.970 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.967+0000 7f32dffff700 1 -- 172.21.2.102:0/2644094881 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f32e00737b0 con 0x7f32e814e530 2021-02-12T17:25:06.970 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.967+0000 7f32e7fff700 1 --2- 172.21.2.102:0/2644094881 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f32cc059db0 0x7f32cc05c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:06.970 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.967+0000 7f32e7fff700 1 --2- 172.21.2.102:0/2644094881 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f32cc059db0 0x7f32cc05c270 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f32d0001330 tx=0x7f32d00077f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:06.970 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:06.970+0000 7f32dffff700 1 -- 172.21.2.102:0/2644094881 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f32e0046c00 con 0x7f32e814e530 2021-02-12T17:25:07.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:07.125+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2644094881 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32c0005790 con 0x7f32e814e530 2021-02-12T17:25:07.126 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:07.125+0000 7f32dffff700 1 -- 172.21.2.102:0/2644094881 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+3407 (secure 0 0 0) 0x7f32e001a020 con 0x7f32e814e530 2021-02-12T17:25:07.126 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:07.126 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:07.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:07.126+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2644094881 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f32cc059db0 msgr2=0x7f32cc05c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:07.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:07.126+0000 7f32ee6f3700 1 --2- 172.21.2.102:0/2644094881 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f32cc059db0 0x7f32cc05c270 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f32d0001330 tx=0x7f32d00077f0).stop 2021-02-12T17:25:07.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:07.126+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2644094881 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32e814e530 msgr2=0x7f32e80b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:07.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:07.126+0000 7f32ee6f3700 1 --2- 172.21.2.102:0/2644094881 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32e814e530 0x7f32e80b1af0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f32e000bae0 tx=0x7f32e0009220).stop 2021-02-12T17:25:07.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:07.126+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2644094881 shutdown_connections 2021-02-12T17:25:07.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:07.126+0000 7f32ee6f3700 1 --2- 172.21.2.102:0/2644094881 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f32cc059db0 0x7f32cc05c270 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:07.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:07.126+0000 7f32ee6f3700 1 --2- 172.21.2.102:0/2644094881 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f32e814e530 0x7f32e80b1af0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:07.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:07.126+0000 7f32ee6f3700 1 --2- 172.21.2.102:0/2644094881 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f32e8062740 0x7f32e815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:07.127 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:07.126+0000 7f32ee6f3700 1 --2- 172.21.2.102:0/2644094881 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f32e80b8d20 0x7f32e80afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:07.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:07.126+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2644094881 >> 172.21.2.102:0/2644094881 conn(0x7f32e80bc480 msgr2=0x7f32e814cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:07.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:07.126+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2644094881 shutdown_connections 2021-02-12T17:25:07.128 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:07.126+0000 7f32ee6f3700 1 -- 172.21.2.102:0/2644094881 wait complete. 2021-02-12T17:25:07.128 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 59 2021-02-12T17:25:07.136 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-02-12T17:25:09.136 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:09.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.224+0000 7fa1be58e700 1 Processor -- start 2021-02-12T17:25:09.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.224+0000 7fa1be58e700 1 -- start start 2021-02-12T17:25:09.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.225+0000 7fa1be58e700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa1b8068af0 0x7fa1b80b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:09.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.225+0000 7fa1be58e700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b80b7680 con 0x7fa1b80b6350 2021-02-12T17:25:09.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.225+0000 7fa1be58e700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b80b2360 con 0x7fa1b8068710 2021-02-12T17:25:09.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.225+0000 7fa1be58e700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b80b2600 con 0x7fa1b8068af0 2021-02-12T17:25:09.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.225+0000 7fa1bcb2b700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fa1b80b6350 0x7fa1b80b8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56944/0 (socket says 172.21.2.102:56944) 2021-02-12T17:25:09.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.225+0000 7fa1bcb2b700 1 -- 172.21.2.102:0/1792523031 learned_addr learned my addr 172.21.2.102:0/1792523031 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:09.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.225+0000 7fa1b77fe700 1 --2- 172.21.2.102:0/1792523031 >> v2:172.21.2.102:3300/0 conn(0x7fa1b8068af0 0x7fa1b80b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:09.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.225+0000 7fa1b77fe700 1 -- 172.21.2.102:0/1792523031 >> v1:172.21.2.104:6789/0 conn(0x7fa1b8068710 legacy=0x7fa1b814a020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:25:09.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.225+0000 7fa1b77fe700 1 -- 172.21.2.102:0/1792523031 >> v1:172.21.2.102:6789/0 conn(0x7fa1b80b6350 legacy=0x7fa1b80b8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:09.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.225+0000 7fa1b77fe700 1 -- 172.21.2.102:0/1792523031 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b81498e0 con 0x7fa1b8068af0 2021-02-12T17:25:09.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.225+0000 7fa1b6ffd700 1 -- 172.21.2.102:0/1792523031 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427801580 0 0) 0x7fa1b80b7680 con 0x7fa1b80b6350 2021-02-12T17:25:09.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.226+0000 7fa1b77fe700 1 --2- 172.21.2.102:0/1792523031 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa1b8068af0 0x7fa1b80b1440 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fa1a000b980 tx=0x7fa1a0006de0).ready entity=mon.0 client_cookie=34fa0da64544df45 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:09.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.226+0000 7fa1b6ffd700 1 -- 172.21.2.102:0/1792523031 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00097a0 con 0x7fa1b8068af0 2021-02-12T17:25:09.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.226+0000 7fa1b6ffd700 1 -- 172.21.2.102:0/1792523031 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a0009900 con 0x7fa1b8068af0 2021-02-12T17:25:09.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.226+0000 7fa1b6ffd700 1 -- 172.21.2.102:0/1792523031 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0009c80 con 0x7fa1b8068af0 2021-02-12T17:25:09.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.226+0000 7fa1be58e700 1 -- 172.21.2.102:0/1792523031 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa1b8068af0 msgr2=0x7fa1b80b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:09.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.226+0000 7fa1be58e700 1 --2- 172.21.2.102:0/1792523031 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa1b8068af0 0x7fa1b80b1440 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fa1a000b980 tx=0x7fa1a0006de0).stop 2021-02-12T17:25:09.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.226+0000 7fa1be58e700 1 -- 172.21.2.102:0/1792523031 shutdown_connections 2021-02-12T17:25:09.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.226+0000 7fa1be58e700 1 --2- 172.21.2.102:0/1792523031 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa1b8068af0 0x7fa1b80b1440 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:09.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.226+0000 7fa1be58e700 1 -- 172.21.2.102:0/1792523031 >> 172.21.2.102:0/1792523031 conn(0x7fa1b80bc480 msgr2=0x7fa1b80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:09.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.226+0000 7fa1be58e700 1 -- 172.21.2.102:0/1792523031 shutdown_connections 2021-02-12T17:25:09.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.226+0000 7fa1be58e700 1 -- 172.21.2.102:0/1792523031 wait complete. 2021-02-12T17:25:09.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.227+0000 7fa1be58e700 1 Processor -- start 2021-02-12T17:25:09.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.227+0000 7fa1be58e700 1 -- start start 2021-02-12T17:25:09.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1be58e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1b8068710 0x7fa1b80babc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:09.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1be58e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa1b8068af0 0x7fa1b815d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:09.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1be58e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa1b80b6350 0x7fa1b815d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:09.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1be58e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b815dc50 con 0x7fa1b8068af0 2021-02-12T17:25:09.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1be58e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b8143fe0 con 0x7fa1b80b6350 2021-02-12T17:25:09.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1be58e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b81607c0 con 0x7fa1b8068710 2021-02-12T17:25:09.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1b77fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa1b8068af0 0x7fa1b815d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:09.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1b77fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa1b8068af0 0x7fa1b815d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48308/0 (socket says 172.21.2.102:48308) 2021-02-12T17:25:09.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1b77fe700 1 -- 172.21.2.102:0/339353299 learned_addr learned my addr 172.21.2.102:0/339353299 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:09.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1b77fe700 1 -- 172.21.2.102:0/339353299 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1b8068710 msgr2=0x7fa1b80babc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:09.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1b77fe700 1 --2- 172.21.2.102:0/339353299 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1b8068710 0x7fa1b80babc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:09.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1b77fe700 1 -- 172.21.2.102:0/339353299 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa1b80b6350 msgr2=0x7fa1b815d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:09.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1b77fe700 1 --2- 172.21.2.102:0/339353299 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa1b80b6350 0x7fa1b815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:09.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1b77fe700 1 -- 172.21.2.102:0/339353299 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b8160a60 con 0x7fa1b8068af0 2021-02-12T17:25:09.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1b77fe700 1 --2- 172.21.2.102:0/339353299 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa1b8068af0 0x7fa1b815d270 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fa1a0009340 tx=0x7fa1a0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:09.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1affff700 1 -- 172.21.2.102:0/339353299 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a001c420 con 0x7fa1b8068af0 2021-02-12T17:25:09.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1affff700 1 -- 172.21.2.102:0/339353299 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a001c580 con 0x7fa1b8068af0 2021-02-12T17:25:09.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1be58e700 1 -- 172.21.2.102:0/339353299 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b8160d00 con 0x7fa1b8068af0 2021-02-12T17:25:09.232 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.228+0000 7fa1affff700 1 -- 172.21.2.102:0/339353299 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a001c900 con 0x7fa1b8068af0 2021-02-12T17:25:09.233 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.229+0000 7fa1be58e700 1 -- 172.21.2.102:0/339353299 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b80bb0b0 con 0x7fa1b8068af0 2021-02-12T17:25:09.233 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.229+0000 7fa1be58e700 1 -- 172.21.2.102:0/339353299 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b8161160 con 0x7fa1b8068af0 2021-02-12T17:25:09.233 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.229+0000 7fa1affff700 1 -- 172.21.2.102:0/339353299 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fa1a000f070 con 0x7fa1b8068af0 2021-02-12T17:25:09.233 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.230+0000 7fa1affff700 1 --2- 172.21.2.102:0/339353299 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa19c059d30 0x7fa19c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:09.233 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.230+0000 7fa1affff700 1 -- 172.21.2.102:0/339353299 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7fa1a0075940 con 0x7fa1b8068af0 2021-02-12T17:25:09.233 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.230+0000 7fa1b7fff700 1 --2- 172.21.2.102:0/339353299 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa19c059d30 0x7fa19c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:09.233 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.230+0000 7fa1b7fff700 1 --2- 172.21.2.102:0/339353299 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa19c059d30 0x7fa19c05c1f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fa1a8009480 tx=0x7fa1a80069a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:09.233 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.233+0000 7fa1affff700 1 -- 172.21.2.102:0/339353299 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fa1a0048e20 con 0x7fa1b8068af0 2021-02-12T17:25:09.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.391+0000 7fa1be58e700 1 -- 172.21.2.102:0/339353299 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1b8045460 con 0x7fa1b8068af0 2021-02-12T17:25:09.392 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.392+0000 7fa1affff700 1 -- 172.21.2.102:0/339353299 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3760 (secure 0 0 0) 0x7fa1a004c440 con 0x7fa1b8068af0 2021-02-12T17:25:09.393 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:09.393 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":60,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:09.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.393+0000 7fa1be58e700 1 -- 172.21.2.102:0/339353299 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa19c059d30 msgr2=0x7fa19c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:09.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.393+0000 7fa1be58e700 1 --2- 172.21.2.102:0/339353299 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa19c059d30 0x7fa19c05c1f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fa1a8009480 tx=0x7fa1a80069a0).stop 2021-02-12T17:25:09.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.393+0000 7fa1be58e700 1 -- 172.21.2.102:0/339353299 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa1b8068af0 msgr2=0x7fa1b815d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:09.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.393+0000 7fa1be58e700 1 --2- 172.21.2.102:0/339353299 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa1b8068af0 0x7fa1b815d270 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fa1a0009340 tx=0x7fa1a0016000).stop 2021-02-12T17:25:09.394 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.393+0000 7fa1be58e700 1 -- 172.21.2.102:0/339353299 shutdown_connections 2021-02-12T17:25:09.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.393+0000 7fa1be58e700 1 --2- 172.21.2.102:0/339353299 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa1b80b6350 0x7fa1b815d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:09.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.393+0000 7fa1be58e700 1 --2- 172.21.2.102:0/339353299 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa1b8068710 0x7fa1b80babc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:09.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.393+0000 7fa1be58e700 1 --2- 172.21.2.102:0/339353299 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa19c059d30 0x7fa19c05c1f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:09.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.393+0000 7fa1be58e700 1 --2- 172.21.2.102:0/339353299 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa1b8068af0 0x7fa1b815d270 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:09.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.393+0000 7fa1be58e700 1 -- 172.21.2.102:0/339353299 >> 172.21.2.102:0/339353299 conn(0x7fa1b80bc480 msgr2=0x7fa1b80b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:09.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.394+0000 7fa1be58e700 1 -- 172.21.2.102:0/339353299 shutdown_connections 2021-02-12T17:25:09.395 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:09.394+0000 7fa1be58e700 1 -- 172.21.2.102:0/339353299 wait complete. 2021-02-12T17:25:09.395 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 60 2021-02-12T17:25:09.403 INFO:tasks.mds_thrash.fs.[b]:mds.a reported in up:standby state 2021-02-12T17:25:09.403 INFO:tasks.mds_thrash.fs.[b]:waiting for 20 secs before thrashing 2021-02-12T17:25:11.469 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:25:11.472 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:25:22.001 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:22.091 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.091+0000 7f1f2c02e700 1 Processor -- start 2021-02-12T17:25:22.092 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.091+0000 7f1f2c02e700 1 -- start start 2021-02-12T17:25:22.094 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.091+0000 7f1f2c02e700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f1f24067720 0x7f1f240b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.094 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.091+0000 7f1f2c02e700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f240b2930 con 0x7f1f24062580 2021-02-12T17:25:22.094 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.091+0000 7f1f2c02e700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f24066db0 con 0x7f1f24144ea0 2021-02-12T17:25:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.091+0000 7f1f2c02e700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f24068980 con 0x7f1f24067720 2021-02-12T17:25:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f295c9700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f1f24062580 0x7f1f241463a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56974/0 (socket says 172.21.2.102:56974) 2021-02-12T17:25:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f295c9700 1 -- 172.21.2.102:0/359434096 learned_addr learned my addr 172.21.2.102:0/359434096 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 -- 172.21.2.102:0/359434096 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776286662 0 0) 0x7f1f200010d0 con 0x7f1f24062580 2021-02-12T17:25:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 -- 172.21.2.102:0/359434096 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f0c004340 con 0x7f1f24062580 2021-02-12T17:25:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 -- 172.21.2.102:0/359434096 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3119732699 0 0) 0x7f1f0c004340 con 0x7f1f24062580 2021-02-12T17:25:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 -- 172.21.2.102:0/359434096 >> v2:172.21.2.104:3300/0 conn(0x7f1f24067720 msgr2=0x7f1f240b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 --2- 172.21.2.102:0/359434096 >> v2:172.21.2.104:3300/0 conn(0x7f1f24067720 0x7f1f240b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:22.095 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 -- 172.21.2.102:0/359434096 >> v1:172.21.2.104:6789/0 conn(0x7f1f24144ea0 legacy=0x7f1f24145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:22.096 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 -- 172.21.2.102:0/359434096 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f24067050 con 0x7f1f24062580 2021-02-12T17:25:22.096 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 -- 172.21.2.102:0/359434096 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f1f20001670 con 0x7f1f24062580 2021-02-12T17:25:22.096 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 -- 172.21.2.102:0/359434096 >> v1:172.21.2.102:6789/0 conn(0x7f1f24062580 legacy=0x7f1f241463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:22.096 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 --2- 172.21.2.102:0/359434096 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1f0c004900 0x7f1f0c004d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.096 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 --2- 172.21.2.102:0/359434096 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1f0c0055e0 0x7f1f0c005a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.096 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 --2- 172.21.2.102:0/359434096 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1f0c005f50 0x7f1f0c00c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 -- 172.21.2.102:0/359434096 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f24068980 con 0x7f1f0c005f50 2021-02-12T17:25:22.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 -- 172.21.2.102:0/359434096 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c006400 con 0x7f1f0c0055e0 2021-02-12T17:25:22.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f28dc8700 1 -- 172.21.2.102:0/359434096 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c00cd20 con 0x7f1f0c004900 2021-02-12T17:25:22.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.092+0000 7f1f2a5cb700 1 --2- 172.21.2.102:0/359434096 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1f0c005f50 0x7f1f0c00c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:22.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f295c9700 1 --2- 172.21.2.102:0/359434096 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1f0c0055e0 0x7f1f0c005a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:22.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f2a5cb700 1 -- 172.21.2.102:0/359434096 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1f0c004900 msgr2=0x7f1f0c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:22.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f2a5cb700 1 --2- 172.21.2.102:0/359434096 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1f0c004900 0x7f1f0c004d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:22.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f2a5cb700 1 -- 172.21.2.102:0/359434096 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1f0c0055e0 msgr2=0x7f1f0c005a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:22.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f2a5cb700 1 --2- 172.21.2.102:0/359434096 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1f0c0055e0 0x7f1f0c005a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:22.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f2a5cb700 1 -- 172.21.2.102:0/359434096 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c004340 con 0x7f1f0c005f50 2021-02-12T17:25:22.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f2a5cb700 1 -- 172.21.2.102:0/359434096 reap_dead start 2021-02-12T17:25:22.097 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f2a5cb700 1 --2- 172.21.2.102:0/359434096 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1f0c005f50 0x7f1f0c00c830 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f1f1c001d50 tx=0x7f1f1c007ee0).ready entity=mon.0 client_cookie=cbf70d5a61428d5e server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:22.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f28dc8700 1 -- 172.21.2.102:0/359434096 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c00c8d0 con 0x7f1f0c005f50 2021-02-12T17:25:22.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f28dc8700 1 -- 172.21.2.102:0/359434096 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c00ca30 con 0x7f1f0c005f50 2021-02-12T17:25:22.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f28dc8700 1 -- 172.21.2.102:0/359434096 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c00cdf0 con 0x7f1f0c005f50 2021-02-12T17:25:22.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f2c02e700 1 -- 172.21.2.102:0/359434096 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1f0c005f50 msgr2=0x7f1f0c00c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:22.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f2c02e700 1 --2- 172.21.2.102:0/359434096 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1f0c005f50 0x7f1f0c00c830 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f1f1c001d50 tx=0x7f1f1c007ee0).stop 2021-02-12T17:25:22.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f2c02e700 1 -- 172.21.2.102:0/359434096 shutdown_connections 2021-02-12T17:25:22.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f2c02e700 1 --2- 172.21.2.102:0/359434096 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1f0c005f50 0x7f1f0c00c830 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:22.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f2c02e700 1 -- 172.21.2.102:0/359434096 >> 172.21.2.102:0/359434096 conn(0x7f1f240bc480 msgr2=0x7f1f240b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:22.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f2c02e700 1 -- 172.21.2.102:0/359434096 shutdown_connections 2021-02-12T17:25:22.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.093+0000 7f1f2c02e700 1 -- 172.21.2.102:0/359434096 wait complete. 2021-02-12T17:25:22.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.094+0000 7f1f2c02e700 1 Processor -- start 2021-02-12T17:25:22.098 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.094+0000 7f1f2c02e700 1 -- start start 2021-02-12T17:25:22.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2c02e700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1f0c005f50 0x7f1f241473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2c02e700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1f24148300 0x7f1f240b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2c02e700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1f240b3ec0 0x7f1f240b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2c02e700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f24146ab0 con 0x7f1f240b3ec0 2021-02-12T17:25:22.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2c02e700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2415d440 con 0x7f1f0c005f50 2021-02-12T17:25:22.100 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2c02e700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f240b2d50 con 0x7f1f24148300 2021-02-12T17:25:22.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2a5cb700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1f240b3ec0 0x7f1f240b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:22.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2a5cb700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1f240b3ec0 0x7f1f240b4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48344/0 (socket says 172.21.2.102:48344) 2021-02-12T17:25:22.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2a5cb700 1 -- 172.21.2.102:0/2968528003 learned_addr learned my addr 172.21.2.102:0/2968528003 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:22.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2a5cb700 1 -- 172.21.2.102:0/2968528003 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1f24148300 msgr2=0x7f1f240b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:22.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2a5cb700 1 --2- 172.21.2.102:0/2968528003 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1f24148300 0x7f1f240b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:22.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2a5cb700 1 -- 172.21.2.102:0/2968528003 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1f0c005f50 msgr2=0x7f1f241473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:22.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2a5cb700 1 --2- 172.21.2.102:0/2968528003 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1f0c005f50 0x7f1f241473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:22.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2a5cb700 1 -- 172.21.2.102:0/2968528003 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f240b2ff0 con 0x7f1f240b3ec0 2021-02-12T17:25:22.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2a5cb700 1 --2- 172.21.2.102:0/2968528003 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1f240b3ec0 0x7f1f240b4320 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f1f1c008fd0 tx=0x7f1f1c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:22.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f15ffb700 1 -- 172.21.2.102:0/2968528003 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c006840 con 0x7f1f240b3ec0 2021-02-12T17:25:22.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f15ffb700 1 -- 172.21.2.102:0/2968528003 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c0069a0 con 0x7f1f240b3ec0 2021-02-12T17:25:22.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f2c02e700 1 -- 172.21.2.102:0/2968528003 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f240b3290 con 0x7f1f240b3ec0 2021-02-12T17:25:22.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.095+0000 7f1f15ffb700 1 -- 172.21.2.102:0/2968528003 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c006d40 con 0x7f1f240b3ec0 2021-02-12T17:25:22.101 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.096+0000 7f1f2c02e700 1 -- 172.21.2.102:0/2968528003 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f241478d0 con 0x7f1f240b3ec0 2021-02-12T17:25:22.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.096+0000 7f1f2c02e700 1 -- 172.21.2.102:0/2968528003 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f240b92b0 con 0x7f1f240b3ec0 2021-02-12T17:25:22.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.097+0000 7f1f15ffb700 1 -- 172.21.2.102:0/2968528003 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f1f1c025030 con 0x7f1f240b3ec0 2021-02-12T17:25:22.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.097+0000 7f1f15ffb700 1 --2- 172.21.2.102:0/2968528003 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1f04059d30 0x7f1f0405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.097+0000 7f1f15ffb700 1 -- 172.21.2.102:0/2968528003 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f1f1c0756b0 con 0x7f1f240b3ec0 2021-02-12T17:25:22.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.097+0000 7f1f29dca700 1 --2- 172.21.2.102:0/2968528003 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1f04059d30 0x7f1f0405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:22.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.097+0000 7f1f29dca700 1 --2- 172.21.2.102:0/2968528003 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1f04059d30 0x7f1f0405c1f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f1f180094c0 tx=0x7f1f180069f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:22.102 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.100+0000 7f1f15ffb700 1 -- 172.21.2.102:0/2968528003 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f1f1c048b30 con 0x7f1f240b3ec0 2021-02-12T17:25:22.258 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.258+0000 7f1f2c02e700 1 -- 172.21.2.102:0/2968528003 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f24045460 con 0x7f1f240b3ec0 2021-02-12T17:25:22.259 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.258+0000 7f1f15ffb700 1 -- 172.21.2.102:0/2968528003 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f1f1c023020 con 0x7f1f240b3ec0 2021-02-12T17:25:22.259 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:22.259 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":60,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:22.260 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.259+0000 7f1f2c02e700 1 -- 172.21.2.102:0/2968528003 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1f04059d30 msgr2=0x7f1f0405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:22.260 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.260+0000 7f1f2c02e700 1 --2- 172.21.2.102:0/2968528003 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1f04059d30 0x7f1f0405c1f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f1f180094c0 tx=0x7f1f180069f0).stop 2021-02-12T17:25:22.260 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.260+0000 7f1f2c02e700 1 -- 172.21.2.102:0/2968528003 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1f240b3ec0 msgr2=0x7f1f240b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:22.260 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.260+0000 7f1f2c02e700 1 --2- 172.21.2.102:0/2968528003 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1f240b3ec0 0x7f1f240b4320 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f1f1c008fd0 tx=0x7f1f1c016000).stop 2021-02-12T17:25:22.260 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.260+0000 7f1f2c02e700 1 -- 172.21.2.102:0/2968528003 shutdown_connections 2021-02-12T17:25:22.260 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.260+0000 7f1f2c02e700 1 --2- 172.21.2.102:0/2968528003 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f1f04059d30 0x7f1f0405c1f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:22.260 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.260+0000 7f1f2c02e700 1 --2- 172.21.2.102:0/2968528003 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f1f240b3ec0 0x7f1f240b4320 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:22.260 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.260+0000 7f1f2c02e700 1 --2- 172.21.2.102:0/2968528003 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f1f0c005f50 0x7f1f241473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:22.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.260+0000 7f1f2c02e700 1 --2- 172.21.2.102:0/2968528003 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f1f24148300 0x7f1f240b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:22.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.260+0000 7f1f2c02e700 1 -- 172.21.2.102:0/2968528003 >> 172.21.2.102:0/2968528003 conn(0x7f1f240bc480 msgr2=0x7f1f240baca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:22.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.260+0000 7f1f2c02e700 1 -- 172.21.2.102:0/2968528003 shutdown_connections 2021-02-12T17:25:22.261 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.260+0000 7f1f2c02e700 1 -- 172.21.2.102:0/2968528003 wait complete. 2021-02-12T17:25:22.261 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 60 2021-02-12T17:25:22.269 INFO:tasks.mds_thrash.fs.[a]:kill mds.d (rank=0) 2021-02-12T17:25:22.269 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2021-02-12T17:25:22.269 INFO:teuthology.orchestra.run:waiting for 300 2021-02-12T17:25:22.275 INFO:tasks.ceph.mds.d:Stopped 2021-02-12T17:25:22.276 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:22.362 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.361+0000 7f42ef612700 1 Processor -- start 2021-02-12T17:25:22.362 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.362+0000 7f42ef612700 1 -- start start 2021-02-12T17:25:22.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.362+0000 7f42ef612700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f42e814e530 0x7f42e8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.362+0000 7f42ef612700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e80b7960 con 0x7f42e80b8d20 2021-02-12T17:25:22.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.362+0000 7f42ef612700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e80622a0 con 0x7f42e8062740 2021-02-12T17:25:22.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.362+0000 7f42ef612700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e8068d20 con 0x7f42e814e530 2021-02-12T17:25:22.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.362+0000 7f42ed3ae700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f42e80b8d20 0x7f42e80b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:56998/0 (socket says 172.21.2.102:56998) 2021-02-12T17:25:22.363 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.362+0000 7f42ed3ae700 1 -- 172.21.2.102:0/3711631951 learned_addr learned my addr 172.21.2.102:0/3711631951 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:22.364 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 -- 172.21.2.102:0/3711631951 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045877995 0 0) 0x7f42e80b7960 con 0x7f42e80b8d20 2021-02-12T17:25:22.364 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 -- 172.21.2.102:0/3711631951 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d0003230 con 0x7f42e80b8d20 2021-02-12T17:25:22.364 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42ecbad700 1 --2- 172.21.2.102:0/3711631951 >> v2:172.21.2.104:3300/0 conn(0x7f42e814e530 0x7f42e8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:22.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 -- 172.21.2.102:0/3711631951 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1850306701 0 0) 0x7f42d0003230 con 0x7f42e80b8d20 2021-02-12T17:25:22.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 -- 172.21.2.102:0/3711631951 >> v2:172.21.2.104:3300/0 conn(0x7f42e814e530 msgr2=0x7f42e8068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:22.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 --2- 172.21.2.102:0/3711631951 >> v2:172.21.2.104:3300/0 conn(0x7f42e814e530 0x7f42e8068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:22.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 -- 172.21.2.102:0/3711631951 >> v1:172.21.2.104:6789/0 conn(0x7f42e8062740 legacy=0x7f42e8062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:22.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 -- 172.21.2.102:0/3711631951 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e814ea10 con 0x7f42e80b8d20 2021-02-12T17:25:22.367 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 -- 172.21.2.102:0/3711631951 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f42dc0014e0 con 0x7f42e80b8d20 2021-02-12T17:25:22.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 -- 172.21.2.102:0/3711631951 >> v1:172.21.2.102:6789/0 conn(0x7f42e80b8d20 legacy=0x7f42e80b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:22.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 --2- 172.21.2.102:0/3711631951 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f42d0003770 0x7f42d0003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 --2- 172.21.2.102:0/3711631951 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f42d00044d0 0x7f42d0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 --2- 172.21.2.102:0/3711631951 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f42d0004e40 0x7f42d000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 -- 172.21.2.102:0/3711631951 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e8068d20 con 0x7f42d0003770 2021-02-12T17:25:22.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 -- 172.21.2.102:0/3711631951 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d0005320 con 0x7f42d0004e40 2021-02-12T17:25:22.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42dbfff700 1 -- 172.21.2.102:0/3711631951 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d000bc10 con 0x7f42d00044d0 2021-02-12T17:25:22.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42ed3ae700 1 --2- 172.21.2.102:0/3711631951 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f42d0003770 0x7f42d0003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:22.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42edbaf700 1 --2- 172.21.2.102:0/3711631951 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f42d0004e40 0x7f42d000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:22.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42ed3ae700 1 -- 172.21.2.102:0/3711631951 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f42d00044d0 msgr2=0x7f42d0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:22.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42ed3ae700 1 --2- 172.21.2.102:0/3711631951 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f42d00044d0 0x7f42d0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:22.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42ed3ae700 1 -- 172.21.2.102:0/3711631951 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f42d0004e40 msgr2=0x7f42d000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:22.368 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42ed3ae700 1 --2- 172.21.2.102:0/3711631951 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f42d0004e40 0x7f42d000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:22.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42ed3ae700 1 -- 172.21.2.102:0/3711631951 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d0003230 con 0x7f42d0003770 2021-02-12T17:25:22.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.363+0000 7f42edbaf700 1 --2- 172.21.2.102:0/3711631951 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f42d0004e40 0x7f42d000b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:22.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.364+0000 7f42edbaf700 1 -- 172.21.2.102:0/3711631951 reap_dead start 2021-02-12T17:25:22.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.364+0000 7f42ed3ae700 1 --2- 172.21.2.102:0/3711631951 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f42d0003770 0x7f42d0003b90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f42dc00c210 tx=0x7f42e814eba0).ready entity=mon.0 client_cookie=c8c3c0dab448ed15 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:22.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.364+0000 7f42dbfff700 1 -- 172.21.2.102:0/3711631951 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc0070d0 con 0x7f42d0003770 2021-02-12T17:25:22.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.364+0000 7f42dbfff700 1 -- 172.21.2.102:0/3711631951 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc007230 con 0x7f42d0003770 2021-02-12T17:25:22.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.364+0000 7f42dbfff700 1 -- 172.21.2.102:0/3711631951 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc0055e0 con 0x7f42d0003770 2021-02-12T17:25:22.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.364+0000 7f42ef612700 1 -- 172.21.2.102:0/3711631951 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f42d0003770 msgr2=0x7f42d0003b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:22.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.364+0000 7f42ef612700 1 --2- 172.21.2.102:0/3711631951 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f42d0003770 0x7f42d0003b90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f42dc00c210 tx=0x7f42e814eba0).stop 2021-02-12T17:25:22.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.364+0000 7f42ef612700 1 -- 172.21.2.102:0/3711631951 shutdown_connections 2021-02-12T17:25:22.369 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.364+0000 7f42ef612700 1 --2- 172.21.2.102:0/3711631951 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f42d0003770 0x7f42d0003b90 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:22.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.364+0000 7f42ef612700 1 -- 172.21.2.102:0/3711631951 >> 172.21.2.102:0/3711631951 conn(0x7f42e80bc480 msgr2=0x7f42e80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:22.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.364+0000 7f42ef612700 1 -- 172.21.2.102:0/3711631951 shutdown_connections 2021-02-12T17:25:22.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.364+0000 7f42ef612700 1 -- 172.21.2.102:0/3711631951 wait complete. 2021-02-12T17:25:22.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.365+0000 7f42ef612700 1 Processor -- start 2021-02-12T17:25:22.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.365+0000 7f42ef612700 1 -- start start 2021-02-12T17:25:22.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ef612700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f42d0003770 0x7f42e814cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ef612700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f42e81503c0 0x7f42e8150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ef612700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f42e8160cd0 0x7f42e8161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ef612700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e8161620 con 0x7f42e81503c0 2021-02-12T17:25:22.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ef612700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e815d0b0 con 0x7f42d0003770 2021-02-12T17:25:22.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ef612700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e80ad090 con 0x7f42e8160cd0 2021-02-12T17:25:22.370 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ecbad700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f42e81503c0 0x7f42e8150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:22.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ecbad700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f42e81503c0 0x7f42e8150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48366/0 (socket says 172.21.2.102:48366) 2021-02-12T17:25:22.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ecbad700 1 -- 172.21.2.102:0/1966015977 learned_addr learned my addr 172.21.2.102:0/1966015977 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:22.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ed3ae700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f42d0003770 0x7f42e814cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:22.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42edbaf700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f42e8160cd0 0x7f42e8161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:22.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ecbad700 1 -- 172.21.2.102:0/1966015977 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f42e8160cd0 msgr2=0x7f42e8161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:22.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ecbad700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f42e8160cd0 0x7f42e8161130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:22.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ecbad700 1 -- 172.21.2.102:0/1966015977 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f42d0003770 msgr2=0x7f42e814cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:22.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ecbad700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f42d0003770 0x7f42e814cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:22.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ecbad700 1 -- 172.21.2.102:0/1966015977 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e80ad330 con 0x7f42e81503c0 2021-02-12T17:25:22.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42edbaf700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f42e8160cd0 0x7f42e8161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:22.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ecbad700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f42e81503c0 0x7f42e8150840 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f42e400b940 tx=0x7f42e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:22.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42d97fa700 1 -- 172.21.2.102:0/1966015977 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e400be80 con 0x7f42e81503c0 2021-02-12T17:25:22.371 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42d97fa700 1 -- 172.21.2.102:0/1966015977 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e40097c0 con 0x7f42e81503c0 2021-02-12T17:25:22.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42ef612700 1 -- 172.21.2.102:0/1966015977 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e80ad5d0 con 0x7f42e81503c0 2021-02-12T17:25:22.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.366+0000 7f42d97fa700 1 -- 172.21.2.102:0/1966015977 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4009b60 con 0x7f42e81503c0 2021-02-12T17:25:22.372 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.367+0000 7f42ef612700 1 -- 172.21.2.102:0/1966015977 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e8153b30 con 0x7f42e81503c0 2021-02-12T17:25:22.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.367+0000 7f42ef612700 1 -- 172.21.2.102:0/1966015977 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e8045460 con 0x7f42e81503c0 2021-02-12T17:25:22.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.367+0000 7f42d97fa700 1 -- 172.21.2.102:0/1966015977 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f42e40123e0 con 0x7f42e81503c0 2021-02-12T17:25:22.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.368+0000 7f42d97fa700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f42c8059d30 0x7f42c805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:22.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.368+0000 7f42d97fa700 1 -- 172.21.2.102:0/1966015977 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f42e4073a10 con 0x7f42e81503c0 2021-02-12T17:25:22.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.368+0000 7f42ed3ae700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f42c8059d30 0x7f42c805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:22.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.368+0000 7f42ed3ae700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f42c8059d30 0x7f42c805c1f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f42dc000bc0 tx=0x7f42dc013000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:22.373 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.371+0000 7f42d97fa700 1 -- 172.21.2.102:0/1966015977 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f42e4046e90 con 0x7f42e81503c0 2021-02-12T17:25:22.534 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.534+0000 7f42ef612700 1 -- 172.21.2.102:0/1966015977 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42e8063670 con 0x7f42e81503c0 2021-02-12T17:25:22.535 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.534+0000 7f42d97fa700 1 -- 172.21.2.102:0/1966015977 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f42e404a4b0 con 0x7f42e81503c0 2021-02-12T17:25:22.535 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:22.535 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":60,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:22.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.535+0000 7f42ef612700 1 -- 172.21.2.102:0/1966015977 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f42c8059d30 msgr2=0x7f42c805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:22.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.535+0000 7f42ef612700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f42c8059d30 0x7f42c805c1f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f42dc000bc0 tx=0x7f42dc013000).stop 2021-02-12T17:25:22.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.535+0000 7f42ef612700 1 -- 172.21.2.102:0/1966015977 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f42e81503c0 msgr2=0x7f42e8150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:22.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.535+0000 7f42ef612700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f42e81503c0 0x7f42e8150840 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f42e400b940 tx=0x7f42e4008040).stop 2021-02-12T17:25:22.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.535+0000 7f42ef612700 1 -- 172.21.2.102:0/1966015977 shutdown_connections 2021-02-12T17:25:22.536 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.535+0000 7f42ef612700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f42e8160cd0 0x7f42e8161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:22.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.535+0000 7f42ef612700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f42d0003770 0x7f42e814cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:22.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.535+0000 7f42ef612700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f42c8059d30 0x7f42c805c1f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:22.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.535+0000 7f42ef612700 1 --2- 172.21.2.102:0/1966015977 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f42e81503c0 0x7f42e8150840 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:22.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.535+0000 7f42ef612700 1 -- 172.21.2.102:0/1966015977 >> 172.21.2.102:0/1966015977 conn(0x7f42e80bc480 msgr2=0x7f42e80b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:22.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.536+0000 7f42ef612700 1 -- 172.21.2.102:0/1966015977 shutdown_connections 2021-02-12T17:25:22.537 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:22.536+0000 7f42ef612700 1 -- 172.21.2.102:0/1966015977 wait complete. 2021-02-12T17:25:22.537 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 60 2021-02-12T17:25:22.545 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:25:24.545 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:24.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.634+0000 7f1633353700 1 Processor -- start 2021-02-12T17:25:24.634 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.634+0000 7f1633353700 1 -- start start 2021-02-12T17:25:24.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.634+0000 7f1633353700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f162c0b8d20 0x7f162c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:24.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.634+0000 7f1633353700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f162c14e530 0x7f162c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:24.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.634+0000 7f1633353700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c0622a0 con 0x7f162c062740 2021-02-12T17:25:24.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.634+0000 7f1633353700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162c068d20 con 0x7f162c0b8d20 2021-02-12T17:25:24.635 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.634+0000 7f1633353700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c14ea10 con 0x7f162c14e530 2021-02-12T17:25:24.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.635+0000 7f16308ee700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f162c14e530 0x7f162c0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:24.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.635+0000 7f16308ee700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f162c14e530 0x7f162c0b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3301/0 says I am v2:172.21.2.102:50530/0 (socket says 172.21.2.102:50530) 2021-02-12T17:25:24.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.635+0000 7f16308ee700 1 -- 172.21.2.102:0/1448159215 learned_addr learned my addr 172.21.2.102:0/1448159215 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:24.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.635+0000 7f16318f0700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f162c062740 0x7f162c062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:39394/0 (socket says 172.21.2.102:39394) 2021-02-12T17:25:24.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.635+0000 7f16310ef700 1 --2- 172.21.2.102:0/1448159215 >> v2:172.21.2.104:3300/0 conn(0x7f162c0b8d20 0x7f162c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:24.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.636+0000 7f161ffff700 1 -- 172.21.2.102:0/1448159215 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805807624 0 0) 0x7f162c0622a0 con 0x7f162c062740 2021-02-12T17:25:24.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.636+0000 7f16308ee700 1 -- 172.21.2.102:0/1448159215 >> v2:172.21.2.104:3300/0 conn(0x7f162c0b8d20 msgr2=0x7f162c068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:24.637 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.636+0000 7f16308ee700 1 --2- 172.21.2.102:0/1448159215 >> v2:172.21.2.104:3300/0 conn(0x7f162c0b8d20 0x7f162c068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:24.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.636+0000 7f16308ee700 1 -- 172.21.2.102:0/1448159215 >> v1:172.21.2.104:6789/0 conn(0x7f162c062740 legacy=0x7f162c062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:24.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.636+0000 7f16308ee700 1 -- 172.21.2.102:0/1448159215 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0b63f0 con 0x7f162c14e530 2021-02-12T17:25:24.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.636+0000 7f16310ef700 1 --2- 172.21.2.102:0/1448159215 >> v2:172.21.2.104:3300/0 conn(0x7f162c0b8d20 0x7f162c068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:25:24.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.636+0000 7f16308ee700 1 --2- 172.21.2.102:0/1448159215 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f162c14e530 0x7f162c0b7250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f162800b9e0 tx=0x7f1628006ea0).ready entity=mon.2 client_cookie=dfbfc9fad1cf498e server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:24.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.636+0000 7f161ffff700 1 -- 172.21.2.102:0/1448159215 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628009840 con 0x7f162c14e530 2021-02-12T17:25:24.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.636+0000 7f161ffff700 1 -- 172.21.2.102:0/1448159215 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16280099a0 con 0x7f162c14e530 2021-02-12T17:25:24.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.636+0000 7f161ffff700 1 -- 172.21.2.102:0/1448159215 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628009d20 con 0x7f162c14e530 2021-02-12T17:25:24.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.636+0000 7f1633353700 1 -- 172.21.2.102:0/1448159215 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f162c14e530 msgr2=0x7f162c0b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:24.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.636+0000 7f1633353700 1 --2- 172.21.2.102:0/1448159215 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f162c14e530 0x7f162c0b7250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f162800b9e0 tx=0x7f1628006ea0).stop 2021-02-12T17:25:24.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.637+0000 7f1633353700 1 -- 172.21.2.102:0/1448159215 shutdown_connections 2021-02-12T17:25:24.638 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.637+0000 7f1633353700 1 --2- 172.21.2.102:0/1448159215 >> v2:172.21.2.104:3300/0 conn(0x7f162c0b8d20 0x7f162c068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.637+0000 7f1633353700 1 --2- 172.21.2.102:0/1448159215 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f162c14e530 0x7f162c0b7250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.637+0000 7f1633353700 1 -- 172.21.2.102:0/1448159215 >> 172.21.2.102:0/1448159215 conn(0x7f162c0bc480 msgr2=0x7f162c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.637+0000 7f1633353700 1 -- 172.21.2.102:0/1448159215 shutdown_connections 2021-02-12T17:25:24.639 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.637+0000 7f1633353700 1 -- 172.21.2.102:0/1448159215 wait complete. 2021-02-12T17:25:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.637+0000 7f1633353700 1 Processor -- start 2021-02-12T17:25:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.637+0000 7f1633353700 1 -- start start 2021-02-12T17:25:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.638+0000 7f1633353700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f162c062740 0x7f162c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.638+0000 7f1633353700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f162c0b8d20 0x7f162c14cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.638+0000 7f1633353700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f162c14e530 0x7f162c15d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.638+0000 7f1633353700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c0b2520 con 0x7f162c0b8d20 2021-02-12T17:25:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.638+0000 7f1633353700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c0b0840 con 0x7f162c062740 2021-02-12T17:25:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.638+0000 7f1633353700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c0ae320 con 0x7f162c14e530 2021-02-12T17:25:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.638+0000 7f16308ee700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f162c0b8d20 0x7f162c14cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.638+0000 7f16308ee700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f162c0b8d20 0x7f162c14cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48384/0 (socket says 172.21.2.102:48384) 2021-02-12T17:25:24.641 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.638+0000 7f16308ee700 1 -- 172.21.2.102:0/4140612296 learned_addr learned my addr 172.21.2.102:0/4140612296 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:24.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.639+0000 7f16318f0700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f162c14e530 0x7f162c15d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:24.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.639+0000 7f16308ee700 1 -- 172.21.2.102:0/4140612296 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f162c14e530 msgr2=0x7f162c15d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:24.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.639+0000 7f16310ef700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f162c062740 0x7f162c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:24.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.639+0000 7f16308ee700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f162c14e530 0x7f162c15d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:24.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.639+0000 7f16308ee700 1 -- 172.21.2.102:0/4140612296 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f162c062740 msgr2=0x7f162c0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:24.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.639+0000 7f16308ee700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f162c062740 0x7f162c0b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:24.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.639+0000 7f16308ee700 1 -- 172.21.2.102:0/4140612296 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0ae5c0 con 0x7f162c0b8d20 2021-02-12T17:25:24.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.639+0000 7f16310ef700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f162c062740 0x7f162c0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:24.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.639+0000 7f16308ee700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f162c0b8d20 0x7f162c14cdd0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f162c14eb50 tx=0x7f1628016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:24.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.639+0000 7f161d7fa700 1 -- 172.21.2.102:0/4140612296 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628012ce0 con 0x7f162c0b8d20 2021-02-12T17:25:24.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.639+0000 7f161d7fa700 1 -- 172.21.2.102:0/4140612296 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1628012e40 con 0x7f162c0b8d20 2021-02-12T17:25:24.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.639+0000 7f1633353700 1 -- 172.21.2.102:0/4140612296 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c0ae860 con 0x7f162c0b8d20 2021-02-12T17:25:24.642 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.639+0000 7f161d7fa700 1 -- 172.21.2.102:0/4140612296 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162801c670 con 0x7f162c0b8d20 2021-02-12T17:25:24.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.639+0000 7f1633353700 1 -- 172.21.2.102:0/4140612296 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c0acf10 con 0x7f162c0b8d20 2021-02-12T17:25:24.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.640+0000 7f1633353700 1 -- 172.21.2.102:0/4140612296 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162c0bb7f0 con 0x7f162c0b8d20 2021-02-12T17:25:24.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.640+0000 7f161d7fa700 1 -- 172.21.2.102:0/4140612296 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f162800f070 con 0x7f162c0b8d20 2021-02-12T17:25:24.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.640+0000 7f161d7fa700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f160c059d60 0x7f160c05c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:24.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.640+0000 7f161d7fa700 1 -- 172.21.2.102:0/4140612296 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f16280754a0 con 0x7f162c0b8d20 2021-02-12T17:25:24.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.640+0000 7f16310ef700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f160c059d60 0x7f160c05c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:24.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.641+0000 7f16310ef700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f160c059d60 0x7f160c05c220 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f1620006bc0 tx=0x7f1620008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:24.643 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.643+0000 7f161d7fa700 1 -- 172.21.2.102:0/4140612296 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f162804c3b0 con 0x7f162c0b8d20 2021-02-12T17:25:24.805 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.805+0000 7f1633353700 1 -- 172.21.2.102:0/4140612296 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f162c045460 con 0x7f162c0b8d20 2021-02-12T17:25:24.806 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.805+0000 7f161d7fa700 1 -- 172.21.2.102:0/4140612296 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f162804bfa0 con 0x7f162c0b8d20 2021-02-12T17:25:24.806 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:24.806 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":60,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:24.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.806+0000 7f1633353700 1 -- 172.21.2.102:0/4140612296 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f160c059d60 msgr2=0x7f160c05c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:24.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.806+0000 7f1633353700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f160c059d60 0x7f160c05c220 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f1620006bc0 tx=0x7f1620008040).stop 2021-02-12T17:25:24.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.806+0000 7f1633353700 1 -- 172.21.2.102:0/4140612296 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f162c0b8d20 msgr2=0x7f162c14cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:24.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.806+0000 7f1633353700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f162c0b8d20 0x7f162c14cdd0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f162c14eb50 tx=0x7f1628016000).stop 2021-02-12T17:25:24.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.807+0000 7f1633353700 1 -- 172.21.2.102:0/4140612296 shutdown_connections 2021-02-12T17:25:24.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.807+0000 7f1633353700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f162c14e530 0x7f162c15d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:24.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.807+0000 7f1633353700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f162c062740 0x7f162c0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:24.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.807+0000 7f1633353700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f160c059d60 0x7f160c05c220 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:24.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.807+0000 7f1633353700 1 --2- 172.21.2.102:0/4140612296 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f162c0b8d20 0x7f162c14cdd0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:24.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.807+0000 7f1633353700 1 -- 172.21.2.102:0/4140612296 >> 172.21.2.102:0/4140612296 conn(0x7f162c0bc480 msgr2=0x7f162c0ba290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:24.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.807+0000 7f1633353700 1 -- 172.21.2.102:0/4140612296 shutdown_connections 2021-02-12T17:25:24.808 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:24.807+0000 7f1633353700 1 -- 172.21.2.102:0/4140612296 wait complete. 2021-02-12T17:25:24.808 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 60 2021-02-12T17:25:24.816 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:25:26.818 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:26.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.907+0000 7f52067aa700 1 Processor -- start 2021-02-12T17:25:26.908 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.907+0000 7f52067aa700 1 -- start start 2021-02-12T17:25:26.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.908+0000 7f52067aa700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f520014e530 0x7f5200068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:26.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.908+0000 7f52067aa700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52000b7960 con 0x7f5200062740 2021-02-12T17:25:26.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.908+0000 7f52067aa700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52000622a0 con 0x7f52000b8d20 2021-02-12T17:25:26.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.908+0000 7f52067aa700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5200068d20 con 0x7f520014e530 2021-02-12T17:25:26.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.908+0000 7f5204d47700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f5200062740 0x7f5200062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:57038/0 (socket says 172.21.2.102:57038) 2021-02-12T17:25:26.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.908+0000 7f5204d47700 1 -- 172.21.2.102:0/1585618485 learned_addr learned my addr 172.21.2.102:0/1585618485 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:26.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.908+0000 7f51feffd700 1 -- 172.21.2.102:0/1585618485 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230489401 0 0) 0x7f52000b7960 con 0x7f5200062740 2021-02-12T17:25:26.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.908+0000 7f51feffd700 1 -- 172.21.2.102:0/1585618485 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51ec003230 con 0x7f5200062740 2021-02-12T17:25:26.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.908+0000 7f51feffd700 1 -- 172.21.2.102:0/1585618485 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1564770746 0 0) 0x7f51ec003230 con 0x7f5200062740 2021-02-12T17:25:26.909 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.908+0000 7f51ff7fe700 1 --2- 172.21.2.102:0/1585618485 >> v2:172.21.2.104:3300/0 conn(0x7f520014e530 0x7f5200068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:26.910 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.908+0000 7f51feffd700 1 -- 172.21.2.102:0/1585618485 >> v2:172.21.2.104:3300/0 conn(0x7f520014e530 msgr2=0x7f5200068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:26.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51feffd700 1 --2- 172.21.2.102:0/1585618485 >> v2:172.21.2.104:3300/0 conn(0x7f520014e530 0x7f5200068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:26.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51feffd700 1 -- 172.21.2.102:0/1585618485 >> v1:172.21.2.104:6789/0 conn(0x7f52000b8d20 legacy=0x7f52000b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:26.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51feffd700 1 -- 172.21.2.102:0/1585618485 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520014ea10 con 0x7f5200062740 2021-02-12T17:25:26.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51feffd700 1 -- 172.21.2.102:0/1585618485 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f51f8001860 con 0x7f5200062740 2021-02-12T17:25:26.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51ff7fe700 1 --2- 172.21.2.102:0/1585618485 >> v2:172.21.2.104:3300/0 conn(0x7f520014e530 0x7f5200068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:26.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51feffd700 1 -- 172.21.2.102:0/1585618485 >> v1:172.21.2.102:6789/0 conn(0x7f5200062740 legacy=0x7f5200062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:26.912 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51feffd700 1 --2- 172.21.2.102:0/1585618485 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f51ec0037f0 0x7f51ec003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:26.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51feffd700 1 --2- 172.21.2.102:0/1585618485 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f51ec0044d0 0x7f51ec004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:26.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51feffd700 1 --2- 172.21.2.102:0/1585618485 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f51ec004e40 0x7f51ec00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:26.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51feffd700 1 -- 172.21.2.102:0/1585618485 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5200068d20 con 0x7f51ec004e40 2021-02-12T17:25:26.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51feffd700 1 -- 172.21.2.102:0/1585618485 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0053a0 con 0x7f51ec0044d0 2021-02-12T17:25:26.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51feffd700 1 -- 172.21.2.102:0/1585618485 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec00bc60 con 0x7f51ec0037f0 2021-02-12T17:25:26.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f5204d47700 1 --2- 172.21.2.102:0/1585618485 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f51ec004e40 0x7f51ec00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:26.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51fffff700 1 --2- 172.21.2.102:0/1585618485 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f51ec0037f0 0x7f51ec003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:26.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f5204d47700 1 -- 172.21.2.102:0/1585618485 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f51ec0037f0 msgr2=0x7f51ec003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:26.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f5204d47700 1 --2- 172.21.2.102:0/1585618485 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f51ec0037f0 0x7f51ec003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:26.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f5204d47700 1 -- 172.21.2.102:0/1585618485 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f51ec0044d0 msgr2=0x7f51ec004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:26.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f5204d47700 1 --2- 172.21.2.102:0/1585618485 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f51ec0044d0 0x7f51ec004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:26.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f5204d47700 1 -- 172.21.2.102:0/1585618485 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec003230 con 0x7f51ec004e40 2021-02-12T17:25:26.913 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f5204d47700 1 -- 172.21.2.102:0/1585618485 reap_dead start 2021-02-12T17:25:26.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f5204d47700 1 --2- 172.21.2.102:0/1585618485 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f51ec004e40 0x7f51ec00b720 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f51f800c630 tx=0x7f520014eba0).ready entity=mon.0 client_cookie=e1423d0f02680c88 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:26.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51feffd700 1 -- 172.21.2.102:0/1585618485 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8005b70 con 0x7f51ec004e40 2021-02-12T17:25:26.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51feffd700 1 -- 172.21.2.102:0/1585618485 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f8005cd0 con 0x7f51ec004e40 2021-02-12T17:25:26.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.909+0000 7f51feffd700 1 -- 172.21.2.102:0/1585618485 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8007300 con 0x7f51ec004e40 2021-02-12T17:25:26.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.910+0000 7f52067aa700 1 -- 172.21.2.102:0/1585618485 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f51ec004e40 msgr2=0x7f51ec00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:26.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.910+0000 7f52067aa700 1 --2- 172.21.2.102:0/1585618485 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f51ec004e40 0x7f51ec00b720 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f51f800c630 tx=0x7f520014eba0).stop 2021-02-12T17:25:26.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.910+0000 7f52067aa700 1 -- 172.21.2.102:0/1585618485 shutdown_connections 2021-02-12T17:25:26.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.910+0000 7f52067aa700 1 --2- 172.21.2.102:0/1585618485 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f51ec004e40 0x7f51ec00b720 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:26.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.910+0000 7f52067aa700 1 -- 172.21.2.102:0/1585618485 >> 172.21.2.102:0/1585618485 conn(0x7f52000bc480 msgr2=0x7f52000b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:26.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.910+0000 7f52067aa700 1 -- 172.21.2.102:0/1585618485 shutdown_connections 2021-02-12T17:25:26.914 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.910+0000 7f52067aa700 1 -- 172.21.2.102:0/1585618485 wait complete. 2021-02-12T17:25:26.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.911+0000 7f52067aa700 1 Processor -- start 2021-02-12T17:25:26.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.911+0000 7f52067aa700 1 -- start start 2021-02-12T17:25:26.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.911+0000 7f52067aa700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f51ec004e40 0x7f52001534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:26.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.911+0000 7f52067aa700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f520015dc50 0x7f52000ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:26.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.911+0000 7f52067aa700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f52000ae9b0 0x7f52000b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:26.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.911+0000 7f52067aa700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52000b2260 con 0x7f51ec004e40 2021-02-12T17:25:26.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.911+0000 7f52067aa700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52000b2500 con 0x7f52000ae9b0 2021-02-12T17:25:26.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.911+0000 7f52067aa700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520015d270 con 0x7f520015dc50 2021-02-12T17:25:26.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.911+0000 7f51fffff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f51ec004e40 0x7f52001534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:26.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.911+0000 7f51fffff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f51ec004e40 0x7f52001534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48410/0 (socket says 172.21.2.102:48410) 2021-02-12T17:25:26.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.911+0000 7f51fffff700 1 -- 172.21.2.102:0/3609430908 learned_addr learned my addr 172.21.2.102:0/3609430908 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:26.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.912+0000 7f51ff7fe700 1 --2- 172.21.2.102:0/3609430908 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f520015dc50 0x7f52000ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:26.915 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.912+0000 7f5204d47700 1 --2- 172.21.2.102:0/3609430908 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f52000ae9b0 0x7f52000b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:26.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.912+0000 7f51fffff700 1 -- 172.21.2.102:0/3609430908 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f520015dc50 msgr2=0x7f52000ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:26.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.912+0000 7f51fffff700 1 --2- 172.21.2.102:0/3609430908 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f520015dc50 0x7f52000ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:26.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.912+0000 7f51fffff700 1 -- 172.21.2.102:0/3609430908 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f52000ae9b0 msgr2=0x7f52000b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:26.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.912+0000 7f51fffff700 1 --2- 172.21.2.102:0/3609430908 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f52000ae9b0 0x7f52000b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:26.916 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.912+0000 7f51fffff700 1 -- 172.21.2.102:0/3609430908 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520015d510 con 0x7f51ec004e40 2021-02-12T17:25:26.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.912+0000 7f51fffff700 1 --2- 172.21.2.102:0/3609430908 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f51ec004e40 0x7f52001534c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f51f400e750 tx=0x7f51f4009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:26.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.912+0000 7f51e7fff700 1 -- 172.21.2.102:0/3609430908 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4012500 con 0x7f51ec004e40 2021-02-12T17:25:26.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.912+0000 7f51e7fff700 1 -- 172.21.2.102:0/3609430908 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f4010040 con 0x7f51ec004e40 2021-02-12T17:25:26.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.912+0000 7f51e7fff700 1 -- 172.21.2.102:0/3609430908 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4012890 con 0x7f51ec004e40 2021-02-12T17:25:26.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.912+0000 7f52067aa700 1 -- 172.21.2.102:0/3609430908 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520015d7b0 con 0x7f51ec004e40 2021-02-12T17:25:26.917 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.912+0000 7f52067aa700 1 -- 172.21.2.102:0/3609430908 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5200153100 con 0x7f51ec004e40 2021-02-12T17:25:26.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.913+0000 7f52067aa700 1 -- 172.21.2.102:0/3609430908 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520015d940 con 0x7f51ec004e40 2021-02-12T17:25:26.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.913+0000 7f51e7fff700 1 -- 172.21.2.102:0/3609430908 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f51f4012c40 con 0x7f51ec004e40 2021-02-12T17:25:26.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.913+0000 7f51e7fff700 1 --2- 172.21.2.102:0/3609430908 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f51e0059d60 0x7f51e005c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:26.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.914+0000 7f51e7fff700 1 -- 172.21.2.102:0/3609430908 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f51f4073e00 con 0x7f51ec004e40 2021-02-12T17:25:26.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.914+0000 7f51ff7fe700 1 --2- 172.21.2.102:0/3609430908 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f51e0059d60 0x7f51e005c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:26.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.914+0000 7f51ff7fe700 1 --2- 172.21.2.102:0/3609430908 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f51e0059d60 0x7f51e005c220 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f52000b8240 tx=0x7f51f0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:26.918 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:26.916+0000 7f51e7fff700 1 -- 172.21.2.102:0/3609430908 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f51f4047170 con 0x7f51ec004e40 2021-02-12T17:25:27.077 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:27.076+0000 7f52067aa700 1 -- 172.21.2.102:0/3609430908 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5200045460 con 0x7f51ec004e40 2021-02-12T17:25:27.077 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:27.077+0000 7f51e7fff700 1 -- 172.21.2.102:0/3609430908 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f51f4071e60 con 0x7f51ec004e40 2021-02-12T17:25:27.077 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:27.078 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":60,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:27.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:27.078+0000 7f52067aa700 1 -- 172.21.2.102:0/3609430908 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f51e0059d60 msgr2=0x7f51e005c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:27.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:27.078+0000 7f52067aa700 1 --2- 172.21.2.102:0/3609430908 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f51e0059d60 0x7f51e005c220 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f52000b8240 tx=0x7f51f0008040).stop 2021-02-12T17:25:27.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:27.078+0000 7f52067aa700 1 -- 172.21.2.102:0/3609430908 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f51ec004e40 msgr2=0x7f52001534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:27.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:27.078+0000 7f52067aa700 1 --2- 172.21.2.102:0/3609430908 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f51ec004e40 0x7f52001534c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f51f400e750 tx=0x7f51f4009040).stop 2021-02-12T17:25:27.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:27.078+0000 7f52067aa700 1 -- 172.21.2.102:0/3609430908 shutdown_connections 2021-02-12T17:25:27.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:27.078+0000 7f52067aa700 1 --2- 172.21.2.102:0/3609430908 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f52000ae9b0 0x7f52000b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:27.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:27.078+0000 7f52067aa700 1 --2- 172.21.2.102:0/3609430908 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f51e0059d60 0x7f51e005c220 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:27.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:27.078+0000 7f52067aa700 1 --2- 172.21.2.102:0/3609430908 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f51ec004e40 0x7f52001534c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:27.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:27.078+0000 7f52067aa700 1 --2- 172.21.2.102:0/3609430908 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f520015dc50 0x7f52000ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:27.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:27.078+0000 7f52067aa700 1 -- 172.21.2.102:0/3609430908 >> 172.21.2.102:0/3609430908 conn(0x7f52000bc480 msgr2=0x7f520014cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:27.080 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:27.078+0000 7f52067aa700 1 -- 172.21.2.102:0/3609430908 shutdown_connections 2021-02-12T17:25:27.080 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:27.078+0000 7f52067aa700 1 -- 172.21.2.102:0/3609430908 wait complete. 2021-02-12T17:25:27.080 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 60 2021-02-12T17:25:27.087 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:25:29.088 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:29.176 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.176+0000 7f38c4920700 1 Processor -- start 2021-02-12T17:25:29.176 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.176+0000 7f38c4920700 1 -- start start 2021-02-12T17:25:29.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.176+0000 7f38c4920700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f38c014e530 0x7f38c0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.176+0000 7f38c4920700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f38c0062740 0x7f38c0062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.176+0000 7f38c4920700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c00b7960 con 0x7f38c00b8d20 2021-02-12T17:25:29.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.176+0000 7f38c4920700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c0068d20 con 0x7f38c014e530 2021-02-12T17:25:29.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.176+0000 7f38c4920700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c00622a0 con 0x7f38c0062740 2021-02-12T17:25:29.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.177+0000 7f38be59c700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f38c00b8d20 0x7f38c00b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:57060/0 (socket says 172.21.2.102:57060) 2021-02-12T17:25:29.177 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.177+0000 7f38be59c700 1 -- 172.21.2.102:0/4080575539 learned_addr learned my addr 172.21.2.102:0/4080575539 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:29.178 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.177+0000 7f38bdd9b700 1 --2- 172.21.2.102:0/4080575539 >> v2:172.21.2.102:3300/0 conn(0x7f38c014e530 0x7f38c0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.177+0000 7f38bd59a700 1 -- 172.21.2.102:0/4080575539 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885166096 0 0) 0x7f38c00b7960 con 0x7f38c00b8d20 2021-02-12T17:25:29.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.177+0000 7f38bd59a700 1 -- 172.21.2.102:0/4080575539 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38a4003230 con 0x7f38c00b8d20 2021-02-12T17:25:29.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.177+0000 7f38bdd9b700 1 -- 172.21.2.102:0/4080575539 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f38c0062740 msgr2=0x7f38c0062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:29.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.177+0000 7f38bdd9b700 1 --2- 172.21.2.102:0/4080575539 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f38c0062740 0x7f38c0062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:29.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.177+0000 7f38bdd9b700 1 -- 172.21.2.102:0/4080575539 >> v1:172.21.2.102:6789/0 conn(0x7f38c00b8d20 legacy=0x7f38c00b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.177+0000 7f38bdd9b700 1 -- 172.21.2.102:0/4080575539 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c014ea10 con 0x7f38c014e530 2021-02-12T17:25:29.179 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.177+0000 7f38bdd9b700 1 --2- 172.21.2.102:0/4080575539 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38c014e530 0x7f38c0068830 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f38b400b980 tx=0x7f38b4006de0).ready entity=mon.0 client_cookie=20891a74902be7d9 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:29.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.177+0000 7f38bd59a700 1 -- 172.21.2.102:0/4080575539 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b400be70 con 0x7f38c014e530 2021-02-12T17:25:29.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.177+0000 7f38bd59a700 1 -- 172.21.2.102:0/4080575539 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b40097e0 con 0x7f38c014e530 2021-02-12T17:25:29.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.177+0000 7f38bd59a700 1 -- 172.21.2.102:0/4080575539 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4009b60 con 0x7f38c014e530 2021-02-12T17:25:29.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.178+0000 7f38c4920700 1 -- 172.21.2.102:0/4080575539 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38c014e530 msgr2=0x7f38c0068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.178+0000 7f38c4920700 1 --2- 172.21.2.102:0/4080575539 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38c014e530 0x7f38c0068830 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f38b400b980 tx=0x7f38b4006de0).stop 2021-02-12T17:25:29.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.178+0000 7f38c4920700 1 -- 172.21.2.102:0/4080575539 shutdown_connections 2021-02-12T17:25:29.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.178+0000 7f38c4920700 1 --2- 172.21.2.102:0/4080575539 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f38c0062740 0x7f38c0062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:29.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.178+0000 7f38c4920700 1 --2- 172.21.2.102:0/4080575539 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38c014e530 0x7f38c0068830 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.178+0000 7f38c4920700 1 -- 172.21.2.102:0/4080575539 >> 172.21.2.102:0/4080575539 conn(0x7f38c00bc480 msgr2=0x7f38c00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:29.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.178+0000 7f38c4920700 1 -- 172.21.2.102:0/4080575539 shutdown_connections 2021-02-12T17:25:29.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.178+0000 7f38c4920700 1 -- 172.21.2.102:0/4080575539 wait complete. 2021-02-12T17:25:29.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.179+0000 7f38c4920700 1 Processor -- start 2021-02-12T17:25:29.180 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.179+0000 7f38c4920700 1 -- start start 2021-02-12T17:25:29.182 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.179+0000 7f38c4920700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f38c0062740 0x7f38c015e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.182 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.179+0000 7f38c4920700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38c00b8d20 0x7f38c00b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.182 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.179+0000 7f38c4920700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38c014e530 0x7f38c00b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.182 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.179+0000 7f38c4920700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c015e5e0 con 0x7f38c014e530 2021-02-12T17:25:29.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.179+0000 7f38c4920700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c00b4fa0 con 0x7f38c00b8d20 2021-02-12T17:25:29.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.179+0000 7f38c4920700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c00b5240 con 0x7f38c0062740 2021-02-12T17:25:29.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.179+0000 7f38bed9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38c014e530 0x7f38c00b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.179+0000 7f38bed9d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38c014e530 0x7f38c00b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48424/0 (socket says 172.21.2.102:48424) 2021-02-12T17:25:29.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.179+0000 7f38bed9d700 1 -- 172.21.2.102:0/3335442709 learned_addr learned my addr 172.21.2.102:0/3335442709 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:29.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.180+0000 7f38bed9d700 1 -- 172.21.2.102:0/3335442709 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f38c0062740 msgr2=0x7f38c015e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.180+0000 7f38bed9d700 1 --2- 172.21.2.102:0/3335442709 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f38c0062740 0x7f38c015e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:29.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.180+0000 7f38bed9d700 1 -- 172.21.2.102:0/3335442709 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38c00b8d20 msgr2=0x7f38c00b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.180+0000 7f38bed9d700 1 --2- 172.21.2.102:0/3335442709 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38c00b8d20 0x7f38c00b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:29.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.180+0000 7f38bed9d700 1 -- 172.21.2.102:0/3335442709 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c00b54e0 con 0x7f38c014e530 2021-02-12T17:25:29.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.180+0000 7f38bed9d700 1 --2- 172.21.2.102:0/3335442709 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38c014e530 0x7f38c00b0d00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f38b800bae0 tx=0x7f38b8009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:29.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.180+0000 7f38ae7fc700 1 -- 172.21.2.102:0/3335442709 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b800c960 con 0x7f38c014e530 2021-02-12T17:25:29.183 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.180+0000 7f38ae7fc700 1 -- 172.21.2.102:0/3335442709 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b800cac0 con 0x7f38c014e530 2021-02-12T17:25:29.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.180+0000 7f38c4920700 1 -- 172.21.2.102:0/3335442709 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c00b5780 con 0x7f38c014e530 2021-02-12T17:25:29.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.180+0000 7f38ae7fc700 1 -- 172.21.2.102:0/3335442709 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b800cc70 con 0x7f38c014e530 2021-02-12T17:25:29.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.180+0000 7f38c4920700 1 -- 172.21.2.102:0/3335442709 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c00b0700 con 0x7f38c014e530 2021-02-12T17:25:29.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.181+0000 7f38c4920700 1 -- 172.21.2.102:0/3335442709 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c00b5be0 con 0x7f38c014e530 2021-02-12T17:25:29.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.181+0000 7f38ae7fc700 1 -- 172.21.2.102:0/3335442709 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f38b801c070 con 0x7f38c014e530 2021-02-12T17:25:29.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.181+0000 7f38ae7fc700 1 --2- 172.21.2.102:0/3335442709 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f389c059d80 0x7f389c05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.181+0000 7f38ae7fc700 1 -- 172.21.2.102:0/3335442709 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f38b80738f0 con 0x7f38c014e530 2021-02-12T17:25:29.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.181+0000 7f38be59c700 1 --2- 172.21.2.102:0/3335442709 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f389c059d80 0x7f389c05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.184 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.182+0000 7f38be59c700 1 --2- 172.21.2.102:0/3335442709 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f389c059d80 0x7f389c05c240 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f38b0005590 tx=0x7f38b0007690).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:29.185 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.184+0000 7f38ae7fc700 1 -- 172.21.2.102:0/3335442709 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f38b8046d40 con 0x7f38c014e530 2021-02-12T17:25:29.341 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.341+0000 7f38c4920700 1 -- 172.21.2.102:0/3335442709 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38c0045460 con 0x7f38c014e530 2021-02-12T17:25:29.342 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.342+0000 7f38ae7fc700 1 -- 172.21.2.102:0/3335442709 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f38b801a070 con 0x7f38c014e530 2021-02-12T17:25:29.342 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:29.342 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":60,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:29.343 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.343+0000 7f38c4920700 1 -- 172.21.2.102:0/3335442709 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f389c059d80 msgr2=0x7f389c05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.343 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.343+0000 7f38c4920700 1 --2- 172.21.2.102:0/3335442709 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f389c059d80 0x7f389c05c240 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f38b0005590 tx=0x7f38b0007690).stop 2021-02-12T17:25:29.343 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.343+0000 7f38c4920700 1 -- 172.21.2.102:0/3335442709 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38c014e530 msgr2=0x7f38c00b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.344 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.343+0000 7f38c4920700 1 --2- 172.21.2.102:0/3335442709 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38c014e530 0x7f38c00b0d00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f38b800bae0 tx=0x7f38b8009220).stop 2021-02-12T17:25:29.344 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.343+0000 7f38c4920700 1 -- 172.21.2.102:0/3335442709 shutdown_connections 2021-02-12T17:25:29.344 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.343+0000 7f38c4920700 1 --2- 172.21.2.102:0/3335442709 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f389c059d80 0x7f389c05c240 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.344 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.343+0000 7f38c4920700 1 --2- 172.21.2.102:0/3335442709 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f38c014e530 0x7f38c00b0d00 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.344 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.343+0000 7f38c4920700 1 --2- 172.21.2.102:0/3335442709 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f38c0062740 0x7f38c015e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:29.344 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.343+0000 7f38c4920700 1 --2- 172.21.2.102:0/3335442709 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f38c00b8d20 0x7f38c00b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:29.344 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.343+0000 7f38c4920700 1 -- 172.21.2.102:0/3335442709 >> 172.21.2.102:0/3335442709 conn(0x7f38c00bc480 msgr2=0x7f38c014db30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:29.344 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.343+0000 7f38c4920700 1 -- 172.21.2.102:0/3335442709 shutdown_connections 2021-02-12T17:25:29.344 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.343+0000 7f38c4920700 1 -- 172.21.2.102:0/3335442709 wait complete. 2021-02-12T17:25:29.344 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 60 2021-02-12T17:25:29.352 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:25:29.404 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:29.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.492+0000 7f5db1ca3700 1 Processor -- start 2021-02-12T17:25:29.493 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.492+0000 7f5db1ca3700 1 -- start start 2021-02-12T17:25:29.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.493+0000 7f5db1ca3700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f5dac0b8d20 0x7f5dac068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.493+0000 7f5db1ca3700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dac0b7960 con 0x7f5dac14e530 2021-02-12T17:25:29.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.493+0000 7f5db1ca3700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dac0622a0 con 0x7f5dac062740 2021-02-12T17:25:29.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.493+0000 7f5db1ca3700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dac068d20 con 0x7f5dac0b8d20 2021-02-12T17:25:29.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.493+0000 7f5daaffd700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f5dac14e530 0x7f5dac0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:57074/0 (socket says 172.21.2.102:57074) 2021-02-12T17:25:29.495 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.493+0000 7f5daaffd700 1 -- 172.21.2.102:0/74661258 learned_addr learned my addr 172.21.2.102:0/74661258 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:29.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.493+0000 7f5daa7fc700 1 -- 172.21.2.102:0/74661258 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535793937 0 0) 0x7f5dac0b7960 con 0x7f5dac14e530 2021-02-12T17:25:29.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.493+0000 7f5daa7fc700 1 -- 172.21.2.102:0/74661258 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d8c003230 con 0x7f5dac14e530 2021-02-12T17:25:29.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.493+0000 7f5dab7fe700 1 --2- 172.21.2.102:0/74661258 >> v2:172.21.2.104:3300/0 conn(0x7f5dac0b8d20 0x7f5dac068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.493+0000 7f5daa7fc700 1 -- 172.21.2.102:0/74661258 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2143405233 0 0) 0x7f5d8c003230 con 0x7f5dac14e530 2021-02-12T17:25:29.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 -- 172.21.2.102:0/74661258 >> v2:172.21.2.104:3300/0 conn(0x7f5dac0b8d20 msgr2=0x7f5dac068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:29.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 --2- 172.21.2.102:0/74661258 >> v2:172.21.2.104:3300/0 conn(0x7f5dac0b8d20 0x7f5dac068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 -- 172.21.2.102:0/74661258 >> v1:172.21.2.104:6789/0 conn(0x7f5dac062740 legacy=0x7f5dac062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 -- 172.21.2.102:0/74661258 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac14ea10 con 0x7f5dac14e530 2021-02-12T17:25:29.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 -- 172.21.2.102:0/74661258 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f5d940014e0 con 0x7f5dac14e530 2021-02-12T17:25:29.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 -- 172.21.2.102:0/74661258 >> v1:172.21.2.102:6789/0 conn(0x7f5dac14e530 legacy=0x7f5dac0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 --2- 172.21.2.102:0/74661258 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5d8c003720 0x7f5d8c003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 --2- 172.21.2.102:0/74661258 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d8c0044d0 0x7f5d8c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.496 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 --2- 172.21.2.102:0/74661258 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d8c004e40 0x7f5d8c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 -- 172.21.2.102:0/74661258 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac068d20 con 0x7f5d8c004e40 2021-02-12T17:25:29.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 -- 172.21.2.102:0/74661258 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c004210 con 0x7f5d8c003720 2021-02-12T17:25:29.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 -- 172.21.2.102:0/74661258 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c00bc10 con 0x7f5d8c0044d0 2021-02-12T17:25:29.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5dabfff700 1 --2- 172.21.2.102:0/74661258 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d8c004e40 0x7f5d8c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daaffd700 1 --2- 172.21.2.102:0/74661258 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d8c0044d0 0x7f5d8c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5dab7fe700 1 --2- 172.21.2.102:0/74661258 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5d8c003720 0x7f5d8c003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5dabfff700 1 -- 172.21.2.102:0/74661258 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d8c0044d0 msgr2=0x7f5d8c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:29.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5dabfff700 1 --2- 172.21.2.102:0/74661258 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d8c0044d0 0x7f5d8c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5dabfff700 1 -- 172.21.2.102:0/74661258 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5d8c003720 msgr2=0x7f5d8c003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:29.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5dabfff700 1 --2- 172.21.2.102:0/74661258 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5d8c003720 0x7f5d8c003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5dabfff700 1 -- 172.21.2.102:0/74661258 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c003230 con 0x7f5d8c004e40 2021-02-12T17:25:29.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5dab7fe700 1 --2- 172.21.2.102:0/74661258 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5d8c003720 0x7f5d8c003b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:29.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daaffd700 1 --2- 172.21.2.102:0/74661258 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d8c0044d0 0x7f5d8c004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:29.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5dabfff700 1 -- 172.21.2.102:0/74661258 reap_dead start 2021-02-12T17:25:29.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5dabfff700 1 --2- 172.21.2.102:0/74661258 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d8c004e40 0x7f5d8c00b720 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f5da4001f50 tx=0x7f5da4007ee0).ready entity=mon.0 client_cookie=f2f08668ce5260af server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:29.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 -- 172.21.2.102:0/74661258 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da400cbf0 con 0x7f5d8c004e40 2021-02-12T17:25:29.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 -- 172.21.2.102:0/74661258 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da400cd50 con 0x7f5d8c004e40 2021-02-12T17:25:29.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.494+0000 7f5daa7fc700 1 -- 172.21.2.102:0/74661258 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da4013660 con 0x7f5d8c004e40 2021-02-12T17:25:29.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.495+0000 7f5db1ca3700 1 -- 172.21.2.102:0/74661258 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d8c004e40 msgr2=0x7f5d8c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.495+0000 7f5db1ca3700 1 --2- 172.21.2.102:0/74661258 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d8c004e40 0x7f5d8c00b720 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f5da4001f50 tx=0x7f5da4007ee0).stop 2021-02-12T17:25:29.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.495+0000 7f5db1ca3700 1 -- 172.21.2.102:0/74661258 shutdown_connections 2021-02-12T17:25:29.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.495+0000 7f5db1ca3700 1 --2- 172.21.2.102:0/74661258 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5d8c004e40 0x7f5d8c00b720 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.495+0000 7f5db1ca3700 1 -- 172.21.2.102:0/74661258 >> 172.21.2.102:0/74661258 conn(0x7f5dac0bc480 msgr2=0x7f5dac0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:29.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.495+0000 7f5db1ca3700 1 -- 172.21.2.102:0/74661258 shutdown_connections 2021-02-12T17:25:29.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.495+0000 7f5db1ca3700 1 -- 172.21.2.102:0/74661258 wait complete. 2021-02-12T17:25:29.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.496+0000 7f5db1ca3700 1 Processor -- start 2021-02-12T17:25:29.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.496+0000 7f5db1ca3700 1 -- start start 2021-02-12T17:25:29.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.496+0000 7f5db1ca3700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d8c004e40 0x7f5dac0b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.496+0000 7f5db1ca3700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5dac153870 0x7f5dac0b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.496+0000 7f5db1ca3700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5dac14aa70 0x7f5dac14aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.496+0000 7f5db1ca3700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac0b2680 con 0x7f5dac153870 2021-02-12T17:25:29.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.496+0000 7f5db1ca3700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac0b2140 con 0x7f5dac14aa70 2021-02-12T17:25:29.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.496+0000 7f5db1ca3700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac0b23e0 con 0x7f5d8c004e40 2021-02-12T17:25:29.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.496+0000 7f5daaffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5dac153870 0x7f5dac0b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.496+0000 7f5daaffd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5dac153870 0x7f5dac0b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48444/0 (socket says 172.21.2.102:48444) 2021-02-12T17:25:29.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.496+0000 7f5daaffd700 1 -- 172.21.2.102:0/2423542446 learned_addr learned my addr 172.21.2.102:0/2423542446 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:29.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.497+0000 7f5dab7fe700 1 --2- 172.21.2.102:0/2423542446 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d8c004e40 0x7f5dac0b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.497+0000 7f5dabfff700 1 --2- 172.21.2.102:0/2423542446 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5dac14aa70 0x7f5dac14aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.497+0000 7f5daaffd700 1 -- 172.21.2.102:0/2423542446 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d8c004e40 msgr2=0x7f5dac0b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.497+0000 7f5daaffd700 1 --2- 172.21.2.102:0/2423542446 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d8c004e40 0x7f5dac0b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.497+0000 7f5daaffd700 1 -- 172.21.2.102:0/2423542446 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5dac14aa70 msgr2=0x7f5dac14aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.497+0000 7f5daaffd700 1 --2- 172.21.2.102:0/2423542446 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5dac14aa70 0x7f5dac14aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.497+0000 7f5daaffd700 1 -- 172.21.2.102:0/2423542446 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac150f90 con 0x7f5dac153870 2021-02-12T17:25:29.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.497+0000 7f5daaffd700 1 --2- 172.21.2.102:0/2423542446 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5dac153870 0x7f5dac0b0670 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f5d9400db60 tx=0x7f5d94009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:29.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.497+0000 7f5da37fe700 1 -- 172.21.2.102:0/2423542446 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94007170 con 0x7f5dac153870 2021-02-12T17:25:29.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.497+0000 7f5da37fe700 1 -- 172.21.2.102:0/2423542446 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d940072d0 con 0x7f5dac153870 2021-02-12T17:25:29.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.497+0000 7f5db1ca3700 1 -- 172.21.2.102:0/2423542446 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dac151230 con 0x7f5dac153870 2021-02-12T17:25:29.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.497+0000 7f5da37fe700 1 -- 172.21.2.102:0/2423542446 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9400bac0 con 0x7f5dac153870 2021-02-12T17:25:29.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.497+0000 7f5db1ca3700 1 -- 172.21.2.102:0/2423542446 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dac0b0e90 con 0x7f5dac153870 2021-02-12T17:25:29.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.498+0000 7f5db1ca3700 1 -- 172.21.2.102:0/2423542446 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dac045460 con 0x7f5dac153870 2021-02-12T17:25:29.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.498+0000 7f5da37fe700 1 -- 172.21.2.102:0/2423542446 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f5d940044f0 con 0x7f5dac153870 2021-02-12T17:25:29.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.498+0000 7f5da37fe700 1 --2- 172.21.2.102:0/2423542446 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5d90059d30 0x7f5d9005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.498+0000 7f5da37fe700 1 -- 172.21.2.102:0/2423542446 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f5d940743f0 con 0x7f5dac153870 2021-02-12T17:25:29.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.498+0000 7f5dab7fe700 1 --2- 172.21.2.102:0/2423542446 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5d90059d30 0x7f5d9005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.502 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.499+0000 7f5dab7fe700 1 --2- 172.21.2.102:0/2423542446 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5d90059d30 0x7f5d9005c1f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f5d9c006eb0 tx=0x7f5d9c00b040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:29.503 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.501+0000 7f5da37fe700 1 -- 172.21.2.102:0/2423542446 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f5d940477c0 con 0x7f5dac153870 2021-02-12T17:25:29.661 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.661+0000 7f5db1ca3700 1 -- 172.21.2.102:0/2423542446 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5dac062520 con 0x7f5dac153870 2021-02-12T17:25:29.662 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.661+0000 7f5da37fe700 1 -- 172.21.2.102:0/2423542446 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f5d9404ade0 con 0x7f5dac153870 2021-02-12T17:25:29.662 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:29.662 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":60,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:29.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.662+0000 7f5db1ca3700 1 -- 172.21.2.102:0/2423542446 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5d90059d30 msgr2=0x7f5d9005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.662+0000 7f5db1ca3700 1 --2- 172.21.2.102:0/2423542446 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5d90059d30 0x7f5d9005c1f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f5d9c006eb0 tx=0x7f5d9c00b040).stop 2021-02-12T17:25:29.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.662+0000 7f5db1ca3700 1 -- 172.21.2.102:0/2423542446 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5dac153870 msgr2=0x7f5dac0b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.662+0000 7f5db1ca3700 1 --2- 172.21.2.102:0/2423542446 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5dac153870 0x7f5dac0b0670 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f5d9400db60 tx=0x7f5d94009040).stop 2021-02-12T17:25:29.663 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.662+0000 7f5db1ca3700 1 -- 172.21.2.102:0/2423542446 shutdown_connections 2021-02-12T17:25:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.662+0000 7f5db1ca3700 1 --2- 172.21.2.102:0/2423542446 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5dac14aa70 0x7f5dac14aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.663+0000 7f5db1ca3700 1 --2- 172.21.2.102:0/2423542446 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5d8c004e40 0x7f5dac0b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.663+0000 7f5db1ca3700 1 --2- 172.21.2.102:0/2423542446 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5d90059d30 0x7f5d9005c1f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.663+0000 7f5db1ca3700 1 --2- 172.21.2.102:0/2423542446 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5dac153870 0x7f5dac0b0670 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.663+0000 7f5db1ca3700 1 -- 172.21.2.102:0/2423542446 >> 172.21.2.102:0/2423542446 conn(0x7f5dac0bc480 msgr2=0x7f5dac14cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.663+0000 7f5db1ca3700 1 -- 172.21.2.102:0/2423542446 shutdown_connections 2021-02-12T17:25:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.663+0000 7f5db1ca3700 1 -- 172.21.2.102:0/2423542446 wait complete. 2021-02-12T17:25:29.664 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 60 2021-02-12T17:25:29.672 INFO:tasks.mds_thrash.fs.[b]:kill mds.c (rank=0) 2021-02-12T17:25:29.672 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-02-12T17:25:29.672 INFO:teuthology.orchestra.run:waiting for 300 2021-02-12T17:25:29.678 INFO:tasks.ceph.mds.c:Stopped 2021-02-12T17:25:29.678 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:29.806 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.806+0000 7f463b563700 1 Processor -- start 2021-02-12T17:25:29.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.806+0000 7f463b563700 1 -- start start 2021-02-12T17:25:29.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.807+0000 7f463b563700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f46340b8d20 0x7f4634068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.807+0000 7f463b563700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f463414e530 0x7f46340b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.807+0000 7f463b563700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46340622a0 con 0x7f4634062740 2021-02-12T17:25:29.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.807+0000 7f463b563700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4634068d20 con 0x7f463414e530 2021-02-12T17:25:29.807 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.807+0000 7f463b563700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463414ea10 con 0x7f46340b8d20 2021-02-12T17:25:29.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.807+0000 7f4639b00700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f4634062740 0x7f4634062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:57096/0 (socket says 172.21.2.102:57096) 2021-02-12T17:25:29.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.807+0000 7f4639b00700 1 -- 172.21.2.102:0/3050450277 learned_addr learned my addr 172.21.2.102:0/3050450277 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:29.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.807+0000 7f4623fff700 1 -- 172.21.2.102:0/3050450277 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194553871 0 0) 0x7f46340622a0 con 0x7f4634062740 2021-02-12T17:25:29.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.807+0000 7f4623fff700 1 -- 172.21.2.102:0/3050450277 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f461c003230 con 0x7f4634062740 2021-02-12T17:25:29.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.807+0000 7f46392ff700 1 --2- 172.21.2.102:0/3050450277 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f46340b8d20 0x7f4634068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.807+0000 7f4638afe700 1 --2- 172.21.2.102:0/3050450277 >> v2:172.21.2.104:3300/0 conn(0x7f463414e530 0x7f46340b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 -- 172.21.2.102:0/3050450277 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 940971570 0 0) 0x7f461c003230 con 0x7f4634062740 2021-02-12T17:25:29.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 -- 172.21.2.102:0/3050450277 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f46340b8d20 msgr2=0x7f4634068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:29.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 --2- 172.21.2.102:0/3050450277 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f46340b8d20 0x7f4634068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 -- 172.21.2.102:0/3050450277 >> v2:172.21.2.104:3300/0 conn(0x7f463414e530 msgr2=0x7f46340b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:29.809 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 --2- 172.21.2.102:0/3050450277 >> v2:172.21.2.104:3300/0 conn(0x7f463414e530 0x7f46340b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 -- 172.21.2.102:0/3050450277 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46340b63f0 con 0x7f4634062740 2021-02-12T17:25:29.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 -- 172.21.2.102:0/3050450277 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f462c001860 con 0x7f4634062740 2021-02-12T17:25:29.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 -- 172.21.2.102:0/3050450277 >> v1:172.21.2.102:6789/0 conn(0x7f4634062740 legacy=0x7f4634062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 --2- 172.21.2.102:0/3050450277 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f461c0037a0 0x7f461c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 --2- 172.21.2.102:0/3050450277 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f461c0044d0 0x7f461c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 --2- 172.21.2.102:0/3050450277 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f461c004e40 0x7f461c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 -- 172.21.2.102:0/3050450277 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4634068d20 con 0x7f461c004e40 2021-02-12T17:25:29.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 -- 172.21.2.102:0/3050450277 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463414ea10 con 0x7f461c0044d0 2021-02-12T17:25:29.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 -- 172.21.2.102:0/3050450277 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c005340 con 0x7f461c0037a0 2021-02-12T17:25:29.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4639b00700 1 --2- 172.21.2.102:0/3050450277 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f461c004e40 0x7f461c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4638afe700 1 --2- 172.21.2.102:0/3050450277 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f461c0044d0 0x7f461c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f46392ff700 1 --2- 172.21.2.102:0/3050450277 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f461c0037a0 0x7f461c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4639b00700 1 -- 172.21.2.102:0/3050450277 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f461c0037a0 msgr2=0x7f461c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:29.810 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4639b00700 1 --2- 172.21.2.102:0/3050450277 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f461c0037a0 0x7f461c003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.811 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4639b00700 1 -- 172.21.2.102:0/3050450277 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f461c0044d0 msgr2=0x7f461c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:29.811 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4639b00700 1 --2- 172.21.2.102:0/3050450277 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f461c0044d0 0x7f461c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.811 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4639b00700 1 -- 172.21.2.102:0/3050450277 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c003230 con 0x7f461c004e40 2021-02-12T17:25:29.811 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4639b00700 1 --2- 172.21.2.102:0/3050450277 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f461c004e40 0x7f461c00b720 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f462c00c5d0 tx=0x7f46340b6580).ready entity=mon.0 client_cookie=5562cc81bd3701c3 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:29.811 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 -- 172.21.2.102:0/3050450277 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c005b70 con 0x7f461c004e40 2021-02-12T17:25:29.811 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 -- 172.21.2.102:0/3050450277 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c005cd0 con 0x7f461c004e40 2021-02-12T17:25:29.811 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.808+0000 7f4623fff700 1 -- 172.21.2.102:0/3050450277 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c007320 con 0x7f461c004e40 2021-02-12T17:25:29.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.809+0000 7f463b563700 1 -- 172.21.2.102:0/3050450277 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f461c004e40 msgr2=0x7f461c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.809+0000 7f463b563700 1 --2- 172.21.2.102:0/3050450277 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f461c004e40 0x7f461c00b720 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f462c00c5d0 tx=0x7f46340b6580).stop 2021-02-12T17:25:29.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.809+0000 7f4639b00700 1 -- 172.21.2.102:0/3050450277 reap_dead start 2021-02-12T17:25:29.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.809+0000 7f463b563700 1 -- 172.21.2.102:0/3050450277 shutdown_connections 2021-02-12T17:25:29.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.809+0000 7f463b563700 1 -- 172.21.2.102:0/3050450277 >> 172.21.2.102:0/3050450277 conn(0x7f46340bc480 msgr2=0x7f46340b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:29.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.809+0000 7f463b563700 1 -- 172.21.2.102:0/3050450277 shutdown_connections 2021-02-12T17:25:29.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.809+0000 7f463b563700 1 -- 172.21.2.102:0/3050450277 wait complete. 2021-02-12T17:25:29.813 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.810+0000 7f463b563700 1 Processor -- start 2021-02-12T17:25:29.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.810+0000 7f463b563700 1 -- start start 2021-02-12T17:25:29.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.810+0000 7f463b563700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f463414fe50 0x7f46340b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.810+0000 7f463b563700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f46340b5930 0x7f46340b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.810+0000 7f463b563700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f46340b3c30 0x7f46340ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.810+0000 7f463b563700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46340b40b0 con 0x7f46340b3c30 2021-02-12T17:25:29.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.810+0000 7f463b563700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46340b5460 con 0x7f46340b5930 2021-02-12T17:25:29.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.810+0000 7f463b563700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463415d4c0 con 0x7f463414fe50 2021-02-12T17:25:29.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.810+0000 7f4639b00700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f46340b3c30 0x7f46340ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.810+0000 7f4639b00700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f46340b3c30 0x7f46340ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48462/0 (socket says 172.21.2.102:48462) 2021-02-12T17:25:29.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.810+0000 7f4639b00700 1 -- 172.21.2.102:0/698467963 learned_addr learned my addr 172.21.2.102:0/698467963 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:29.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.811+0000 7f46392ff700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f463414fe50 0x7f46340b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.811+0000 7f4639b00700 1 -- 172.21.2.102:0/698467963 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f463414fe50 msgr2=0x7f46340b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.811+0000 7f4639b00700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f463414fe50 0x7f46340b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.814 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.811+0000 7f4639b00700 1 -- 172.21.2.102:0/698467963 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f46340b5930 msgr2=0x7f46340b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.811+0000 7f4638afe700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f46340b5930 0x7f46340b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.811+0000 7f4639b00700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f46340b5930 0x7f46340b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.811+0000 7f4639b00700 1 -- 172.21.2.102:0/698467963 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463415d760 con 0x7f46340b3c30 2021-02-12T17:25:29.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.811+0000 7f4638afe700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f46340b5930 0x7f46340b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:29.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.811+0000 7f4639b00700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f46340b3c30 0x7f46340ae150 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f462c007fd0 tx=0x7f462c013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:29.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.811+0000 7f46217fa700 1 -- 172.21.2.102:0/698467963 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00c220 con 0x7f46340b3c30 2021-02-12T17:25:29.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.811+0000 7f46217fa700 1 -- 172.21.2.102:0/698467963 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c018030 con 0x7f46340b3c30 2021-02-12T17:25:29.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.811+0000 7f463b563700 1 -- 172.21.2.102:0/698467963 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463415da00 con 0x7f46340b3c30 2021-02-12T17:25:29.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.811+0000 7f46217fa700 1 -- 172.21.2.102:0/698467963 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c0138b0 con 0x7f46340b3c30 2021-02-12T17:25:29.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.811+0000 7f463b563700 1 -- 172.21.2.102:0/698467963 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46340b0920 con 0x7f46340b3c30 2021-02-12T17:25:29.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.812+0000 7f463b563700 1 -- 172.21.2.102:0/698467963 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463415de60 con 0x7f46340b3c30 2021-02-12T17:25:29.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.812+0000 7f46217fa700 1 -- 172.21.2.102:0/698467963 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f462c025030 con 0x7f46340b3c30 2021-02-12T17:25:29.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.812+0000 7f46217fa700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4614059d60 0x7f461405c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:29.815 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.812+0000 7f46217fa700 1 -- 172.21.2.102:0/698467963 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f462c075140 con 0x7f46340b3c30 2021-02-12T17:25:29.816 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.812+0000 7f46392ff700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4614059d60 0x7f461405c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:29.816 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.813+0000 7f46392ff700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4614059d60 0x7f461405c220 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f4630006850 tx=0x7f4630008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:29.816 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.815+0000 7f46217fa700 1 -- 172.21.2.102:0/698467963 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f462c0486d0 con 0x7f46340b3c30 2021-02-12T17:25:29.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.976+0000 7f463b563700 1 -- 172.21.2.102:0/698467963 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4634045460 con 0x7f46340b3c30 2021-02-12T17:25:29.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.977+0000 7f46217fa700 1 -- 172.21.2.102:0/698467963 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f462c023070 con 0x7f46340b3c30 2021-02-12T17:25:29.978 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:29.978 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":60,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:29.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.978+0000 7f463b563700 1 -- 172.21.2.102:0/698467963 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4614059d60 msgr2=0x7f461405c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.978+0000 7f463b563700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4614059d60 0x7f461405c220 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f4630006850 tx=0x7f4630008040).stop 2021-02-12T17:25:29.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.978+0000 7f463b563700 1 -- 172.21.2.102:0/698467963 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f46340b3c30 msgr2=0x7f46340ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:29.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.978+0000 7f463b563700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f46340b3c30 0x7f46340ae150 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f462c007fd0 tx=0x7f462c013000).stop 2021-02-12T17:25:29.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.978+0000 7f463b563700 1 -- 172.21.2.102:0/698467963 shutdown_connections 2021-02-12T17:25:29.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.978+0000 7f463b563700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f4614059d60 0x7f461405c220 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.978+0000 7f463b563700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f46340b3c30 0x7f46340ae150 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.978+0000 7f463b563700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f463414fe50 0x7f46340b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.978+0000 7f463b563700 1 --2- 172.21.2.102:0/698467963 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f46340b5930 0x7f46340b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:29.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.978+0000 7f463b563700 1 -- 172.21.2.102:0/698467963 >> 172.21.2.102:0/698467963 conn(0x7f46340bc480 msgr2=0x7f463414ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:29.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.978+0000 7f463b563700 1 -- 172.21.2.102:0/698467963 shutdown_connections 2021-02-12T17:25:29.980 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:29.978+0000 7f463b563700 1 -- 172.21.2.102:0/698467963 wait complete. 2021-02-12T17:25:29.980 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 60 2021-02-12T17:25:29.988 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:25:31.354 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:31.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.443+0000 7f5397b59700 1 Processor -- start 2021-02-12T17:25:31.444 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.443+0000 7f5397b59700 1 -- start start 2021-02-12T17:25:31.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.444+0000 7f5397b59700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53900b8d20 0x7f5390068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:31.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.444+0000 7f5397b59700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f539014e530 0x7f53900b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:31.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.444+0000 7f5397b59700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53900622a0 con 0x7f5390062740 2021-02-12T17:25:31.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.444+0000 7f5397b59700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5390068d20 con 0x7f539014e530 2021-02-12T17:25:31.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.444+0000 7f5397b59700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539014ea10 con 0x7f53900b8d20 2021-02-12T17:25:31.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.444+0000 7f53950f4700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f539014e530 0x7f53900b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:31.445 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.444+0000 7f53950f4700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f539014e530 0x7f53900b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48470/0 (socket says 172.21.2.102:48470) 2021-02-12T17:25:31.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.444+0000 7f53950f4700 1 -- 172.21.2.102:0/2015495183 learned_addr learned my addr 172.21.2.102:0/2015495183 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:31.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.444+0000 7f53950f4700 1 -- 172.21.2.102:0/2015495183 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53900b8d20 msgr2=0x7f5390068830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:25:31.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.444+0000 7f53950f4700 1 --2- 172.21.2.102:0/2015495183 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53900b8d20 0x7f5390068830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:31.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.444+0000 7f53950f4700 1 -- 172.21.2.102:0/2015495183 >> v1:172.21.2.104:6789/0 conn(0x7f5390062740 legacy=0x7f5390062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:25:31.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.444+0000 7f53950f4700 1 -- 172.21.2.102:0/2015495183 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53900b63f0 con 0x7f539014e530 2021-02-12T17:25:31.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.444+0000 7f53950f4700 1 --2- 172.21.2.102:0/2015495183 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f539014e530 0x7f53900b7250 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f538c00b9e0 tx=0x7f538c006ea0).ready entity=mon.0 client_cookie=fc309a82c52187b0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:31.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.444+0000 7f53948f3700 1 -- 172.21.2.102:0/2015495183 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c009800 con 0x7f539014e530 2021-02-12T17:25:31.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.445+0000 7f53948f3700 1 -- 172.21.2.102:0/2015495183 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c009960 con 0x7f539014e530 2021-02-12T17:25:31.446 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.445+0000 7f53948f3700 1 -- 172.21.2.102:0/2015495183 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c009ce0 con 0x7f539014e530 2021-02-12T17:25:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.445+0000 7f5397b59700 1 -- 172.21.2.102:0/2015495183 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f539014e530 msgr2=0x7f53900b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.445+0000 7f5397b59700 1 --2- 172.21.2.102:0/2015495183 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f539014e530 0x7f53900b7250 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f538c00b9e0 tx=0x7f538c006ea0).stop 2021-02-12T17:25:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.445+0000 7f5397b59700 1 -- 172.21.2.102:0/2015495183 shutdown_connections 2021-02-12T17:25:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.445+0000 7f5397b59700 1 --2- 172.21.2.102:0/2015495183 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53900b8d20 0x7f5390068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.445+0000 7f5397b59700 1 --2- 172.21.2.102:0/2015495183 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f539014e530 0x7f53900b7250 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.445+0000 7f5397b59700 1 -- 172.21.2.102:0/2015495183 >> 172.21.2.102:0/2015495183 conn(0x7f53900bc480 msgr2=0x7f53900b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:31.448 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.445+0000 7f5397b59700 1 -- 172.21.2.102:0/2015495183 shutdown_connections 2021-02-12T17:25:31.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.445+0000 7f5397b59700 1 -- 172.21.2.102:0/2015495183 wait complete. 2021-02-12T17:25:31.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.446+0000 7f5397b59700 1 Processor -- start 2021-02-12T17:25:31.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.446+0000 7f5397b59700 1 -- start start 2021-02-12T17:25:31.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.446+0000 7f5397b59700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5390062740 0x7f539015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:31.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.446+0000 7f5397b59700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53900b8d20 0x7f53901517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:31.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.446+0000 7f5397b59700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f539014e530 0x7f53900ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:31.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.446+0000 7f5397b59700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539015e250 con 0x7f5390062740 2021-02-12T17:25:31.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.446+0000 7f5397b59700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53900aef40 con 0x7f539014e530 2021-02-12T17:25:31.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.446+0000 7f5397b59700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53900af1e0 con 0x7f53900b8d20 2021-02-12T17:25:31.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.446+0000 7f53958f5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5390062740 0x7f539015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:31.449 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.447+0000 7f53958f5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5390062740 0x7f539015dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48474/0 (socket says 172.21.2.102:48474) 2021-02-12T17:25:31.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.447+0000 7f53958f5700 1 -- 172.21.2.102:0/3483308268 learned_addr learned my addr 172.21.2.102:0/3483308268 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:31.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.447+0000 7f53958f5700 1 -- 172.21.2.102:0/3483308268 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53900b8d20 msgr2=0x7f53901517d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:25:31.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.447+0000 7f53958f5700 1 --2- 172.21.2.102:0/3483308268 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53900b8d20 0x7f53901517d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:31.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.447+0000 7f53958f5700 1 -- 172.21.2.102:0/3483308268 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f539014e530 msgr2=0x7f53900ad8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-02-12T17:25:31.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.447+0000 7f53958f5700 1 --2- 172.21.2.102:0/3483308268 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f539014e530 0x7f53900ad8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:31.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.447+0000 7f53958f5700 1 -- 172.21.2.102:0/3483308268 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53900acf10 con 0x7f5390062740 2021-02-12T17:25:31.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.447+0000 7f53958f5700 1 --2- 172.21.2.102:0/3483308268 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5390062740 0x7f539015dd60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f53800096b0 tx=0x7f5380006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:31.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.447+0000 7f537dffb700 1 -- 172.21.2.102:0/3483308268 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538000d500 con 0x7f5390062740 2021-02-12T17:25:31.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.447+0000 7f537dffb700 1 -- 172.21.2.102:0/3483308268 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538000d680 con 0x7f5390062740 2021-02-12T17:25:31.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.447+0000 7f537dffb700 1 -- 172.21.2.102:0/3483308268 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538000da40 con 0x7f5390062740 2021-02-12T17:25:31.450 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.447+0000 7f5397b59700 1 -- 172.21.2.102:0/3483308268 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53900ad1b0 con 0x7f5390062740 2021-02-12T17:25:31.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.447+0000 7f5397b59700 1 -- 172.21.2.102:0/3483308268 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53900aec70 con 0x7f5390062740 2021-02-12T17:25:31.451 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.448+0000 7f5397b59700 1 -- 172.21.2.102:0/3483308268 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5390045460 con 0x7f5390062740 2021-02-12T17:25:31.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.448+0000 7f537dffb700 1 -- 172.21.2.102:0/3483308268 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f5380012420 con 0x7f5390062740 2021-02-12T17:25:31.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.448+0000 7f537dffb700 1 --2- 172.21.2.102:0/3483308268 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5370059d30 0x7f537005c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:31.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.448+0000 7f537dffb700 1 -- 172.21.2.102:0/3483308268 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f5380073f50 con 0x7f5390062740 2021-02-12T17:25:31.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.449+0000 7f53950f4700 1 --2- 172.21.2.102:0/3483308268 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5370059d30 0x7f537005c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:31.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.449+0000 7f53950f4700 1 --2- 172.21.2.102:0/3483308268 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5370059d30 0x7f537005c1f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f538c00b9e0 tx=0x7f538c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:31.452 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.451+0000 7f537dffb700 1 -- 172.21.2.102:0/3483308268 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f538004aeb0 con 0x7f5390062740 2021-02-12T17:25:31.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.609+0000 7f5397b59700 1 -- 172.21.2.102:0/3483308268 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5390063670 con 0x7f5390062740 2021-02-12T17:25:31.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.609+0000 7f537dffb700 1 -- 172.21.2.102:0/3483308268 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f538000ddb0 con 0x7f5390062740 2021-02-12T17:25:31.610 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:31.610 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":60,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:31.611 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.610+0000 7f5397b59700 1 -- 172.21.2.102:0/3483308268 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5370059d30 msgr2=0x7f537005c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:31.611 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.610+0000 7f5397b59700 1 --2- 172.21.2.102:0/3483308268 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5370059d30 0x7f537005c1f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f538c00b9e0 tx=0x7f538c016000).stop 2021-02-12T17:25:31.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.610+0000 7f5397b59700 1 -- 172.21.2.102:0/3483308268 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5390062740 msgr2=0x7f539015dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:31.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.610+0000 7f5397b59700 1 --2- 172.21.2.102:0/3483308268 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5390062740 0x7f539015dd60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f53800096b0 tx=0x7f5380006de0).stop 2021-02-12T17:25:31.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.611+0000 7f5397b59700 1 -- 172.21.2.102:0/3483308268 shutdown_connections 2021-02-12T17:25:31.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.611+0000 7f5397b59700 1 --2- 172.21.2.102:0/3483308268 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f539014e530 0x7f53900ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:31.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.611+0000 7f5397b59700 1 --2- 172.21.2.102:0/3483308268 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5370059d30 0x7f537005c1f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:31.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.611+0000 7f5397b59700 1 --2- 172.21.2.102:0/3483308268 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5390062740 0x7f539015dd60 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:31.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.611+0000 7f5397b59700 1 --2- 172.21.2.102:0/3483308268 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f53900b8d20 0x7f53901517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:31.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.611+0000 7f5397b59700 1 -- 172.21.2.102:0/3483308268 >> 172.21.2.102:0/3483308268 conn(0x7f53900bc480 msgr2=0x7f53900b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:31.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.611+0000 7f5397b59700 1 -- 172.21.2.102:0/3483308268 shutdown_connections 2021-02-12T17:25:31.612 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:31.611+0000 7f5397b59700 1 -- 172.21.2.102:0/3483308268 wait complete. 2021-02-12T17:25:31.613 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 60 2021-02-12T17:25:31.620 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:25:31.989 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:32.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.077+0000 7ff4a2832700 1 Processor -- start 2021-02-12T17:25:32.078 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.077+0000 7ff4a2832700 1 -- start start 2021-02-12T17:25:32.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.078+0000 7ff4a2832700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff49c067720 0x7ff49c0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:32.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.078+0000 7ff4a2832700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7ff49c0b8b60 0x7ff49c144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:32.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.078+0000 7ff4a2832700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49c0b2930 con 0x7ff49c062580 2021-02-12T17:25:32.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.078+0000 7ff4a2832700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49c068980 con 0x7ff49c0b8b60 2021-02-12T17:25:32.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.078+0000 7ff4a2832700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c146ab0 con 0x7ff49c067720 2021-02-12T17:25:32.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.078+0000 7ff49b7fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7ff49c062580 0x7ff49c1463a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:57126/0 (socket says 172.21.2.102:57126) 2021-02-12T17:25:32.079 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.078+0000 7ff49b7fe700 1 -- 172.21.2.102:0/4121512240 learned_addr learned my addr 172.21.2.102:0/4121512240 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:32.081 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 -- 172.21.2.102:0/4121512240 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104756991 0 0) 0x7ff4900010d0 con 0x7ff49c062580 2021-02-12T17:25:32.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 -- 172.21.2.102:0/4121512240 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff488003230 con 0x7ff49c062580 2021-02-12T17:25:32.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff4a0dcf700 1 --2- 172.21.2.102:0/4121512240 >> v2:172.21.2.104:3300/0 conn(0x7ff49c0b8b60 0x7ff49c144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:32.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49bfff700 1 --2- 172.21.2.102:0/4121512240 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff49c067720 0x7ff49c0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:32.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 -- 172.21.2.102:0/4121512240 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2327773060 0 0) 0x7ff488003230 con 0x7ff49c062580 2021-02-12T17:25:32.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 -- 172.21.2.102:0/4121512240 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff49c067720 msgr2=0x7ff49c0b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:32.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 --2- 172.21.2.102:0/4121512240 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff49c067720 0x7ff49c0b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:32.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 -- 172.21.2.102:0/4121512240 >> v2:172.21.2.104:3300/0 conn(0x7ff49c0b8b60 msgr2=0x7ff49c144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:32.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 --2- 172.21.2.102:0/4121512240 >> v2:172.21.2.104:3300/0 conn(0x7ff49c0b8b60 0x7ff49c144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:32.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 -- 172.21.2.102:0/4121512240 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c066db0 con 0x7ff49c062580 2021-02-12T17:25:32.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 -- 172.21.2.102:0/4121512240 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7ff490001670 con 0x7ff49c062580 2021-02-12T17:25:32.082 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 -- 172.21.2.102:0/4121512240 >> v1:172.21.2.102:6789/0 conn(0x7ff49c062580 legacy=0x7ff49c1463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:32.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 --2- 172.21.2.102:0/4121512240 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff49c067720 0x7ff4880037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:32.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 --2- 172.21.2.102:0/4121512240 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff488003d00 0x7ff4880044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:32.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 --2- 172.21.2.102:0/4121512240 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4880049c0 0x7ff488004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:32.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 -- 172.21.2.102:0/4121512240 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c068980 con 0x7ff4880049c0 2021-02-12T17:25:32.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 -- 172.21.2.102:0/4121512240 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c146ab0 con 0x7ff488003d00 2021-02-12T17:25:32.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff49affd700 1 -- 172.21.2.102:0/4121512240 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880042c0 con 0x7ff49c067720 2021-02-12T17:25:32.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.079+0000 7ff4a0dcf700 1 --2- 172.21.2.102:0/4121512240 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4880049c0 0x7ff488004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:32.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff49b7fe700 1 --2- 172.21.2.102:0/4121512240 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff488003d00 0x7ff4880044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:32.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff49bfff700 1 --2- 172.21.2.102:0/4121512240 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff49c067720 0x7ff4880037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:32.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff4a0dcf700 1 -- 172.21.2.102:0/4121512240 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff49c067720 msgr2=0x7ff4880037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:32.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff4a0dcf700 1 --2- 172.21.2.102:0/4121512240 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff49c067720 0x7ff4880037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:32.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff4a0dcf700 1 -- 172.21.2.102:0/4121512240 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff488003d00 msgr2=0x7ff4880044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:32.083 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff4a0dcf700 1 --2- 172.21.2.102:0/4121512240 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff488003d00 0x7ff4880044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:32.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff4a0dcf700 1 -- 172.21.2.102:0/4121512240 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff488003230 con 0x7ff4880049c0 2021-02-12T17:25:32.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff49b7fe700 1 --2- 172.21.2.102:0/4121512240 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff488003d00 0x7ff4880044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:32.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff49bfff700 1 --2- 172.21.2.102:0/4121512240 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff49c067720 0x7ff4880037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:32.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff4a0dcf700 1 --2- 172.21.2.102:0/4121512240 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4880049c0 0x7ff488004e40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7ff494009d70 tx=0x7ff494008040).ready entity=mon.0 client_cookie=21e16404a155dcda server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:32.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff49affd700 1 -- 172.21.2.102:0/4121512240 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49400c070 con 0x7ff4880049c0 2021-02-12T17:25:32.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff49affd700 1 -- 172.21.2.102:0/4121512240 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49400e990 con 0x7ff4880049c0 2021-02-12T17:25:32.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff49affd700 1 -- 172.21.2.102:0/4121512240 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49400ed50 con 0x7ff4880049c0 2021-02-12T17:25:32.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff4a2832700 1 -- 172.21.2.102:0/4121512240 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4880049c0 msgr2=0x7ff488004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:32.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff4a2832700 1 --2- 172.21.2.102:0/4121512240 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff4880049c0 0x7ff488004e40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7ff494009d70 tx=0x7ff494008040).stop 2021-02-12T17:25:32.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff4a0dcf700 1 -- 172.21.2.102:0/4121512240 reap_dead start 2021-02-12T17:25:32.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff4a2832700 1 -- 172.21.2.102:0/4121512240 shutdown_connections 2021-02-12T17:25:32.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff4a2832700 1 -- 172.21.2.102:0/4121512240 >> 172.21.2.102:0/4121512240 conn(0x7ff49c0bc480 msgr2=0x7ff49c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:32.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff4a2832700 1 -- 172.21.2.102:0/4121512240 shutdown_connections 2021-02-12T17:25:32.084 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.080+0000 7ff4a2832700 1 -- 172.21.2.102:0/4121512240 wait complete. 2021-02-12T17:25:32.085 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.081+0000 7ff4a2832700 1 Processor -- start 2021-02-12T17:25:32.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.081+0000 7ff4a2832700 1 -- start start 2021-02-12T17:25:32.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff4a2832700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff49c0b1760 0x7ff49c0b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:32.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff4a2832700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff49c138f70 0x7ff49c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:32.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff4a2832700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff49c0aed70 0x7ff49c0af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:32.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff4a2832700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0b5040 con 0x7ff49c138f70 2021-02-12T17:25:32.086 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff4a2832700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c13d720 con 0x7ff49c0aed70 2021-02-12T17:25:32.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff4a2832700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0ae350 con 0x7ff49c0b1760 2021-02-12T17:25:32.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff49b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff49c138f70 0x7ff49c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:32.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff49b7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff49c138f70 0x7ff49c0b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48494/0 (socket says 172.21.2.102:48494) 2021-02-12T17:25:32.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff49b7fe700 1 -- 172.21.2.102:0/439808435 learned_addr learned my addr 172.21.2.102:0/439808435 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:32.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff49b7fe700 1 -- 172.21.2.102:0/439808435 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff49c0b1760 msgr2=0x7ff49c0b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:32.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff49b7fe700 1 --2- 172.21.2.102:0/439808435 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff49c0b1760 0x7ff49c0b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:32.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff49b7fe700 1 -- 172.21.2.102:0/439808435 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff49c0aed70 msgr2=0x7ff49c0af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:32.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff49b7fe700 1 --2- 172.21.2.102:0/439808435 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff49c0aed70 0x7ff49c0af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:32.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff49b7fe700 1 -- 172.21.2.102:0/439808435 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c0ae5f0 con 0x7ff49c138f70 2021-02-12T17:25:32.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.082+0000 7ff49b7fe700 1 --2- 172.21.2.102:0/439808435 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff49c138f70 0x7ff49c0b4b50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7ff49000de80 tx=0x7ff490009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:32.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.083+0000 7ff483fff700 1 -- 172.21.2.102:0/439808435 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49000bb90 con 0x7ff49c138f70 2021-02-12T17:25:32.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.083+0000 7ff483fff700 1 -- 172.21.2.102:0/439808435 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49000bcf0 con 0x7ff49c138f70 2021-02-12T17:25:32.087 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.083+0000 7ff4a2832700 1 -- 172.21.2.102:0/439808435 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49c0ae890 con 0x7ff49c138f70 2021-02-12T17:25:32.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.083+0000 7ff4a2832700 1 -- 172.21.2.102:0/439808435 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c1384c0 con 0x7ff49c138f70 2021-02-12T17:25:32.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.083+0000 7ff483fff700 1 -- 172.21.2.102:0/439808435 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490007380 con 0x7ff49c138f70 2021-02-12T17:25:32.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.083+0000 7ff4a2832700 1 -- 172.21.2.102:0/439808435 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff474004f60 con 0x7ff49c138f70 2021-02-12T17:25:32.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.084+0000 7ff483fff700 1 -- 172.21.2.102:0/439808435 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7ff4900047c0 con 0x7ff49c138f70 2021-02-12T17:25:32.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.084+0000 7ff483fff700 1 --2- 172.21.2.102:0/439808435 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff47c059d60 0x7ff47c05c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:32.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.084+0000 7ff483fff700 1 -- 172.21.2.102:0/439808435 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7ff490074320 con 0x7ff49c138f70 2021-02-12T17:25:32.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.084+0000 7ff49bfff700 1 --2- 172.21.2.102:0/439808435 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff47c059d60 0x7ff47c05c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:32.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.084+0000 7ff49bfff700 1 --2- 172.21.2.102:0/439808435 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff47c059d60 0x7ff47c05c220 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7ff48c006fd0 tx=0x7ff48c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:32.088 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.087+0000 7ff483fff700 1 -- 172.21.2.102:0/439808435 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7ff4900477a0 con 0x7ff49c138f70 2021-02-12T17:25:32.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.242+0000 7ff4a2832700 1 -- 172.21.2.102:0/439808435 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff474005790 con 0x7ff49c138f70 2021-02-12T17:25:32.243 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.243+0000 7ff483fff700 1 -- 172.21.2.102:0/439808435 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3760 (secure 0 0 0) 0x7ff49000be60 con 0x7ff49c138f70 2021-02-12T17:25:32.243 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:32.243 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":60,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:32.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.244+0000 7ff4a2832700 1 -- 172.21.2.102:0/439808435 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff47c059d60 msgr2=0x7ff47c05c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:32.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.244+0000 7ff4a2832700 1 --2- 172.21.2.102:0/439808435 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff47c059d60 0x7ff47c05c220 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7ff48c006fd0 tx=0x7ff48c008040).stop 2021-02-12T17:25:32.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.244+0000 7ff4a2832700 1 -- 172.21.2.102:0/439808435 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff49c138f70 msgr2=0x7ff49c0b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:32.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.244+0000 7ff4a2832700 1 --2- 172.21.2.102:0/439808435 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff49c138f70 0x7ff49c0b4b50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7ff49000de80 tx=0x7ff490009040).stop 2021-02-12T17:25:32.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.244+0000 7ff4a2832700 1 -- 172.21.2.102:0/439808435 shutdown_connections 2021-02-12T17:25:32.244 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.244+0000 7ff4a2832700 1 --2- 172.21.2.102:0/439808435 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff49c0aed70 0x7ff49c0af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.244+0000 7ff4a2832700 1 --2- 172.21.2.102:0/439808435 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff49c0b1760 0x7ff49c0b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.244+0000 7ff4a2832700 1 --2- 172.21.2.102:0/439808435 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff47c059d60 0x7ff47c05c220 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.244+0000 7ff4a2832700 1 --2- 172.21.2.102:0/439808435 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff49c138f70 0x7ff49c0b4b50 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.244+0000 7ff4a2832700 1 -- 172.21.2.102:0/439808435 >> 172.21.2.102:0/439808435 conn(0x7ff49c0bc480 msgr2=0x7ff49c139d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.244+0000 7ff4a2832700 1 -- 172.21.2.102:0/439808435 shutdown_connections 2021-02-12T17:25:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:32.244+0000 7ff4a2832700 1 -- 172.21.2.102:0/439808435 wait complete. 2021-02-12T17:25:32.245 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 60 2021-02-12T17:25:32.253 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:25:33.620 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:33.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.709+0000 7ff5d99b4700 1 Processor -- start 2021-02-12T17:25:33.709 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.709+0000 7ff5d99b4700 1 -- start start 2021-02-12T17:25:33.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.709+0000 7ff5d99b4700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7ff5d40b8d20 0x7ff5d4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:33.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.709+0000 7ff5d99b4700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d40b7960 con 0x7ff5d414e530 2021-02-12T17:25:33.710 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.709+0000 7ff5d99b4700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d40622a0 con 0x7ff5d4062740 2021-02-12T17:25:33.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.709+0000 7ff5d99b4700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d4068d20 con 0x7ff5d40b8d20 2021-02-12T17:25:33.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.710+0000 7ff5d2ffd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7ff5d40b8d20 0x7ff5d4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:33.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.710+0000 7ff5d27fc700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7ff5d414e530 0x7ff5d40b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:57144/0 (socket says 172.21.2.102:57144) 2021-02-12T17:25:33.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.710+0000 7ff5d27fc700 1 -- 172.21.2.102:0/1942589367 learned_addr learned my addr 172.21.2.102:0/1942589367 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:33.711 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.710+0000 7ff5d2ffd700 1 --2- 172.21.2.102:0/1942589367 >> v2:172.21.2.102:3300/0 conn(0x7ff5d40b8d20 0x7ff5d4068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48502/0 (socket says 172.21.2.102:48502) 2021-02-12T17:25:33.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.710+0000 7ff5d2ffd700 1 -- 172.21.2.102:0/1942589367 >> v1:172.21.2.104:6789/0 conn(0x7ff5d4062740 legacy=0x7ff5d4062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:33.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.710+0000 7ff5d2ffd700 1 -- 172.21.2.102:0/1942589367 >> v1:172.21.2.102:6789/0 conn(0x7ff5d414e530 legacy=0x7ff5d40b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:33.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.710+0000 7ff5d2ffd700 1 -- 172.21.2.102:0/1942589367 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d414ea10 con 0x7ff5d40b8d20 2021-02-12T17:25:33.712 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.710+0000 7ff5d2ffd700 1 --2- 172.21.2.102:0/1942589367 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff5d40b8d20 0x7ff5d4068830 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7ff5c400b980 tx=0x7ff5c4006de0).ready entity=mon.0 client_cookie=a2432fb348d7165f server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:33.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.710+0000 7ff5d1ffb700 1 -- 172.21.2.102:0/1942589367 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40097a0 con 0x7ff5d40b8d20 2021-02-12T17:25:33.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.710+0000 7ff5d1ffb700 1 -- 172.21.2.102:0/1942589367 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c4009900 con 0x7ff5d40b8d20 2021-02-12T17:25:33.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.710+0000 7ff5d1ffb700 1 -- 172.21.2.102:0/1942589367 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4009c80 con 0x7ff5d40b8d20 2021-02-12T17:25:33.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.711+0000 7ff5d99b4700 1 -- 172.21.2.102:0/1942589367 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff5d40b8d20 msgr2=0x7ff5d4068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:33.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.711+0000 7ff5d99b4700 1 --2- 172.21.2.102:0/1942589367 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff5d40b8d20 0x7ff5d4068830 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7ff5c400b980 tx=0x7ff5c4006de0).stop 2021-02-12T17:25:33.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.711+0000 7ff5d99b4700 1 -- 172.21.2.102:0/1942589367 shutdown_connections 2021-02-12T17:25:33.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.711+0000 7ff5d99b4700 1 --2- 172.21.2.102:0/1942589367 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff5d40b8d20 0x7ff5d4068830 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:33.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.711+0000 7ff5d99b4700 1 -- 172.21.2.102:0/1942589367 >> 172.21.2.102:0/1942589367 conn(0x7ff5d40bc480 msgr2=0x7ff5d40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:33.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.711+0000 7ff5d99b4700 1 -- 172.21.2.102:0/1942589367 shutdown_connections 2021-02-12T17:25:33.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.711+0000 7ff5d99b4700 1 -- 172.21.2.102:0/1942589367 wait complete. 2021-02-12T17:25:33.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.712+0000 7ff5d99b4700 1 Processor -- start 2021-02-12T17:25:33.713 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.712+0000 7ff5d99b4700 1 -- start start 2021-02-12T17:25:33.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.712+0000 7ff5d99b4700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff5d4062740 0x7ff5d4161aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:33.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.712+0000 7ff5d99b4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff5d40b8d20 0x7ff5d40b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:33.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.712+0000 7ff5d99b4700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5d414e530 0x7ff5d40b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:33.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.712+0000 7ff5d99b4700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40aeff0 con 0x7ff5d40b8d20 2021-02-12T17:25:33.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.712+0000 7ff5d99b4700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40af290 con 0x7ff5d4062740 2021-02-12T17:25:33.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.712+0000 7ff5d99b4700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d41610c0 con 0x7ff5d414e530 2021-02-12T17:25:33.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.712+0000 7ff5d27fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff5d40b8d20 0x7ff5d40b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:33.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.712+0000 7ff5d27fc700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff5d40b8d20 0x7ff5d40b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48510/0 (socket says 172.21.2.102:48510) 2021-02-12T17:25:33.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.712+0000 7ff5d27fc700 1 -- 172.21.2.102:0/4047024883 learned_addr learned my addr 172.21.2.102:0/4047024883 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:33.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.713+0000 7ff5d27fc700 1 -- 172.21.2.102:0/4047024883 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5d414e530 msgr2=0x7ff5d40b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:33.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.713+0000 7ff5d27fc700 1 --2- 172.21.2.102:0/4047024883 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5d414e530 0x7ff5d40b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:33.716 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.713+0000 7ff5d27fc700 1 -- 172.21.2.102:0/4047024883 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff5d4062740 msgr2=0x7ff5d4161aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:33.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.713+0000 7ff5d27fc700 1 --2- 172.21.2.102:0/4047024883 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff5d4062740 0x7ff5d4161aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:33.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.713+0000 7ff5d27fc700 1 -- 172.21.2.102:0/4047024883 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d4161360 con 0x7ff5d40b8d20 2021-02-12T17:25:33.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.713+0000 7ff5d27fc700 1 --2- 172.21.2.102:0/4047024883 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff5d40b8d20 0x7ff5d40b5220 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7ff5c800c710 tx=0x7ff5c8007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:33.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.713+0000 7ff5baffd700 1 -- 172.21.2.102:0/4047024883 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c80072e0 con 0x7ff5d40b8d20 2021-02-12T17:25:33.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.713+0000 7ff5baffd700 1 -- 172.21.2.102:0/4047024883 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c8007440 con 0x7ff5d40b8d20 2021-02-12T17:25:33.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.713+0000 7ff5d99b4700 1 -- 172.21.2.102:0/4047024883 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d4161600 con 0x7ff5d40b8d20 2021-02-12T17:25:33.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.713+0000 7ff5d99b4700 1 -- 172.21.2.102:0/4047024883 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d40b0e80 con 0x7ff5d40b8d20 2021-02-12T17:25:33.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.713+0000 7ff5baffd700 1 -- 172.21.2.102:0/4047024883 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c80057f0 con 0x7ff5d40b8d20 2021-02-12T17:25:33.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.714+0000 7ff5d99b4700 1 -- 172.21.2.102:0/4047024883 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d4065be0 con 0x7ff5d40b8d20 2021-02-12T17:25:33.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.714+0000 7ff5baffd700 1 -- 172.21.2.102:0/4047024883 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7ff5c8010070 con 0x7ff5d40b8d20 2021-02-12T17:25:33.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.714+0000 7ff5baffd700 1 --2- 172.21.2.102:0/4047024883 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff5b4059d80 0x7ff5b405c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:33.717 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.715+0000 7ff5baffd700 1 -- 172.21.2.102:0/4047024883 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7ff5c8073700 con 0x7ff5d40b8d20 2021-02-12T17:25:33.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.715+0000 7ff5d2ffd700 1 --2- 172.21.2.102:0/4047024883 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff5b4059d80 0x7ff5b405c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:33.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.715+0000 7ff5d2ffd700 1 --2- 172.21.2.102:0/4047024883 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff5b4059d80 0x7ff5b405c240 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7ff5d40b6020 tx=0x7ff5c4016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:33.718 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.718+0000 7ff5baffd700 1 -- 172.21.2.102:0/4047024883 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7ff5c8046b50 con 0x7ff5d40b8d20 2021-02-12T17:25:33.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.878+0000 7ff5d99b4700 1 -- 172.21.2.102:0/4047024883 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5d4161790 con 0x7ff5d40b8d20 2021-02-12T17:25:33.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.878+0000 7ff5baffd700 1 -- 172.21.2.102:0/4047024883 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3760 (secure 0 0 0) 0x7ff5c804a170 con 0x7ff5d40b8d20 2021-02-12T17:25:33.879 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:33.879 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":60,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:33.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.879+0000 7ff5d99b4700 1 -- 172.21.2.102:0/4047024883 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff5b4059d80 msgr2=0x7ff5b405c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:33.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.879+0000 7ff5d99b4700 1 --2- 172.21.2.102:0/4047024883 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff5b4059d80 0x7ff5b405c240 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7ff5d40b6020 tx=0x7ff5c4016000).stop 2021-02-12T17:25:33.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.879+0000 7ff5d99b4700 1 -- 172.21.2.102:0/4047024883 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff5d40b8d20 msgr2=0x7ff5d40b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:33.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.879+0000 7ff5d99b4700 1 --2- 172.21.2.102:0/4047024883 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff5d40b8d20 0x7ff5d40b5220 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7ff5c800c710 tx=0x7ff5c8007c90).stop 2021-02-12T17:25:33.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.880+0000 7ff5d99b4700 1 -- 172.21.2.102:0/4047024883 shutdown_connections 2021-02-12T17:25:33.880 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.880+0000 7ff5d99b4700 1 --2- 172.21.2.102:0/4047024883 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff5d414e530 0x7ff5d40b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:33.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.880+0000 7ff5d99b4700 1 --2- 172.21.2.102:0/4047024883 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff5d4062740 0x7ff5d4161aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:33.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.880+0000 7ff5d99b4700 1 --2- 172.21.2.102:0/4047024883 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff5b4059d80 0x7ff5b405c240 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:33.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.880+0000 7ff5d99b4700 1 --2- 172.21.2.102:0/4047024883 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff5d40b8d20 0x7ff5d40b5220 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:33.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.880+0000 7ff5d99b4700 1 -- 172.21.2.102:0/4047024883 >> 172.21.2.102:0/4047024883 conn(0x7ff5d40bc480 msgr2=0x7ff5d4062bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:33.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.880+0000 7ff5d99b4700 1 -- 172.21.2.102:0/4047024883 shutdown_connections 2021-02-12T17:25:33.881 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:33.880+0000 7ff5d99b4700 1 -- 172.21.2.102:0/4047024883 wait complete. 2021-02-12T17:25:33.881 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 60 2021-02-12T17:25:33.889 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:25:34.255 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:34.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.342+0000 7fa2fae0b700 1 Processor -- start 2021-02-12T17:25:34.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.342+0000 7fa2fae0b700 1 -- start start 2021-02-12T17:25:34.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.342+0000 7fa2fae0b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa2f40b8d20 0x7fa2f4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:34.346 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.342+0000 7fa2fae0b700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa2f414e530 0x7fa2f40b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:34.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.342+0000 7fa2fae0b700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f40622a0 con 0x7fa2f4062740 2021-02-12T17:25:34.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.343+0000 7fa2fae0b700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f4068d20 con 0x7fa2f414e530 2021-02-12T17:25:34.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.343+0000 7fa2fae0b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f414ea10 con 0x7fa2f40b8d20 2021-02-12T17:25:34.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.343+0000 7fa2f3fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa2f414e530 0x7fa2f40b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:34.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.343+0000 7fa2f3fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fa2f414e530 0x7fa2f40b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48514/0 (socket says 172.21.2.102:48514) 2021-02-12T17:25:34.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.343+0000 7fa2f3fff700 1 -- 172.21.2.102:0/4150274068 learned_addr learned my addr 172.21.2.102:0/4150274068 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:34.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.343+0000 7fa2f3fff700 1 -- 172.21.2.102:0/4150274068 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa2f40b8d20 msgr2=0x7fa2f4068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:34.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.343+0000 7fa2f3fff700 1 --2- 172.21.2.102:0/4150274068 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa2f40b8d20 0x7fa2f4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:34.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.343+0000 7fa2f3fff700 1 -- 172.21.2.102:0/4150274068 >> v1:172.21.2.102:6789/0 conn(0x7fa2f4062740 legacy=0x7fa2f4062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:34.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.343+0000 7fa2f3fff700 1 -- 172.21.2.102:0/4150274068 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f40b63f0 con 0x7fa2f414e530 2021-02-12T17:25:34.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.343+0000 7fa2f3fff700 1 --2- 172.21.2.102:0/4150274068 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa2f414e530 0x7fa2f40b7250 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fa2e400b9e0 tx=0x7fa2e4006ea0).ready entity=mon.0 client_cookie=ff2dec22431fc15c server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:34.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.344+0000 7fa2f37fe700 1 -- 172.21.2.102:0/4150274068 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4009840 con 0x7fa2f414e530 2021-02-12T17:25:34.347 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.344+0000 7fa2f37fe700 1 -- 172.21.2.102:0/4150274068 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e40099a0 con 0x7fa2f414e530 2021-02-12T17:25:34.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.344+0000 7fa2f37fe700 1 -- 172.21.2.102:0/4150274068 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4009d20 con 0x7fa2f414e530 2021-02-12T17:25:34.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.344+0000 7fa2fae0b700 1 -- 172.21.2.102:0/4150274068 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa2f414e530 msgr2=0x7fa2f40b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:34.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.344+0000 7fa2fae0b700 1 --2- 172.21.2.102:0/4150274068 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa2f414e530 0x7fa2f40b7250 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fa2e400b9e0 tx=0x7fa2e4006ea0).stop 2021-02-12T17:25:34.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.344+0000 7fa2fae0b700 1 -- 172.21.2.102:0/4150274068 shutdown_connections 2021-02-12T17:25:34.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.344+0000 7fa2fae0b700 1 --2- 172.21.2.102:0/4150274068 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa2f40b8d20 0x7fa2f4068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:34.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.344+0000 7fa2fae0b700 1 --2- 172.21.2.102:0/4150274068 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa2f414e530 0x7fa2f40b7250 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:34.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.344+0000 7fa2fae0b700 1 -- 172.21.2.102:0/4150274068 >> 172.21.2.102:0/4150274068 conn(0x7fa2f40bc480 msgr2=0x7fa2f40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:34.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.344+0000 7fa2fae0b700 1 -- 172.21.2.102:0/4150274068 shutdown_connections 2021-02-12T17:25:34.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.344+0000 7fa2fae0b700 1 -- 172.21.2.102:0/4150274068 wait complete. 2021-02-12T17:25:34.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.345+0000 7fa2fae0b700 1 Processor -- start 2021-02-12T17:25:34.348 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.345+0000 7fa2fae0b700 1 -- start start 2021-02-12T17:25:34.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2fae0b700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa2f4062740 0x7fa2f411da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:34.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2fae0b700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa2f40b8d20 0x7fa2f40b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:34.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2fae0b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa2f411d420 0x7fa2f415dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:34.350 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2fae0b700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f411df40 con 0x7fa2f411d420 2021-02-12T17:25:34.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2fae0b700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40ae520 con 0x7fa2f40b8d20 2021-02-12T17:25:34.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2fae0b700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40ae780 con 0x7fa2f4062740 2021-02-12T17:25:34.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2f93a8700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa2f411d420 0x7fa2f415dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:34.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2f93a8700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa2f411d420 0x7fa2f415dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48524/0 (socket says 172.21.2.102:48524) 2021-02-12T17:25:34.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2f93a8700 1 -- 172.21.2.102:0/320960119 learned_addr learned my addr 172.21.2.102:0/320960119 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:34.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2f8ba7700 1 --2- 172.21.2.102:0/320960119 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa2f4062740 0x7fa2f411da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:34.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2f3fff700 1 --2- 172.21.2.102:0/320960119 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa2f40b8d20 0x7fa2f40b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:34.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2f93a8700 1 -- 172.21.2.102:0/320960119 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa2f4062740 msgr2=0x7fa2f411da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:34.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2f93a8700 1 --2- 172.21.2.102:0/320960119 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa2f4062740 0x7fa2f411da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:34.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2f93a8700 1 -- 172.21.2.102:0/320960119 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa2f40b8d20 msgr2=0x7fa2f40b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:34.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2f93a8700 1 --2- 172.21.2.102:0/320960119 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa2f40b8d20 0x7fa2f40b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:34.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2f93a8700 1 -- 172.21.2.102:0/320960119 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f40aea20 con 0x7fa2f411d420 2021-02-12T17:25:34.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.346+0000 7fa2f93a8700 1 --2- 172.21.2.102:0/320960119 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa2f411d420 0x7fa2f415dc10 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fa2ec00ca90 tx=0x7fa2ec007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:34.351 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.347+0000 7fa2f0ff9700 1 -- 172.21.2.102:0/320960119 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec00a760 con 0x7fa2f411d420 2021-02-12T17:25:34.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.347+0000 7fa2f0ff9700 1 -- 172.21.2.102:0/320960119 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec00a8c0 con 0x7fa2f411d420 2021-02-12T17:25:34.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.347+0000 7fa2fae0b700 1 -- 172.21.2.102:0/320960119 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f40aecc0 con 0x7fa2f411d420 2021-02-12T17:25:34.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.347+0000 7fa2fae0b700 1 -- 172.21.2.102:0/320960119 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f40aefb0 con 0x7fa2f411d420 2021-02-12T17:25:34.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.347+0000 7fa2f0ff9700 1 -- 172.21.2.102:0/320960119 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec00ac40 con 0x7fa2f411d420 2021-02-12T17:25:34.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.348+0000 7fa2fae0b700 1 -- 172.21.2.102:0/320960119 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f40acfd0 con 0x7fa2f411d420 2021-02-12T17:25:34.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.348+0000 7fa2f0ff9700 1 -- 172.21.2.102:0/320960119 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fa2ec019030 con 0x7fa2f411d420 2021-02-12T17:25:34.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.348+0000 7fa2f0ff9700 1 --2- 172.21.2.102:0/320960119 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa2d8059d80 0x7fa2d805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:34.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.348+0000 7fa2f0ff9700 1 -- 172.21.2.102:0/320960119 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7fa2ec0738e0 con 0x7fa2f411d420 2021-02-12T17:25:34.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.348+0000 7fa2f8ba7700 1 --2- 172.21.2.102:0/320960119 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa2d8059d80 0x7fa2d805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:34.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.348+0000 7fa2f8ba7700 1 --2- 172.21.2.102:0/320960119 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa2d8059d80 0x7fa2d805c240 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fa2dc00b6b0 tx=0x7fa2dc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:34.352 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.351+0000 7fa2f0ff9700 1 -- 172.21.2.102:0/320960119 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fa2ec046de0 con 0x7fa2f411d420 2021-02-12T17:25:34.511 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.511+0000 7fa2fae0b700 1 -- 172.21.2.102:0/320960119 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2f4045460 con 0x7fa2f411d420 2021-02-12T17:25:34.512 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.512+0000 7fa2f0ff9700 1 -- 172.21.2.102:0/320960119 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3760 (secure 0 0 0) 0x7fa2ec04a400 con 0x7fa2f411d420 2021-02-12T17:25:34.512 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:34.512 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":60,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:34.513 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.513+0000 7fa2fae0b700 1 -- 172.21.2.102:0/320960119 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa2d8059d80 msgr2=0x7fa2d805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:34.513 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.513+0000 7fa2fae0b700 1 --2- 172.21.2.102:0/320960119 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa2d8059d80 0x7fa2d805c240 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fa2dc00b6b0 tx=0x7fa2dc008040).stop 2021-02-12T17:25:34.513 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.513+0000 7fa2fae0b700 1 -- 172.21.2.102:0/320960119 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa2f411d420 msgr2=0x7fa2f415dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:34.514 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.513+0000 7fa2fae0b700 1 --2- 172.21.2.102:0/320960119 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa2f411d420 0x7fa2f415dc10 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fa2ec00ca90 tx=0x7fa2ec007f30).stop 2021-02-12T17:25:34.514 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.513+0000 7fa2fae0b700 1 -- 172.21.2.102:0/320960119 shutdown_connections 2021-02-12T17:25:34.514 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.513+0000 7fa2fae0b700 1 --2- 172.21.2.102:0/320960119 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fa2d8059d80 0x7fa2d805c240 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:34.514 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.513+0000 7fa2fae0b700 1 --2- 172.21.2.102:0/320960119 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fa2f411d420 0x7fa2f415dc10 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:34.514 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.513+0000 7fa2fae0b700 1 --2- 172.21.2.102:0/320960119 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fa2f4062740 0x7fa2f411da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:34.514 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.513+0000 7fa2fae0b700 1 --2- 172.21.2.102:0/320960119 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fa2f40b8d20 0x7fa2f40b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:34.514 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.513+0000 7fa2fae0b700 1 -- 172.21.2.102:0/320960119 >> 172.21.2.102:0/320960119 conn(0x7fa2f40bc480 msgr2=0x7fa2f414cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:34.515 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.513+0000 7fa2fae0b700 1 -- 172.21.2.102:0/320960119 shutdown_connections 2021-02-12T17:25:34.515 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:34.513+0000 7fa2fae0b700 1 -- 172.21.2.102:0/320960119 wait complete. 2021-02-12T17:25:34.515 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 60 2021-02-12T17:25:34.522 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:25:35.890 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:35.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.977+0000 7f94808bf700 1 Processor -- start 2021-02-12T17:25:35.977 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.977+0000 7f94808bf700 1 -- start start 2021-02-12T17:25:35.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.978+0000 7f94808bf700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f947c062e50 0x7f947c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:35.978 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.978+0000 7f94808bf700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c0b7960 con 0x7f947c0b8d20 2021-02-12T17:25:35.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.978+0000 7f94808bf700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c0622a0 con 0x7f947c14e530 2021-02-12T17:25:35.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.978+0000 7f94808bf700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c068d20 con 0x7f947c062e50 2021-02-12T17:25:35.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.978+0000 7f947a59c700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f947c0b8d20 0x7f947c0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:57176/0 (socket says 172.21.2.102:57176) 2021-02-12T17:25:35.979 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.978+0000 7f947a59c700 1 -- 172.21.2.102:0/847094283 learned_addr learned my addr 172.21.2.102:0/847094283 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:35.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.978+0000 7f947959a700 1 -- 172.21.2.102:0/847094283 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512149137 0 0) 0x7f947c0b7960 con 0x7f947c0b8d20 2021-02-12T17:25:35.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.978+0000 7f947959a700 1 -- 172.21.2.102:0/847094283 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9460003230 con 0x7f947c0b8d20 2021-02-12T17:25:35.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947959a700 1 -- 172.21.2.102:0/847094283 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3202351388 0 0) 0x7f9460003230 con 0x7f947c0b8d20 2021-02-12T17:25:35.981 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947959a700 1 -- 172.21.2.102:0/847094283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f947c062e50 msgr2=0x7f947c068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:35.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947959a700 1 --2- 172.21.2.102:0/847094283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f947c062e50 0x7f947c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:35.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947959a700 1 -- 172.21.2.102:0/847094283 >> v1:172.21.2.104:6789/0 conn(0x7f947c14e530 legacy=0x7f947c062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:35.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947959a700 1 -- 172.21.2.102:0/847094283 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c14ea10 con 0x7f947c0b8d20 2021-02-12T17:25:35.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947959a700 1 -- 172.21.2.102:0/847094283 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f946c0014e0 con 0x7f947c0b8d20 2021-02-12T17:25:35.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947959a700 1 -- 172.21.2.102:0/847094283 >> v1:172.21.2.102:6789/0 conn(0x7f947c0b8d20 legacy=0x7f947c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:35.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947959a700 1 --2- 172.21.2.102:0/847094283 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f94600037d0 0x7f9460003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:35.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947959a700 1 --2- 172.21.2.102:0/847094283 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94600044d0 0x7f9460004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:35.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947959a700 1 --2- 172.21.2.102:0/847094283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f947c062e50 0x7f9460004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:35.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947959a700 1 -- 172.21.2.102:0/847094283 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c068d20 con 0x7f94600044d0 2021-02-12T17:25:35.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947959a700 1 -- 172.21.2.102:0/847094283 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9460005330 con 0x7f94600037d0 2021-02-12T17:25:35.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947959a700 1 -- 172.21.2.102:0/847094283 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946000b720 con 0x7f947c062e50 2021-02-12T17:25:35.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f9479d9b700 1 --2- 172.21.2.102:0/847094283 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94600044d0 0x7f9460004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:35.982 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947a59c700 1 --2- 172.21.2.102:0/847094283 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f94600037d0 0x7f9460003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f947ad9d700 1 --2- 172.21.2.102:0/847094283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f947c062e50 0x7f9460004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f9479d9b700 1 -- 172.21.2.102:0/847094283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f947c062e50 msgr2=0x7f9460004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f9479d9b700 1 --2- 172.21.2.102:0/847094283 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f947c062e50 0x7f9460004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f9479d9b700 1 -- 172.21.2.102:0/847094283 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f94600037d0 msgr2=0x7f9460003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f9479d9b700 1 --2- 172.21.2.102:0/847094283 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f94600037d0 0x7f9460003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.979+0000 7f9479d9b700 1 -- 172.21.2.102:0/847094283 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460003230 con 0x7f94600044d0 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.980+0000 7f9479d9b700 1 --2- 172.21.2.102:0/847094283 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94600044d0 0x7f9460004950 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f9470002860 tx=0x7f9470007b80).ready entity=mon.0 client_cookie=2cac37600a1ed2df server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.980+0000 7f947959a700 1 -- 172.21.2.102:0/847094283 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470007020 con 0x7f94600044d0 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.980+0000 7f947959a700 1 -- 172.21.2.102:0/847094283 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94700071c0 con 0x7f94600044d0 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.980+0000 7f947959a700 1 -- 172.21.2.102:0/847094283 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947000cab0 con 0x7f94600044d0 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.980+0000 7f94808bf700 1 -- 172.21.2.102:0/847094283 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94600044d0 msgr2=0x7f9460004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.980+0000 7f94808bf700 1 --2- 172.21.2.102:0/847094283 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f94600044d0 0x7f9460004950 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f9470002860 tx=0x7f9470007b80).stop 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.980+0000 7f947ad9d700 1 -- 172.21.2.102:0/847094283 reap_dead start 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.980+0000 7f94808bf700 1 -- 172.21.2.102:0/847094283 shutdown_connections 2021-02-12T17:25:35.983 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.980+0000 7f94808bf700 1 -- 172.21.2.102:0/847094283 >> 172.21.2.102:0/847094283 conn(0x7f947c0bc480 msgr2=0x7f947c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:35.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.980+0000 7f94808bf700 1 -- 172.21.2.102:0/847094283 shutdown_connections 2021-02-12T17:25:35.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.980+0000 7f94808bf700 1 -- 172.21.2.102:0/847094283 wait complete. 2021-02-12T17:25:35.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.981+0000 7f94808bf700 1 Processor -- start 2021-02-12T17:25:35.984 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.981+0000 7f94808bf700 1 -- start start 2021-02-12T17:25:35.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.981+0000 7f94808bf700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94600044d0 0x7f947c152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:35.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.981+0000 7f94808bf700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f947c151cd0 0x7f947c160ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:35.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.981+0000 7f94808bf700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f947c0b5640 0x7f947c15d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:35.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.981+0000 7f94808bf700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c161390 con 0x7f947c151cd0 2021-02-12T17:25:35.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.981+0000 7f94808bf700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c150fb0 con 0x7f947c0b5640 2021-02-12T17:25:35.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.981+0000 7f94808bf700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c151250 con 0x7f94600044d0 2021-02-12T17:25:35.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f9479d9b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f947c151cd0 0x7f947c160ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:35.986 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f9479d9b700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f947c151cd0 0x7f947c160ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48546/0 (socket says 172.21.2.102:48546) 2021-02-12T17:25:35.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f9479d9b700 1 -- 172.21.2.102:0/171224112 learned_addr learned my addr 172.21.2.102:0/171224112 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:35.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f947a59c700 1 --2- 172.21.2.102:0/171224112 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94600044d0 0x7f947c152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:35.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f947ad9d700 1 --2- 172.21.2.102:0/171224112 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f947c0b5640 0x7f947c15d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:35.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f9479d9b700 1 -- 172.21.2.102:0/171224112 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94600044d0 msgr2=0x7f947c152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:35.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f9479d9b700 1 --2- 172.21.2.102:0/171224112 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94600044d0 0x7f947c152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:35.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f9479d9b700 1 -- 172.21.2.102:0/171224112 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f947c0b5640 msgr2=0x7f947c15d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:35.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f9479d9b700 1 --2- 172.21.2.102:0/171224112 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f947c0b5640 0x7f947c15d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:35.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f9479d9b700 1 -- 172.21.2.102:0/171224112 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c1514f0 con 0x7f947c151cd0 2021-02-12T17:25:35.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f9479d9b700 1 --2- 172.21.2.102:0/171224112 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f947c151cd0 0x7f947c160ea0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f9460004360 tx=0x7f9470015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:35.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f946a7fc700 1 -- 172.21.2.102:0/171224112 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470013c20 con 0x7f947c151cd0 2021-02-12T17:25:35.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f946a7fc700 1 -- 172.21.2.102:0/171224112 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9470013d80 con 0x7f947c151cd0 2021-02-12T17:25:35.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f94808bf700 1 -- 172.21.2.102:0/171224112 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c15d010 con 0x7f947c151cd0 2021-02-12T17:25:35.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f946a7fc700 1 -- 172.21.2.102:0/171224112 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947001f640 con 0x7f947c151cd0 2021-02-12T17:25:35.987 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.982+0000 7f94808bf700 1 -- 172.21.2.102:0/171224112 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c0b5ac0 con 0x7f947c151cd0 2021-02-12T17:25:35.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.983+0000 7f94808bf700 1 -- 172.21.2.102:0/171224112 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947c15d470 con 0x7f947c151cd0 2021-02-12T17:25:35.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.983+0000 7f946a7fc700 1 -- 172.21.2.102:0/171224112 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f9470010030 con 0x7f947c151cd0 2021-02-12T17:25:35.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.983+0000 7f946a7fc700 1 --2- 172.21.2.102:0/171224112 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9458059d30 0x7f945805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:35.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.983+0000 7f946a7fc700 1 -- 172.21.2.102:0/171224112 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7709+0+0 (secure 0 0 0) 0x7f9470075840 con 0x7f947c151cd0 2021-02-12T17:25:35.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.983+0000 7f947a59c700 1 --2- 172.21.2.102:0/171224112 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9458059d30 0x7f945805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:35.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.984+0000 7f947a59c700 1 --2- 172.21.2.102:0/171224112 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9458059d30 0x7f945805c1f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f947c14d740 tx=0x7f947c14eba0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:35.988 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:35.986+0000 7f946a7fc700 1 -- 172.21.2.102:0/171224112 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f9470048c10 con 0x7f947c151cd0 2021-02-12T17:25:36.145 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.144+0000 7f94808bf700 1 -- 172.21.2.102:0/171224112 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f947c045460 con 0x7f947c151cd0 2021-02-12T17:25:36.145 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.145+0000 7f946a7fc700 1 -- 172.21.2.102:0/171224112 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3760 (secure 0 0 0) 0x7f947004c230 con 0x7f947c151cd0 2021-02-12T17:25:36.145 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:36.145 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":60,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:23:14.352545+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34571":{"gid":34571,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":12,"addr":"172.21.2.104:6835/973150871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":973150871},{"type":"v1","addr":"172.21.2.104:6835","nonce":973150871}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:36.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.146+0000 7f94808bf700 1 -- 172.21.2.102:0/171224112 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9458059d30 msgr2=0x7f945805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:36.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.146+0000 7f94808bf700 1 --2- 172.21.2.102:0/171224112 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9458059d30 0x7f945805c1f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f947c14d740 tx=0x7f947c14eba0).stop 2021-02-12T17:25:36.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.146+0000 7f94808bf700 1 -- 172.21.2.102:0/171224112 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f947c151cd0 msgr2=0x7f947c160ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:36.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.146+0000 7f94808bf700 1 --2- 172.21.2.102:0/171224112 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f947c151cd0 0x7f947c160ea0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f9460004360 tx=0x7f9470015000).stop 2021-02-12T17:25:36.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.146+0000 7f94808bf700 1 -- 172.21.2.102:0/171224112 shutdown_connections 2021-02-12T17:25:36.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.146+0000 7f94808bf700 1 --2- 172.21.2.102:0/171224112 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f947c0b5640 0x7f947c15d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:36.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.146+0000 7f94808bf700 1 --2- 172.21.2.102:0/171224112 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f94600044d0 0x7f947c152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:36.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.146+0000 7f94808bf700 1 --2- 172.21.2.102:0/171224112 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9458059d30 0x7f945805c1f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:36.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.146+0000 7f94808bf700 1 --2- 172.21.2.102:0/171224112 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f947c151cd0 0x7f947c160ea0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:36.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.146+0000 7f94808bf700 1 -- 172.21.2.102:0/171224112 >> 172.21.2.102:0/171224112 conn(0x7f947c0bc480 msgr2=0x7f947c14c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:36.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.146+0000 7f94808bf700 1 -- 172.21.2.102:0/171224112 shutdown_connections 2021-02-12T17:25:36.147 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.146+0000 7f94808bf700 1 -- 172.21.2.102:0/171224112 wait complete. 2021-02-12T17:25:36.148 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 60 2021-02-12T17:25:36.156 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2021-02-12T17:25:36.523 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:36.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.613+0000 7fb97ad86700 1 Processor -- start 2021-02-12T17:25:36.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.613+0000 7fb97ad86700 1 -- start start 2021-02-12T17:25:36.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb97ad86700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb974062e50 0x7fb974068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:36.614 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb97ad86700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9740b7960 con 0x7fb9740b8d20 2021-02-12T17:25:36.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb97ad86700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9740622a0 con 0x7fb97414e530 2021-02-12T17:25:36.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb97ad86700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb974068d20 con 0x7fb974062e50 2021-02-12T17:25:36.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb978b22700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fb9740b8d20 0x7fb9740b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:57206/0 (socket says 172.21.2.102:57206) 2021-02-12T17:25:36.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb978b22700 1 -- 172.21.2.102:0/2661096450 learned_addr learned my addr 172.21.2.102:0/2661096450 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:36.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb9737fe700 1 -- 172.21.2.102:0/2661096450 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493631094 0 0) 0x7fb9740b7960 con 0x7fb9740b8d20 2021-02-12T17:25:36.615 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb9737fe700 1 -- 172.21.2.102:0/2661096450 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb954003230 con 0x7fb9740b8d20 2021-02-12T17:25:36.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb9737fe700 1 -- 172.21.2.102:0/2661096450 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1714778593 0 0) 0x7fb954003230 con 0x7fb9740b8d20 2021-02-12T17:25:36.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb9737fe700 1 -- 172.21.2.102:0/2661096450 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb974062e50 msgr2=0x7fb974068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:36.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb979323700 1 --2- 172.21.2.102:0/2661096450 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb974062e50 0x7fb974068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:36.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb9737fe700 1 --2- 172.21.2.102:0/2661096450 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb974062e50 0x7fb974068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:36.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb9737fe700 1 -- 172.21.2.102:0/2661096450 >> v1:172.21.2.104:6789/0 conn(0x7fb97414e530 legacy=0x7fb974062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:36.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb9737fe700 1 -- 172.21.2.102:0/2661096450 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97414ea10 con 0x7fb9740b8d20 2021-02-12T17:25:36.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb9737fe700 1 -- 172.21.2.102:0/2661096450 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7fb95c0014e0 con 0x7fb9740b8d20 2021-02-12T17:25:36.617 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.614+0000 7fb979323700 1 --2- 172.21.2.102:0/2661096450 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb974062e50 0x7fb974068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:36.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb9737fe700 1 -- 172.21.2.102:0/2661096450 >> v1:172.21.2.102:6789/0 conn(0x7fb9740b8d20 legacy=0x7fb9740b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:36.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb9737fe700 1 --2- 172.21.2.102:0/2661096450 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb974062e50 0x7fb9540037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:36.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb9737fe700 1 --2- 172.21.2.102:0/2661096450 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb954003d10 0x7fb9540044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:36.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb9737fe700 1 --2- 172.21.2.102:0/2661096450 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb9540049c0 0x7fb954004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:36.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb9737fe700 1 -- 172.21.2.102:0/2661096450 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb974068d20 con 0x7fb954003d10 2021-02-12T17:25:36.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb9737fe700 1 -- 172.21.2.102:0/2661096450 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb954004280 con 0x7fb9540049c0 2021-02-12T17:25:36.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb9737fe700 1 -- 172.21.2.102:0/2661096450 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95400b720 con 0x7fb974062e50 2021-02-12T17:25:36.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb973fff700 1 --2- 172.21.2.102:0/2661096450 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb954003d10 0x7fb9540044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:36.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb978b22700 1 --2- 172.21.2.102:0/2661096450 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb974062e50 0x7fb9540037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:36.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb973fff700 1 -- 172.21.2.102:0/2661096450 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb974062e50 msgr2=0x7fb9540037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:36.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb973fff700 1 --2- 172.21.2.102:0/2661096450 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb974062e50 0x7fb9540037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:36.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb973fff700 1 -- 172.21.2.102:0/2661096450 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb9540049c0 msgr2=0x7fb954004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:36.618 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb973fff700 1 --2- 172.21.2.102:0/2661096450 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb9540049c0 0x7fb954004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:36.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb973fff700 1 -- 172.21.2.102:0/2661096450 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb954003230 con 0x7fb954003d10 2021-02-12T17:25:36.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb973fff700 1 --2- 172.21.2.102:0/2661096450 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb954003d10 0x7fb9540044d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fb964002890 tx=0x7fb964007b80).ready entity=mon.0 client_cookie=9b898c7858a6af6b server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:36.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb9737fe700 1 -- 172.21.2.102:0/2661096450 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964007020 con 0x7fb954003d10 2021-02-12T17:25:36.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb9737fe700 1 -- 172.21.2.102:0/2661096450 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9640071c0 con 0x7fb954003d10 2021-02-12T17:25:36.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.615+0000 7fb9737fe700 1 -- 172.21.2.102:0/2661096450 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96400c800 con 0x7fb954003d10 2021-02-12T17:25:36.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.616+0000 7fb97ad86700 1 -- 172.21.2.102:0/2661096450 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb954003d10 msgr2=0x7fb9540044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:36.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.616+0000 7fb97ad86700 1 --2- 172.21.2.102:0/2661096450 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb954003d10 0x7fb9540044d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fb964002890 tx=0x7fb964007b80).stop 2021-02-12T17:25:36.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.616+0000 7fb979323700 1 -- 172.21.2.102:0/2661096450 reap_dead start 2021-02-12T17:25:36.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.616+0000 7fb97ad86700 1 -- 172.21.2.102:0/2661096450 shutdown_connections 2021-02-12T17:25:36.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.616+0000 7fb97ad86700 1 -- 172.21.2.102:0/2661096450 >> 172.21.2.102:0/2661096450 conn(0x7fb9740bc480 msgr2=0x7fb9740b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:36.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.616+0000 7fb97ad86700 1 -- 172.21.2.102:0/2661096450 shutdown_connections 2021-02-12T17:25:36.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.616+0000 7fb97ad86700 1 -- 172.21.2.102:0/2661096450 wait complete. 2021-02-12T17:25:36.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.616+0000 7fb97ad86700 1 Processor -- start 2021-02-12T17:25:36.619 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb97ad86700 1 -- start start 2021-02-12T17:25:36.621 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb97ad86700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb9740b8130 0x7fb9740b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:36.621 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb97ad86700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb9740b4b30 0x7fb974161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:36.621 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb97ad86700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb9740687c0 0x7fb97414a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:36.621 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb97ad86700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb974160a70 con 0x7fb9740b8130 2021-02-12T17:25:36.621 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb97ad86700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9740b5530 con 0x7fb9740687c0 2021-02-12T17:25:36.621 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb97ad86700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9740b5a00 con 0x7fb9740b4b30 2021-02-12T17:25:36.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb978b22700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb9740b8130 0x7fb9740b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:36.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb978b22700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb9740b8130 0x7fb9740b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48572/0 (socket says 172.21.2.102:48572) 2021-02-12T17:25:36.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb978b22700 1 -- 172.21.2.102:0/2539722804 learned_addr learned my addr 172.21.2.102:0/2539722804 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:36.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb978b22700 1 -- 172.21.2.102:0/2539722804 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb9740b4b30 msgr2=0x7fb974161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:36.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb978b22700 1 --2- 172.21.2.102:0/2539722804 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb9740b4b30 0x7fb974161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:36.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb978b22700 1 -- 172.21.2.102:0/2539722804 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb9740687c0 msgr2=0x7fb97414a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:36.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb978b22700 1 --2- 172.21.2.102:0/2539722804 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb9740687c0 0x7fb97414a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:36.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.617+0000 7fb978b22700 1 -- 172.21.2.102:0/2539722804 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9740b5290 con 0x7fb9740b8130 2021-02-12T17:25:36.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.618+0000 7fb978b22700 1 --2- 172.21.2.102:0/2539722804 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb9740b8130 0x7fb9740b0700 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fb95c00de50 tx=0x7fb95c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:36.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.618+0000 7fb970ff9700 1 -- 172.21.2.102:0/2539722804 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c00bbf0 con 0x7fb9740b8130 2021-02-12T17:25:36.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.618+0000 7fb970ff9700 1 -- 172.21.2.102:0/2539722804 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c00bd50 con 0x7fb9740b8130 2021-02-12T17:25:36.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.618+0000 7fb97ad86700 1 -- 172.21.2.102:0/2539722804 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb974160cd0 con 0x7fb9740b8130 2021-02-12T17:25:36.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.618+0000 7fb97ad86700 1 -- 172.21.2.102:0/2539722804 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb974161660 con 0x7fb9740b8130 2021-02-12T17:25:36.622 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.618+0000 7fb970ff9700 1 -- 172.21.2.102:0/2539722804 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0073a0 con 0x7fb9740b8130 2021-02-12T17:25:36.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.619+0000 7fb97ad86700 1 -- 172.21.2.102:0/2539722804 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c004f60 con 0x7fb9740b8130 2021-02-12T17:25:36.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.619+0000 7fb970ff9700 1 -- 172.21.2.102:0/2539722804 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fb95c0047c0 con 0x7fb9740b8130 2021-02-12T17:25:36.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.619+0000 7fb970ff9700 1 --2- 172.21.2.102:0/2539722804 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb958059d80 0x7fb95805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:36.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.619+0000 7fb970ff9700 1 -- 172.21.2.102:0/2539722804 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7795+0+0 (secure 0 0 0) 0x7fb95c074550 con 0x7fb9740b8130 2021-02-12T17:25:36.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.619+0000 7fb973fff700 1 --2- 172.21.2.102:0/2539722804 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb958059d80 0x7fb95805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:36.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.619+0000 7fb973fff700 1 --2- 172.21.2.102:0/2539722804 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb958059d80 0x7fb95805c240 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fb97405fa40 tx=0x7fb964015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:36.623 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.622+0000 7fb970ff9700 1 -- 172.21.2.102:0/2539722804 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fb95c047940 con 0x7fb9740b8130 2021-02-12T17:25:36.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.785+0000 7fb97ad86700 1 -- 172.21.2.102:0/2539722804 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb94c005790 con 0x7fb9740b8130 2021-02-12T17:25:36.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.785+0000 7fb970ff9700 1 -- 172.21.2.102:0/2539722804 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+3406 (secure 0 0 0) 0x7fb95c04af60 con 0x7fb9740b8130 2021-02-12T17:25:36.786 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:36.786 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":61,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:25:36.370907+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5925},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5925":{"gid":5925,"name":"a","rank":0,"incarnation":61,"state":"up:replay","state_seq":2,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:36.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.786+0000 7fb97ad86700 1 -- 172.21.2.102:0/2539722804 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb958059d80 msgr2=0x7fb95805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:36.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.786+0000 7fb97ad86700 1 --2- 172.21.2.102:0/2539722804 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb958059d80 0x7fb95805c240 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fb97405fa40 tx=0x7fb964015000).stop 2021-02-12T17:25:36.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.786+0000 7fb97ad86700 1 -- 172.21.2.102:0/2539722804 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb9740b8130 msgr2=0x7fb9740b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:36.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.786+0000 7fb97ad86700 1 --2- 172.21.2.102:0/2539722804 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb9740b8130 0x7fb9740b0700 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fb95c00de50 tx=0x7fb95c009040).stop 2021-02-12T17:25:36.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.787+0000 7fb97ad86700 1 -- 172.21.2.102:0/2539722804 shutdown_connections 2021-02-12T17:25:36.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.787+0000 7fb97ad86700 1 --2- 172.21.2.102:0/2539722804 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fb9740687c0 0x7fb97414a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:36.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.787+0000 7fb97ad86700 1 --2- 172.21.2.102:0/2539722804 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fb958059d80 0x7fb95805c240 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:36.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.787+0000 7fb97ad86700 1 --2- 172.21.2.102:0/2539722804 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fb9740b8130 0x7fb9740b0700 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:36.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.787+0000 7fb97ad86700 1 --2- 172.21.2.102:0/2539722804 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fb9740b4b30 0x7fb974161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:36.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.787+0000 7fb97ad86700 1 -- 172.21.2.102:0/2539722804 >> 172.21.2.102:0/2539722804 conn(0x7fb9740bc480 msgr2=0x7fb97414db60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:36.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.787+0000 7fb97ad86700 1 -- 172.21.2.102:0/2539722804 shutdown_connections 2021-02-12T17:25:36.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:36.787+0000 7fb97ad86700 1 -- 172.21.2.102:0/2539722804 wait complete. 2021-02-12T17:25:36.789 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 61 2021-02-12T17:25:36.796 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:25:38.157 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:38.245 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.245+0000 7ff2f3a10700 1 Processor -- start 2021-02-12T17:25:38.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.245+0000 7ff2f3a10700 1 -- start start 2021-02-12T17:25:38.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.246+0000 7ff2f3a10700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff2ec14e530 0x7ff2ec068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.246+0000 7ff2f3a10700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec0b7960 con 0x7ff2ec0b8d20 2021-02-12T17:25:38.246 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.246+0000 7ff2f3a10700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec0622a0 con 0x7ff2ec062740 2021-02-12T17:25:38.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.246+0000 7ff2f3a10700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec068d20 con 0x7ff2ec14e530 2021-02-12T17:25:38.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.246+0000 7ff2f17ac700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7ff2ec0b8d20 0x7ff2ec0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:57226/0 (socket says 172.21.2.102:57226) 2021-02-12T17:25:38.247 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.246+0000 7ff2f17ac700 1 -- 172.21.2.102:0/144002044 learned_addr learned my addr 172.21.2.102:0/144002044 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:38.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.246+0000 7ff2dbfff700 1 -- 172.21.2.102:0/144002044 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004958205 0 0) 0x7ff2ec0b7960 con 0x7ff2ec0b8d20 2021-02-12T17:25:38.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.246+0000 7ff2dbfff700 1 -- 172.21.2.102:0/144002044 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d4003230 con 0x7ff2ec0b8d20 2021-02-12T17:25:38.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2dbfff700 1 -- 172.21.2.102:0/144002044 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1650228290 0 0) 0x7ff2d4003230 con 0x7ff2ec0b8d20 2021-02-12T17:25:38.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2dbfff700 1 -- 172.21.2.102:0/144002044 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff2ec14e530 msgr2=0x7ff2ec068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:38.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2dbfff700 1 --2- 172.21.2.102:0/144002044 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff2ec14e530 0x7ff2ec068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:38.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2dbfff700 1 -- 172.21.2.102:0/144002044 >> v1:172.21.2.104:6789/0 conn(0x7ff2ec062740 legacy=0x7ff2ec062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:38.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2dbfff700 1 -- 172.21.2.102:0/144002044 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec14ea10 con 0x7ff2ec0b8d20 2021-02-12T17:25:38.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2dbfff700 1 -- 172.21.2.102:0/144002044 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7ff2dc0014e0 con 0x7ff2ec0b8d20 2021-02-12T17:25:38.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2dbfff700 1 -- 172.21.2.102:0/144002044 >> v1:172.21.2.102:6789/0 conn(0x7ff2ec0b8d20 legacy=0x7ff2ec0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.249 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2dbfff700 1 --2- 172.21.2.102:0/144002044 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff2d40037d0 0x7ff2d4003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2dbfff700 1 --2- 172.21.2.102:0/144002044 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff2ec14e530 0x7ff2d40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2dbfff700 1 --2- 172.21.2.102:0/144002044 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff2d40049c0 0x7ff2d4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2dbfff700 1 -- 172.21.2.102:0/144002044 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec068d20 con 0x7ff2d40049c0 2021-02-12T17:25:38.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2dbfff700 1 -- 172.21.2.102:0/144002044 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40042a0 con 0x7ff2d40037d0 2021-02-12T17:25:38.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2dbfff700 1 -- 172.21.2.102:0/144002044 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d400b720 con 0x7ff2ec14e530 2021-02-12T17:25:38.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2f1fad700 1 --2- 172.21.2.102:0/144002044 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff2d40049c0 0x7ff2d4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2f17ac700 1 --2- 172.21.2.102:0/144002044 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff2d40037d0 0x7ff2d4003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2f0fab700 1 --2- 172.21.2.102:0/144002044 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff2ec14e530 0x7ff2d40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2f1fad700 1 -- 172.21.2.102:0/144002044 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff2ec14e530 msgr2=0x7ff2d40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:38.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2f1fad700 1 --2- 172.21.2.102:0/144002044 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff2ec14e530 0x7ff2d40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2f1fad700 1 -- 172.21.2.102:0/144002044 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff2d40037d0 msgr2=0x7ff2d4003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:38.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2f1fad700 1 --2- 172.21.2.102:0/144002044 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff2d40037d0 0x7ff2d4003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.250 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.247+0000 7ff2f1fad700 1 -- 172.21.2.102:0/144002044 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d4003230 con 0x7ff2d40049c0 2021-02-12T17:25:38.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.248+0000 7ff2f1fad700 1 --2- 172.21.2.102:0/144002044 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff2d40049c0 0x7ff2d4004e40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7ff2e4002db0 tx=0x7ff2e4007f00).ready entity=mon.0 client_cookie=1f6b54cc016b48d9 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:38.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.248+0000 7ff2dbfff700 1 -- 172.21.2.102:0/144002044 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4002430 con 0x7ff2d40049c0 2021-02-12T17:25:38.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.248+0000 7ff2dbfff700 1 -- 172.21.2.102:0/144002044 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e400c960 con 0x7ff2d40049c0 2021-02-12T17:25:38.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.248+0000 7ff2dbfff700 1 -- 172.21.2.102:0/144002044 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e400cd20 con 0x7ff2d40049c0 2021-02-12T17:25:38.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.248+0000 7ff2f3a10700 1 -- 172.21.2.102:0/144002044 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff2d40049c0 msgr2=0x7ff2d4004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.248+0000 7ff2f3a10700 1 --2- 172.21.2.102:0/144002044 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff2d40049c0 0x7ff2d4004e40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7ff2e4002db0 tx=0x7ff2e4007f00).stop 2021-02-12T17:25:38.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.248+0000 7ff2f1fad700 1 -- 172.21.2.102:0/144002044 reap_dead start 2021-02-12T17:25:38.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.248+0000 7ff2f3a10700 1 -- 172.21.2.102:0/144002044 shutdown_connections 2021-02-12T17:25:38.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.248+0000 7ff2f3a10700 1 -- 172.21.2.102:0/144002044 >> 172.21.2.102:0/144002044 conn(0x7ff2ec0bc480 msgr2=0x7ff2ec0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:38.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.248+0000 7ff2f3a10700 1 -- 172.21.2.102:0/144002044 shutdown_connections 2021-02-12T17:25:38.251 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.248+0000 7ff2f3a10700 1 -- 172.21.2.102:0/144002044 wait complete. 2021-02-12T17:25:38.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.249+0000 7ff2f3a10700 1 Processor -- start 2021-02-12T17:25:38.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.249+0000 7ff2f3a10700 1 -- start start 2021-02-12T17:25:38.253 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f3a10700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff2d40049c0 0x7ff2ec14bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f3a10700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff2ec0b5380 0x7ff2ec0ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f3a10700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff2ec0b22a0 0x7ff2ec0ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f3a10700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec0b5820 con 0x7ff2ec0b5380 2021-02-12T17:25:38.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f3a10700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec0aee00 con 0x7ff2ec0b22a0 2021-02-12T17:25:38.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f3a10700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec1608f0 con 0x7ff2d40049c0 2021-02-12T17:25:38.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f0fab700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff2ec0b5380 0x7ff2ec0ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f0fab700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff2ec0b5380 0x7ff2ec0ae420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48594/0 (socket says 172.21.2.102:48594) 2021-02-12T17:25:38.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f0fab700 1 -- 172.21.2.102:0/65485729 learned_addr learned my addr 172.21.2.102:0/65485729 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:38.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f1fad700 1 --2- 172.21.2.102:0/65485729 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff2ec0b22a0 0x7ff2ec0ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f17ac700 1 --2- 172.21.2.102:0/65485729 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff2d40049c0 0x7ff2ec14bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f0fab700 1 -- 172.21.2.102:0/65485729 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff2d40049c0 msgr2=0x7ff2ec14bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f0fab700 1 --2- 172.21.2.102:0/65485729 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff2d40049c0 0x7ff2ec14bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.254 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f0fab700 1 -- 172.21.2.102:0/65485729 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff2ec0b22a0 msgr2=0x7ff2ec0ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f0fab700 1 --2- 172.21.2.102:0/65485729 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff2ec0b22a0 0x7ff2ec0ae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.250+0000 7ff2f0fab700 1 -- 172.21.2.102:0/65485729 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec160b90 con 0x7ff2ec0b5380 2021-02-12T17:25:38.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.251+0000 7ff2f0fab700 1 --2- 172.21.2.102:0/65485729 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff2ec0b5380 0x7ff2ec0ae420 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7ff2e800d7a0 tx=0x7ff2e8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:38.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.251+0000 7ff2d97fa700 1 -- 172.21.2.102:0/65485729 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e800f490 con 0x7ff2ec0b5380 2021-02-12T17:25:38.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.251+0000 7ff2d97fa700 1 -- 172.21.2.102:0/65485729 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e8000e90 con 0x7ff2ec0b5380 2021-02-12T17:25:38.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.251+0000 7ff2d97fa700 1 -- 172.21.2.102:0/65485729 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e800f800 con 0x7ff2ec0b5380 2021-02-12T17:25:38.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.251+0000 7ff2f3a10700 1 -- 172.21.2.102:0/65485729 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec160e30 con 0x7ff2ec0b5380 2021-02-12T17:25:38.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.251+0000 7ff2f3a10700 1 -- 172.21.2.102:0/65485729 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec14c170 con 0x7ff2ec0b5380 2021-02-12T17:25:38.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.251+0000 7ff2f3a10700 1 -- 172.21.2.102:0/65485729 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec161290 con 0x7ff2ec0b5380 2021-02-12T17:25:38.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.252+0000 7ff2d97fa700 1 -- 172.21.2.102:0/65485729 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7ff2e800fb70 con 0x7ff2ec0b5380 2021-02-12T17:25:38.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.252+0000 7ff2d97fa700 1 --2- 172.21.2.102:0/65485729 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff2cc059d30 0x7ff2cc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.252+0000 7ff2d97fa700 1 -- 172.21.2.102:0/65485729 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7795+0+0 (secure 0 0 0) 0x7ff2e8073430 con 0x7ff2ec0b5380 2021-02-12T17:25:38.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.252+0000 7ff2f17ac700 1 --2- 172.21.2.102:0/65485729 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff2cc059d30 0x7ff2cc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.255 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.252+0000 7ff2f17ac700 1 --2- 172.21.2.102:0/65485729 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff2cc059d30 0x7ff2cc05c1f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7ff2dc0013b0 tx=0x7ff2dc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:38.256 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.255+0000 7ff2d97fa700 1 -- 172.21.2.102:0/65485729 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7ff2e8046850 con 0x7ff2ec0b5380 2021-02-12T17:25:38.414 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.414+0000 7ff2f3a10700 1 -- 172.21.2.102:0/65485729 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2ec045460 con 0x7ff2ec0b5380 2021-02-12T17:25:38.415 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.414+0000 7ff2d97fa700 1 -- 172.21.2.102:0/65485729 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+3410 (secure 0 0 0) 0x7ff2e8049e70 con 0x7ff2ec0b5380 2021-02-12T17:25:38.415 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:38.415 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:25:37.476245+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5925},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5925":{"gid":5925,"name":"a","rank":0,"incarnation":61,"state":"up:reconnect","state_seq":10,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:38.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.415+0000 7ff2f3a10700 1 -- 172.21.2.102:0/65485729 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff2cc059d30 msgr2=0x7ff2cc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.415+0000 7ff2f3a10700 1 --2- 172.21.2.102:0/65485729 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff2cc059d30 0x7ff2cc05c1f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7ff2dc0013b0 tx=0x7ff2dc009040).stop 2021-02-12T17:25:38.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.415+0000 7ff2f3a10700 1 -- 172.21.2.102:0/65485729 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff2ec0b5380 msgr2=0x7ff2ec0ae420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.415+0000 7ff2f3a10700 1 --2- 172.21.2.102:0/65485729 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff2ec0b5380 0x7ff2ec0ae420 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7ff2e800d7a0 tx=0x7ff2e8008040).stop 2021-02-12T17:25:38.416 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.416+0000 7ff2f3a10700 1 -- 172.21.2.102:0/65485729 shutdown_connections 2021-02-12T17:25:38.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.416+0000 7ff2f3a10700 1 --2- 172.21.2.102:0/65485729 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7ff2ec0b22a0 0x7ff2ec0ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.416+0000 7ff2f3a10700 1 --2- 172.21.2.102:0/65485729 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7ff2d40049c0 0x7ff2ec14bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.416+0000 7ff2f3a10700 1 --2- 172.21.2.102:0/65485729 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7ff2cc059d30 0x7ff2cc05c1f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.416+0000 7ff2f3a10700 1 --2- 172.21.2.102:0/65485729 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7ff2ec0b5380 0x7ff2ec0ae420 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.416+0000 7ff2f3a10700 1 -- 172.21.2.102:0/65485729 >> 172.21.2.102:0/65485729 conn(0x7ff2ec0bc480 msgr2=0x7ff2ec14cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:38.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.416+0000 7ff2f3a10700 1 -- 172.21.2.102:0/65485729 shutdown_connections 2021-02-12T17:25:38.417 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.416+0000 7ff2f3a10700 1 -- 172.21.2.102:0/65485729 wait complete. 2021-02-12T17:25:38.417 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 62 2021-02-12T17:25:38.425 INFO:tasks.mds_thrash.fs.[a]:mds.d down, removed from mdsmap 2021-02-12T17:25:38.425 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2021-02-12T17:25:38.425 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:38.515 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.514+0000 7f22b228d700 1 Processor -- start 2021-02-12T17:25:38.515 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.515+0000 7f22b228d700 1 -- start start 2021-02-12T17:25:38.516 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.515+0000 7f22b228d700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f22ac14e530 0x7f22ac068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.516 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.515+0000 7f22b228d700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ac0b7960 con 0x7f22ac062740 2021-02-12T17:25:38.516 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.515+0000 7f22b228d700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ac0622a0 con 0x7f22ac0b8d20 2021-02-12T17:25:38.516 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.515+0000 7f22b228d700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac068d20 con 0x7f22ac14e530 2021-02-12T17:25:38.516 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.515+0000 7f22b082a700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f22ac062740 0x7f22ac062bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:57246/0 (socket says 172.21.2.102:57246) 2021-02-12T17:25:38.516 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.515+0000 7f22b082a700 1 -- 172.21.2.102:0/294838537 learned_addr learned my addr 172.21.2.102:0/294838537 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:38.516 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.515+0000 7f22aaffd700 1 -- 172.21.2.102:0/294838537 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903017263 0 0) 0x7f22ac0b7960 con 0x7f22ac062740 2021-02-12T17:25:38.516 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.515+0000 7f22aaffd700 1 -- 172.21.2.102:0/294838537 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2298003230 con 0x7f22ac062740 2021-02-12T17:25:38.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 -- 172.21.2.102:0/294838537 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3608629756 0 0) 0x7f2298003230 con 0x7f22ac062740 2021-02-12T17:25:38.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 -- 172.21.2.102:0/294838537 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f22ac14e530 msgr2=0x7f22ac068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:38.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 --2- 172.21.2.102:0/294838537 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f22ac14e530 0x7f22ac068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:38.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 -- 172.21.2.102:0/294838537 >> v1:172.21.2.104:6789/0 conn(0x7f22ac0b8d20 legacy=0x7f22ac0b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:25:38.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 -- 172.21.2.102:0/294838537 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac14ea10 con 0x7f22ac062740 2021-02-12T17:25:38.518 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 -- 172.21.2.102:0/294838537 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f22a4001860 con 0x7f22ac062740 2021-02-12T17:25:38.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 -- 172.21.2.102:0/294838537 >> v1:172.21.2.102:6789/0 conn(0x7f22ac062740 legacy=0x7f22ac062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 --2- 172.21.2.102:0/294838537 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f22980037d0 0x7f2298003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 --2- 172.21.2.102:0/294838537 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f22980044d0 0x7f2298004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 --2- 172.21.2.102:0/294838537 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f22ac14e530 0x7f2298004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 -- 172.21.2.102:0/294838537 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac068d20 con 0x7f22980044d0 2021-02-12T17:25:38.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 -- 172.21.2.102:0/294838537 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2298005330 con 0x7f22980037d0 2021-02-12T17:25:38.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 -- 172.21.2.102:0/294838537 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229800b720 con 0x7f22ac14e530 2021-02-12T17:25:38.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22ab7fe700 1 --2- 172.21.2.102:0/294838537 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f22980044d0 0x7f2298004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22ab7fe700 1 -- 172.21.2.102:0/294838537 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f22ac14e530 msgr2=0x7f2298004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:38.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22ab7fe700 1 --2- 172.21.2.102:0/294838537 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f22ac14e530 0x7f2298004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:38.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22ab7fe700 1 -- 172.21.2.102:0/294838537 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f22980037d0 msgr2=0x7f2298003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:38.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22ab7fe700 1 --2- 172.21.2.102:0/294838537 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f22980037d0 0x7f2298003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:38.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22ab7fe700 1 -- 172.21.2.102:0/294838537 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2298003230 con 0x7f22980044d0 2021-02-12T17:25:38.519 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22ab7fe700 1 --2- 172.21.2.102:0/294838537 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f22980044d0 0x7f2298004950 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f22a000b950 tx=0x7f22a0006e20).ready entity=mon.0 client_cookie=c9530f7c32f24cd7 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:38.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 -- 172.21.2.102:0/294838537 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a00097e0 con 0x7f22980044d0 2021-02-12T17:25:38.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 -- 172.21.2.102:0/294838537 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a0009940 con 0x7f22980044d0 2021-02-12T17:25:38.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.516+0000 7f22aaffd700 1 -- 172.21.2.102:0/294838537 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0009d00 con 0x7f22980044d0 2021-02-12T17:25:38.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.517+0000 7f22b228d700 1 -- 172.21.2.102:0/294838537 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f22980044d0 msgr2=0x7f2298004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.517+0000 7f22b228d700 1 --2- 172.21.2.102:0/294838537 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f22980044d0 0x7f2298004950 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f22a000b950 tx=0x7f22a0006e20).stop 2021-02-12T17:25:38.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.517+0000 7f22b082a700 1 -- 172.21.2.102:0/294838537 reap_dead start 2021-02-12T17:25:38.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.517+0000 7f22b228d700 1 -- 172.21.2.102:0/294838537 shutdown_connections 2021-02-12T17:25:38.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.517+0000 7f22b228d700 1 -- 172.21.2.102:0/294838537 >> 172.21.2.102:0/294838537 conn(0x7f22ac0bc480 msgr2=0x7f22ac0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:38.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.517+0000 7f22b228d700 1 -- 172.21.2.102:0/294838537 shutdown_connections 2021-02-12T17:25:38.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.517+0000 7f22b228d700 1 -- 172.21.2.102:0/294838537 wait complete. 2021-02-12T17:25:38.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.518+0000 7f22b228d700 1 Processor -- start 2021-02-12T17:25:38.520 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.518+0000 7f22b228d700 1 -- start start 2021-02-12T17:25:38.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.518+0000 7f22b228d700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f22980044d0 0x7f22ac15d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.518+0000 7f22b228d700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f22ac151ef0 0x7f22ac0b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.518+0000 7f22b228d700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f22ac0ad450 0x7f22ac0ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.518+0000 7f22b228d700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac153b10 con 0x7f22ac151ef0 2021-02-12T17:25:38.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.518+0000 7f22b228d700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac1529d0 con 0x7f22980044d0 2021-02-12T17:25:38.522 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.518+0000 7f22b228d700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac152c70 con 0x7f22ac0ad450 2021-02-12T17:25:38.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.518+0000 7f22ab7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f22ac151ef0 0x7f22ac0b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.518+0000 7f22ab7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f22ac151ef0 0x7f22ac0b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48616/0 (socket says 172.21.2.102:48616) 2021-02-12T17:25:38.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.518+0000 7f22ab7fe700 1 -- 172.21.2.102:0/1981113883 learned_addr learned my addr 172.21.2.102:0/1981113883 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:38.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.519+0000 7f22ab7fe700 1 -- 172.21.2.102:0/1981113883 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f22ac0ad450 msgr2=0x7f22ac0ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.519+0000 7f22ab7fe700 1 --2- 172.21.2.102:0/1981113883 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f22ac0ad450 0x7f22ac0ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:38.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.519+0000 7f22ab7fe700 1 -- 172.21.2.102:0/1981113883 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f22980044d0 msgr2=0x7f22ac15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.519+0000 7f22abfff700 1 --2- 172.21.2.102:0/1981113883 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f22980044d0 0x7f22ac15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.519+0000 7f22ab7fe700 1 --2- 172.21.2.102:0/1981113883 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f22980044d0 0x7f22ac15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.519+0000 7f22ab7fe700 1 -- 172.21.2.102:0/1981113883 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac152f10 con 0x7f22ac151ef0 2021-02-12T17:25:38.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.519+0000 7f22abfff700 1 --2- 172.21.2.102:0/1981113883 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f22980044d0 0x7f22ac15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:38.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.519+0000 7f22ab7fe700 1 --2- 172.21.2.102:0/1981113883 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f22ac151ef0 0x7f22ac0b4350 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f2298004360 tx=0x7f22a0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:38.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.519+0000 7f2293fff700 1 -- 172.21.2.102:0/1981113883 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0012d60 con 0x7f22ac151ef0 2021-02-12T17:25:38.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.519+0000 7f2293fff700 1 -- 172.21.2.102:0/1981113883 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a0000e90 con 0x7f22ac151ef0 2021-02-12T17:25:38.523 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.519+0000 7f22b228d700 1 -- 172.21.2.102:0/1981113883 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac0acfb0 con 0x7f22ac151ef0 2021-02-12T17:25:38.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.519+0000 7f22b228d700 1 -- 172.21.2.102:0/1981113883 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac1537e0 con 0x7f22ac151ef0 2021-02-12T17:25:38.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.519+0000 7f2293fff700 1 -- 172.21.2.102:0/1981113883 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a001c650 con 0x7f22ac151ef0 2021-02-12T17:25:38.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.520+0000 7f22b228d700 1 -- 172.21.2.102:0/1981113883 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac045460 con 0x7f22ac151ef0 2021-02-12T17:25:38.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.520+0000 7f2293fff700 1 -- 172.21.2.102:0/1981113883 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f22a0023030 con 0x7f22ac151ef0 2021-02-12T17:25:38.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.520+0000 7f2293fff700 1 --2- 172.21.2.102:0/1981113883 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f228c059d80 0x7f228c05c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.520+0000 7f2293fff700 1 -- 172.21.2.102:0/1981113883 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7795+0+0 (secure 0 0 0) 0x7f22a0074e70 con 0x7f22ac151ef0 2021-02-12T17:25:38.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.520+0000 7f22abfff700 1 --2- 172.21.2.102:0/1981113883 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f228c059d80 0x7f228c05c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.520+0000 7f22abfff700 1 --2- 172.21.2.102:0/1981113883 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f228c059d80 0x7f228c05c240 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f22ac0afcd0 tx=0x7f229c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:38.524 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.523+0000 7f2293fff700 1 -- 172.21.2.102:0/1981113883 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f22a0048260 con 0x7f22ac151ef0 2021-02-12T17:25:38.684 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.683+0000 7f22b228d700 1 -- 172.21.2.102:0/1981113883 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22ac063670 con 0x7f22ac151ef0 2021-02-12T17:25:38.684 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.684+0000 7f2293fff700 1 -- 172.21.2.102:0/1981113883 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+3407 (secure 0 0 0) 0x7f22a0021070 con 0x7f22ac151ef0 2021-02-12T17:25:38.685 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:38.685 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":63,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:25:38.480619+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5925},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5925":{"gid":5925,"name":"a","rank":0,"incarnation":61,"state":"up:rejoin","state_seq":11,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:38.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.685+0000 7f22b228d700 1 -- 172.21.2.102:0/1981113883 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f228c059d80 msgr2=0x7f228c05c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.685+0000 7f22b228d700 1 --2- 172.21.2.102:0/1981113883 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f228c059d80 0x7f228c05c240 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f22ac0afcd0 tx=0x7f229c008040).stop 2021-02-12T17:25:38.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.685+0000 7f22b228d700 1 -- 172.21.2.102:0/1981113883 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f22ac151ef0 msgr2=0x7f22ac0b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.685+0000 7f22b228d700 1 --2- 172.21.2.102:0/1981113883 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f22ac151ef0 0x7f22ac0b4350 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f2298004360 tx=0x7f22a0016000).stop 2021-02-12T17:25:38.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.685+0000 7f22b228d700 1 -- 172.21.2.102:0/1981113883 shutdown_connections 2021-02-12T17:25:38.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.685+0000 7f22b228d700 1 --2- 172.21.2.102:0/1981113883 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f22ac0ad450 0x7f22ac0ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:38.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.685+0000 7f22b228d700 1 --2- 172.21.2.102:0/1981113883 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f22980044d0 0x7f22ac15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.685+0000 7f22b228d700 1 --2- 172.21.2.102:0/1981113883 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f228c059d80 0x7f228c05c240 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.685+0000 7f22b228d700 1 --2- 172.21.2.102:0/1981113883 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f22ac151ef0 0x7f22ac0b4350 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.685+0000 7f22b228d700 1 -- 172.21.2.102:0/1981113883 >> 172.21.2.102:0/1981113883 conn(0x7f22ac0bc480 msgr2=0x7f22ac14d010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:38.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.685+0000 7f22b228d700 1 -- 172.21.2.102:0/1981113883 shutdown_connections 2021-02-12T17:25:38.686 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.685+0000 7f22b228d700 1 -- 172.21.2.102:0/1981113883 wait complete. 2021-02-12T17:25:38.687 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 63 2021-02-12T17:25:38.695 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 63, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:01.991560+0000", "damaged": [], "data_pools": [ 4 ], "enabled": true, "epoch": 63, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "a", "in": [ 0 ], "info": { "gid_5925": { "addr": "172.21.2.102:6835/3259536493", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6834", "nonce": 3259536493, "type": "v2" }, { "addr": "172.21.2.102:6835", "nonce": 3259536493, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5925, "incarnation": 61, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:rejoin", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 38, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2021-02-12T17:25:38.480619+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5925 } } }, { "id": 2, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:08.529588+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 59, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "b", "in": [ 0 ], "info": { "gid_5823": { "addr": "172.21.2.102:6837/3756112970", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6836", "nonce": 3756112970, "type": "v2" }, { "addr": "172.21.2.102:6837", "nonce": 3756112970, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5823, "incarnation": 56, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 28 } }, "last_failure": 0, "last_failure_osd_epoch": 37, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 5, "modified": "2021-02-12T17:24:59.797709+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5823 } } } ], "standbys": [ { "addr": "172.21.2.104:6834/3149030842", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6832", "nonce": 3149030842, "type": "v2" }, { "addr": "172.21.2.104:6834", "nonce": 3149030842, "type": "v1" } ] }, "epoch": 5, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4243, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 2 } ] } 2021-02-12T17:25:38.797 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:38.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.884+0000 7f9d25cb4700 1 Processor -- start 2021-02-12T17:25:38.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.884+0000 7f9d25cb4700 1 -- start start 2021-02-12T17:25:38.885 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.885+0000 7f9d25cb4700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f9d200b6350 0x7f9d201463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.885+0000 7f9d25cb4700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9d20144ea0 0x7f9d20145330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.885+0000 7f9d25cb4700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d200b2930 con 0x7f9d20067720 2021-02-12T17:25:38.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.885+0000 7f9d25cb4700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d20068980 con 0x7f9d200b6350 2021-02-12T17:25:38.886 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.885+0000 7f9d25cb4700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200b67b0 con 0x7f9d20144ea0 2021-02-12T17:25:38.887 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.886+0000 7f9d1effd700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f9d200b6350 0x7f9d201463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.887 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.886+0000 7f9d1f7fe700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f9d20067720 0x7f9d20062580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:39636/0 (socket says 172.21.2.102:39636) 2021-02-12T17:25:38.887 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.886+0000 7f9d1f7fe700 1 -- 172.21.2.102:0/4230483650 learned_addr learned my addr 172.21.2.102:0/4230483650 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:38.887 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.886+0000 7f9d1ffff700 1 --2- 172.21.2.102:0/4230483650 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9d20144ea0 0x7f9d20145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.888 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.887+0000 7f9d1effd700 1 -- 172.21.2.102:0/4230483650 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9d20144ea0 msgr2=0x7f9d20145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:38.888 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.887+0000 7f9d1e7fc700 1 -- 172.21.2.102:0/4230483650 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680663381 0 0) 0x7f9d10001030 con 0x7f9d20067720 2021-02-12T17:25:38.888 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.887+0000 7f9d1effd700 1 --2- 172.21.2.102:0/4230483650 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9d20144ea0 0x7f9d20145330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.888 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.887+0000 7f9d1effd700 1 -- 172.21.2.102:0/4230483650 >> v1:172.21.2.104:6789/0 conn(0x7f9d20067720 legacy=0x7f9d20062580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.888 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.887+0000 7f9d1effd700 1 -- 172.21.2.102:0/4230483650 --> v2:172.21.2.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d20066db0 con 0x7f9d200b6350 2021-02-12T17:25:38.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.887+0000 7f9d1ffff700 1 --2- 172.21.2.102:0/4230483650 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9d20144ea0 0x7f9d20145330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:25:38.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.887+0000 7f9d1effd700 1 --2- 172.21.2.102:0/4230483650 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9d200b6350 0x7f9d201463a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f9d1400dc30 tx=0x7f9d14006e70).ready entity=mon.1 client_cookie=9f7b8751cff682d6 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:38.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.887+0000 7f9d1e7fc700 1 -- 172.21.2.102:0/4230483650 <== mon.1 v2:172.21.2.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400bae0 con 0x7f9d200b6350 2021-02-12T17:25:38.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.887+0000 7f9d1e7fc700 1 -- 172.21.2.102:0/4230483650 <== mon.1 v2:172.21.2.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1400bc40 con 0x7f9d200b6350 2021-02-12T17:25:38.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.887+0000 7f9d1e7fc700 1 -- 172.21.2.102:0/4230483650 <== mon.1 v2:172.21.2.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14012770 con 0x7f9d200b6350 2021-02-12T17:25:38.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.887+0000 7f9d25cb4700 1 -- 172.21.2.102:0/4230483650 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9d200b6350 msgr2=0x7f9d201463a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.887+0000 7f9d25cb4700 1 --2- 172.21.2.102:0/4230483650 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9d200b6350 0x7f9d201463a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f9d1400dc30 tx=0x7f9d14006e70).stop 2021-02-12T17:25:38.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.888+0000 7f9d25cb4700 1 -- 172.21.2.102:0/4230483650 shutdown_connections 2021-02-12T17:25:38.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.888+0000 7f9d25cb4700 1 --2- 172.21.2.102:0/4230483650 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9d20144ea0 0x7f9d20145330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.888+0000 7f9d25cb4700 1 --2- 172.21.2.102:0/4230483650 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9d200b6350 0x7f9d201463a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:38.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.888+0000 7f9d25cb4700 1 -- 172.21.2.102:0/4230483650 >> 172.21.2.102:0/4230483650 conn(0x7f9d200bc480 msgr2=0x7f9d200b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:38.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.888+0000 7f9d25cb4700 1 -- 172.21.2.102:0/4230483650 shutdown_connections 2021-02-12T17:25:38.889 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.888+0000 7f9d25cb4700 1 -- 172.21.2.102:0/4230483650 wait complete. 2021-02-12T17:25:38.890 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.889+0000 7f9d25cb4700 1 Processor -- start 2021-02-12T17:25:38.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.889+0000 7f9d25cb4700 1 -- start start 2021-02-12T17:25:38.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.889+0000 7f9d25cb4700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9d20067720 0x7f9d200acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.889+0000 7f9d25cb4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9d200b6350 0x7f9d200b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.889+0000 7f9d25cb4700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9d20144ea0 0x7f9d201548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.889+0000 7f9d25cb4700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200ae450 con 0x7f9d200b6350 2021-02-12T17:25:38.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.889+0000 7f9d25cb4700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d201493a0 con 0x7f9d20067720 2021-02-12T17:25:38.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.889+0000 7f9d25cb4700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200af470 con 0x7f9d20144ea0 2021-02-12T17:25:38.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.889+0000 7f9d1effd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9d200b6350 0x7f9d200b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.889+0000 7f9d1effd700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9d200b6350 0x7f9d200b1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48628/0 (socket says 172.21.2.102:48628) 2021-02-12T17:25:38.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.889+0000 7f9d1effd700 1 -- 172.21.2.102:0/2335198713 learned_addr learned my addr 172.21.2.102:0/2335198713 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:38.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.890+0000 7f9d1effd700 1 -- 172.21.2.102:0/2335198713 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9d20144ea0 msgr2=0x7f9d201548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.891 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.890+0000 7f9d1effd700 1 --2- 172.21.2.102:0/2335198713 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9d20144ea0 0x7f9d201548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:38.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.890+0000 7f9d1effd700 1 -- 172.21.2.102:0/2335198713 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9d20067720 msgr2=0x7f9d200acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:38.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.890+0000 7f9d1effd700 1 --2- 172.21.2.102:0/2335198713 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9d20067720 0x7f9d200acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:38.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.890+0000 7f9d1effd700 1 -- 172.21.2.102:0/2335198713 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d20148d50 con 0x7f9d200b6350 2021-02-12T17:25:38.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.890+0000 7f9d1effd700 1 --2- 172.21.2.102:0/2335198713 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9d200b6350 0x7f9d200b1910 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f9d2006ab20 tx=0x7f9d14018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:38.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.890+0000 7f9d077fe700 1 -- 172.21.2.102:0/2335198713 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1401a7d0 con 0x7f9d200b6350 2021-02-12T17:25:38.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.890+0000 7f9d077fe700 1 -- 172.21.2.102:0/2335198713 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1401a930 con 0x7f9d200b6350 2021-02-12T17:25:38.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.890+0000 7f9d25cb4700 1 -- 172.21.2.102:0/2335198713 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d20149600 con 0x7f9d200b6350 2021-02-12T17:25:38.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.890+0000 7f9d25cb4700 1 -- 172.21.2.102:0/2335198713 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d201489d0 con 0x7f9d200b6350 2021-02-12T17:25:38.892 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.890+0000 7f9d077fe700 1 -- 172.21.2.102:0/2335198713 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1401acf0 con 0x7f9d200b6350 2021-02-12T17:25:38.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.891+0000 7f9d25cb4700 1 -- 172.21.2.102:0/2335198713 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf8004f60 con 0x7f9d200b6350 2021-02-12T17:25:38.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.891+0000 7f9d077fe700 1 -- 172.21.2.102:0/2335198713 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f9d14018070 con 0x7f9d200b6350 2021-02-12T17:25:38.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.891+0000 7f9d077fe700 1 --2- 172.21.2.102:0/2335198713 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9d00059d80 0x7f9d0005c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:38.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.891+0000 7f9d077fe700 1 -- 172.21.2.102:0/2335198713 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7795+0+0 (secure 0 0 0) 0x7f9d14076250 con 0x7f9d200b6350 2021-02-12T17:25:38.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.891+0000 7f9d1f7fe700 1 --2- 172.21.2.102:0/2335198713 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9d00059d80 0x7f9d0005c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:38.893 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.892+0000 7f9d1f7fe700 1 --2- 172.21.2.102:0/2335198713 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9d00059d80 0x7f9d0005c240 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f9d100066a0 tx=0x7f9d10001140).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:38.895 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:38.894+0000 7f9d077fe700 1 -- 172.21.2.102:0/2335198713 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f9d14049640 con 0x7f9d200b6350 2021-02-12T17:25:39.051 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:39.051+0000 7f9d25cb4700 1 -- 172.21.2.102:0/2335198713 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cf8005790 con 0x7f9d200b6350 2021-02-12T17:25:39.052 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:39.051+0000 7f9d077fe700 1 -- 172.21.2.102:0/2335198713 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+3407 (secure 0 0 0) 0x7f9d1404cc60 con 0x7f9d200b6350 2021-02-12T17:25:39.052 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:39.052 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":63,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:25:38.480619+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5925},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5925":{"gid":5925,"name":"a","rank":0,"incarnation":61,"state":"up:rejoin","state_seq":11,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:39.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:39.052+0000 7f9d25cb4700 1 -- 172.21.2.102:0/2335198713 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9d00059d80 msgr2=0x7f9d0005c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:39.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:39.052+0000 7f9d25cb4700 1 --2- 172.21.2.102:0/2335198713 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9d00059d80 0x7f9d0005c240 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f9d100066a0 tx=0x7f9d10001140).stop 2021-02-12T17:25:39.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:39.052+0000 7f9d25cb4700 1 -- 172.21.2.102:0/2335198713 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9d200b6350 msgr2=0x7f9d200b1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:39.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:39.052+0000 7f9d25cb4700 1 --2- 172.21.2.102:0/2335198713 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9d200b6350 0x7f9d200b1910 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f9d2006ab20 tx=0x7f9d14018000).stop 2021-02-12T17:25:39.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:39.053+0000 7f9d25cb4700 1 -- 172.21.2.102:0/2335198713 shutdown_connections 2021-02-12T17:25:39.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:39.053+0000 7f9d25cb4700 1 --2- 172.21.2.102:0/2335198713 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f9d20144ea0 0x7f9d201548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:39.053 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:39.053+0000 7f9d25cb4700 1 --2- 172.21.2.102:0/2335198713 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f9d20067720 0x7f9d200acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:39.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:39.053+0000 7f9d25cb4700 1 --2- 172.21.2.102:0/2335198713 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f9d00059d80 0x7f9d0005c240 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:39.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:39.053+0000 7f9d25cb4700 1 --2- 172.21.2.102:0/2335198713 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f9d200b6350 0x7f9d200b1910 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:39.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:39.053+0000 7f9d25cb4700 1 -- 172.21.2.102:0/2335198713 >> 172.21.2.102:0/2335198713 conn(0x7f9d200bc480 msgr2=0x7f9d200bae20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:39.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:39.053+0000 7f9d25cb4700 1 -- 172.21.2.102:0/2335198713 shutdown_connections 2021-02-12T17:25:39.054 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:39.053+0000 7f9d25cb4700 1 -- 172.21.2.102:0/2335198713 wait complete. 2021-02-12T17:25:39.054 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 63 2021-02-12T17:25:39.062 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:25:40.695 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:40.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.782+0000 7f75fd70f700 1 Processor -- start 2021-02-12T17:25:40.783 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.782+0000 7f75fd70f700 1 -- start start 2021-02-12T17:25:40.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75fd70f700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f75f80b8d20 0x7f75f8068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:40.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75fd70f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75f814e530 0x7f75f80b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:40.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75fd70f700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f80622a0 con 0x7f75f8062740 2021-02-12T17:25:40.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75fd70f700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f8068d20 con 0x7f75f80b8d20 2021-02-12T17:25:40.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75fd70f700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f814ea10 con 0x7f75f814e530 2021-02-12T17:25:40.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75f6ffd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f75f80b8d20 0x7f75f8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:40.784 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75f6ffd700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7f75f80b8d20 0x7f75f8068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48640/0 (socket says 172.21.2.102:48640) 2021-02-12T17:25:40.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75f6ffd700 1 -- 172.21.2.102:0/3545569180 learned_addr learned my addr 172.21.2.102:0/3545569180 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:40.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75f67fc700 1 --2- 172.21.2.102:0/3545569180 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75f814e530 0x7f75f80b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:40.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75f6ffd700 1 -- 172.21.2.102:0/3545569180 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75f814e530 msgr2=0x7f75f80b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:40.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75f6ffd700 1 --2- 172.21.2.102:0/3545569180 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75f814e530 0x7f75f80b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:40.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75f6ffd700 1 -- 172.21.2.102:0/3545569180 >> v1:172.21.2.104:6789/0 conn(0x7f75f8062740 legacy=0x7f75f8062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:40.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75f6ffd700 1 -- 172.21.2.102:0/3545569180 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f80b63f0 con 0x7f75f80b8d20 2021-02-12T17:25:40.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75f67fc700 1 --2- 172.21.2.102:0/3545569180 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75f814e530 0x7f75f80b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:25:40.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.783+0000 7f75f6ffd700 1 --2- 172.21.2.102:0/3545569180 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75f80b8d20 0x7f75f8068830 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f75e000b9e0 tx=0x7f75e0006ea0).ready entity=mon.0 client_cookie=68b4f18a5be92389 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:40.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.784+0000 7f75f5ffb700 1 -- 172.21.2.102:0/3545569180 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0009840 con 0x7f75f80b8d20 2021-02-12T17:25:40.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.784+0000 7f75f5ffb700 1 -- 172.21.2.102:0/3545569180 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e00099a0 con 0x7f75f80b8d20 2021-02-12T17:25:40.785 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.784+0000 7f75f5ffb700 1 -- 172.21.2.102:0/3545569180 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0009d20 con 0x7f75f80b8d20 2021-02-12T17:25:40.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.784+0000 7f75fd70f700 1 -- 172.21.2.102:0/3545569180 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75f80b8d20 msgr2=0x7f75f8068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:40.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.784+0000 7f75fd70f700 1 --2- 172.21.2.102:0/3545569180 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75f80b8d20 0x7f75f8068830 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f75e000b9e0 tx=0x7f75e0006ea0).stop 2021-02-12T17:25:40.786 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.784+0000 7f75fd70f700 1 -- 172.21.2.102:0/3545569180 shutdown_connections 2021-02-12T17:25:40.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.784+0000 7f75fd70f700 1 --2- 172.21.2.102:0/3545569180 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75f80b8d20 0x7f75f8068830 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:40.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.784+0000 7f75fd70f700 1 --2- 172.21.2.102:0/3545569180 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75f814e530 0x7f75f80b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:40.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.784+0000 7f75fd70f700 1 -- 172.21.2.102:0/3545569180 >> 172.21.2.102:0/3545569180 conn(0x7f75f80bc480 msgr2=0x7f75f80b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:40.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.784+0000 7f75fd70f700 1 -- 172.21.2.102:0/3545569180 shutdown_connections 2021-02-12T17:25:40.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.784+0000 7f75fd70f700 1 -- 172.21.2.102:0/3545569180 wait complete. 2021-02-12T17:25:40.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.785+0000 7f75fd70f700 1 Processor -- start 2021-02-12T17:25:40.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.785+0000 7f75fd70f700 1 -- start start 2021-02-12T17:25:40.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75fd70f700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75f8062740 0x7f75f815df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:40.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75fd70f700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75f80b8d20 0x7f75f814ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:40.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75fd70f700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75f814e530 0x7f75f80af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:40.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75fd70f700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f815e400 con 0x7f75f814e530 2021-02-12T17:25:40.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75fd70f700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80b0150 con 0x7f75f80b8d20 2021-02-12T17:25:40.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75fd70f700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f814d560 con 0x7f75f8062740 2021-02-12T17:25:40.787 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75f77fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75f814e530 0x7f75f80af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:40.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75f77fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75f814e530 0x7f75f80af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48644/0 (socket says 172.21.2.102:48644) 2021-02-12T17:25:40.788 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75f77fe700 1 -- 172.21.2.102:0/2903105399 learned_addr learned my addr 172.21.2.102:0/2903105399 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:40.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75f6ffd700 1 --2- 172.21.2.102:0/2903105399 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75f8062740 0x7f75f815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:40.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75f67fc700 1 --2- 172.21.2.102:0/2903105399 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75f80b8d20 0x7f75f814ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:40.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75f77fe700 1 -- 172.21.2.102:0/2903105399 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75f8062740 msgr2=0x7f75f815df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:40.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75f77fe700 1 --2- 172.21.2.102:0/2903105399 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75f8062740 0x7f75f815df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:40.789 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75f77fe700 1 -- 172.21.2.102:0/2903105399 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75f80b8d20 msgr2=0x7f75f814ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:40.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75f77fe700 1 --2- 172.21.2.102:0/2903105399 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75f80b8d20 0x7f75f814ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:40.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.786+0000 7f75f77fe700 1 -- 172.21.2.102:0/2903105399 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f80b03a0 con 0x7f75f814e530 2021-02-12T17:25:40.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.787+0000 7f75f77fe700 1 --2- 172.21.2.102:0/2903105399 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75f814e530 0x7f75f80af650 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f75f000ca90 tx=0x7f75f0007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:40.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.787+0000 7f75eeffd700 1 -- 172.21.2.102:0/2903105399 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f000a5e0 con 0x7f75f814e530 2021-02-12T17:25:40.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.787+0000 7f75eeffd700 1 -- 172.21.2.102:0/2903105399 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f000a740 con 0x7f75f814e530 2021-02-12T17:25:40.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.787+0000 7f75fd70f700 1 -- 172.21.2.102:0/2903105399 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f80b0640 con 0x7f75f814e530 2021-02-12T17:25:40.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.787+0000 7f75eeffd700 1 -- 172.21.2.102:0/2903105399 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f000aae0 con 0x7f75f814e530 2021-02-12T17:25:40.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.787+0000 7f75fd70f700 1 -- 172.21.2.102:0/2903105399 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f80b08e0 con 0x7f75f814e530 2021-02-12T17:25:40.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.788+0000 7f75fd70f700 1 -- 172.21.2.102:0/2903105399 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f8045460 con 0x7f75f814e530 2021-02-12T17:25:40.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.788+0000 7f75eeffd700 1 -- 172.21.2.102:0/2903105399 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f75f0010070 con 0x7f75f814e530 2021-02-12T17:25:40.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.788+0000 7f75eeffd700 1 --2- 172.21.2.102:0/2903105399 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f75dc059d30 0x7f75dc05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:40.790 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.788+0000 7f75eeffd700 1 -- 172.21.2.102:0/2903105399 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7795+0+0 (secure 0 0 0) 0x7f75f0073d60 con 0x7f75f814e530 2021-02-12T17:25:40.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.788+0000 7f75f6ffd700 1 --2- 172.21.2.102:0/2903105399 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f75dc059d30 0x7f75dc05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:40.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.788+0000 7f75f6ffd700 1 --2- 172.21.2.102:0/2903105399 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f75dc059d30 0x7f75dc05c1f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f75e0006ee0 tx=0x7f75e0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:40.791 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.791+0000 7f75eeffd700 1 -- 172.21.2.102:0/2903105399 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f75f004ac10 con 0x7f75f814e530 2021-02-12T17:25:40.954 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.954+0000 7f75fd70f700 1 -- 172.21.2.102:0/2903105399 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75f8063670 con 0x7f75f814e530 2021-02-12T17:25:40.955 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.954+0000 7f75eeffd700 1 -- 172.21.2.102:0/2903105399 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3407 (secure 0 0 0) 0x7f75f004a800 con 0x7f75f814e530 2021-02-12T17:25:40.955 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:40.955 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":64,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:25:39.486584+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5925},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5925":{"gid":5925,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":12,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.955+0000 7f75fd70f700 1 -- 172.21.2.102:0/2903105399 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f75dc059d30 msgr2=0x7f75dc05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.955+0000 7f75fd70f700 1 --2- 172.21.2.102:0/2903105399 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f75dc059d30 0x7f75dc05c1f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f75e0006ee0 tx=0x7f75e0016000).stop 2021-02-12T17:25:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.955+0000 7f75fd70f700 1 -- 172.21.2.102:0/2903105399 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75f814e530 msgr2=0x7f75f80af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.955+0000 7f75fd70f700 1 --2- 172.21.2.102:0/2903105399 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75f814e530 0x7f75f80af650 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f75f000ca90 tx=0x7f75f0007ef0).stop 2021-02-12T17:25:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.955+0000 7f75fd70f700 1 -- 172.21.2.102:0/2903105399 shutdown_connections 2021-02-12T17:25:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.955+0000 7f75fd70f700 1 --2- 172.21.2.102:0/2903105399 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f75dc059d30 0x7f75dc05c1f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.955+0000 7f75fd70f700 1 --2- 172.21.2.102:0/2903105399 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f75f814e530 0x7f75f80af650 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:40.956 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.955+0000 7f75fd70f700 1 --2- 172.21.2.102:0/2903105399 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f75f8062740 0x7f75f815df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:40.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.955+0000 7f75fd70f700 1 --2- 172.21.2.102:0/2903105399 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f75f80b8d20 0x7f75f814ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:40.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.955+0000 7f75fd70f700 1 -- 172.21.2.102:0/2903105399 >> 172.21.2.102:0/2903105399 conn(0x7f75f80bc480 msgr2=0x7f75f80b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:40.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.955+0000 7f75fd70f700 1 -- 172.21.2.102:0/2903105399 shutdown_connections 2021-02-12T17:25:40.957 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:40.956+0000 7f75fd70f700 1 -- 172.21.2.102:0/2903105399 wait complete. 2021-02-12T17:25:40.957 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 64 2021-02-12T17:25:40.964 INFO:tasks.mds_thrash.fs.[a]:mds.a has gained rank=0, replacing gid=34571 2021-02-12T17:25:40.964 INFO:tasks.mds_thrash.fs.[a]:waiting for 1 secs before reviving mds.d 2021-02-12T17:25:41.063 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:41.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.150+0000 7f5a84729700 1 Processor -- start 2021-02-12T17:25:41.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.150+0000 7f5a84729700 1 -- start start 2021-02-12T17:25:41.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.151+0000 7f5a84729700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f5a7c14e530 0x7f5a7c068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:41.151 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.151+0000 7f5a84729700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5a7c062740 0x7f5a7c062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:41.152 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.151+0000 7f5a84729700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7c0b7960 con 0x7f5a7c0b8d20 2021-02-12T17:25:41.152 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.151+0000 7f5a84729700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7c068d20 con 0x7f5a7c14e530 2021-02-12T17:25:41.152 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.151+0000 7f5a84729700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0622a0 con 0x7f5a7c062740 2021-02-12T17:25:41.152 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.151+0000 7f5a824c5700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f5a7c0b8d20 0x7f5a7c0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:57294/0 (socket says 172.21.2.102:57294) 2021-02-12T17:25:41.152 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.151+0000 7f5a824c5700 1 -- 172.21.2.102:0/1394184144 learned_addr learned my addr 172.21.2.102:0/1394184144 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:41.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.151+0000 7f5a814c3700 1 -- 172.21.2.102:0/1394184144 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223276133 0 0) 0x7f5a7c0b7960 con 0x7f5a7c0b8d20 2021-02-12T17:25:41.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.151+0000 7f5a814c3700 1 -- 172.21.2.102:0/1394184144 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a64003230 con 0x7f5a7c0b8d20 2021-02-12T17:25:41.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a82cc6700 1 --2- 172.21.2.102:0/1394184144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5a7c062740 0x7f5a7c062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:41.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a81cc4700 1 --2- 172.21.2.102:0/1394184144 >> v2:172.21.2.104:3300/0 conn(0x7f5a7c14e530 0x7f5a7c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:41.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a814c3700 1 -- 172.21.2.102:0/1394184144 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2241883260 0 0) 0x7f5a64003230 con 0x7f5a7c0b8d20 2021-02-12T17:25:41.154 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a814c3700 1 -- 172.21.2.102:0/1394184144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5a7c062740 msgr2=0x7f5a7c062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:41.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a814c3700 1 --2- 172.21.2.102:0/1394184144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5a7c062740 0x7f5a7c062bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:41.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a814c3700 1 -- 172.21.2.102:0/1394184144 >> v2:172.21.2.104:3300/0 conn(0x7f5a7c14e530 msgr2=0x7f5a7c068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:41.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a814c3700 1 --2- 172.21.2.102:0/1394184144 >> v2:172.21.2.104:3300/0 conn(0x7f5a7c14e530 0x7f5a7c068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:41.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a814c3700 1 -- 172.21.2.102:0/1394184144 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c14ea10 con 0x7f5a7c0b8d20 2021-02-12T17:25:41.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a814c3700 1 -- 172.21.2.102:0/1394184144 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f5a780014e0 con 0x7f5a7c0b8d20 2021-02-12T17:25:41.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a814c3700 1 -- 172.21.2.102:0/1394184144 >> v1:172.21.2.102:6789/0 conn(0x7f5a7c0b8d20 legacy=0x7f5a7c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:41.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a814c3700 1 --2- 172.21.2.102:0/1394184144 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5a640037a0 0x7f5a64003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:41.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a814c3700 1 --2- 172.21.2.102:0/1394184144 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5a640044d0 0x7f5a64004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:41.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a814c3700 1 --2- 172.21.2.102:0/1394184144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5a7c062740 0x7f5a64004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:41.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a814c3700 1 -- 172.21.2.102:0/1394184144 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c068d20 con 0x7f5a640044d0 2021-02-12T17:25:41.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a814c3700 1 -- 172.21.2.102:0/1394184144 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0622a0 con 0x7f5a640037a0 2021-02-12T17:25:41.155 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a814c3700 1 -- 172.21.2.102:0/1394184144 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a64005330 con 0x7f5a7c062740 2021-02-12T17:25:41.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a81cc4700 1 --2- 172.21.2.102:0/1394184144 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5a640044d0 0x7f5a64004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:41.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a82cc6700 1 --2- 172.21.2.102:0/1394184144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5a7c062740 0x7f5a64004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:41.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a824c5700 1 --2- 172.21.2.102:0/1394184144 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5a640037a0 0x7f5a64003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:41.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a81cc4700 1 -- 172.21.2.102:0/1394184144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5a7c062740 msgr2=0x7f5a64004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:41.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a81cc4700 1 --2- 172.21.2.102:0/1394184144 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5a7c062740 0x7f5a64004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:41.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a81cc4700 1 -- 172.21.2.102:0/1394184144 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5a640037a0 msgr2=0x7f5a64003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:41.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a81cc4700 1 --2- 172.21.2.102:0/1394184144 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5a640037a0 0x7f5a64003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:41.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a81cc4700 1 -- 172.21.2.102:0/1394184144 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a64003230 con 0x7f5a640044d0 2021-02-12T17:25:41.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.152+0000 7f5a824c5700 1 --2- 172.21.2.102:0/1394184144 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5a640037a0 0x7f5a64003bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:25:41.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.153+0000 7f5a81cc4700 1 --2- 172.21.2.102:0/1394184144 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5a640044d0 0x7f5a64004950 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f5a7000ba70 tx=0x7f5a70008040).ready entity=mon.0 client_cookie=baefaa8bad8fbd69 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:41.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.153+0000 7f5a814c3700 1 -- 172.21.2.102:0/1394184144 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7000d860 con 0x7f5a640044d0 2021-02-12T17:25:41.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.153+0000 7f5a814c3700 1 -- 172.21.2.102:0/1394184144 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7000d9c0 con 0x7f5a640044d0 2021-02-12T17:25:41.156 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.153+0000 7f5a814c3700 1 -- 172.21.2.102:0/1394184144 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7000dd40 con 0x7f5a640044d0 2021-02-12T17:25:41.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.153+0000 7f5a84729700 1 -- 172.21.2.102:0/1394184144 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5a640044d0 msgr2=0x7f5a64004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:41.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.153+0000 7f5a84729700 1 --2- 172.21.2.102:0/1394184144 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5a640044d0 0x7f5a64004950 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f5a7000ba70 tx=0x7f5a70008040).stop 2021-02-12T17:25:41.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.153+0000 7f5a82cc6700 1 -- 172.21.2.102:0/1394184144 reap_dead start 2021-02-12T17:25:41.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.153+0000 7f5a84729700 1 -- 172.21.2.102:0/1394184144 shutdown_connections 2021-02-12T17:25:41.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.153+0000 7f5a84729700 1 -- 172.21.2.102:0/1394184144 >> 172.21.2.102:0/1394184144 conn(0x7f5a7c0bc480 msgr2=0x7f5a7c0b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:41.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.153+0000 7f5a84729700 1 -- 172.21.2.102:0/1394184144 shutdown_connections 2021-02-12T17:25:41.157 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.153+0000 7f5a84729700 1 -- 172.21.2.102:0/1394184144 wait complete. 2021-02-12T17:25:41.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.154+0000 7f5a84729700 1 Processor -- start 2021-02-12T17:25:41.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.154+0000 7f5a84729700 1 -- start start 2021-02-12T17:25:41.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a84729700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5a640044d0 0x7f5a7c152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:41.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a84729700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5a7c0b56a0 0x7f5a7c14a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:41.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a84729700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5a7c0b5b20 0x7f5a7c14aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:41.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a84729700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c15dad0 con 0x7f5a7c0b56a0 2021-02-12T17:25:41.159 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a84729700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c15dd70 con 0x7f5a7c0b5b20 2021-02-12T17:25:41.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a84729700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c15e010 con 0x7f5a640044d0 2021-02-12T17:25:41.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a81cc4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5a7c0b56a0 0x7f5a7c14a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:41.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a81cc4700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5a7c0b56a0 0x7f5a7c14a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48662/0 (socket says 172.21.2.102:48662) 2021-02-12T17:25:41.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a81cc4700 1 -- 172.21.2.102:0/3753483788 learned_addr learned my addr 172.21.2.102:0/3753483788 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:41.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a82cc6700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5a7c0b5b20 0x7f5a7c14aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:41.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a81cc4700 1 -- 172.21.2.102:0/3753483788 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5a640044d0 msgr2=0x7f5a7c152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:41.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a824c5700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5a640044d0 0x7f5a7c152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:41.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a81cc4700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5a640044d0 0x7f5a7c152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:41.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a81cc4700 1 -- 172.21.2.102:0/3753483788 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5a7c0b5b20 msgr2=0x7f5a7c14aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:41.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a81cc4700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5a7c0b5b20 0x7f5a7c14aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:41.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a81cc4700 1 -- 172.21.2.102:0/3753483788 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c15e2b0 con 0x7f5a7c0b56a0 2021-02-12T17:25:41.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a82cc6700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5a7c0b5b20 0x7f5a7c14aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:41.160 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.155+0000 7f5a824c5700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5a640044d0 0x7f5a7c152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:41.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.156+0000 7f5a81cc4700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5a7c0b56a0 0x7f5a7c14a9e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f5a64004350 tx=0x7f5a70008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:41.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.156+0000 7f5a6e7fc700 1 -- 172.21.2.102:0/3753483788 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7001d410 con 0x7f5a7c0b56a0 2021-02-12T17:25:41.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.156+0000 7f5a6e7fc700 1 -- 172.21.2.102:0/3753483788 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7001d570 con 0x7f5a7c0b56a0 2021-02-12T17:25:41.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.156+0000 7f5a84729700 1 -- 172.21.2.102:0/3753483788 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7c152a10 con 0x7f5a7c0b56a0 2021-02-12T17:25:41.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.156+0000 7f5a6e7fc700 1 -- 172.21.2.102:0/3753483788 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7001d950 con 0x7f5a7c0b56a0 2021-02-12T17:25:41.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.156+0000 7f5a84729700 1 -- 172.21.2.102:0/3753483788 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7c15d6a0 con 0x7f5a7c0b56a0 2021-02-12T17:25:41.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.157+0000 7f5a84729700 1 -- 172.21.2.102:0/3753483788 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7c15e5a0 con 0x7f5a7c0b56a0 2021-02-12T17:25:41.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.157+0000 7f5a6e7fc700 1 -- 172.21.2.102:0/3753483788 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f5a7002c070 con 0x7f5a7c0b56a0 2021-02-12T17:25:41.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.157+0000 7f5a6e7fc700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5a5c059d30 0x7f5a5c05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:41.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.157+0000 7f5a6e7fc700 1 -- 172.21.2.102:0/3753483788 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7795+0+0 (secure 0 0 0) 0x7f5a70075b70 con 0x7f5a7c0b56a0 2021-02-12T17:25:41.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.157+0000 7f5a824c5700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5a5c059d30 0x7f5a5c05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:41.161 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.158+0000 7f5a824c5700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5a5c059d30 0x7f5a5c05c1f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f5a78001e00 tx=0x7f5a7c14eba0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:41.162 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.160+0000 7f5a6e7fc700 1 -- 172.21.2.102:0/3753483788 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f5a70048ee0 con 0x7f5a7c0b56a0 2021-02-12T17:25:41.318 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.318+0000 7f5a84729700 1 -- 172.21.2.102:0/3753483788 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a7c0643d0 con 0x7f5a7c0b56a0 2021-02-12T17:25:41.319 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.318+0000 7f5a6e7fc700 1 -- 172.21.2.102:0/3753483788 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3407 (secure 0 0 0) 0x7f5a7004c500 con 0x7f5a7c0b56a0 2021-02-12T17:25:41.319 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:41.319 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":64,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:25:39.486584+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5925},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5925":{"gid":5925,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":12,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:41.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.319+0000 7f5a84729700 1 -- 172.21.2.102:0/3753483788 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5a5c059d30 msgr2=0x7f5a5c05c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:41.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.319+0000 7f5a84729700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5a5c059d30 0x7f5a5c05c1f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f5a78001e00 tx=0x7f5a7c14eba0).stop 2021-02-12T17:25:41.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.319+0000 7f5a84729700 1 -- 172.21.2.102:0/3753483788 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5a7c0b56a0 msgr2=0x7f5a7c14a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:41.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.319+0000 7f5a84729700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5a7c0b56a0 0x7f5a7c14a9e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f5a64004350 tx=0x7f5a70008040).stop 2021-02-12T17:25:41.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.319+0000 7f5a84729700 1 -- 172.21.2.102:0/3753483788 shutdown_connections 2021-02-12T17:25:41.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.319+0000 7f5a84729700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f5a7c0b5b20 0x7f5a7c14aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:41.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.319+0000 7f5a84729700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5a640044d0 0x7f5a7c152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:41.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.319+0000 7f5a84729700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5a5c059d30 0x7f5a5c05c1f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:41.320 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.319+0000 7f5a84729700 1 --2- 172.21.2.102:0/3753483788 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f5a7c0b56a0 0x7f5a7c14a9e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:41.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.319+0000 7f5a84729700 1 -- 172.21.2.102:0/3753483788 >> 172.21.2.102:0/3753483788 conn(0x7f5a7c0bc480 msgr2=0x7f5a7c0bb160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:41.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.319+0000 7f5a84729700 1 -- 172.21.2.102:0/3753483788 shutdown_connections 2021-02-12T17:25:41.321 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:41.319+0000 7f5a84729700 1 -- 172.21.2.102:0/3753483788 wait complete. 2021-02-12T17:25:41.321 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 64 2021-02-12T17:25:41.328 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:25:41.532 DEBUG:teuthology.orchestra.run.gibba002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:25:41.535 DEBUG:teuthology.orchestra.run.gibba004:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-12T17:25:41.965 INFO:tasks.mds_thrash.fs.[a]:reviving mds.d 2021-02-12T17:25:41.966 INFO:tasks.ceph.mds.d:Restarting daemon 2021-02-12T17:25:41.966 DEBUG:teuthology.orchestra.run.gibba004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2021-02-12T17:25:41.969 INFO:tasks.ceph.mds.d:Started 2021-02-12T17:25:41.969 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:42.023 INFO:tasks.ceph.mds.d.gibba004.stdout:starting mds.d at 2021-02-12T17:25:42.058 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.058+0000 7f594fd1c700 1 Processor -- start 2021-02-12T17:25:42.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.058+0000 7f594fd1c700 1 -- start start 2021-02-12T17:25:42.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.059+0000 7f594fd1c700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f59480b8d20 0x7f5948068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:42.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.059+0000 7f594fd1c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5948062740 0x7f5948062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:42.059 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.059+0000 7f594fd1c700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59480b7960 con 0x7f594814e530 2021-02-12T17:25:42.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.059+0000 7f594fd1c700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5948068d20 con 0x7f59480b8d20 2021-02-12T17:25:42.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.059+0000 7f594fd1c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59480622a0 con 0x7f5948062740 2021-02-12T17:25:42.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.059+0000 7f594d2b7700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7f594814e530 0x7f59480b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:57314/0 (socket says 172.21.2.102:57314) 2021-02-12T17:25:42.060 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.059+0000 7f594d2b7700 1 -- 172.21.2.102:0/3835639324 learned_addr learned my addr 172.21.2.102:0/3835639324 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:42.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.059+0000 7f594cab6700 1 -- 172.21.2.102:0/3835639324 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749667837 0 0) 0x7f59480b7960 con 0x7f594814e530 2021-02-12T17:25:42.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.059+0000 7f594cab6700 1 -- 172.21.2.102:0/3835639324 --> v1:172.21.2.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5930003230 con 0x7f594814e530 2021-02-12T17:25:42.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 -- 172.21.2.102:0/3835639324 <== mon.0 v1:172.21.2.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1781165496 0 0) 0x7f5930003230 con 0x7f594814e530 2021-02-12T17:25:42.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594dab8700 1 --2- 172.21.2.102:0/3835639324 >> v2:172.21.2.104:3300/0 conn(0x7f59480b8d20 0x7f5948068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:42.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 -- 172.21.2.102:0/3835639324 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5948062740 msgr2=0x7f5948062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:42.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 --2- 172.21.2.102:0/3835639324 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5948062740 0x7f5948062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:42.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 -- 172.21.2.102:0/3835639324 >> v2:172.21.2.104:3300/0 conn(0x7f59480b8d20 msgr2=0x7f5948068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:42.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 --2- 172.21.2.102:0/3835639324 >> v2:172.21.2.104:3300/0 conn(0x7f59480b8d20 0x7f5948068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:42.062 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 -- 172.21.2.102:0/3835639324 --> v1:172.21.2.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594814ea10 con 0x7f594814e530 2021-02-12T17:25:42.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 -- 172.21.2.102:0/3835639324 <== mon.0 v1:172.21.2.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3254086426 0 0) 0x7f593c0014e0 con 0x7f594814e530 2021-02-12T17:25:42.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 -- 172.21.2.102:0/3835639324 >> v1:172.21.2.102:6789/0 conn(0x7f594814e530 legacy=0x7f59480b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:42.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 --2- 172.21.2.102:0/3835639324 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59300037a0 0x7f5930003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:42.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 --2- 172.21.2.102:0/3835639324 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59300044d0 0x7f5930004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:42.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 --2- 172.21.2.102:0/3835639324 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5948062740 0x7f5930004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:42.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 -- 172.21.2.102:0/3835639324 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5948068d20 con 0x7f59300044d0 2021-02-12T17:25:42.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 -- 172.21.2.102:0/3835639324 --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59480622a0 con 0x7f59300037a0 2021-02-12T17:25:42.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 -- 172.21.2.102:0/3835639324 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5930005330 con 0x7f5948062740 2021-02-12T17:25:42.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594dab8700 1 --2- 172.21.2.102:0/3835639324 >> v2:172.21.2.104:3300/0 conn(0x7f59480b8d20 0x7f5948068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:42.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594d2b7700 1 --2- 172.21.2.102:0/3835639324 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59300044d0 0x7f5930004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:42.063 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594d2b7700 1 -- 172.21.2.102:0/3835639324 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5948062740 msgr2=0x7f5930004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:42.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594dab8700 1 --2- 172.21.2.102:0/3835639324 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59300037a0 0x7f5930003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:42.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594d2b7700 1 --2- 172.21.2.102:0/3835639324 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f5948062740 0x7f5930004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:42.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594d2b7700 1 -- 172.21.2.102:0/3835639324 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59300037a0 msgr2=0x7f5930003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:42.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594d2b7700 1 --2- 172.21.2.102:0/3835639324 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59300037a0 0x7f5930003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:42.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594d2b7700 1 -- 172.21.2.102:0/3835639324 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5930003230 con 0x7f59300044d0 2021-02-12T17:25:42.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594dab8700 1 --2- 172.21.2.102:0/3835639324 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59300037a0 0x7f5930003bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:42.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594d2b7700 1 --2- 172.21.2.102:0/3835639324 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59300044d0 0x7f5930004950 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f593c00c210 tx=0x7f594814eba0).ready entity=mon.0 client_cookie=eeb0edfc88f0c776 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:42.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 -- 172.21.2.102:0/3835639324 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c0076e0 con 0x7f59300044d0 2021-02-12T17:25:42.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 -- 172.21.2.102:0/3835639324 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c0070d0 con 0x7f59300044d0 2021-02-12T17:25:42.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594cab6700 1 -- 172.21.2.102:0/3835639324 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c007470 con 0x7f59300044d0 2021-02-12T17:25:42.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594fd1c700 1 -- 172.21.2.102:0/3835639324 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59300044d0 msgr2=0x7f5930004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:42.064 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.060+0000 7f594fd1c700 1 --2- 172.21.2.102:0/3835639324 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f59300044d0 0x7f5930004950 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f593c00c210 tx=0x7f594814eba0).stop 2021-02-12T17:25:42.065 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.061+0000 7f594e2b9700 1 -- 172.21.2.102:0/3835639324 reap_dead start 2021-02-12T17:25:42.065 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.061+0000 7f594fd1c700 1 -- 172.21.2.102:0/3835639324 shutdown_connections 2021-02-12T17:25:42.065 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.061+0000 7f594fd1c700 1 -- 172.21.2.102:0/3835639324 >> 172.21.2.102:0/3835639324 conn(0x7f59480bc480 msgr2=0x7f59480b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:42.065 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.061+0000 7f594fd1c700 1 -- 172.21.2.102:0/3835639324 shutdown_connections 2021-02-12T17:25:42.065 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.061+0000 7f594fd1c700 1 -- 172.21.2.102:0/3835639324 wait complete. 2021-02-12T17:25:42.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.062+0000 7f594fd1c700 1 Processor -- start 2021-02-12T17:25:42.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.062+0000 7f594fd1c700 1 -- start start 2021-02-12T17:25:42.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.062+0000 7f594fd1c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59300044d0 0x7f59480b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:42.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.062+0000 7f594fd1c700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59480b2230 0x7f594814a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:42.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.062+0000 7f594fd1c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f594814ada0 0x7f5948150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:42.067 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.062+0000 7f594fd1c700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59480b1da0 con 0x7f594814ada0 2021-02-12T17:25:42.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.062+0000 7f594fd1c700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5948152880 con 0x7f59480b2230 2021-02-12T17:25:42.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.062+0000 7f594fd1c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59480b0bb0 con 0x7f59300044d0 2021-02-12T17:25:42.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.062+0000 7f594e2b9700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f594814ada0 0x7f5948150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:42.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.062+0000 7f594e2b9700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f594814ada0 0x7f5948150130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48684/0 (socket says 172.21.2.102:48684) 2021-02-12T17:25:42.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.062+0000 7f594e2b9700 1 -- 172.21.2.102:0/408272871 learned_addr learned my addr 172.21.2.102:0/408272871 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:42.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.063+0000 7f594dab8700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59300044d0 0x7f59480b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:42.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.063+0000 7f594d2b7700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59480b2230 0x7f594814a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:42.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.063+0000 7f594e2b9700 1 -- 172.21.2.102:0/408272871 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59300044d0 msgr2=0x7f59480b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:42.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.063+0000 7f594e2b9700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59300044d0 0x7f59480b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:42.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.063+0000 7f594e2b9700 1 -- 172.21.2.102:0/408272871 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59480b2230 msgr2=0x7f594814a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:42.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.063+0000 7f594e2b9700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59480b2230 0x7f594814a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:42.068 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.063+0000 7f594e2b9700 1 -- 172.21.2.102:0/408272871 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59480b1b00 con 0x7f594814ada0 2021-02-12T17:25:42.069 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.063+0000 7f594d2b7700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59480b2230 0x7f594814a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:42.069 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.063+0000 7f594e2b9700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f594814ada0 0x7f5948150130 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f5948065550 tx=0x7f5940007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:42.069 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.063+0000 7f5939ffb700 1 -- 172.21.2.102:0/408272871 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5940005c00 con 0x7f594814ada0 2021-02-12T17:25:42.069 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.063+0000 7f5939ffb700 1 -- 172.21.2.102:0/408272871 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5940005da0 con 0x7f594814ada0 2021-02-12T17:25:42.069 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.063+0000 7f594fd1c700 1 -- 172.21.2.102:0/408272871 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5948152340 con 0x7f594814ada0 2021-02-12T17:25:42.069 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.063+0000 7f5939ffb700 1 -- 172.21.2.102:0/408272871 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59400072c0 con 0x7f594814ada0 2021-02-12T17:25:42.069 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.063+0000 7f594fd1c700 1 -- 172.21.2.102:0/408272871 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59480b0790 con 0x7f594814ada0 2021-02-12T17:25:42.069 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.064+0000 7f594fd1c700 1 -- 172.21.2.102:0/408272871 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594814fe50 con 0x7f594814ada0 2021-02-12T17:25:42.069 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.064+0000 7f5939ffb700 1 -- 172.21.2.102:0/408272871 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f594001d070 con 0x7f594814ada0 2021-02-12T17:25:42.069 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.064+0000 7f5939ffb700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5928059d30 0x7f592805c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:42.069 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.065+0000 7f5939ffb700 1 -- 172.21.2.102:0/408272871 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7795+0+0 (secure 0 0 0) 0x7f5940073010 con 0x7f594814ada0 2021-02-12T17:25:42.069 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.065+0000 7f594dab8700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5928059d30 0x7f592805c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:42.069 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.065+0000 7f594dab8700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5928059d30 0x7f592805c1f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f594400ba30 tx=0x7f5944008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:42.070 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.067+0000 7f5939ffb700 1 -- 172.21.2.102:0/408272871 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f5940046430 con 0x7f594814ada0 2021-02-12T17:25:42.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.227+0000 7f594fd1c700 1 -- 172.21.2.102:0/408272871 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5948045460 con 0x7f594814ada0 2021-02-12T17:25:42.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.228+0000 7f5939ffb700 1 -- 172.21.2.102:0/408272871 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3407 (secure 0 0 0) 0x7f594001b020 con 0x7f594814ada0 2021-02-12T17:25:42.229 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:42.229 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":64,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:25:39.486584+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5925},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5925":{"gid":5925,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":12,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:42.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.229+0000 7f594fd1c700 1 -- 172.21.2.102:0/408272871 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5928059d30 msgr2=0x7f592805c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:42.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.229+0000 7f594fd1c700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5928059d30 0x7f592805c1f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f594400ba30 tx=0x7f5944008040).stop 2021-02-12T17:25:42.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.229+0000 7f594fd1c700 1 -- 172.21.2.102:0/408272871 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f594814ada0 msgr2=0x7f5948150130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:42.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.229+0000 7f594fd1c700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f594814ada0 0x7f5948150130 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f5948065550 tx=0x7f5940007e10).stop 2021-02-12T17:25:42.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.229+0000 7f594fd1c700 1 -- 172.21.2.102:0/408272871 shutdown_connections 2021-02-12T17:25:42.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.229+0000 7f594fd1c700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f5928059d30 0x7f592805c1f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:42.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.229+0000 7f594fd1c700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f594814ada0 0x7f5948150130 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:42.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.229+0000 7f594fd1c700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f59300044d0 0x7f59480b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:42.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.229+0000 7f594fd1c700 1 --2- 172.21.2.102:0/408272871 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f59480b2230 0x7f594814a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:42.230 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.229+0000 7f594fd1c700 1 -- 172.21.2.102:0/408272871 >> 172.21.2.102:0/408272871 conn(0x7f59480bc480 msgr2=0x7f594814cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:42.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.229+0000 7f594fd1c700 1 -- 172.21.2.102:0/408272871 shutdown_connections 2021-02-12T17:25:42.231 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:42.229+0000 7f594fd1c700 1 -- 172.21.2.102:0/408272871 wait complete. 2021-02-12T17:25:42.231 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 64 2021-02-12T17:25:42.239 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2021-02-12T17:25:43.329 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:43.419 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.418+0000 7fbb2a171700 1 Processor -- start 2021-02-12T17:25:43.419 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.418+0000 7fbb2a171700 1 -- start start 2021-02-12T17:25:43.420 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.419+0000 7fbb2a171700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fbb2414e530 0x7fbb24068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:43.420 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.419+0000 7fbb2a171700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fbb24062740 0x7fbb24062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:43.420 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.419+0000 7fbb2a171700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb240b7960 con 0x7fbb240b8d20 2021-02-12T17:25:43.420 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.419+0000 7fbb2a171700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb24068d20 con 0x7fbb24062740 2021-02-12T17:25:43.420 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.419+0000 7fbb2a171700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb240622a0 con 0x7fbb2414e530 2021-02-12T17:25:43.420 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.419+0000 7fbb23fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fbb24062740 0x7fbb24062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:43.420 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.419+0000 7fbb237fe700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fbb240b8d20 0x7fbb240b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:57332/0 (socket says 172.21.2.102:57332) 2021-02-12T17:25:43.421 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.419+0000 7fbb237fe700 1 -- 172.21.2.102:0/2692569503 learned_addr learned my addr 172.21.2.102:0/2692569503 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:43.421 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.420+0000 7fbb23fff700 1 -- 172.21.2.102:0/2692569503 >> v2:172.21.2.104:3300/0 conn(0x7fbb2414e530 msgr2=0x7fbb24068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:43.421 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.420+0000 7fbb227fc700 1 -- 172.21.2.102:0/2692569503 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640034056 0 0) 0x7fbb240b7960 con 0x7fbb240b8d20 2021-02-12T17:25:43.421 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.420+0000 7fbb23fff700 1 --2- 172.21.2.102:0/2692569503 >> v2:172.21.2.104:3300/0 conn(0x7fbb2414e530 0x7fbb24068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:43.421 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.420+0000 7fbb23fff700 1 -- 172.21.2.102:0/2692569503 >> v1:172.21.2.102:6789/0 conn(0x7fbb240b8d20 legacy=0x7fbb240b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:43.421 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.420+0000 7fbb23fff700 1 -- 172.21.2.102:0/2692569503 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2414ea10 con 0x7fbb24062740 2021-02-12T17:25:43.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.420+0000 7fbb23fff700 1 --2- 172.21.2.102:0/2692569503 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbb24062740 0x7fbb24062bf0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fbb240654b0 tx=0x7fbb1c0091d0).ready entity=mon.0 client_cookie=82512c13b507095a server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:43.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.420+0000 7fbb227fc700 1 -- 172.21.2.102:0/2692569503 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c009e70 con 0x7fbb24062740 2021-02-12T17:25:43.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.420+0000 7fbb227fc700 1 -- 172.21.2.102:0/2692569503 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c00bbf0 con 0x7fbb24062740 2021-02-12T17:25:43.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.420+0000 7fbb227fc700 1 -- 172.21.2.102:0/2692569503 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c011400 con 0x7fbb24062740 2021-02-12T17:25:43.422 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.420+0000 7fbb2a171700 1 -- 172.21.2.102:0/2692569503 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbb24062740 msgr2=0x7fbb24062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:43.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.420+0000 7fbb2a171700 1 --2- 172.21.2.102:0/2692569503 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbb24062740 0x7fbb24062bf0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fbb240654b0 tx=0x7fbb1c0091d0).stop 2021-02-12T17:25:43.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.421+0000 7fbb2a171700 1 -- 172.21.2.102:0/2692569503 shutdown_connections 2021-02-12T17:25:43.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.421+0000 7fbb2a171700 1 --2- 172.21.2.102:0/2692569503 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbb24062740 0x7fbb24062bf0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:43.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.421+0000 7fbb2a171700 1 --2- 172.21.2.102:0/2692569503 >> v2:172.21.2.104:3300/0 conn(0x7fbb2414e530 0x7fbb24068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:43.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.421+0000 7fbb2a171700 1 -- 172.21.2.102:0/2692569503 >> 172.21.2.102:0/2692569503 conn(0x7fbb240bc480 msgr2=0x7fbb240b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:43.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.421+0000 7fbb2a171700 1 -- 172.21.2.102:0/2692569503 shutdown_connections 2021-02-12T17:25:43.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.421+0000 7fbb2a171700 1 -- 172.21.2.102:0/2692569503 wait complete. 2021-02-12T17:25:43.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.422+0000 7fbb2a171700 1 Processor -- start 2021-02-12T17:25:43.423 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.422+0000 7fbb2a171700 1 -- start start 2021-02-12T17:25:43.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.422+0000 7fbb2a171700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbb24062740 0x7fbb24151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:43.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.422+0000 7fbb2a171700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbb240b8d20 0x7fbb240acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:43.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.422+0000 7fbb2a171700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbb2414e530 0x7fbb241607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:43.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.422+0000 7fbb2a171700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240b1860 con 0x7fbb2414e530 2021-02-12T17:25:43.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.422+0000 7fbb2a171700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240b1ac0 con 0x7fbb24062740 2021-02-12T17:25:43.425 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.422+0000 7fbb2a171700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240b1d60 con 0x7fbb240b8d20 2021-02-12T17:25:43.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.422+0000 7fbb23fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbb2414e530 0x7fbb241607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:43.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.422+0000 7fbb23fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbb2414e530 0x7fbb241607d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48698/0 (socket says 172.21.2.102:48698) 2021-02-12T17:25:43.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.422+0000 7fbb23fff700 1 -- 172.21.2.102:0/981322857 learned_addr learned my addr 172.21.2.102:0/981322857 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:43.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.423+0000 7fbb23fff700 1 -- 172.21.2.102:0/981322857 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbb240b8d20 msgr2=0x7fbb240acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:43.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.423+0000 7fbb23fff700 1 --2- 172.21.2.102:0/981322857 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbb240b8d20 0x7fbb240acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:43.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.423+0000 7fbb23fff700 1 -- 172.21.2.102:0/981322857 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbb24062740 msgr2=0x7fbb24151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:43.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.423+0000 7fbb23fff700 1 --2- 172.21.2.102:0/981322857 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbb24062740 0x7fbb24151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:43.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.423+0000 7fbb23fff700 1 -- 172.21.2.102:0/981322857 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb240b2000 con 0x7fbb2414e530 2021-02-12T17:25:43.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.423+0000 7fbb23fff700 1 --2- 172.21.2.102:0/981322857 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbb2414e530 0x7fbb241607d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fbb1c00b750 tx=0x7fbb1c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:43.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.423+0000 7fbb1b7fe700 1 -- 172.21.2.102:0/981322857 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c01c700 con 0x7fbb2414e530 2021-02-12T17:25:43.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.423+0000 7fbb1b7fe700 1 -- 172.21.2.102:0/981322857 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c01c860 con 0x7fbb2414e530 2021-02-12T17:25:43.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.423+0000 7fbb2a171700 1 -- 172.21.2.102:0/981322857 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb240ad900 con 0x7fbb2414e530 2021-02-12T17:25:43.426 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.423+0000 7fbb2a171700 1 -- 172.21.2.102:0/981322857 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb240b24a0 con 0x7fbb2414e530 2021-02-12T17:25:43.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.423+0000 7fbb1b7fe700 1 -- 172.21.2.102:0/981322857 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c01cc00 con 0x7fbb2414e530 2021-02-12T17:25:43.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.424+0000 7fbb2a171700 1 -- 172.21.2.102:0/981322857 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb240b2190 con 0x7fbb2414e530 2021-02-12T17:25:43.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.424+0000 7fbb1b7fe700 1 -- 172.21.2.102:0/981322857 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fbb1c02c070 con 0x7fbb2414e530 2021-02-12T17:25:43.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.424+0000 7fbb1b7fe700 1 --2- 172.21.2.102:0/981322857 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbb08059d60 0x7fbb0805c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:43.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.424+0000 7fbb1b7fe700 1 -- 172.21.2.102:0/981322857 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7795+0+0 (secure 0 0 0) 0x7fbb1c076630 con 0x7fbb2414e530 2021-02-12T17:25:43.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.424+0000 7fbb237fe700 1 --2- 172.21.2.102:0/981322857 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbb08059d60 0x7fbb0805c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:43.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.425+0000 7fbb237fe700 1 --2- 172.21.2.102:0/981322857 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbb08059d60 0x7fbb0805c220 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fbb140011a0 tx=0x7fbb14007690).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:43.427 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.427+0000 7fbb1b7fe700 1 -- 172.21.2.102:0/981322857 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fbb1c049ab0 con 0x7fbb2414e530 2021-02-12T17:25:43.588 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.587+0000 7fbb2a171700 1 -- 172.21.2.102:0/981322857 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb24045460 con 0x7fbb2414e530 2021-02-12T17:25:43.589 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.588+0000 7fbb1b7fe700 1 -- 172.21.2.102:0/981322857 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3407 (secure 0 0 0) 0x7fbb1c020030 con 0x7fbb2414e530 2021-02-12T17:25:43.589 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:43.589 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":64,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:25:39.486584+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5925},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5925":{"gid":5925,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":12,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:43.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.589+0000 7fbb2a171700 1 -- 172.21.2.102:0/981322857 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbb08059d60 msgr2=0x7fbb0805c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:43.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.589+0000 7fbb2a171700 1 --2- 172.21.2.102:0/981322857 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbb08059d60 0x7fbb0805c220 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fbb140011a0 tx=0x7fbb14007690).stop 2021-02-12T17:25:43.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.589+0000 7fbb2a171700 1 -- 172.21.2.102:0/981322857 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbb2414e530 msgr2=0x7fbb241607d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:43.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.589+0000 7fbb2a171700 1 --2- 172.21.2.102:0/981322857 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbb2414e530 0x7fbb241607d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fbb1c00b750 tx=0x7fbb1c017000).stop 2021-02-12T17:25:43.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.589+0000 7fbb2a171700 1 -- 172.21.2.102:0/981322857 shutdown_connections 2021-02-12T17:25:43.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.589+0000 7fbb2a171700 1 --2- 172.21.2.102:0/981322857 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fbb08059d60 0x7fbb0805c220 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:43.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.589+0000 7fbb2a171700 1 --2- 172.21.2.102:0/981322857 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fbb2414e530 0x7fbb241607d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:43.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.589+0000 7fbb2a171700 1 --2- 172.21.2.102:0/981322857 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fbb24062740 0x7fbb24151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:43.590 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.589+0000 7fbb2a171700 1 --2- 172.21.2.102:0/981322857 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fbb240b8d20 0x7fbb240acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:43.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.589+0000 7fbb2a171700 1 -- 172.21.2.102:0/981322857 >> 172.21.2.102:0/981322857 conn(0x7fbb240bc480 msgr2=0x7fbb24062b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:43.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.589+0000 7fbb2a171700 1 -- 172.21.2.102:0/981322857 shutdown_connections 2021-02-12T17:25:43.591 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:43.590+0000 7fbb2a171700 1 -- 172.21.2.102:0/981322857 wait complete. 2021-02-12T17:25:43.591 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 64 2021-02-12T17:25:43.599 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:25:44.240 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:44.329 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.328+0000 7f35c650a700 1 Processor -- start 2021-02-12T17:25:44.329 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.328+0000 7f35c650a700 1 -- start start 2021-02-12T17:25:44.329 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.328+0000 7f35c650a700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7f35c014e530 0x7f35c0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:44.330 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.329+0000 7f35c650a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c0062740 0x7f35c0062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:44.330 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.329+0000 7f35c650a700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c00b7960 con 0x7f35c00b8d20 2021-02-12T17:25:44.330 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.329+0000 7f35c650a700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c0068d20 con 0x7f35c014e530 2021-02-12T17:25:44.330 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.329+0000 7f35c650a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00622a0 con 0x7f35c0062740 2021-02-12T17:25:44.336 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.329+0000 7f35bffff700 1 --1- >> v1:172.21.2.104:6789/0 conn(0x7f35c00b8d20 0x7f35c00b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.104:6789/0 says I am v1:172.21.2.102:39716/0 (socket says 172.21.2.102:39716) 2021-02-12T17:25:44.336 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.329+0000 7f35bffff700 1 -- 172.21.2.102:0/3962226796 learned_addr learned my addr 172.21.2.102:0/3962226796 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:44.336 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.329+0000 7f35c4aa7700 1 --2- 172.21.2.102:0/3962226796 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c0062740 0x7f35c0062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:44.336 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.330+0000 7f35bf7fe700 1 --2- 172.21.2.102:0/3962226796 >> v2:172.21.2.104:3300/0 conn(0x7f35c014e530 0x7f35c0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:44.336 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.330+0000 7f35c4aa7700 1 -- 172.21.2.102:0/3962226796 >> v2:172.21.2.104:3300/0 conn(0x7f35c014e530 msgr2=0x7f35c0068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:44.336 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.330+0000 7f35c4aa7700 1 --2- 172.21.2.102:0/3962226796 >> v2:172.21.2.104:3300/0 conn(0x7f35c014e530 0x7f35c0068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:44.336 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.330+0000 7f35c4aa7700 1 -- 172.21.2.102:0/3962226796 >> v1:172.21.2.104:6789/0 conn(0x7f35c00b8d20 legacy=0x7f35c00b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:44.336 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.330+0000 7f35c4aa7700 1 -- 172.21.2.102:0/3962226796 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c014ea10 con 0x7f35c0062740 2021-02-12T17:25:44.336 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.330+0000 7f35c4aa7700 1 --2- 172.21.2.102:0/3962226796 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c0062740 0x7f35c0062bc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f35b8009c90 tx=0x7f35b80091d0).ready entity=mon.2 client_cookie=6ea29b3cb0728eb7 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:44.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.330+0000 7f35beffd700 1 -- 172.21.2.102:0/3962226796 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800b8e0 con 0x7f35c0062740 2021-02-12T17:25:44.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.330+0000 7f35beffd700 1 -- 172.21.2.102:0/3962226796 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b800ba40 con 0x7f35c0062740 2021-02-12T17:25:44.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.330+0000 7f35beffd700 1 -- 172.21.2.102:0/3962226796 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800bdc0 con 0x7f35c0062740 2021-02-12T17:25:44.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.331+0000 7f35c650a700 1 -- 172.21.2.102:0/3962226796 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c0062740 msgr2=0x7f35c0062bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:44.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.331+0000 7f35c650a700 1 --2- 172.21.2.102:0/3962226796 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c0062740 0x7f35c0062bc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f35b8009c90 tx=0x7f35b80091d0).stop 2021-02-12T17:25:44.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.331+0000 7f35c650a700 1 -- 172.21.2.102:0/3962226796 shutdown_connections 2021-02-12T17:25:44.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.331+0000 7f35c650a700 1 --2- 172.21.2.102:0/3962226796 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c0062740 0x7f35c0062bc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:44.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.331+0000 7f35c650a700 1 --2- 172.21.2.102:0/3962226796 >> v2:172.21.2.104:3300/0 conn(0x7f35c014e530 0x7f35c0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:44.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.331+0000 7f35c650a700 1 -- 172.21.2.102:0/3962226796 >> 172.21.2.102:0/3962226796 conn(0x7f35c00bc480 msgr2=0x7f35c00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:44.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.331+0000 7f35c650a700 1 -- 172.21.2.102:0/3962226796 shutdown_connections 2021-02-12T17:25:44.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.331+0000 7f35c650a700 1 -- 172.21.2.102:0/3962226796 wait complete. 2021-02-12T17:25:44.337 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.332+0000 7f35c650a700 1 Processor -- start 2021-02-12T17:25:44.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.332+0000 7f35c650a700 1 -- start start 2021-02-12T17:25:44.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.332+0000 7f35c650a700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f35c0062740 0x7f35c0160f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:44.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.332+0000 7f35c650a700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35c00b8d20 0x7f35c0153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:44.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.332+0000 7f35c650a700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c014e530 0x7f35c015cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:44.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.332+0000 7f35c650a700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c01605a0 con 0x7f35c00b8d20 2021-02-12T17:25:44.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.332+0000 7f35c650a700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00b0840 con 0x7f35c0062740 2021-02-12T17:25:44.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.332+0000 7f35c650a700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00b4ee0 con 0x7f35c014e530 2021-02-12T17:25:44.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.332+0000 7f35bf7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35c00b8d20 0x7f35c0153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:44.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.332+0000 7f35bf7fe700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35c00b8d20 0x7f35c0153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48712/0 (socket says 172.21.2.102:48712) 2021-02-12T17:25:44.338 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.333+0000 7f35bf7fe700 1 -- 172.21.2.102:0/3675824220 learned_addr learned my addr 172.21.2.102:0/3675824220 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:44.339 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.333+0000 7f35bf7fe700 1 -- 172.21.2.102:0/3675824220 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c014e530 msgr2=0x7f35c015cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:44.339 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.333+0000 7f35bf7fe700 1 --2- 172.21.2.102:0/3675824220 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c014e530 0x7f35c015cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:44.339 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.333+0000 7f35bf7fe700 1 -- 172.21.2.102:0/3675824220 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f35c0062740 msgr2=0x7f35c0160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:44.339 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.333+0000 7f35bf7fe700 1 --2- 172.21.2.102:0/3675824220 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f35c0062740 0x7f35c0160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:44.339 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.333+0000 7f35bf7fe700 1 -- 172.21.2.102:0/3675824220 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c00b5180 con 0x7f35c00b8d20 2021-02-12T17:25:44.339 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.333+0000 7f35bf7fe700 1 --2- 172.21.2.102:0/3675824220 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35c00b8d20 0x7f35c0153ac0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f35b000ebd0 tx=0x7f35b0006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:44.339 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.333+0000 7f35b7fff700 1 -- 172.21.2.102:0/3675824220 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b000b840 con 0x7f35c00b8d20 2021-02-12T17:25:44.339 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.333+0000 7f35b7fff700 1 -- 172.21.2.102:0/3675824220 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b000b9a0 con 0x7f35c00b8d20 2021-02-12T17:25:44.339 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.333+0000 7f35b7fff700 1 -- 172.21.2.102:0/3675824220 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b000bd20 con 0x7f35c00b8d20 2021-02-12T17:25:44.339 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.333+0000 7f35c650a700 1 -- 172.21.2.102:0/3675824220 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c01607d0 con 0x7f35c00b8d20 2021-02-12T17:25:44.339 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.333+0000 7f35c650a700 1 -- 172.21.2.102:0/3675824220 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c0161400 con 0x7f35c00b8d20 2021-02-12T17:25:44.339 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.334+0000 7f35c650a700 1 -- 172.21.2.102:0/3675824220 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c0160c30 con 0x7f35c00b8d20 2021-02-12T17:25:44.339 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.334+0000 7f35b7fff700 1 -- 172.21.2.102:0/3675824220 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7f35b0012600 con 0x7f35c00b8d20 2021-02-12T17:25:44.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.334+0000 7f35b7fff700 1 --2- 172.21.2.102:0/3675824220 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f35a4059d30 0x7f35a405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:44.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.334+0000 7f35b7fff700 1 -- 172.21.2.102:0/3675824220 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7795+0+0 (secure 0 0 0) 0x7f35b0074450 con 0x7f35c00b8d20 2021-02-12T17:25:44.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.334+0000 7f35bffff700 1 --2- 172.21.2.102:0/3675824220 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f35a4059d30 0x7f35a405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:44.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.335+0000 7f35bffff700 1 --2- 172.21.2.102:0/3675824220 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f35a4059d30 0x7f35a405c1f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f35a8001470 tx=0x7f35a8007740).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:44.340 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.337+0000 7f35b7fff700 1 -- 172.21.2.102:0/3675824220 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7f35b00477c0 con 0x7f35c00b8d20 2021-02-12T17:25:44.390 INFO:tasks.ceph.mds.a.gibba002.stderr:2021-02-12T17:25:44.390+0000 7f8774c6f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-02-12T17:25:44.497 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.497+0000 7f35c650a700 1 -- 172.21.2.102:0/3675824220 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35c0045460 con 0x7f35c00b8d20 2021-02-12T17:25:44.498 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.497+0000 7f35b7fff700 1 -- 172.21.2.102:0/3675824220 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3407 (secure 0 0 0) 0x7f35b004ade0 con 0x7f35c00b8d20 2021-02-12T17:25:44.498 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:44.498 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":64,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:25:39.486584+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5925},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5925":{"gid":5925,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":12,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.499+0000 7f35c650a700 1 -- 172.21.2.102:0/3675824220 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f35a4059d30 msgr2=0x7f35a405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.499+0000 7f35c650a700 1 --2- 172.21.2.102:0/3675824220 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f35a4059d30 0x7f35a405c1f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f35a8001470 tx=0x7f35a8007740).stop 2021-02-12T17:25:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.499+0000 7f35c650a700 1 -- 172.21.2.102:0/3675824220 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35c00b8d20 msgr2=0x7f35c0153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.499+0000 7f35c650a700 1 --2- 172.21.2.102:0/3675824220 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35c00b8d20 0x7f35c0153ac0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f35b000ebd0 tx=0x7f35b0006de0).stop 2021-02-12T17:25:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.499+0000 7f35c650a700 1 -- 172.21.2.102:0/3675824220 shutdown_connections 2021-02-12T17:25:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.499+0000 7f35c650a700 1 --2- 172.21.2.102:0/3675824220 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7f35c014e530 0x7f35c015cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.499+0000 7f35c650a700 1 --2- 172.21.2.102:0/3675824220 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7f35c0062740 0x7f35c0160f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.499+0000 7f35c650a700 1 --2- 172.21.2.102:0/3675824220 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7f35a4059d30 0x7f35a405c1f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:44.500 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.499+0000 7f35c650a700 1 --2- 172.21.2.102:0/3675824220 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7f35c00b8d20 0x7f35c0153ac0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.499+0000 7f35c650a700 1 -- 172.21.2.102:0/3675824220 >> 172.21.2.102:0/3675824220 conn(0x7f35c00bc480 msgr2=0x7f35c0151810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.499+0000 7f35c650a700 1 -- 172.21.2.102:0/3675824220 shutdown_connections 2021-02-12T17:25:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:44.499+0000 7f35c650a700 1 -- 172.21.2.102:0/3675824220 wait complete. 2021-02-12T17:25:44.501 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 64 2021-02-12T17:25:44.509 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2021-02-12T17:25:45.600 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:45.689 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.688+0000 7fc17bef9700 1 Processor -- start 2021-02-12T17:25:45.689 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.689+0000 7fc17bef9700 1 -- start start 2021-02-12T17:25:45.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.689+0000 7fc17bef9700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fc1740b8d20 0x7fc174068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:45.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.689+0000 7fc17bef9700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fc17414e530 0x7fc1740b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:45.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.689+0000 7fc17bef9700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1740622a0 con 0x7fc174062740 2021-02-12T17:25:45.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.689+0000 7fc17bef9700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc174068d20 con 0x7fc1740b8d20 2021-02-12T17:25:45.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.689+0000 7fc17bef9700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17414ea10 con 0x7fc17414e530 2021-02-12T17:25:45.691 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.689+0000 7fc179c95700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fc1740b8d20 0x7fc174068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.689+0000 7fc179c95700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fc1740b8d20 0x7fc174068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48716/0 (socket says 172.21.2.102:48716) 2021-02-12T17:25:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.689+0000 7fc179c95700 1 -- 172.21.2.102:0/1201961580 learned_addr learned my addr 172.21.2.102:0/1201961580 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.689+0000 7fc179c95700 1 -- 172.21.2.102:0/1201961580 >> v2:172.21.2.104:3300/0 conn(0x7fc17414e530 msgr2=0x7fc1740b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:25:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.689+0000 7fc179c95700 1 --2- 172.21.2.102:0/1201961580 >> v2:172.21.2.104:3300/0 conn(0x7fc17414e530 0x7fc1740b7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc179c95700 1 -- 172.21.2.102:0/1201961580 >> v1:172.21.2.102:6789/0 conn(0x7fc174062740 legacy=0x7fc174062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc178c93700 1 -- 172.21.2.102:0/1201961580 <== mon.0 v1:172.21.2.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858555724 0 0) 0x7fc1740622a0 con 0x7fc174062740 2021-02-12T17:25:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc179c95700 1 -- 172.21.2.102:0/1201961580 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740b63f0 con 0x7fc1740b8d20 2021-02-12T17:25:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc179c95700 1 --2- 172.21.2.102:0/1201961580 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc1740b8d20 0x7fc174068830 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fc1740654b0 tx=0x7fc170006ea0).ready entity=mon.0 client_cookie=764330b7115b7b73 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc178c93700 1 -- 172.21.2.102:0/1201961580 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170009840 con 0x7fc1740b8d20 2021-02-12T17:25:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc178c93700 1 -- 172.21.2.102:0/1201961580 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1700099a0 con 0x7fc1740b8d20 2021-02-12T17:25:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc178c93700 1 -- 172.21.2.102:0/1201961580 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170009d20 con 0x7fc1740b8d20 2021-02-12T17:25:45.692 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc17bef9700 1 -- 172.21.2.102:0/1201961580 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc1740b8d20 msgr2=0x7fc174068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:45.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc17bef9700 1 --2- 172.21.2.102:0/1201961580 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc1740b8d20 0x7fc174068830 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fc1740654b0 tx=0x7fc170006ea0).stop 2021-02-12T17:25:45.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc17bef9700 1 -- 172.21.2.102:0/1201961580 shutdown_connections 2021-02-12T17:25:45.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc17bef9700 1 --2- 172.21.2.102:0/1201961580 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc1740b8d20 0x7fc174068830 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:45.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc17bef9700 1 --2- 172.21.2.102:0/1201961580 >> v2:172.21.2.104:3300/0 conn(0x7fc17414e530 0x7fc1740b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:45.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc17bef9700 1 -- 172.21.2.102:0/1201961580 >> 172.21.2.102:0/1201961580 conn(0x7fc1740bc480 msgr2=0x7fc1740b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:45.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc17bef9700 1 -- 172.21.2.102:0/1201961580 shutdown_connections 2021-02-12T17:25:45.693 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.690+0000 7fc17bef9700 1 -- 172.21.2.102:0/1201961580 wait complete. 2021-02-12T17:25:45.695 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.691+0000 7fc17bef9700 1 Processor -- start 2021-02-12T17:25:45.695 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.691+0000 7fc17bef9700 1 -- start start 2021-02-12T17:25:45.695 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc17bef9700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc174062740 0x7fc1740b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:45.695 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc17bef9700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc1740b8d20 0x7fc1740b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:45.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc17bef9700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc17414e530 0x7fc1740b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:45.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc17bef9700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740aebd0 con 0x7fc174062740 2021-02-12T17:25:45.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc17bef9700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740b0cc0 con 0x7fc1740b8d20 2021-02-12T17:25:45.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc17bef9700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17415e210 con 0x7fc17414e530 2021-02-12T17:25:45.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc179c95700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc174062740 0x7fc1740b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:45.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc179c95700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc174062740 0x7fc1740b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48722/0 (socket says 172.21.2.102:48722) 2021-02-12T17:25:45.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc179c95700 1 -- 172.21.2.102:0/737610589 learned_addr learned my addr 172.21.2.102:0/737610589 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:45.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc179c95700 1 -- 172.21.2.102:0/737610589 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc17414e530 msgr2=0x7fc1740b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:45.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc179c95700 1 --2- 172.21.2.102:0/737610589 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc17414e530 0x7fc1740b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:45.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc179c95700 1 -- 172.21.2.102:0/737610589 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc1740b8d20 msgr2=0x7fc1740b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:45.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc179c95700 1 --2- 172.21.2.102:0/737610589 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc1740b8d20 0x7fc1740b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:45.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc179c95700 1 -- 172.21.2.102:0/737610589 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740b4e80 con 0x7fc174062740 2021-02-12T17:25:45.696 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc179c95700 1 --2- 172.21.2.102:0/737610589 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc174062740 0x7fc1740b00e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fc1740653c0 tx=0x7fc170016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:45.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc165ffb700 1 -- 172.21.2.102:0/737610589 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17001c420 con 0x7fc174062740 2021-02-12T17:25:45.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc165ffb700 1 -- 172.21.2.102:0/737610589 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17001c580 con 0x7fc174062740 2021-02-12T17:25:45.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc17bef9700 1 -- 172.21.2.102:0/737610589 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1740b5120 con 0x7fc174062740 2021-02-12T17:25:45.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.692+0000 7fc165ffb700 1 -- 172.21.2.102:0/737610589 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17001c900 con 0x7fc174062740 2021-02-12T17:25:45.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.693+0000 7fc17bef9700 1 -- 172.21.2.102:0/737610589 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1740b53c0 con 0x7fc174062740 2021-02-12T17:25:45.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.693+0000 7fc17bef9700 1 -- 172.21.2.102:0/737610589 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1740b0e30 con 0x7fc174062740 2021-02-12T17:25:45.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.694+0000 7fc165ffb700 1 -- 172.21.2.102:0/737610589 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fc17000f070 con 0x7fc174062740 2021-02-12T17:25:45.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.694+0000 7fc165ffb700 1 --2- 172.21.2.102:0/737610589 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc154059d30 0x7fc15405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:45.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.694+0000 7fc165ffb700 1 -- 172.21.2.102:0/737610589 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7795+0+0 (secure 0 0 0) 0x7fc1700758c0 con 0x7fc174062740 2021-02-12T17:25:45.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.694+0000 7fc179494700 1 --2- 172.21.2.102:0/737610589 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc154059d30 0x7fc15405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:45.697 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.694+0000 7fc179494700 1 --2- 172.21.2.102:0/737610589 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc154059d30 0x7fc15405c1f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fc1740bb0c0 tx=0x7fc168006900).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:45.698 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.697+0000 7fc165ffb700 1 -- 172.21.2.102:0/737610589 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fc1740b0e30 con 0x7fc174062740 2021-02-12T17:25:45.858 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.858+0000 7fc17bef9700 1 -- 172.21.2.102:0/737610589 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1740b0e30 con 0x7fc174062740 2021-02-12T17:25:45.859 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.858+0000 7fc165ffb700 1 -- 172.21.2.102:0/737610589 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3407 (secure 0 0 0) 0x7fc170048c30 con 0x7fc174062740 2021-02-12T17:25:45.859 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:45.859 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":64,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:25:39.486584+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5925},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5925":{"gid":5925,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":12,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:24:59.797709+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":28,"addr":"172.21.2.102:6837/3756112970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6836","nonce":3756112970},{"type":"v1","addr":"172.21.2.102:6837","nonce":3756112970}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:45.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.860+0000 7fc17bef9700 1 -- 172.21.2.102:0/737610589 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc154059d30 msgr2=0x7fc15405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:45.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.860+0000 7fc17bef9700 1 --2- 172.21.2.102:0/737610589 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc154059d30 0x7fc15405c1f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fc1740bb0c0 tx=0x7fc168006900).stop 2021-02-12T17:25:45.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.860+0000 7fc17bef9700 1 -- 172.21.2.102:0/737610589 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc174062740 msgr2=0x7fc1740b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:45.860 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.860+0000 7fc17bef9700 1 --2- 172.21.2.102:0/737610589 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc174062740 0x7fc1740b00e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fc1740653c0 tx=0x7fc170016000).stop 2021-02-12T17:25:45.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.860+0000 7fc17bef9700 1 -- 172.21.2.102:0/737610589 shutdown_connections 2021-02-12T17:25:45.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.860+0000 7fc17bef9700 1 --2- 172.21.2.102:0/737610589 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc17414e530 0x7fc1740b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:45.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.860+0000 7fc17bef9700 1 --2- 172.21.2.102:0/737610589 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc154059d30 0x7fc15405c1f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:45.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.860+0000 7fc17bef9700 1 --2- 172.21.2.102:0/737610589 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc174062740 0x7fc1740b00e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:45.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.860+0000 7fc17bef9700 1 --2- 172.21.2.102:0/737610589 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc1740b8d20 0x7fc1740b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:45.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.860+0000 7fc17bef9700 1 -- 172.21.2.102:0/737610589 >> 172.21.2.102:0/737610589 conn(0x7fc1740bc480 msgr2=0x7fc174151990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:45.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.860+0000 7fc17bef9700 1 -- 172.21.2.102:0/737610589 shutdown_connections 2021-02-12T17:25:45.861 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:45.860+0000 7fc17bef9700 1 -- 172.21.2.102:0/737610589 wait complete. 2021-02-12T17:25:45.862 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 64 2021-02-12T17:25:45.869 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2021-02-12T17:25:46.510 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:46.599 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.599+0000 7fe8baa7c700 1 Processor -- start 2021-02-12T17:25:46.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.599+0000 7fe8baa7c700 1 -- start start 2021-02-12T17:25:46.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.600+0000 7fe8baa7c700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fe8b40b8d20 0x7fe8b4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:46.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.600+0000 7fe8baa7c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 0x7fe8b40b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:46.600 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.600+0000 7fe8baa7c700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b40622a0 con 0x7fe8b4062740 2021-02-12T17:25:46.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.600+0000 7fe8baa7c700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b4068d20 con 0x7fe8b40b8d20 2021-02-12T17:25:46.601 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.600+0000 7fe8baa7c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b414ea10 con 0x7fe8b414e530 2021-02-12T17:25:46.602 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.600+0000 7fe8b8818700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fe8b40b8d20 0x7fe8b4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:46.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.600+0000 7fe8b8818700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fe8b40b8d20 0x7fe8b4068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.104:3300/0 says I am v2:172.21.2.102:47090/0 (socket says 172.21.2.102:47090) 2021-02-12T17:25:46.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.600+0000 7fe8b8818700 1 -- 172.21.2.102:0/2286245992 learned_addr learned my addr 172.21.2.102:0/2286245992 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:46.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.600+0000 7fe8b3fff700 1 --2- 172.21.2.102:0/2286245992 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 0x7fe8b40b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:46.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.601+0000 7fe8b37fe700 1 -- 172.21.2.102:0/2286245992 <== mon.1 v1:172.21.2.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743638863 0 0) 0x7fe8b40622a0 con 0x7fe8b4062740 2021-02-12T17:25:46.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.601+0000 7fe8b37fe700 1 -- 172.21.2.102:0/2286245992 --> v1:172.21.2.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe894003230 con 0x7fe8b4062740 2021-02-12T17:25:46.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.601+0000 7fe8b3fff700 1 -- 172.21.2.102:0/2286245992 >> v2:172.21.2.104:3300/0 conn(0x7fe8b40b8d20 msgr2=0x7fe8b4068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:46.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.601+0000 7fe8b3fff700 1 --2- 172.21.2.102:0/2286245992 >> v2:172.21.2.104:3300/0 conn(0x7fe8b40b8d20 0x7fe8b4068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:46.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.601+0000 7fe8b3fff700 1 -- 172.21.2.102:0/2286245992 >> v1:172.21.2.104:6789/0 conn(0x7fe8b4062740 legacy=0x7fe8b4062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:46.603 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.601+0000 7fe8b3fff700 1 -- 172.21.2.102:0/2286245992 --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b40b63f0 con 0x7fe8b414e530 2021-02-12T17:25:46.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.601+0000 7fe8b8818700 1 --2- 172.21.2.102:0/2286245992 >> v2:172.21.2.104:3300/0 conn(0x7fe8b40b8d20 0x7fe8b4068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-12T17:25:46.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.601+0000 7fe8b3fff700 1 --2- 172.21.2.102:0/2286245992 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 0x7fe8b40b7250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe8a400b980 tx=0x7fe8a4006de0).ready entity=mon.2 client_cookie=787993f989df3671 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:46.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.601+0000 7fe8b37fe700 1 -- 172.21.2.102:0/2286245992 <== mon.2 v2:172.21.2.104:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40095c0 con 0x7fe8b414e530 2021-02-12T17:25:46.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.601+0000 7fe8b37fe700 1 -- 172.21.2.102:0/2286245992 <== mon.2 v2:172.21.2.104:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a4009720 con 0x7fe8b414e530 2021-02-12T17:25:46.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.601+0000 7fe8b37fe700 1 -- 172.21.2.102:0/2286245992 <== mon.2 v2:172.21.2.104:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4009aa0 con 0x7fe8b414e530 2021-02-12T17:25:46.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.602+0000 7fe8baa7c700 1 -- 172.21.2.102:0/2286245992 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 msgr2=0x7fe8b40b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:46.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.602+0000 7fe8baa7c700 1 --2- 172.21.2.102:0/2286245992 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 0x7fe8b40b7250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe8a400b980 tx=0x7fe8a4006de0).stop 2021-02-12T17:25:46.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.602+0000 7fe8baa7c700 1 -- 172.21.2.102:0/2286245992 shutdown_connections 2021-02-12T17:25:46.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.602+0000 7fe8baa7c700 1 --2- 172.21.2.102:0/2286245992 >> v2:172.21.2.104:3300/0 conn(0x7fe8b40b8d20 0x7fe8b4068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:46.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.602+0000 7fe8baa7c700 1 --2- 172.21.2.102:0/2286245992 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 0x7fe8b40b7250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:46.604 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.602+0000 7fe8baa7c700 1 -- 172.21.2.102:0/2286245992 >> 172.21.2.102:0/2286245992 conn(0x7fe8b40bc480 msgr2=0x7fe8b40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:46.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.602+0000 7fe8baa7c700 1 -- 172.21.2.102:0/2286245992 shutdown_connections 2021-02-12T17:25:46.605 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.602+0000 7fe8baa7c700 1 -- 172.21.2.102:0/2286245992 wait complete. 2021-02-12T17:25:46.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.603+0000 7fe8baa7c700 1 Processor -- start 2021-02-12T17:25:46.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.603+0000 7fe8baa7c700 1 -- start start 2021-02-12T17:25:46.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.603+0000 7fe8baa7c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b4062740 0x7fe8b40b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:46.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.603+0000 7fe8baa7c700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b40b8d20 0x7fe8b40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:46.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.603+0000 7fe8baa7c700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 0x7fe8b40b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:46.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.603+0000 7fe8baa7c700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b40ae7c0 con 0x7fe8b4062740 2021-02-12T17:25:46.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.603+0000 7fe8baa7c700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b40aea60 con 0x7fe8b40b8d20 2021-02-12T17:25:46.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.603+0000 7fe8baa7c700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b40aff90 con 0x7fe8b414e530 2021-02-12T17:25:46.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.603+0000 7fe8b8818700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b4062740 0x7fe8b40b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:46.607 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.603+0000 7fe8b8818700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b4062740 0x7fe8b40b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48740/0 (socket says 172.21.2.102:48740) 2021-02-12T17:25:46.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.603+0000 7fe8b8818700 1 -- 172.21.2.102:0/194572358 learned_addr learned my addr 172.21.2.102:0/194572358 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:46.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.603+0000 7fe8b3fff700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b40b8d20 0x7fe8b40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:46.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.604+0000 7fe8b9019700 1 --2- 172.21.2.102:0/194572358 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 0x7fe8b40b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:46.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.604+0000 7fe8b8818700 1 -- 172.21.2.102:0/194572358 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 msgr2=0x7fe8b40b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:46.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.604+0000 7fe8b8818700 1 --2- 172.21.2.102:0/194572358 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 0x7fe8b40b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:46.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.604+0000 7fe8b8818700 1 -- 172.21.2.102:0/194572358 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b40b8d20 msgr2=0x7fe8b40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:46.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.604+0000 7fe8b8818700 1 --2- 172.21.2.102:0/194572358 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b40b8d20 0x7fe8b40b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:46.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.604+0000 7fe8b8818700 1 -- 172.21.2.102:0/194572358 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b40b0230 con 0x7fe8b4062740 2021-02-12T17:25:46.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.604+0000 7fe8b8818700 1 --2- 172.21.2.102:0/194572358 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b4062740 0x7fe8b40b49b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fe89c00ed20 tx=0x7fe89c006ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:46.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.604+0000 7fe8b0ff9700 1 -- 172.21.2.102:0/194572358 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c00ee80 con 0x7fe8b4062740 2021-02-12T17:25:46.608 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.604+0000 7fe8b0ff9700 1 -- 172.21.2.102:0/194572358 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c00cc10 con 0x7fe8b4062740 2021-02-12T17:25:46.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.604+0000 7fe8b0ff9700 1 -- 172.21.2.102:0/194572358 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0123f0 con 0x7fe8b4062740 2021-02-12T17:25:46.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.604+0000 7fe8baa7c700 1 -- 172.21.2.102:0/194572358 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b40b04d0 con 0x7fe8b4062740 2021-02-12T17:25:46.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.604+0000 7fe8baa7c700 1 -- 172.21.2.102:0/194572358 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b40b25e0 con 0x7fe8b4062740 2021-02-12T17:25:46.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.605+0000 7fe8baa7c700 1 -- 172.21.2.102:0/194572358 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b40b0660 con 0x7fe8b4062740 2021-02-12T17:25:46.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.605+0000 7fe8b0ff9700 1 -- 172.21.2.102:0/194572358 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fe89c022070 con 0x7fe8b4062740 2021-02-12T17:25:46.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.605+0000 7fe8b0ff9700 1 --2- 172.21.2.102:0/194572358 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe898059d80 0x7fe89805c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:46.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.605+0000 7fe8b0ff9700 1 -- 172.21.2.102:0/194572358 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7881+0+0 (secure 0 0 0) 0x7fe89c074760 con 0x7fe8b4062740 2021-02-12T17:25:46.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.605+0000 7fe8b3fff700 1 --2- 172.21.2.102:0/194572358 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe898059d80 0x7fe89805c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:46.609 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.605+0000 7fe8b3fff700 1 --2- 172.21.2.102:0/194572358 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe898059d80 0x7fe89805c240 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fe8a4007fd0 tx=0x7fe8a4016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:46.610 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.608+0000 7fe8b0ff9700 1 -- 172.21.2.102:0/194572358 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fe89c047b00 con 0x7fe8b4062740 2021-02-12T17:25:46.769 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.769+0000 7fe8baa7c700 1 -- 172.21.2.102:0/194572358 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8b4045460 con 0x7fe8b4062740 2021-02-12T17:25:46.770 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.769+0000 7fe8b0ff9700 1 -- 172.21.2.102:0/194572358 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+3406 (secure 0 0 0) 0x7fe89c016030 con 0x7fe8b4062740 2021-02-12T17:25:46.770 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:46.770 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":65,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:25:39.486584+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5925},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5925":{"gid":5925,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":12,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":65,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:25:46.373216+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5038},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5038":{"gid":5038,"name":"d","rank":0,"incarnation":65,"state":"up:replay","state_seq":2,"addr":"172.21.2.104:6835/1960750274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":1960750274},{"type":"v1","addr":"172.21.2.104:6835","nonce":1960750274}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:46.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.770+0000 7fe8baa7c700 1 -- 172.21.2.102:0/194572358 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe898059d80 msgr2=0x7fe89805c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:46.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.770+0000 7fe8baa7c700 1 --2- 172.21.2.102:0/194572358 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe898059d80 0x7fe89805c240 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fe8a4007fd0 tx=0x7fe8a4016000).stop 2021-02-12T17:25:46.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.770+0000 7fe8baa7c700 1 -- 172.21.2.102:0/194572358 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b4062740 msgr2=0x7fe8b40b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:46.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.770+0000 7fe8baa7c700 1 --2- 172.21.2.102:0/194572358 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b4062740 0x7fe8b40b49b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fe89c00ed20 tx=0x7fe89c006ea0).stop 2021-02-12T17:25:46.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.771+0000 7fe8baa7c700 1 -- 172.21.2.102:0/194572358 shutdown_connections 2021-02-12T17:25:46.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.771+0000 7fe8baa7c700 1 --2- 172.21.2.102:0/194572358 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fe8b414e530 0x7fe8b40b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:46.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.771+0000 7fe8baa7c700 1 --2- 172.21.2.102:0/194572358 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fe898059d80 0x7fe89805c240 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:46.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.771+0000 7fe8baa7c700 1 --2- 172.21.2.102:0/194572358 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fe8b4062740 0x7fe8b40b49b0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:46.771 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.771+0000 7fe8baa7c700 1 --2- 172.21.2.102:0/194572358 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fe8b40b8d20 0x7fe8b40b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:46.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.771+0000 7fe8baa7c700 1 -- 172.21.2.102:0/194572358 >> 172.21.2.102:0/194572358 conn(0x7fe8b40bc480 msgr2=0x7fe8b41519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:46.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.771+0000 7fe8baa7c700 1 -- 172.21.2.102:0/194572358 shutdown_connections 2021-02-12T17:25:46.772 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:46.771+0000 7fe8baa7c700 1 -- 172.21.2.102:0/194572358 wait complete. 2021-02-12T17:25:46.772 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 65 2021-02-12T17:25:46.779 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2021-02-12T17:25:47.870 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:47.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.958+0000 7fc4b4fd7700 1 Processor -- start 2021-02-12T17:25:47.958 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.958+0000 7fc4b4fd7700 1 -- start start 2021-02-12T17:25:47.959 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.958+0000 7fc4b4fd7700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7fc4b00b8d20 0x7fc4b0068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:47.959 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.958+0000 7fc4b4fd7700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fc4b0062740 0x7fc4b0062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:47.959 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.958+0000 7fc4b4fd7700 1 -- --> v1:172.21.2.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b00b7960 con 0x7fc4b014e530 2021-02-12T17:25:47.959 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.958+0000 7fc4b4fd7700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b0068d20 con 0x7fc4b0062740 2021-02-12T17:25:47.959 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.958+0000 7fc4b4fd7700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b00622a0 con 0x7fc4b00b8d20 2021-02-12T17:25:47.959 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.959+0000 7fc4aed9d700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fc4b0062740 0x7fc4b0062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:47.960 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.959+0000 7fc4a7fff700 1 --1- >> v1:172.21.2.102:6789/0 conn(0x7fc4b014e530 0x7fc4b00b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.102:6789/0 says I am v1:172.21.2.102:57388/0 (socket says 172.21.2.102:57388) 2021-02-12T17:25:47.960 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.959+0000 7fc4a7fff700 1 -- 172.21.2.102:0/3802762266 learned_addr learned my addr 172.21.2.102:0/3802762266 (peer_addr_for_me v1:172.21.2.102:0/0) 2021-02-12T17:25:47.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.959+0000 7fc4ae59c700 1 --2- 172.21.2.102:0/3802762266 >> v2:172.21.2.104:3300/0 conn(0x7fc4b00b8d20 0x7fc4b0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:47.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.959+0000 7fc4aed9d700 1 -- 172.21.2.102:0/3802762266 >> v2:172.21.2.104:3300/0 conn(0x7fc4b00b8d20 msgr2=0x7fc4b0068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-12T17:25:47.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.959+0000 7fc4aed9d700 1 --2- 172.21.2.102:0/3802762266 >> v2:172.21.2.104:3300/0 conn(0x7fc4b00b8d20 0x7fc4b0068830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:47.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.959+0000 7fc4aed9d700 1 -- 172.21.2.102:0/3802762266 >> v1:172.21.2.102:6789/0 conn(0x7fc4b014e530 legacy=0x7fc4b00b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:47.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.959+0000 7fc4aed9d700 1 -- 172.21.2.102:0/3802762266 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b014ea10 con 0x7fc4b0062740 2021-02-12T17:25:47.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.959+0000 7fc4ae59c700 1 --2- 172.21.2.102:0/3802762266 >> v2:172.21.2.104:3300/0 conn(0x7fc4b00b8d20 0x7fc4b0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:47.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.959+0000 7fc4aed9d700 1 --2- 172.21.2.102:0/3802762266 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc4b0062740 0x7fc4b0062bf0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fc4b006abc0 tx=0x7fc4a80091d0).ready entity=mon.0 client_cookie=3e66493de10ca93a server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:47.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.959+0000 7fc4add9b700 1 -- 172.21.2.102:0/3802762266 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8009e70 con 0x7fc4b0062740 2021-02-12T17:25:47.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.960+0000 7fc4add9b700 1 -- 172.21.2.102:0/3802762266 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a800bbf0 con 0x7fc4b0062740 2021-02-12T17:25:47.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.960+0000 7fc4add9b700 1 -- 172.21.2.102:0/3802762266 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8011400 con 0x7fc4b0062740 2021-02-12T17:25:47.961 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.960+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/3802762266 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc4b0062740 msgr2=0x7fc4b0062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:47.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.960+0000 7fc4b4fd7700 1 --2- 172.21.2.102:0/3802762266 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc4b0062740 0x7fc4b0062bf0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fc4b006abc0 tx=0x7fc4a80091d0).stop 2021-02-12T17:25:47.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.960+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/3802762266 shutdown_connections 2021-02-12T17:25:47.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.960+0000 7fc4b4fd7700 1 --2- 172.21.2.102:0/3802762266 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc4b0062740 0x7fc4b0062bf0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:47.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.960+0000 7fc4b4fd7700 1 --2- 172.21.2.102:0/3802762266 >> v2:172.21.2.104:3300/0 conn(0x7fc4b00b8d20 0x7fc4b0068830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:47.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.960+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/3802762266 >> 172.21.2.102:0/3802762266 conn(0x7fc4b00bc480 msgr2=0x7fc4b00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:47.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.960+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/3802762266 shutdown_connections 2021-02-12T17:25:47.962 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.960+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/3802762266 wait complete. 2021-02-12T17:25:47.963 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.961+0000 7fc4b4fd7700 1 Processor -- start 2021-02-12T17:25:47.963 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.961+0000 7fc4b4fd7700 1 -- start start 2021-02-12T17:25:47.963 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4b4fd7700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc4b0062740 0x7fc4b00ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:47.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4b4fd7700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc4b00b8d20 0x7fc4b00adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:47.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4b4fd7700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc4b014e530 0x7fc4b014ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:47.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4b4fd7700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00b5910 con 0x7fc4b0062740 2021-02-12T17:25:47.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4b4fd7700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00aed90 con 0x7fc4b014e530 2021-02-12T17:25:47.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4b4fd7700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00aeaf0 con 0x7fc4b00b8d20 2021-02-12T17:25:47.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4ae59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc4b0062740 0x7fc4b00ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:47.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4ae59c700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc4b0062740 0x7fc4b00ae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48752/0 (socket says 172.21.2.102:48752) 2021-02-12T17:25:47.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4ae59c700 1 -- 172.21.2.102:0/4172147123 learned_addr learned my addr 172.21.2.102:0/4172147123 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:47.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4ae59c700 1 -- 172.21.2.102:0/4172147123 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc4b00b8d20 msgr2=0x7fc4b00adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:47.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4ae59c700 1 --2- 172.21.2.102:0/4172147123 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc4b00b8d20 0x7fc4b00adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:47.964 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4ae59c700 1 -- 172.21.2.102:0/4172147123 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc4b014e530 msgr2=0x7fc4b014ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:47.965 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4ae59c700 1 --2- 172.21.2.102:0/4172147123 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc4b014e530 0x7fc4b014ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:47.965 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4ae59c700 1 -- 172.21.2.102:0/4172147123 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b00b4bb0 con 0x7fc4b0062740 2021-02-12T17:25:47.965 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4ae59c700 1 --2- 172.21.2.102:0/4172147123 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc4b0062740 0x7fc4b00ae500 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fc4a000cb50 tx=0x7fc4a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:47.965 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4a67fc700 1 -- 172.21.2.102:0/4172147123 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0007740 con 0x7fc4b0062740 2021-02-12T17:25:47.965 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4a67fc700 1 -- 172.21.2.102:0/4172147123 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a00078a0 con 0x7fc4b0062740 2021-02-12T17:25:47.965 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/4172147123 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b00b4e50 con 0x7fc4b0062740 2021-02-12T17:25:47.965 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4a67fc700 1 -- 172.21.2.102:0/4172147123 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0007c20 con 0x7fc4b0062740 2021-02-12T17:25:47.965 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.962+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/4172147123 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b00b5590 con 0x7fc4b0062740 2021-02-12T17:25:47.965 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.963+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/4172147123 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b00bb820 con 0x7fc4b0062740 2021-02-12T17:25:47.966 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.963+0000 7fc4a67fc700 1 -- 172.21.2.102:0/4172147123 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fc4a001b460 con 0x7fc4b0062740 2021-02-12T17:25:47.966 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.964+0000 7fc4a67fc700 1 --2- 172.21.2.102:0/4172147123 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc494059d30 0x7fc49405c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:47.966 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.964+0000 7fc4a67fc700 1 -- 172.21.2.102:0/4172147123 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7881+0+0 (secure 0 0 0) 0x7fc4a0074280 con 0x7fc4b0062740 2021-02-12T17:25:47.966 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.964+0000 7fc4a7fff700 1 --2- 172.21.2.102:0/4172147123 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc494059d30 0x7fc49405c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:47.966 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.964+0000 7fc4a7fff700 1 --2- 172.21.2.102:0/4172147123 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc494059d30 0x7fc49405c1f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fc498001290 tx=0x7fc498007850).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:47.967 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:47.966+0000 7fc4a67fc700 1 -- 172.21.2.102:0/4172147123 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fc4a0047650 con 0x7fc4b0062740 2021-02-12T17:25:48.122 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.122+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/4172147123 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4b00b52b0 con 0x7fc4b0062740 2021-02-12T17:25:48.123 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.122+0000 7fc4a67fc700 1 -- 172.21.2.102:0/4172147123 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+3409 (secure 0 0 0) 0x7fc4a004ac70 con 0x7fc4b0062740 2021-02-12T17:25:48.123 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:48.123 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":66,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:25:39.486584+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5925},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5925":{"gid":5925,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":12,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:25:47.378012+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5038},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5038":{"gid":5038,"name":"d","rank":0,"incarnation":65,"state":"up:reconnect","state_seq":3,"addr":"172.21.2.104:6835/1960750274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":1960750274},{"type":"v1","addr":"172.21.2.104:6835","nonce":1960750274}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:48.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.124+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/4172147123 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc494059d30 msgr2=0x7fc49405c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:48.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.124+0000 7fc4b4fd7700 1 --2- 172.21.2.102:0/4172147123 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc494059d30 0x7fc49405c1f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fc498001290 tx=0x7fc498007850).stop 2021-02-12T17:25:48.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.124+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/4172147123 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc4b0062740 msgr2=0x7fc4b00ae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:48.124 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.124+0000 7fc4b4fd7700 1 --2- 172.21.2.102:0/4172147123 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc4b0062740 0x7fc4b00ae500 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fc4a000cb50 tx=0x7fc4a0008040).stop 2021-02-12T17:25:48.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.124+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/4172147123 shutdown_connections 2021-02-12T17:25:48.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.124+0000 7fc4b4fd7700 1 --2- 172.21.2.102:0/4172147123 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc4b014e530 0x7fc4b014ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:48.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.124+0000 7fc4b4fd7700 1 --2- 172.21.2.102:0/4172147123 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc494059d30 0x7fc49405c1f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:48.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.124+0000 7fc4b4fd7700 1 --2- 172.21.2.102:0/4172147123 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc4b0062740 0x7fc4b00ae500 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:48.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.124+0000 7fc4b4fd7700 1 --2- 172.21.2.102:0/4172147123 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc4b00b8d20 0x7fc4b00adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:48.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.124+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/4172147123 >> 172.21.2.102:0/4172147123 conn(0x7fc4b00bc480 msgr2=0x7fc4b014cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:48.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.124+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/4172147123 shutdown_connections 2021-02-12T17:25:48.125 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.124+0000 7fc4b4fd7700 1 -- 172.21.2.102:0/4172147123 wait complete. 2021-02-12T17:25:48.126 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 66 2021-02-12T17:25:48.133 INFO:tasks.mds_thrash.fs.[b]:mds.c down, removed from mdsmap 2021-02-12T17:25:48.133 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2021-02-12T17:25:48.134 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:48.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.220+0000 7febabdf6700 1 Processor -- start 2021-02-12T17:25:48.221 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.221+0000 7febabdf6700 1 -- start start 2021-02-12T17:25:48.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.221+0000 7febabdf6700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7feba40b8d20 0x7feba4068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:48.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.221+0000 7febabdf6700 1 --2- >> v2:172.21.2.104:3300/0 conn(0x7feba4062740 0x7feba4062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:48.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.221+0000 7febabdf6700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba40b7960 con 0x7feba414e530 2021-02-12T17:25:48.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.221+0000 7febabdf6700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba4068d20 con 0x7feba40b8d20 2021-02-12T17:25:48.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.221+0000 7febabdf6700 1 -- --> v2:172.21.2.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba40622a0 con 0x7feba4062740 2021-02-12T17:25:48.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.221+0000 7feba9b92700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7feba40b8d20 0x7feba4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:48.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.221+0000 7feba9b92700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7feba40b8d20 0x7feba4068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48762/0 (socket says 172.21.2.102:48762) 2021-02-12T17:25:48.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.221+0000 7feba9b92700 1 -- 172.21.2.102:0/4012838090 learned_addr learned my addr 172.21.2.102:0/4012838090 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:48.223 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.221+0000 7feba9b92700 1 -- 172.21.2.102:0/4012838090 >> v2:172.21.2.104:3300/0 conn(0x7feba4062740 msgr2=0x7feba4062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:25:48.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.221+0000 7feba9b92700 1 --2- 172.21.2.102:0/4012838090 >> v2:172.21.2.104:3300/0 conn(0x7feba4062740 0x7feba4062bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:48.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.221+0000 7feba9b92700 1 -- 172.21.2.102:0/4012838090 >> v1:172.21.2.104:6789/0 conn(0x7feba414e530 legacy=0x7feba40b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:25:48.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.221+0000 7feba9b92700 1 -- 172.21.2.102:0/4012838090 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba414ea10 con 0x7feba40b8d20 2021-02-12T17:25:48.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.222+0000 7feba9b92700 1 --2- 172.21.2.102:0/4012838090 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feba40b8d20 0x7feba4068830 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7feba4068710 tx=0x7feba0006ea0).ready entity=mon.0 client_cookie=cf1172604895d649 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:48.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.222+0000 7feba8b90700 1 -- 172.21.2.102:0/4012838090 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0009800 con 0x7feba40b8d20 2021-02-12T17:25:48.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.222+0000 7feba8b90700 1 -- 172.21.2.102:0/4012838090 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba0009960 con 0x7feba40b8d20 2021-02-12T17:25:48.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.222+0000 7feba8b90700 1 -- 172.21.2.102:0/4012838090 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0009ce0 con 0x7feba40b8d20 2021-02-12T17:25:48.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.222+0000 7febabdf6700 1 -- 172.21.2.102:0/4012838090 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feba40b8d20 msgr2=0x7feba4068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:48.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.222+0000 7febabdf6700 1 --2- 172.21.2.102:0/4012838090 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feba40b8d20 0x7feba4068830 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7feba4068710 tx=0x7feba0006ea0).stop 2021-02-12T17:25:48.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.222+0000 7febabdf6700 1 -- 172.21.2.102:0/4012838090 shutdown_connections 2021-02-12T17:25:48.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.222+0000 7febabdf6700 1 --2- 172.21.2.102:0/4012838090 >> v2:172.21.2.104:3300/0 conn(0x7feba4062740 0x7feba4062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:48.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.222+0000 7febabdf6700 1 --2- 172.21.2.102:0/4012838090 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feba40b8d20 0x7feba4068830 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:48.224 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.222+0000 7febabdf6700 1 -- 172.21.2.102:0/4012838090 >> 172.21.2.102:0/4012838090 conn(0x7feba40bc480 msgr2=0x7feba40b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:48.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.222+0000 7febabdf6700 1 -- 172.21.2.102:0/4012838090 shutdown_connections 2021-02-12T17:25:48.225 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.222+0000 7febabdf6700 1 -- 172.21.2.102:0/4012838090 wait complete. 2021-02-12T17:25:48.226 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.223+0000 7febabdf6700 1 Processor -- start 2021-02-12T17:25:48.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.223+0000 7febabdf6700 1 -- start start 2021-02-12T17:25:48.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.223+0000 7febabdf6700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7feba4062740 0x7feba40b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:48.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.223+0000 7febabdf6700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feba40b8d20 0x7feba40aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:48.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.223+0000 7febabdf6700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feba414e530 0x7feba40af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:48.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7febabdf6700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba415de30 con 0x7feba40b8d20 2021-02-12T17:25:48.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7febabdf6700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba415e0d0 con 0x7feba4062740 2021-02-12T17:25:48.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7febabdf6700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba415e370 con 0x7feba414e530 2021-02-12T17:25:48.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7feba9391700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feba40b8d20 0x7feba40aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:48.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7feba9391700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feba40b8d20 0x7feba40aeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48766/0 (socket says 172.21.2.102:48766) 2021-02-12T17:25:48.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7feba9391700 1 -- 172.21.2.102:0/4291571767 learned_addr learned my addr 172.21.2.102:0/4291571767 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:48.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7feba9391700 1 -- 172.21.2.102:0/4291571767 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feba414e530 msgr2=0x7feba40af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:48.227 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7feba9391700 1 --2- 172.21.2.102:0/4291571767 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feba414e530 0x7feba40af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7feba9391700 1 -- 172.21.2.102:0/4291571767 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7feba4062740 msgr2=0x7feba40b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7feba9391700 1 --2- 172.21.2.102:0/4291571767 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7feba4062740 0x7feba40b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7feba9391700 1 -- 172.21.2.102:0/4291571767 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba415e610 con 0x7feba40b8d20 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7feba9391700 1 --2- 172.21.2.102:0/4291571767 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feba40b8d20 0x7feba40aeea0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7feb980096e0 tx=0x7feb98006d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7feb95ffb700 1 -- 172.21.2.102:0/4291571767 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800d500 con 0x7feba40b8d20 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7feb95ffb700 1 -- 172.21.2.102:0/4291571767 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb98000e90 con 0x7feba40b8d20 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7feb95ffb700 1 -- 172.21.2.102:0/4291571767 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800d8d0 con 0x7feba40b8d20 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.224+0000 7febabdf6700 1 -- 172.21.2.102:0/4291571767 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba415e8b0 con 0x7feba40b8d20 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.225+0000 7febabdf6700 1 -- 172.21.2.102:0/4291571767 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba40b5890 con 0x7feba40b8d20 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.225+0000 7febabdf6700 1 -- 172.21.2.102:0/4291571767 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba4045460 con 0x7feba40b8d20 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.225+0000 7feb95ffb700 1 -- 172.21.2.102:0/4291571767 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7feb9800dc40 con 0x7feba40b8d20 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.226+0000 7feb95ffb700 1 --2- 172.21.2.102:0/4291571767 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7feb8c059d60 0x7feb8c05c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.226+0000 7feb95ffb700 1 -- 172.21.2.102:0/4291571767 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7881+0+0 (secure 0 0 0) 0x7feb98073790 con 0x7feba40b8d20 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.226+0000 7feba9b92700 1 --2- 172.21.2.102:0/4291571767 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7feb8c059d60 0x7feb8c05c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:48.228 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.226+0000 7feba9b92700 1 --2- 172.21.2.102:0/4291571767 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7feb8c059d60 0x7feb8c05c220 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7feba0006ee0 tx=0x7feba0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:48.229 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.229+0000 7feb95ffb700 1 -- 172.21.2.102:0/4291571767 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7feb98046b60 con 0x7feba40b8d20 2021-02-12T17:25:48.386 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.386+0000 7febabdf6700 1 -- 172.21.2.102:0/4291571767 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feba415ea40 con 0x7feba40b8d20 2021-02-12T17:25:48.387 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.386+0000 7feb95ffb700 1 -- 172.21.2.102:0/4291571767 <== mon.0 v2:172.21.2.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+3406 (secure 0 0 0) 0x7feb9804a180 con 0x7feba40b8d20 2021-02-12T17:25:48.387 INFO:teuthology.orchestra.run.gibba002.stdout: 2021-02-12T17:25:48.387 INFO:teuthology.orchestra.run.gibba002.stdout:{"epoch":67,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.104:6834/3149030842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6832","nonce":3149030842},{"type":"v1","addr":"172.21.2.104:6834","nonce":3149030842}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:01.991560+0000","modified":"2021-02-12T17:25:39.486584+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":38,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5925},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5925":{"gid":5925,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":12,"addr":"172.21.2.102:6835/3259536493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.102:6834","nonce":3259536493},{"type":"v1","addr":"172.21.2.102:6835","nonce":3259536493}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"a","balancer":"","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-12T17:16:08.529588+0000","modified":"2021-02-12T17:25:48.380352+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5038},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5038":{"gid":5038,"name":"d","rank":0,"incarnation":65,"state":"up:rejoin","state_seq":4,"addr":"172.21.2.104:6835/1960750274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.104:6833","nonce":1960750274},{"type":"v1","addr":"172.21.2.104:6835","nonce":1960750274}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"b","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-12T17:25:48.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.388+0000 7febabdf6700 1 -- 172.21.2.102:0/4291571767 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7feb8c059d60 msgr2=0x7feb8c05c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:48.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.388+0000 7febabdf6700 1 --2- 172.21.2.102:0/4291571767 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7feb8c059d60 0x7feb8c05c220 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7feba0006ee0 tx=0x7feba0016000).stop 2021-02-12T17:25:48.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.388+0000 7febabdf6700 1 -- 172.21.2.102:0/4291571767 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feba40b8d20 msgr2=0x7feba40aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:48.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.388+0000 7febabdf6700 1 --2- 172.21.2.102:0/4291571767 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feba40b8d20 0x7feba40aeea0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7feb980096e0 tx=0x7feb98006d40).stop 2021-02-12T17:25:48.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.388+0000 7febabdf6700 1 -- 172.21.2.102:0/4291571767 shutdown_connections 2021-02-12T17:25:48.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.388+0000 7febabdf6700 1 --2- 172.21.2.102:0/4291571767 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7feba414e530 0x7feba40af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:48.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.388+0000 7febabdf6700 1 --2- 172.21.2.102:0/4291571767 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7feba4062740 0x7feba40b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:48.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.388+0000 7febabdf6700 1 --2- 172.21.2.102:0/4291571767 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7feb8c059d60 0x7feb8c05c220 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:48.389 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.388+0000 7febabdf6700 1 --2- 172.21.2.102:0/4291571767 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7feba40b8d20 0x7feba40aeea0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:48.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.388+0000 7febabdf6700 1 -- 172.21.2.102:0/4291571767 >> 172.21.2.102:0/4291571767 conn(0x7feba40bc480 msgr2=0x7feba40b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:48.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.388+0000 7febabdf6700 1 -- 172.21.2.102:0/4291571767 shutdown_connections 2021-02-12T17:25:48.390 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.388+0000 7febabdf6700 1 -- 172.21.2.102:0/4291571767 wait complete. 2021-02-12T17:25:48.390 INFO:teuthology.orchestra.run.gibba002.stderr:dumped fsmap epoch 67 2021-02-12T17:25:48.398 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 67, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:01.991560+0000", "damaged": [], "data_pools": [ 4 ], "enabled": true, "epoch": 64, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "a", "in": [ 0 ], "info": { "gid_5925": { "addr": "172.21.2.102:6835/3259536493", "addrs": { "addrvec": [ { "addr": "172.21.2.102:6834", "nonce": 3259536493, "type": "v2" }, { "addr": "172.21.2.102:6835", "nonce": 3259536493, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5925, "incarnation": 61, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 12 } }, "last_failure": 0, "last_failure_osd_epoch": 38, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2021-02-12T17:25:39.486584+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5925 } } }, { "id": 2, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-02-12T17:16:08.529588+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 67, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "b", "in": [ 0 ], "info": { "gid_5038": { "addr": "172.21.2.104:6835/1960750274", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6833", "nonce": 1960750274, "type": "v2" }, { "addr": "172.21.2.104:6835", "nonce": 1960750274, "type": "v1" } ] }, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 5038, "incarnation": 65, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:rejoin", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 39, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 5, "modified": "2021-02-12T17:25:48.380352+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5038 } } } ], "standbys": [ { "addr": "172.21.2.104:6834/3149030842", "addrs": { "addrvec": [ { "addr": "172.21.2.104:6832", "nonce": 3149030842, "type": "v2" }, { "addr": "172.21.2.104:6834", "nonce": 3149030842, "type": "v1" } ] }, "epoch": 5, "export_targets": [], "features": 4540138303579357183, "flags": 0, "gid": 4243, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 2 } ] } 2021-02-12T17:25:48.780 DEBUG:teuthology.orchestra.run.gibba002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-02-12T17:25:48.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.869+0000 7fc80e5f5700 1 Processor -- start 2021-02-12T17:25:48.870 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.869+0000 7fc80e5f5700 1 -- start start 2021-02-12T17:25:48.871 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc80e5f5700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fc8080b8d20 0x7fc808068830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:48.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc80e5f5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc80814e530 0x7fc8080b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:48.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc80e5f5700 1 -- --> v1:172.21.2.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8080622a0 con 0x7fc808062740 2021-02-12T17:25:48.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc80e5f5700 1 -- --> v2:172.21.2.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc808068d20 con 0x7fc8080b8d20 2021-02-12T17:25:48.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc80e5f5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80814ea10 con 0x7fc80814e530 2021-02-12T17:25:48.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc807fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fc8080b8d20 0x7fc808068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:48.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc807fff700 1 --2- >> v2:172.21.2.102:3300/0 conn(0x7fc8080b8d20 0x7fc808068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48772/0 (socket says 172.21.2.102:48772) 2021-02-12T17:25:48.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc807fff700 1 -- 172.21.2.102:0/2401605907 learned_addr learned my addr 172.21.2.102:0/2401605907 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:48.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc807fff700 1 -- 172.21.2.102:0/2401605907 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc80814e530 msgr2=0x7fc8080b7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:25:48.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc807fff700 1 --2- 172.21.2.102:0/2401605907 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc80814e530 0x7fc8080b7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:48.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc807fff700 1 -- 172.21.2.102:0/2401605907 >> v1:172.21.2.104:6789/0 conn(0x7fc808062740 legacy=0x7fc808062bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-02-12T17:25:48.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc807fff700 1 -- 172.21.2.102:0/2401605907 --> v2:172.21.2.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8080b63f0 con 0x7fc8080b8d20 2021-02-12T17:25:48.872 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc807fff700 1 --2- 172.21.2.102:0/2401605907 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc8080b8d20 0x7fc808068830 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7fc7f800b9e0 tx=0x7fc7f8006ea0).ready entity=mon.0 client_cookie=4a44887f09a9c47d server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:48.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc8077fe700 1 -- 172.21.2.102:0/2401605907 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8009800 con 0x7fc8080b8d20 2021-02-12T17:25:48.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.870+0000 7fc8077fe700 1 -- 172.21.2.102:0/2401605907 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f8009960 con 0x7fc8080b8d20 2021-02-12T17:25:48.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.871+0000 7fc8077fe700 1 -- 172.21.2.102:0/2401605907 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8009ce0 con 0x7fc8080b8d20 2021-02-12T17:25:48.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.871+0000 7fc80e5f5700 1 -- 172.21.2.102:0/2401605907 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc8080b8d20 msgr2=0x7fc808068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:48.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.871+0000 7fc80e5f5700 1 --2- 172.21.2.102:0/2401605907 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc8080b8d20 0x7fc808068830 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7fc7f800b9e0 tx=0x7fc7f8006ea0).stop 2021-02-12T17:25:48.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.871+0000 7fc80e5f5700 1 -- 172.21.2.102:0/2401605907 shutdown_connections 2021-02-12T17:25:48.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.871+0000 7fc80e5f5700 1 --2- 172.21.2.102:0/2401605907 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc8080b8d20 0x7fc808068830 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:48.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.871+0000 7fc80e5f5700 1 --2- 172.21.2.102:0/2401605907 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc80814e530 0x7fc8080b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-12T17:25:48.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.871+0000 7fc80e5f5700 1 -- 172.21.2.102:0/2401605907 >> 172.21.2.102:0/2401605907 conn(0x7fc8080bc480 msgr2=0x7fc8080b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-12T17:25:48.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.871+0000 7fc80e5f5700 1 -- 172.21.2.102:0/2401605907 shutdown_connections 2021-02-12T17:25:48.873 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.871+0000 7fc80e5f5700 1 -- 172.21.2.102:0/2401605907 wait complete. 2021-02-12T17:25:48.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.872+0000 7fc80e5f5700 1 Processor -- start 2021-02-12T17:25:48.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.872+0000 7fc80e5f5700 1 -- start start 2021-02-12T17:25:48.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc80e5f5700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc808062740 0x7fc808140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:48.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc80e5f5700 1 --2- >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc8080b8d20 0x7fc80815d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:48.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc80e5f5700 1 --2- >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc80814e530 0x7fc8080b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:48.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc80e5f5700 1 -- --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80811e220 con 0x7fc808062740 2021-02-12T17:25:48.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc80e5f5700 1 -- --> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc808140530 con 0x7fc80814e530 2021-02-12T17:25:48.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc80e5f5700 1 -- --> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80811da40 con 0x7fc8080b8d20 2021-02-12T17:25:48.876 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc807fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc808062740 0x7fc808140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:48.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc807fff700 1 --2- >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc808062740 0x7fc808140040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.102:3300/0 says I am v2:172.21.2.102:48780/0 (socket says 172.21.2.102:48780) 2021-02-12T17:25:48.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc807fff700 1 -- 172.21.2.102:0/1359398730 learned_addr learned my addr 172.21.2.102:0/1359398730 (peer_addr_for_me v2:172.21.2.102:0/0) 2021-02-12T17:25:48.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc80cb92700 1 --2- 172.21.2.102:0/1359398730 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc80814e530 0x7fc8080b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:48.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc7ff7fe700 1 --2- 172.21.2.102:0/1359398730 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc8080b8d20 0x7fc80815d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:48.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc807fff700 1 -- 172.21.2.102:0/1359398730 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc8080b8d20 msgr2=0x7fc80815d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:48.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc807fff700 1 --2- 172.21.2.102:0/1359398730 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc8080b8d20 0x7fc80815d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:48.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc807fff700 1 -- 172.21.2.102:0/1359398730 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc80814e530 msgr2=0x7fc8080b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-12T17:25:48.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc807fff700 1 --2- 172.21.2.102:0/1359398730 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc80814e530 0x7fc8080b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-12T17:25:48.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc807fff700 1 -- 172.21.2.102:0/1359398730 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80811dce0 con 0x7fc808062740 2021-02-12T17:25:48.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc80cb92700 1 --2- 172.21.2.102:0/1359398730 >> [v2:172.21.2.104:3300/0,v1:172.21.2.104:6789/0] conn(0x7fc80814e530 0x7fc8080b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-12T17:25:48.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc7ff7fe700 1 --2- 172.21.2.102:0/1359398730 >> [v2:172.21.2.104:3301/0,v1:172.21.2.104:6790/0] conn(0x7fc8080b8d20 0x7fc80815d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-12T17:25:48.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.873+0000 7fc807fff700 1 --2- 172.21.2.102:0/1359398730 >> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] conn(0x7fc808062740 0x7fc808140040 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7fc7f8006ee0 tx=0x7fc7f8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:48.877 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.874+0000 7fc804ff9700 1 -- 172.21.2.102:0/1359398730 <== mon.0 v2:172.21.2.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f801c420 con 0x7fc808062740 2021-02-12T17:25:48.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.874+0000 7fc804ff9700 1 -- 172.21.2.102:0/1359398730 <== mon.0 v2:172.21.2.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f801c5a0 con 0x7fc808062740 2021-02-12T17:25:48.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.874+0000 7fc804ff9700 1 -- 172.21.2.102:0/1359398730 <== mon.0 v2:172.21.2.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f801c960 con 0x7fc808062740 2021-02-12T17:25:48.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.874+0000 7fc80e5f5700 1 -- 172.21.2.102:0/1359398730 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80811df80 con 0x7fc808062740 2021-02-12T17:25:48.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.874+0000 7fc80e5f5700 1 -- 172.21.2.102:0/1359398730 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80815dc60 con 0x7fc808062740 2021-02-12T17:25:48.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.874+0000 7fc80e5f5700 1 -- 172.21.2.102:0/1359398730 --> [v2:172.21.2.102:3300/0,v1:172.21.2.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80813fd60 con 0x7fc808062740 2021-02-12T17:25:48.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.875+0000 7fc804ff9700 1 -- 172.21.2.102:0/1359398730 <== mon.0 v2:172.21.2.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 70165+0+0 (secure 0 0 0) 0x7fc7f800f070 con 0x7fc808062740 2021-02-12T17:25:48.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.875+0000 7fc804ff9700 1 --2- 172.21.2.102:0/1359398730 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc7ec059d30 0x7fc7ec05c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-12T17:25:48.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.875+0000 7fc804ff9700 1 -- 172.21.2.102:0/1359398730 <== mon.0 v2:172.21.2.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7881+0+0 (secure 0 0 0) 0x7fc7f8075850 con 0x7fc808062740 2021-02-12T17:25:48.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.875+0000 7fc7ff7fe700 1 --2- 172.21.2.102:0/1359398730 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc7ec059d30 0x7fc7ec05c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-12T17:25:48.878 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.875+0000 7fc7ff7fe700 1 --2- 172.21.2.102:0/1359398730 >> [v2:172.21.2.102:6832/37352,v1:172.21.2.102:6833/37352] conn(0x7fc7ec059d30 0x7fc7ec05c1f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fc80815e830 tx=0x7fc7f0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-12T17:25:48.879 INFO:teuthology.orchestra.run.gibba002.stderr:2021-02-12T17:25:48.878+0000 7fc804ff9700 1 -- 172.21.2.102:0/1359398730 <== mon.0 v2:172.21.2.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148848 (secure 0 0 0) 0x7fc7f8048c20 con 0x7fc808062740 2021-02-12T17:25:48.894 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-02-12T17:25:48.894 DEBUG:teuthology.task.console_log:Killing console logger for gibba002 2021-02-12T17:25:48.895 DEBUG:teuthology.task.console_log:Killing console logger for gibba004 2021-02-12T17:25:48.895 DEBUG:teuthology.exit:Finished running handlers